Flexible screen terminal display method and device, electronic equipment and storage medium

Abstract

The invention relates to a flexible screen terminal display method and device, electronic equipment and a storage medium in the technical field of flexible screen terminals. The flexible screen terminal display method comprises the steps of obtaining a user gesture and a folding state of a flexible screen terminal; and if a target display gesture matched with the user gesture exists in preset display gestures corresponding to the folding state, switching a target display screen used for displaying of the flexible screen terminal according to a display strategy corresponding to the target display gesture. In each folding state, the display screen used for displaying can be switched according to different user gestures, and the flexible screen terminal does not need to be touched for switching setting, so that the two hands of the user are liberated, and the convenience and flexibility of switching display are improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of flexible screen terminals, and in particular to a flexible screen terminal display method, device, electronic device and storage medium. Background Art

[0002] On a flexible screen terminal, the display screen of the flexible screen terminal is triggered by the user's active folding or opening action. For example, when the user folds the flexible screen terminal, the outer screen is lit as a display screen for display, and the inner screen is turned off as a display screen for non-display; for another example, when the user opens the flexible screen terminal, the outer screen is turned off as a display screen for non-display, and the inner screen is lit as a display screen for display. The user interaction method is highly bound to the folding state of the flexible screen terminal, and its convenience and flexibility are low.

[0003] In related scenarios, the display screen can be switched on the flexible screen terminal. The display screen used for display can be switched by touching the flexible screen terminal while the folded state remains unchanged. However, the convenience and flexibility of switching settings by touch are low. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a flexible screen terminal display method, device, electronic device and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a flexible screen terminal display method is provided, including:

[0006] Acquiring a user gesture and a folding state of the flexible screen terminal;

[0007] If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, the target display screen for display by the flexible screen terminal is switched according to the display strategy corresponding to the target display gesture.

[0008] Optionally, if there is a target display gesture matching the user gesture in the preset display gesture corresponding to the folding state, before switching the target display screen for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture, the method includes:

[0009] Determining the distance between the hand making the user gesture and the flexible screen terminal;

[0010] When the distance satisfies a preset condition, it is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0011] Optionally, when the distance satisfies a preset condition, determining whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state includes:

[0012] When the distance meets a preset condition, calling a preset display gesture corresponding to the folding state in the gesture management framework;

[0013] It is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0014] Optionally, the determining the distance between the hand making the user gesture and the flexible screen terminal includes:

[0015] A time-of-flight sensor on the flexible screen terminal is called to determine the distance between the hand making the user gesture and the flexible screen terminal.

[0016] Optionally, the preset display gesture corresponding to the folding state is determined in the following manner:

[0017] In response to a preset display gesture input, displaying a preset folding state on the display screen of the flexible screen terminal;

[0018] When any folding state is selected, the camera on the flexible screen terminal is called to collect hand gestures within a preset time period;

[0019] The hand gesture is used as a preset display gesture corresponding to the folding state.

[0020] Optionally, if there is a target display gesture matching the user gesture in the preset display gesture corresponding to the folding state, switching the target display screen for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture includes:

[0021] If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, calling the display strategy corresponding to the target display gesture;

[0022] The flexible screen terminal performs in-process interaction with the folding state framework according to the display strategy to switch the target display screen for display.

[0023] Optionally, the display strategy includes at least one of hover display, reverse display, and mirror display.

[0024] According to a second aspect of an embodiment of the present disclosure, a flexible screen terminal display device is provided, including:

[0025] An acquisition module is configured to acquire a user gesture and a folding state of the flexible screen terminal;

[0026] The switching module is configured to switch the target display screen used for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture if there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0027] Optionally, the switching module is configured to determine the distance between the hand making the user gesture and the flexible screen terminal before switching the target display screen for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture if there is a target display gesture matching the user gesture in the preset display gestures corresponding to the folding state;

[0028] When the distance satisfies a preset condition, it is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0029] Optionally, the switching module is configured to:

[0030] When the distance meets a preset condition, calling a preset display gesture corresponding to the folding state in the gesture management framework;

[0031] It is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0032] Optionally, the switching module is configured to:

[0033] A time-of-flight sensor on the flexible screen terminal is called to determine the distance between the hand making the user gesture and the flexible screen terminal.

[0034] Optionally, the acquisition module is configured to determine the preset display gesture corresponding to the folding state in the following manner:

[0035] In response to a preset display gesture input, displaying a preset folding state on the display screen of the flexible screen terminal;

[0036] When any folding state is selected, the camera on the flexible screen terminal is called to collect hand gestures within a preset time period;

[0037] The hand gesture is used as a preset display gesture corresponding to the folding state.

[0038] Optionally, the switching module is configured to:

[0039] If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, calling the display strategy corresponding to the target display gesture;

[0040] The flexible screen terminal performs in-process interaction with the folding state framework according to the display strategy to switch the target display screen for display.

[0041] Optionally, the display strategy includes at least one of hover display, reverse display, and mirror display.

[0042] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0043] processor;

[0044] a memory for storing processor-executable instructions;

[0045] Wherein, the processor is configured to:

[0046] Obtain user gestures and the folding status of the flexible screen terminal;

[0047] If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, the target display screen for display by the flexible screen terminal is switched according to the display strategy corresponding to the target display gesture.

[0048] According to a fourth aspect of an embodiment of the present disclosure, there is provided a computer-readable storage medium on which computer program instructions are stored, and when the program instructions are executed by a processor, the steps of any one of the methods described in the first aspect are implemented.

[0049] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0050] The user gesture and the folding state of the flexible screen terminal are obtained; if there is a target display gesture matching the user gesture in the preset display gesture corresponding to the folding state, the target display screen used for display by the flexible screen terminal is switched according to the display strategy corresponding to the target display gesture. In each folding state, the display screen used for display can be switched according to different user gestures without the need to touch the flexible screen terminal for switching settings, freeing the user's hands and improving the convenience and flexibility of switching displays.

[0051] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0053] Figure 1The present invention is a flowchart of a flexible screen terminal display method according to an exemplary embodiment.

[0054] Figure 2 It is a schematic diagram showing various folding states of a dual display screen according to an exemplary embodiment.

[0055] Figure 3 is a schematic diagram showing various folding states of three display screens according to an exemplary embodiment.

[0056] Figure 4 The figure is a schematic diagram of a flexible screen terminal display frame according to an exemplary embodiment.

[0057] Figure 5 The present invention is a flowchart showing a preset display gesture corresponding to a customized folding state according to an exemplary embodiment.

[0058] Figure 6 An implementation according to an exemplary embodiment is shown Figure 1 Flowchart of step S12 in FIG.

[0059] Figure 7 The diagram is a schematic diagram of hover display according to an exemplary embodiment.

[0060] Figure 8 is a schematic diagram showing inversion display according to an exemplary embodiment.

[0061] Fig. 9 It is a schematic diagram showing mirror display according to an exemplary embodiment.

[0062] Fig.10 The present invention is a block diagram of a flexible screen terminal display device according to an exemplary embodiment.

[0063] Fig.11 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0064] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0065] It should be noted that all actions of acquiring signals, information or data in the present disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the device is located and with the authorization given by the owner of the corresponding device.

[0066] Figure 1 is a flowchart of a flexible screen terminal display method according to an exemplary embodiment, which is applied to a flexible screen terminal, such as Figure 1 As shown, the method includes the following steps.

[0067] In step S11, a user gesture and a folding state of the flexible screen terminal are obtained.

[0068] The flexible screen terminal may be, for example, a bi-foldable terminal device having two left and right display screens, or a tri-foldable terminal device having, for example, a main display screen and foldable display screens hinged to the main display screen by hinges on the left and right sides of the main display screen. However, the present disclosure does not limit the number of display screens of the flexible screen terminal and the hinge position with the main body.

[0069] In the embodiment of the present disclosure, the folded state refers to the physical state of the display screen of the flexible screen terminal, for example, see Figure 2 As shown, the left and right display screens are in a completely folded and fitted folded state, so that a back side and a display screen of the flexible screen terminal can be seen; or, the left and right display screens are in a semi-folded state with a certain angle folded between them, and both the left and right display screens can be seen; or, the left and right display screens are in the same horizontal plane, in an unfolded first flat plate state.

[0070] For example, see Figure 3 As shown, the display screen of the first folding part on the right side of the main body is folded inwards, while the display screen of the second folding part on the left side of the main body is not folded outwards in a first folded state; or, the display screen of the first folding part on the right side of the main body is not folded inwards, while the display screen of the second folding part on the left side of the main body is folded outwards in a second folded state; or, the display screen of the first folding part on the right side of the main body is folded inwards, and the display screen of the second folding part on the left side of the main body is folded outwards in a third folded state; or, the display screen of the first folding part on the right side of the main body is not folded inwards, and the display screen of the second folding part on the left side of the main body is not folded outwards in a second flat plate state.

[0071] In one embodiment, see Figure 4 As shown, the user gesture can be acquired through the camera on the flexible screen terminal, wherein the camera for acquiring the user gesture can be a camera on a display screen currently used for display, or a camera on a display screen currently not used for display.

[0072] Take a three-fold terminal device as an example for explanation. For example, in the second folded state, if the current user chooses or the default choice is to display through the main display screen, the folded left folding display screen and the unfolded right folding display screen are not used for display. In this case, the user gesture can be obtained through the camera on the main display screen, or through the camera on the folded left folding display screen and the camera on the unfolded right folding display screen.

[0073] In one embodiment, see Figure 4 As shown, the folding state of the flexible screen terminal can be obtained through the hinge sensor. For example, the folding state of the flexible screen terminal is determined by obtaining the angle between the display screens reported by the hinge sensor.

[0074] In step S12, if there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, the target display screen used for display by the flexible screen terminal is switched according to the display strategy corresponding to the target display gesture.

[0075] Among them, the target display screen for display means that if it is currently in a locked screen state, it will be displayed on the target display screen after waking up the screen or unlocking the screen, or, if it is currently in an application display or a main screen display, the application or the main screen will be displayed on the target display screen.

[0076] Each folding state is pre-set with at least one display gesture, wherein different preset display gestures may correspond to different display strategies, and the display strategy may be a factory preset or a user-defined preset. That is to say, each state such as the tablet state and the first folding state in the aforementioned embodiment may be pre-set with at least one display gesture.

[0077] Wherein, when the display strategy is factory preset, the user can select the display strategy corresponding to the folding state to establish a mapping relationship between the folding state and the display strategy, thereby improving the flexibility of the user in using the display strategy and display gesture to switch the display screen for display.

[0078] Moreover, in different folding states, the display strategies corresponding to the same display gesture may be different; in the same folding state, the display strategies corresponding to different display gestures may be the same, and the display strategies corresponding to the same display gesture are also the same. For example, in the second tablet state, the display strategy corresponding to the right swipe gesture may be to use the right display screen and the main display screen for display, and then display the currently displayed application interface or main screen on the right display screen and the main display screen. If the right display screen and the main display screen are currently used for display, the right display screen and the main display screen may be kept for display. In the second folding state, the display strategy corresponding to the right swipe gesture may be to use the right display screen for display, and then display the currently displayed application interface or main screen on the right display screen. Similarly, if the right display screen is currently used for display, the right display screen may be kept for display.

[0079] For example, in the second tablet state, the display strategies corresponding to the right swipe gesture and the fist gesture can be to use the right display screen and the main display screen for display, and then display the currently displayed application interface or main screen on the right display screen and the main display screen.

[0080] The above technical solution obtains the user gesture and the folding state of the flexible screen terminal; if there is a target display gesture matching the user gesture in the preset display gesture corresponding to the folding state, the target display screen used for display by the flexible screen terminal is switched according to the display strategy corresponding to the target display gesture. In each folding state, the display screen used for display can be switched according to different user gestures without the need to touch the flexible screen terminal for switching settings, freeing the user's hands and improving the convenience and flexibility of switching displays.

[0081] Optionally, if there is a target display gesture matching the user gesture in the preset display gesture corresponding to the folding state, before switching the target display screen for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture, the method includes:

[0082] Determine the distance between the hand making the user gesture and the flexible screen terminal.

[0083] In the disclosed embodiment, the user gesture may be acquired by, for example, a depth camera, and then the distance between the hand making the user gesture and the flexible screen terminal may be acquired at the same time as the user gesture is acquired.

[0084] When the distance satisfies a preset condition, it is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0085] Among them, when the distance is within the preset range, it is determined that the distance meets the preset condition, that is, the preset condition is that the distance is within the preset range. This can prevent the gesture of the non-target hand far away from interfering with the display screen switched for display by the flexible screen terminal.

[0086] Optionally, when the distance satisfies a preset condition, determining whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state includes:

[0087] When the distance meets a preset condition, a preset display gesture corresponding to the folding state in the gesture management framework is called.

[0088] Continue to see Figure 4 As shown, the gesture sensor unit can collect user gestures from sensors such as cameras, and report the user gestures to the framework layer when it is determined that the distance meets the preset conditions. The framework layer can call the preset display gesture corresponding to the folding state in the gesture management framework.

[0089] It is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0090] The user gesture is matched with at least one preset display gesture corresponding to the current folding state, and it is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state. Generally, if the matching degree between any preset display gesture and the user gesture reaches a preset matching degree threshold, it is determined that there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, and the target display gesture is a preset display gesture whose matching degree reaches the preset matching degree threshold.

[0091] It can be explained that if the matching degree of multiple preset display gestures and user gestures reaches the preset matching degree threshold, the preset display gesture with the highest matching degree will be used as the target display gesture, and then, the target display screen used for display by the flexible screen terminal will be switched according to the display strategy corresponding to the target display gesture.

[0092] Optionally, the determining the distance between the hand making the user gesture and the flexible screen terminal includes:

[0093] A time-of-flight sensor on the flexible screen terminal is called to determine the distance between the hand making the user gesture and the flexible screen terminal.

[0094] In the disclosed embodiment, the time of flight sensor (TOF) calculates the distance between the user's hand and the flexible screen terminal by measuring the flight time of ultrasonic, microwave, light and other signals between the transmitter and the reflector. Figure 4 As shown, the time-of-flight sensor, camera and hinge sensor can all be arranged in the sensor service in the underlying framework, and then connected through the time-of-flight sensor interface, camera interface, etc. in the interface layer.

[0095] Alternatively, see Figure 5 As shown, the preset display gesture corresponding to the folding state is determined in the following manner:

[0096] In step S31, in response to a preset display gesture input, a preset folding state is displayed on the display screen of the flexible screen terminal.

[0097] Among them, responding to the preset display gesture input can be that the user touches the "preset display gesture input" button in the flexible screen terminal, for example, "settings", and displays the preset folding state on the display screen currently used for display by the flexible screen terminal.

[0098] In the disclosed embodiment, the folding state may be a factory setting and cannot be customized by the user, while the preset display gesture corresponding to the folding state and the display strategy corresponding to the preset display gesture may be customized by the user.

[0099] In step S32, when any folding state is selected, the camera on the flexible screen terminal is called to collect hand gestures within a preset time period.

[0100] For example, when any folding state is selected by touch, the camera on the flexible screen terminal is called, and an image capture frame is displayed on the display screen currently used for display by the flexible screen terminal. The picture captured by the camera in real time is displayed in the image capture frame, and then hand gestures are captured within a preset time.

[0101] In step S33, the hand gesture is used as a preset display gesture corresponding to the folding state.

[0102] In the disclosed embodiment, if the hand gesture meets the requirements, the hand gesture is used as the preset display gesture corresponding to the folding state. For example, whether the hand gesture has easy-to-recognize features, or whether the duration of the hand gesture reaches a preset duration threshold.

[0103] In this way, users can customize the display gestures through the settings interface, which improves flexibility.

[0104] Alternatively, see Figure 6 As shown, in step S12, if there is a target display gesture matching the user gesture in the preset display gesture corresponding to the folding state, then according to the display strategy corresponding to the target display gesture, the target display screen for displaying by the flexible screen terminal is switched, including:

[0105] In step S121, if there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, a display strategy corresponding to the target display gesture is called.

[0106] Among them, a preset mapping relationship can be used to call the display strategy corresponding to the target display gesture. For example, at least one display strategy corresponding to each preset display gesture is saved through a unique mapping relationship between the folding state, the preset display gesture and the display strategy. Then, when the target display gesture is determined, the framework layer can directly call the corresponding display strategy through the mapping relationship.

[0107] In step S122, an in-process interaction is performed with the folding state framework according to the display strategy to switch the target display screen used for display by the flexible screen terminal.

[0108] Continue to see Figure 4 As shown, the folding state framework may be arranged with folding state management, preset display gesture management, and screen display management. The display screen used for display may be switched by in-process interaction with the folding state framework according to the display strategy. Thus, the hardware layer may call the inner and outer screens to display on the target display screen used for display after, for example, the screen is awakened or unlocked, or call the inner and outer screens to display through at least one of the hover display, inverted display, and mirror display described later.

[0109] Optionally, the display strategy includes at least one of hover display, reverse display, and mirror display.

[0110] Among them, see Figure 7 As shown, the hover display can be understood as the floating display of an application or a main screen in the middle, top or bottom of one or more display screens. This is only an exemplary display. The principles of other display scenarios are the same and will not be repeated here. The reverse display can be understood as the application or main screen displayed on any display screen is displayed on another display screen instead of the original display screen. See Figure 8 As shown, the application 1 originally displayed on the display screen of the main body is displayed on the display screen of the first folding part, and the display screen of the main body no longer displays the application 1. Reverse display can also be understood as, for example, referring to Figure 4 and Figure 8 As shown, application 1 is displayed on the first display screen, and application 2 is displayed on the second display screen. After the display is reversed, application 2 can be displayed on the first display screen, and application 1 can be displayed on the second display screen. Mirroring display can be understood as copying an application or a main screen displayed on any display screen on another display screen, while keeping the same application or main screen displayed on the original display screen, for example, see Fig. 9As shown, the application 1 originally displayed on the display screen of the main body is simultaneously displayed on the display screen of the first folding part, and the display screen of the main body also displays the application 1. Here, only the second folding state is used for exemplary description. In the present disclosure, different types of flexible screen terminals can be implemented by the same principle, for example, it can be implemented in the first flat state and the second flat state. Similarly, it can also be implemented in other folding states by the same principle, which will not be repeated here.

[0111] The present disclosure also provides a flexible screen terminal display device. Fig.10 As shown, the flexible screen terminal display device includes: an acquisition module 510 and a switching module 520.

[0112] The acquisition module 510 is configured to acquire a user gesture and a folding state of the flexible screen terminal;

[0113] The switching module 520 is configured to switch the target display screen used for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture if there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0114] The above technical solution obtains the user gesture and the folding state of the flexible screen terminal; if there is a target display gesture matching the user gesture in the preset display gesture corresponding to the folding state, the target display screen used for display by the flexible screen terminal is switched according to the display strategy corresponding to the target display gesture. In each folding state, the display screen used for display can be switched according to different user gestures without the need to touch the flexible screen terminal for switching settings, freeing the user's hands and improving the convenience and flexibility of switching displays.

[0115] Optionally, the switching module 520 is configured to determine the distance between the hand making the user gesture and the flexible screen terminal before switching the target display screen for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture if there is a target display gesture matching the user gesture in the preset display gestures corresponding to the folding state;

[0116] When the distance satisfies a preset condition, it is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0117] Optionally, the switching module 520 is configured to:

[0118] When the distance meets a preset condition, calling a preset display gesture corresponding to the folding state in the gesture management framework;

[0119] It is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

[0120] Optionally, the switching module 520 is configured to:

[0121] A time-of-flight sensor on the flexible screen terminal is called to determine the distance between the hand making the user gesture and the flexible screen terminal.

[0122] Optionally, the acquisition module 510 is configured to determine a preset display gesture corresponding to the folding state in the following manner:

[0123] In response to a preset display gesture input, displaying a preset folding state on the display screen of the flexible screen terminal;

[0124] When any folding state is selected, the camera on the flexible screen terminal is called to collect hand gestures within a preset time period;

[0125] The hand gesture is used as a preset display gesture corresponding to the folding state.

[0126] Optionally, the acquisition module 510 is configured to:

[0127] If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, calling the display strategy corresponding to the target display gesture;

[0128] The flexible screen terminal performs in-process interaction with the folding state framework according to the display strategy to switch the target display screen for display.

[0129] Optionally, the display strategy includes at least one of hover display, reverse display, and mirror display.

[0130] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0131] The present disclosure also provides an electronic device, including:

[0132] processor;

[0133] a memory for storing processor-executable instructions;

[0134] Wherein, the processor is configured to:

[0135] Obtain user gestures and the folding status of the flexible screen terminal;

[0136] If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, the target display screen for display by the flexible screen terminal is switched according to the display strategy corresponding to the target display gesture.

[0137] It can be understood that the processor of the present disclosure can be configured to execute executable instructions stored in the memory to implement the method described in any one of the aforementioned embodiments.

[0138] The embodiments of the present disclosure further provide a computer-readable storage medium having computer program instructions stored thereon, which implement the steps of the method described in any one of the aforementioned embodiments when the program instructions are executed by a processor.

[0139] Fig.11 8 is a block diagram of a device 800 for flexible screen terminal display according to an exemplary embodiment. For example, the device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0140] Reference Fig.11 , the device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output interface 812 , a sensor component 814 , and a communication component 816 .

[0141] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0142] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0143] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0144] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0145] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0146] The input / output interface 812 provides an interface between the processing component 802 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0147] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800, and the temperature change of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include a time of flight sensor, an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0148] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0149] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0150] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0151] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0152] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A flexible screen terminal display method, characterized in that: include: Acquiring a user gesture and a folding state of the flexible screen terminal; If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, the target display screen for display by the flexible screen terminal is switched according to the display strategy corresponding to the target display gesture.

2. The method according to claim 1, characterized in that: If there is a target display gesture matching the user gesture in the preset display gestures corresponding to the folding state, before switching the target display screen for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture, the method includes: Determining the distance between the hand making the user gesture and the flexible screen terminal; When the distance satisfies a preset condition, it is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

3. The method according to claim 2, characterized in that When the distance satisfies a preset condition, determining whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, includes: When the distance meets a preset condition, calling a preset display gesture corresponding to the folding state in the gesture management framework; It is determined whether there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

4. The method according to claim 2, characterized in that: The determining the distance between the hand making the user gesture and the flexible screen terminal includes: A time-of-flight sensor on the flexible screen terminal is called to determine the distance between the hand making the user gesture and the flexible screen terminal.

5. The method according to claim 1, characterized in that: The preset display gesture corresponding to the folding state is determined in the following manner: In response to a preset display gesture input, displaying a preset folding state on the display screen of the flexible screen terminal; When any folding state is selected, the camera on the flexible screen terminal is called to collect hand gestures within a preset time period; The hand gesture is used as a preset display gesture corresponding to the folding state.

6. The method according to claim 1, characterized in that If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, switching the target display screen for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture includes: If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, calling the display strategy corresponding to the target display gesture; The flexible screen terminal performs in-process interaction with the folding state framework according to the display strategy to switch the target display screen for display.

7. The method according to any one of claims 1 to 6, characterized in that The display strategy includes: at least one of hover display, reverse display, and mirror display.

8. A flexible screen terminal display device, characterized in that: include: An acquisition module is configured to acquire a user gesture and a folding state of the flexible screen terminal; The switching module is configured to switch the target display screen used for display by the flexible screen terminal according to the display strategy corresponding to the target display gesture if there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state.

9. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: Obtain user gestures and the folding status of the flexible screen terminal; If there is a target display gesture matching the user gesture among the preset display gestures corresponding to the folding state, the target display screen for display by the flexible screen terminal is switched according to the display strategy corresponding to the target display gesture.

10. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the method described in any one of claims 1 to 7 are implemented.

Images