Screen display method and device and storage medium

Abstract

The invention relates to a screen display method and device and a storage medium. The screen display method is applied to the terminal with a folding screen, and comprises the following steps: detecting current posture data of the terminal after responding to switching of the terminal from a first form to a second form; on the basis of the current posture data and initial posture data of the terminal in the first form, the screen display state of the terminal is controlled, and the screen display state comprises a lightening state or an extinguishing state. According to the invention, the corresponding display state can be determined after the terminal form is changed, and the user experience is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of terminal technology, and in particular to a screen display method, device and storage medium. Background Art

[0002] With the development of terminal technology, the market share of foldable screen terminals is increasing.

[0003] In the related art, foldable screen terminals have two forms, an unfolded form and a closed form, according to the characteristics of their display screens that can be unfolded or closed. When the user changes the form of the terminal during use, the terminal will enter the screen-off state by default, and the user needs to perform corresponding instructions before continuing to use it, which affects the user experience. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a screen display method, device and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a screen display method is provided, which is applied to a terminal with a foldable screen, comprising: in response to the terminal switching from a first form to a second form, detecting current posture data of the terminal; based on the current posture data and the initial posture data of the terminal in the first form, controlling the screen display state of the terminal, the screen display state including a lit state or an unlit state.

[0006] In one embodiment, based on the current posture data and the initial posture data of the terminal in the first form, the screen display state of the terminal is controlled, including: in response to the current posture data and the initial posture data of the terminal in the first form being the same, the screen display state of the terminal is controlled to maintain the initial display state unchanged; the initial display state is the display state of the terminal in the initial posture of the first form.

[0007] In another embodiment, the controlling of the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form includes: in response to the current posture data and the initial posture data of the terminal in the first form being different, performing face detection using the front camera of the terminal in the second form; if face data is detected, controlling the screen display state of the terminal to be in a lit state; if no face data is detected, controlling the screen display state of the terminal to be in an off state.

[0008] In another embodiment, after performing face detection using the front camera of the terminal in the second form, the method further includes: if face data is detected, performing eye detection, and controlling the screen display state of the terminal based on the eye detection result.

[0009] In another embodiment, the human eye detection result includes screen gaze time, and controlling the screen display state of the terminal based on the human eye detection result includes: if the gaze time is greater than or equal to a preset time threshold, controlling the screen display state of the terminal to be a lit state; if the gaze time is less than the preset time threshold, controlling the screen display state of the terminal to be an off state.

[0010] In another embodiment, after controlling the screen display state of the terminal, the method further includes: recording a mapping relationship between the screen display state and a posture switching path, wherein the posture switching path represents a spatial position feature corresponding to the terminal switching from an initial posture in the first form to a current posture in the second form.

[0011] In another embodiment, the screen display state of the terminal is controlled based on the current posture data and the initial posture data of the terminal in the first form, including: if the posture switching path corresponding to the initial posture data and the current posture data is stored in the mapping relationship, the screen display state of the terminal is controlled based on the mapping relationship.

[0012] In another embodiment, after controlling the screen display state of the terminal, the method further includes: if the screen display state of the terminal is controlled to be off, in response to the information indication instantly obtained by the terminal, adjusting the screen display state to a lit state.

[0013] According to a second aspect of an embodiment of the present disclosure, there is provided a screen display device, which is applied to a terminal with a folding screen, and includes a detection unit, which is used to detect current posture data of the terminal in response to the terminal switching from a first form to a second form;

[0014] A processing unit is used to control the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form, and the screen display state includes a lit state or an unlit state.

[0015] In one embodiment, the processing unit controls the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form in the following manner: in response to the current posture data and the initial posture data of the terminal in the first form being the same, the screen display state of the terminal is controlled to maintain the initial display state unchanged; the initial display state is the display state of the terminal in the initial posture of the first form.

[0016] In another embodiment, the processing unit controls the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form in the following manner: in response to the current posture data and the initial posture data of the terminal in the first form being different, face detection is performed using the front camera of the terminal in the second form; if face data is detected, the screen display state of the terminal is controlled to be in a lit state; if no face data is detected, the screen display state of the terminal is controlled to be in an off state.

[0017] In another embodiment, the processing unit is further used for: after performing face detection using the front camera of the terminal in the second form, if face data is detected, performing eye detection, and controlling the screen display state of the terminal based on the eye detection result.

[0018] In another embodiment, the human eye detection result includes screen gaze time, and the processing unit controls the screen display state of the terminal based on the human eye detection result in the following manner: if the gaze time is greater than or equal to a preset time threshold, the screen display state of the terminal is controlled to be a lit state; if the gaze time is less than the preset time threshold, the screen display state of the terminal is controlled to be an off state.

[0019] In another embodiment, the processing unit is further used to: after controlling the screen display state of the terminal, record the mapping relationship between the screen display state and the posture switching path, and the posture switching path represents the spatial position characteristics corresponding to the terminal switching from an initial posture in the first form to a current posture in the second form.

[0020] In another embodiment, the processing unit controls the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form in the following manner: if the mapping relationship stores the posture switching path corresponding to the initial posture data and the current posture data, the screen display state of the terminal is controlled based on the mapping relationship.

[0021] In yet another embodiment, the processing unit is further configured to: if the screen display state of the terminal is controlled to be off, in response to an information indication instantly obtained by the terminal, adjust the screen display state to a lit state.

[0022] According to a third aspect of the present disclosure, a screen display device is provided, comprising:

[0023] processor;

[0024] A memory for storing processor executable instructions; wherein the processor is configured to: execute the screen display method described in any one of the embodiments of the first aspect.

[0025] According to a fourth aspect of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor of a device, the device is enabled to execute the screen display method described in any one of the embodiments of the first aspect.

[0026] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: by detecting the posture of the folding screen terminal before and after the shape change, the corresponding screen display state is determined to improve the user experience of using the terminal. The technical solution provided by the embodiments of the present disclosure may avoid the problem in the related art that the screen is locked due to the shape change of the folding screen terminal, thereby affecting the user experience.

[0027] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0029] Figure 1 It is a schematic diagram of a usage scenario of a folding screen terminal in a related technology according to an exemplary embodiment.

[0030] Figure 2 The figure is a flowchart of a screen display method according to an exemplary embodiment.

[0031] Figure 3 The figure is a schematic diagram of a usage scenario of a folding screen terminal according to an exemplary embodiment.

[0032] Figure 4 The present invention is a flow chart of a screen display method based on face detection according to an exemplary embodiment.

[0033] Figure 5The figure is a flow chart of another screen display method based on face detection according to an exemplary embodiment.

[0034] Figure 6 The present invention is a flowchart of a screen display method based on human eye detection according to an exemplary embodiment.

[0035] Figure 7 The present invention is a flowchart of a method for recording a mapping relationship between a display state of a screen and a gesture switching path according to an exemplary embodiment.

[0036] Figure 8 The present invention is a flowchart of a method for controlling a screen display state based on a current posture switching path according to an exemplary embodiment.

[0037] Fig. 9 The figure is a flowchart of another method for determining a screen display state based on path similarity according to an exemplary embodiment.

[0038] Fig.10 The invention is a block diagram of a screen display device according to an exemplary embodiment.

[0039] Fig.11 The invention is a block diagram of a device for screen display according to an exemplary embodiment.

[0040] Fig.12 The invention is a block diagram of a device for screen display according to an exemplary embodiment. DETAILED DESCRIPTION

[0041] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure.

[0042] The screen display method involved in the embodiment of the present disclosure is applied to a terminal with a folding screen. The terminal involved in the present disclosure may also be referred to as a terminal device, a user equipment (User Equipment, UE), a mobile station (Mobile Station, MS), a mobile terminal (Mobile Terminal, MT), etc., which is a device that provides voice and / or data connectivity to users. For example, the terminal can be a handheld device with a wireless connection function, a vehicle-mounted device, etc. At present, some examples of terminals are: smart phones (Mobile Phone), customer premise equipment (Customer Premise Equipment, CPE), pocket computers (Pocket Personal Computer, PPC), PDAs, personal digital assistants (Personal Digital Assistant, PDA), laptops, tablet computers, wearable devices, or vehicle-mounted devices, etc. It should be understood that the embodiments of the present disclosure do not limit the specific technology and specific device form adopted by the terminal.

[0043] It should be noted that, in order to facilitate understanding of the technical solution, the following embodiments are described using a terminal in the form of a smart phone as an example.

[0044] With the continuous development of terminal technology, foldable screen terminals have gradually appeared in people's field of vision. The design of this terminal allows users to switch between ordinary terminals and tablets at will, greatly improving the user experience. The screen of the foldable screen terminal usually adopts flexible organic light emitting diode (OLED) screen technology, which can realize the bending and folding of the screen, and can also reduce battery consumption and improve the color saturation of the screen.

[0045] Foldable screen terminals can generally be divided into a closed form and an unfolded form according to the screen form. The display screen of the foldable screen terminal in the unfolded form is generally called an inner screen, and the display screen in the closed form is generally called an outer screen. Figure 1 FIG. 1 is a schematic diagram of a folding screen terminal usage scenario in a related technology according to an exemplary embodiment. Figure 1 As shown, the surface area of ​​the inner screen 12 of the folding screen terminal 11 in the unfolded state is effectively extended, which can provide a wider viewing field for the user.

[0046] When the user needs to close the foldable screen terminal 11 in certain scenarios, the foldable screen terminal 11 will automatically enter the locked screen state. If you want to cancel the locked screen state and continue to use the outer screen 13, you need to perform the corresponding unlocking operation (fingerprint unlocking or gesture unlocking, etc.) before you can continue to use the terminal 11 on the outer screen. This makes the user terminal use process not smooth and affects the user experience.

[0047] In view of this, an embodiment of the present disclosure provides a terminal display method, which obtains the posture of the terminal before and after the screen shape changes, determines whether the terminal screen is in an on or off state based on the posture, and then determines whether the user has a need to use the terminal, thereby improving the user experience.

[0048] Figure 2 is a flowchart of a screen display method according to an exemplary embodiment. Figure 2 As shown, the method is applied to a folding screen terminal and includes the following steps.

[0049] In step S11 , in response to the terminal switching from the first form to the second form, current posture data of the terminal is detected.

[0050] In one implementation of the embodiment of the present disclosure, the current posture data is the posture of the terminal after completing the form switching.

[0051] Exemplarily, the first form of the terminal may be a screen-expanded form or a screen-closed form, and correspondingly, the second form of the terminal may be a screen-closed form or a screen-expanded form.

[0052] In one implementation of the embodiment of the present disclosure, the current posture data may be represented by acceleration acquired by a posture sensor preset inside the terminal.

[0053] It should be understood that the posture data of the terminal can be understood as a description of the position of the terminal in space or a description of the placement angle. For example, the posture data description of the terminal can include at least one of the following: x centimeters (cm) from the user's face or the display screen is at an angle of y degrees to the plane where the user's face is located (where x is greater than 0 and y is greater than 0).

[0054] It should be understood that when the user uses the terminal in the first form of the terminal, there is a possibility of changing the form of the terminal (ie, changing the expanded form to the closed form or changing the closed form to the expanded form).

[0055] In one implementation of the embodiment of the present disclosure, the terminal changes from a first form to a second form, which can be the terminal changing from a terminal internal screen expanded form to a terminal internal screen closed form, or from a terminal internal screen closed form to a terminal internal screen expanded form.

[0056] In step S12, the screen display state of the terminal is controlled based on the current posture data and the initial posture data of the terminal in the first form.

[0057] It should be understood that the initial posture data can be understood as the posture data corresponding to the terminal before the state switching. If the terminal is in the first state before the state switching, the initial posture data corresponds to the first state of the terminal; if the terminal is in the second state before the state switching, the initial posture data corresponds to the second state of the terminal.

[0058] In one implementation of the embodiment of the present disclosure, the screen display state includes a lighted state or an off state.

[0059] The terminal display method provided by the embodiment of the present disclosure is as follows: Figure 3 As shown, by detecting the posture data before and after the folding screen terminal changes its form, the corresponding screen display state is determined according to the detection results of the posture data before and after, and then the corresponding display state is provided to the user to meet the user's needs. This can avoid the problem in the related art that the screen is locked due to the change of the folding screen terminal's form, thereby affecting the user experience.

[0060] In one implementation of the embodiment of the present disclosure, with respect to the current posture data and the initial posture data, it can be determined whether the current display state is the same as the initial display state.

[0061] For the convenience of description, in the following embodiments, the initial posture data corresponding to the first form of the terminal will be described as an example.

[0062] Exemplarily, based on the current posture data and the initial posture data of the terminal in the first form, controlling the screen display state of the terminal includes:

[0063] In response to the current posture data being the same as the initial posture data of the terminal in the first form, the screen display state of the terminal is controlled to maintain the initial display state unchanged; the initial display state is the display state of the terminal in the initial posture data of the first form.

[0064] In one implementation of the disclosed embodiment, the screen display state before and after the terminal form is switched can be described by posture data corresponding to the acceleration.

[0065] Exemplarily, the acceleration corresponding to the initial posture data is defined as the first acceleration, and the acceleration corresponding to the current posture data is defined as the second acceleration. The first acceleration and the second acceleration may be in an absolute spatial coordinate system. For example, the first acceleration and the second acceleration are both in a physical spatial coordinate system where the gravitational acceleration (g) is located, that is, the first acceleration and the second acceleration are accelerations in an absolute physical spatial coordinate system.

[0066] The first acceleration and the second acceleration may also be in a relative spatial coordinate system. For example, the first acceleration and the second acceleration are accelerations in a predefined spatial coordinate system with the user's face as the origin. That is, the first acceleration and the second acceleration are accelerations relative to the user's face.

[0067] For the convenience of description, the first acceleration and the second acceleration in the following embodiments are both regarded as accelerations in an absolute physical space coordinate system. The initial posture data and the current posture data are both regarded as posture data based on an absolute physical space coordinate system.

[0068] It is understandable that the detection results of the initial posture data and the current posture data correspond to different screen display states. In one example, in response to the current posture data being the same as the initial posture data, it can be determined that the posture of the terminal has not changed before and after the form switching. The user is more likely to maintain the terminal usage action in the first form in the second form of the terminal. Based on this, it is determined that the screen display state of the folding screen in the second form is the lit state.

[0069] When the first acceleration obtained based on the acceleration sensor is equal to the second acceleration, it can be understood that the position and angle of the terminal do not change after the terminal switches from the first form to the second form.

[0070] For example, the first acceleration corresponding to the first form of the terminal is a1, and the second acceleration corresponding to the second form of the terminal is a2. It can be understood that when a1 is equal to a2, it means that the direction of the first acceleration is the same as the direction of the second acceleration, and the magnitude of the first acceleration is the same as the magnitude of the second acceleration. Based on this, combined with the acceleration sensor, it can be judged that the direction and position of the terminal when it changes from the first form to the second form do not change.

[0071] It should be understood that the direction of the first form of the terminal can be understood as the position or angle of the display screen of the terminal in the first form relative to a specified reference object, and the specified reference object may include: the plane where the user's face is located or the sea level, etc. If the first form is the screen unfolded form, the display screen in the first form is the inner screen; if the first form is the screen closed form, the display screen in the first form is the outer screen;

[0072] The position of the terminal in the first form may be understood as the height of the terminal in the first form or other physical quantities that can be used to describe the position information.

[0073] The direction of the second form of the terminal can be understood as the position or angle of the display screen of the terminal in the second form relative to the specified reference object, and the specified reference object may include: the plane or horizontal plane where the user's face is located. If the second form is the screen-unfolded form, the display screen in the second form is the inner screen; if the second form is the screen-closed form, the display screen in the second form is the outer screen;

[0074] The position of the second form of the terminal may be understood as the height of the terminal in the second form or other physical quantities that can be used to describe the position information.

[0075] Furthermore, if the terminal is in a user-used state before the state change, the direction and position of the terminal before the state change can be regarded as the direction and position of the terminal when the user uses the terminal. If the corresponding direction and position of the terminal do not change after the state change, it can be determined that the user still maintains the state of use of the terminal before the state change after the state change, and the display state of the terminal is lit at this time.

[0076] The terminal display method provided in the embodiment of the present disclosure can determine, based on the result that the first acceleration is equal to the second acceleration, that the angle and relative position have not changed after the terminal shape has changed, and further determine that the user still has the need to use the terminal after the terminal shape has changed, so that the terminal is in a lit state to meet the user's needs and improve the user experience.

[0077] It is understandable that when the initial posture data and the current posture data are different, it can be determined that the posture of the terminal after the form change has changed. Then the user needs to further determine whether the terminal should maintain the use action of the terminal in the first form in the second form. In one example, Figure 4 is a flow chart of a screen display method based on face detection according to an exemplary embodiment. When the initial posture data is different from the current posture data, such as Figure 4 As shown, the following steps can be performed:

[0078] In step S21, face detection is performed in the second form of the terminal.

[0079] In one implementation of the embodiments of the present disclosure, user face detection is performed by controlling the camera of the terminal in the second state.

[0080] Exemplarily, the front camera of the terminal in the second state can be controlled to perform user face detection.

[0081] Exemplarily, when the second state is a closed form, the camera preset on the terminal's external screen is controlled to perform user face detection; when the second state is an expanded form, the camera preset on the terminal's internal screen is controlled to perform user face detection.

[0082] In one implementation of the present disclosure, user face detection is performed in real time by controlling an Always ON (AON) camera (or an Always ON camera) of the terminal.

[0083] It should be understood that AON camera refers to a camera function that can still be enabled and capture images and videos when the device is locked. This function is usually used on smartphones or tablets, allowing users to easily take photos or record videos when the device is locked without entering a password or unlocking the device. AON camera has a low power consumption effect compared to other cameras.

[0084] In step S22, if face data is detected, the screen display state of the control terminal is lit.

[0085] In step S23, if no face data is detected, the screen display state of the control terminal is turned off.

[0086] It should be understood that after the terminal completes the transformation, if the camera can still detect the user's face, it can be determined that the user has a need to continue using the terminal. For example, the user's first form of the terminal is the screen unfolded form, and the terminal's inner screen is at an angle a relative to the user's face to watch the video. When the terminal changes to the second form (i.e., the closed form), the user watches the video at an angle b relative to the user's face on the terminal's outer screen for the comfort of watching the video (where a is not equal to b). In this case, the first acceleration of the terminal is not the same as the second acceleration, and face detection is required to determine whether the user is continuing to use the terminal. If the user's face is detected, it is confirmed that the user is still continuing to use the terminal or has a need to continue using the terminal. At this time, the screen display state is lit; if the user's face is not detected, it is confirmed that the user is not continuing to use the terminal or has no need to continue using the terminal. At this time, the screen display state is off.

[0087] The terminal display method provided in the embodiment of the present disclosure, in view of the situation where the posture of the terminal changes after the shape changes, additionally performs face recognition on the terminal, so that the determination result of the subsequent screen display state is more accurate.

[0088] It is understandable that for face detection, the situation where the user's face is out of the terminal camera range can be determined as the user not using the terminal (for example, the user puts the terminal into a backpack, etc.), and the screen is determined to be off based on this. However, if the user's face is within the terminal camera range, whether the user wants to maintain the use of the terminal in the first form needs further determination. In one example, Figure 5 FIG. 1 is a flow chart of another screen display method based on face detection according to an exemplary embodiment. When the first posture is different from the second posture, such as Figure 5As shown, you can also perform the following steps:

[0089] In step S31, face detection is performed in the second form of the terminal.

[0090] In one embodiment of the present disclosure, a camera of a terminal is controlled to perform user face detection. The controlled camera may be an AON camera of the terminal.

[0091] It should be understood that the detailed example description of this embodiment is the same as or similar to the embodiment description corresponding to the above step S21. For details, please refer to the corresponding content description, which will not be repeated here.

[0092] In step S32, if a face is detected, eye detection is performed, and the screen display state of the terminal is controlled based on the eye detection result.

[0093] In the disclosed embodiment, after detecting a human face, the camera of the terminal is controlled to perform user eye detection. The controlled camera may be an AON camera of the terminal.

[0094] In step S33, if no face is detected, the screen display state of the control terminal is turned off.

[0095] It should be understood that eye detection requires higher computing power of the terminal than face detection, and can also more directly determine whether the user is using the terminal or has the need to continue using the terminal. Therefore, after the terminal completes the state change, if the camera can still detect the user's face, it can further determine whether the user has the need to continue using the terminal (that is, determine the screen display state in the second state) through eye detection, and then control the screen display state of the terminal.

[0096] The terminal display method provided in the embodiment of the present disclosure, in view of the situation where the posture of the terminal changes after the shape changes, additionally performs face recognition and eye recognition on the terminal, so that the subsequent determination result of the screen display state is more accurate.

[0097] It is understandable that if the user stares at the terminal display screen for a long time, there is a greater possibility that the user will continue to use the terminal in the first form. Figure 6 The following is a flow chart of a screen display method based on human eye detection according to an exemplary embodiment. The screen display state of the folding screen in the second form is determined based on the human eye detection result, such as Figure 6 As shown, the following steps are included:

[0098] In step S41, based on the eye detection result, the gaze time is determined.

[0099] In one implementation of the embodiments of the present disclosure, the gaze time refers to the time that a human eye gazes at the screen of the folding screen in the second form.

[0100] In the disclosed embodiment, after detecting a human face, the camera of the terminal is controlled to perform user eye detection. The controlled camera may be an AON camera of the terminal.

[0101] Exemplarily, the second form is an expanded form, and the corresponding gaze time is the time that the human eye gazes at the inner screen; the second form is a closed form, and the corresponding gaze time is the time that the human eye gazes at the outer screen.

[0102] In step S42, if the gaze time is greater than or equal to the time threshold, the screen display state of the control terminal is turned on.

[0103] It should be understood that if the gaze time is greater than or equal to the time threshold, it can be inferred that the user has a greater possibility of continuing to use the terminal. Therefore, it is determined that the screen display state of the folding screen of the terminal in the second form is the lit state.

[0104] In step S43, if the gaze time is less than the time threshold, the screen display state of the control terminal is turned off.

[0105] It should be understood that if the gaze time is less than the time threshold, it can be inferred that the user has a small possibility of continuing to use the terminal. Therefore, it is determined that the screen display state of the folding screen of the terminal in the second form is the off state.

[0106] The terminal display method provided by the embodiment of the present disclosure determines the corresponding screen display state by using the magnitude relationship between the gaze time and the time threshold, so that the subsequent determination result of the screen display state is more accurate.

[0107] It is understandable that the embodiment of the present disclosure can also control the screen display state of the terminal based on the relevant information when the terminal switches the posture. For example, the corresponding screen display state can be determined based on the switching path.

[0108] It is understandable that before determining the corresponding screen display state based on the switching path, relevant information needs to be recorded. Figure 7 The present invention is a flowchart of a method for recording the mapping relationship between the display state of a screen and the posture switching path according to an exemplary embodiment. The initial posture data and the current posture determination terminal path after the first form is changed to the second form can also be recorded to determine the display state of the screen, such as Figure 7 As shown, the specific steps include the following:

[0109] In step S51, a posture switching path of the terminal is determined based on the initial posture data and the current posture data.

[0110] In one implementation of the disclosed embodiment, the posture switching path represents the spatial position characteristics corresponding to the terminal changing from the first form to the second form, for example, displacement.

[0111] It should be understood that the initial posture data can be represented by the first acceleration, and the current posture can be represented by the second acceleration.

[0112] Furthermore, since the second-order differential of acceleration is the second-order derivative of the displacement (position) of the moving object with respect to time, the posture switching path of the terminal can be determined based on the initial posture data and the current posture data.

[0113] In step S52, the mapping relationship between the display state of the screen and the gesture switching path is recorded.

[0114] It should be understood that the initial posture data and the current posture can determine the corresponding screen display state, and the initial posture data and the current posture data can also determine the posture switching path of the terminal. Based on this, the screen display state corresponding to the initial posture data and the current posture path information can be obtained, that is, the mapping relationship between the screen display state and the posture switching path of the terminal. The posture switching path of the terminal and the corresponding screen display state are recorded and saved, so as to facilitate the subsequent screen display state of the screen terminal according to the path control.

[0115] It should be understood that the mapping relationship is used to control the terminal to display the screen display state when it is determined that the spatial position characteristics of the folding screen when it is subsequently transformed from the first form to the second form are consistent with the spatial position characteristics of the path information.

[0116] Exemplarily, the recorded mapping relationship between the posture switching path of the terminal and the corresponding screen display state can be used to control the screen display state according to the posture switching path when the terminal switches its form.

[0117] In one example, Figure 8 The present invention is a flow chart of a method for controlling the screen display state based on the current posture data switching path according to an exemplary embodiment. The method for controlling the screen display state based on the posture switching path of the terminal includes the following steps:

[0118] In step S61, second path information of the terminal is determined based on the first posture and the second posture, and the second path information represents a spatial position feature of the terminal when it subsequently changes from the first form to the second form.

[0119] In step S62, the first path information is vectorized to obtain a first feature vector, and the second path information is vectorized to obtain a second feature vector.

[0120] In the implementation of the embodiment of the present disclosure, the first path information can be understood as the posture switching path of the terminal recorded in the mapping relationship. The second path information can be understood as the posture switching path when the current terminal performs posture switching.

[0121] In step S63, the screen display state corresponding to the second path information is determined based on the similarity between the first feature vector and the second feature vector.

[0122] It should be understood that if the similarity between the first feature vector and the second feature vector is greater than or equal to a preset threshold, it can be determined that the first path information is the same or similar to the second path information. Regardless of whether the second path is the same or similar to the first path information, it can be considered that in the mapping relationship, there is at least one posture switching path that has been stored and the posture switching path when the same current terminal performs posture switching. Therefore, the screen display states corresponding to the two are the same. It should be understood that in addition to the above-mentioned feature vector comparison, the evaluation of similarity can also be evaluated by solving cosine distance or Euclidean distance, etc., which will not be repeated here.

[0123] The terminal display method provided in the embodiment of the present disclosure determines the display state of the screen by comparing the path information determined based on the posture before and after the terminal form change with the path information of the known screen display state, thereby avoiding the related face or eye detection process and improving the processing efficiency.

[0124] In one example, Fig. 9 is a flow chart of another method for determining a screen display state based on path similarity according to an exemplary embodiment. The screen display state corresponding to the first path information is determined based on the similarity between the first feature vector and the second feature vector, such as Fig. 9 As shown, the following steps are included:

[0125] In step S71, the similarity between the first feature vector and the second feature vector is determined.

[0126] In step S72, if the similarity is greater than or equal to the similarity threshold, the screen display state of the first path information is consistent with the screen display state of the second path information.

[0127] In step S73 , if the similarity is less than the similarity threshold, the screen display state of the first path information is inconsistent with the screen display state of the second path information.

[0128] In one example, if the screen display state of the control terminal is off, in response to the information indication instantly obtained by the terminal, the screen display state is adjusted to a lit state.

[0129] In one implementation of the embodiment of the present disclosure, when it is determined that the final screen display state of the terminal is off, when the terminal obtains other instant information indications, the screen is adjusted to a lit state in response to the information indications.

[0130] Exemplarily, when the terminal is determined to be in an off state after face and eye detection, when the terminal receives an instant information indication (eg, a text message or message sent by other instant messaging applications), the screen will be adjusted to a lit state so that the user can continue to use the terminal.

[0131] The terminal display method provided by the embodiment of the present disclosure can still make real-time adjustments based on the data transmission status after determining the screen display status, thereby improving the user experience.

[0132] Based on the same concept, an embodiment of the present disclosure also provides a screen display device.

[0133] It is understandable that the screen display device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0134] Fig.10 is a block diagram of a screen display device according to an exemplary embodiment. Fig.10 The device 100 includes a detection unit 101 and a processing unit 102.

[0135] The detection unit 101 is configured to detect current posture data of the terminal in response to the terminal switching from the first form to the second form.

[0136] The processing unit 102 is used to control the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form, and the screen display state includes a lighting state or an off state.

[0137] In one example, the processing unit 102 controls the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form in the following manner: in response to the current posture data and the initial posture data of the terminal in the first form being the same, the screen display state of the terminal is controlled to maintain the initial display state unchanged; the initial display state is the display state of the terminal in the initial posture of the first form.

[0138] In one example, the processing unit 102 controls the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form in the following manner: in response to the current posture data and the initial posture data of the terminal in the first form being different, face detection is performed using the front camera of the terminal in the second form; if face data is detected, the screen display state of the terminal is controlled to be lit; if no face data is detected, the screen display state of the terminal is controlled to be off.

[0139] In one example, the processing unit 102 is further used to: after performing face detection using the front camera of the terminal in the second form, if face data is detected, perform eye detection, and control the screen display state of the terminal based on the eye detection result.

[0140] In one example, the human eye detection result includes the screen gaze time, and the processing unit 102 controls the screen display state of the terminal based on the human eye detection result in the following manner: if the gaze time is greater than or equal to a preset time threshold, the screen display state of the terminal is controlled to be lit; if the gaze time is less than the preset time threshold, the screen display state of the terminal is controlled to be off.

[0141] In one example, the processing unit 102 is also used to: after controlling the screen display state of the terminal, record the mapping relationship between the screen display state and the posture switching path, the posture switching path represents the spatial position characteristics corresponding to the terminal switching from an initial posture in the first form to a current posture in the second form.

[0142] In one example, the processing unit 102 is further configured to: if the screen display state of the control terminal is off, in response to the information indication instantly obtained by the terminal, adjust the screen display state to a lit state.

[0143] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0144] Fig.11 2 is a block diagram of a device 200 for screen display according to an exemplary embodiment. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0145] Reference Fig.11 , the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0146] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0147] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0148] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0149] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0150] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0151] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0152] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0153] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0154] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0155] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the instructions can be executed by the processor 220 of the device 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0156] Fig.12 is a block diagram of a device 300 for screen display according to an exemplary embodiment. For example, the device 300 can be provided as a server. Fig.12 The apparatus 300 includes a processing component 322, which further includes one or more processors, and a memory resource represented by a memory 332 for storing instructions executable by the processing component 322, such as an application. The application stored in the memory 332 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 322 is configured to execute instructions to perform the above-mentioned screen display method.

[0157] The device 300 may also include a power supply component 326 configured to perform power management of the device 300, a wired or wireless network interface 350 configured to connect the device 300 to a network, and an input / output (I / O) interface 358. The device 300 may operate based on an operating system stored in the memory 332, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0158] It is to be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0159] It is further understood that the terms "first", "second", etc. are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, the expressions "first", "second", etc. can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0160] It will be further understood that the terms “center”, “longitudinal”, “lateral”, “front”, “back”, “up”, “down”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0161] It can be further understood that, unless otherwise specified, “connection” includes a direct connection without other components between the two, and also includes an indirect connection with other components between the two.

[0162] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0163] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modifications, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure.

[0164] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A screen display method, characterized in that: include: In response to the terminal switching from the first form to the second form, detecting current posture data of the terminal; Based on the current posture data and the initial posture data of the terminal in the first form, the screen display state of the terminal is controlled, and the screen display state includes a lighting state or an off state.

2. The screen display method according to claim 1, characterized in that: The controlling the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form includes: In response to the current posture data being the same as the initial posture data of the terminal in the first form, the screen display state of the terminal is controlled to maintain the initial display state unchanged; the initial display state is the display state of the terminal in the initial posture of the first form.

3. The screen display method according to claim 1, characterized in that: The controlling the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form includes: In response to the current posture data being different from the initial posture data of the terminal in the first form, performing face detection using a front camera of the terminal in the second form; If face data is detected, the screen display state of the terminal is controlled to be lit; If no face data is detected, the screen display state of the terminal is controlled to be off.

4. The screen display method according to claim 3, characterized in that: After performing face detection using the front camera of the terminal in the second state, the method further includes: If face data is detected, eye detection is performed, and the screen display state of the terminal is controlled based on the eye detection result.

5. The screen display method according to claim 4, characterized in that: The human eye detection result includes screen gaze time, and controlling the screen display state of the terminal based on the human eye detection result includes: If the gaze time is greater than or equal to a preset time threshold, controlling the screen display state of the terminal to be a lighted state; If the gaze time is less than the preset time threshold, the screen display state of the terminal is controlled to be off.

6. The screen display method according to any one of claims 1 to 5, characterized in that: After controlling the screen display state of the terminal, the method further includes: A mapping relationship between the screen display state and a posture switching path is recorded, where the posture switching path represents a spatial position feature corresponding to the terminal switching from an initial posture in the first form to a current posture in the second form.

7. The screen display method according to claim 6, characterized in that: The controlling the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form includes: If the mapping relationship stores the posture switching path corresponding to the initial posture data and the current posture data, the screen display state of the terminal is controlled based on the mapping relationship.

8. The screen display method according to claim 7, characterized in that: After controlling the screen display state of the terminal, the method further includes: If the screen display state of the terminal is controlled to be off, the screen display state is adjusted to be on in response to the information indication instantly obtained by the terminal.

9. A screen display device, characterized in that: Applicable to terminals with foldable screens, including: a detection unit, configured to detect current posture data of the terminal in response to the terminal switching from the first form to the second form; A processing unit is used to control the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form, and the screen display state includes a lit state or an unlit state.

10. The screen display device according to claim 9, characterized in that: The processing unit controls the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form in the following manner: In response to the current posture data being the same as the initial posture data of the terminal in the first form, the screen display state of the terminal is controlled to maintain the initial display state unchanged; the initial display state is the display state of the terminal in the initial posture of the first form.

11. The screen display device according to claim 9, characterized in that: The processing unit controls the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form in the following manner: In response to the current posture data being different from the initial posture data of the terminal in the first form, performing face detection using a front camera of the terminal in the second form; If face data is detected, the screen display state of the terminal is controlled to be lit; If no face data is detected, the screen display state of the terminal is controlled to be off.

12. The screen display device according to claim 11, characterized in that: The processing unit is also used for: after performing face detection using the front camera of the terminal in the second form, if face data is detected, performing eye detection, and controlling the screen display state of the terminal based on the eye detection result.

13. The screen display device according to claim 12, characterized in that: The human eye detection result includes screen gaze time, and the processing unit controls the screen display state of the terminal based on the human eye detection result in the following manner: If the gaze time is greater than or equal to a preset time threshold, controlling the screen display state of the terminal to be a lighted state; If the gaze time is less than the preset time threshold, the screen display state of the terminal is controlled to be off.

14. The screen display device according to any one of claims 9 to 13, characterized in that: The processing unit is also used for: After controlling the screen display state of the terminal, a mapping relationship between the screen display state and a posture switching path is recorded, wherein the posture switching path represents a spatial position feature corresponding to the terminal switching from an initial posture in the first form to a current posture in the second form.

15. The screen display device according to claim 14, characterized in that: The processing unit controls the screen display state of the terminal based on the current posture data and the initial posture data of the terminal in the first form in the following manner: If the mapping relationship stores the posture switching path corresponding to the initial posture data and the current posture data, the screen display state of the terminal is controlled based on the mapping relationship.

16. The screen display device according to claim 15, characterized in that: The processing unit is also used for: If the screen display state of the terminal is controlled to be off, the screen display state is adjusted to be on in response to the information indication instantly obtained by the terminal.

17. A screen display device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: execute the screen display method described in any one of claims 1 to 8.

18. A storage medium, characterized in that: The storage medium stores instructions, and when the instructions in the storage medium are executed by the processor of the terminal, the device is enabled to execute the screen display method described in any one of claims 1 to 8.

Images