Screen control method and device, equipment and storage medium

Abstract

The invention provides a screen control method and device, equipment and a storage medium, and the method comprises the steps: obtaining the motion trails of two touch points under the condition that the two touch points are detected on a screen of terminal equipment; and under the condition that the motion trails of the two touch points indicate that the second touch point moves relative to the first touch point, determining a screen adjustment direction according to the motion direction of the second touch point relative to the first touch point, so that the screen display direction of the terminal equipment is adjusted through the screen adjustment direction. Under the condition that a physical sensor is not used, the display direction of the screen can be adjusted according to the movement direction of the second touch point relative to the first touch point.

Description

Technical Field

[0001] The technical solution disclosed herein relates to the field of terminal devices, and in particular to a screen control method, device, equipment and storage medium. Background Art

[0002] The terminal device can switch between the horizontal screen and the vertical screen freely, for example, when using the terminal device for office work, it switches to the horizontal screen state, and when using the terminal device for entertainment, it switches to the vertical screen state. In the related art, physical sensors are usually used to realize the switching of the screen display direction, but this method is not suitable for some terminal devices without physical sensors or with physical sensors but the physical sensors are invalid. Summary of the invention

[0003] In view of this, the present disclosure provides a screen control method, apparatus, device and storage medium, through which the screen display direction of a terminal device without a physical sensor or with a physical sensor but the physical sensor fails can be adjusted.

[0004] According to a first aspect of an embodiment of the present disclosure, a screen control method is provided, which is applied to a terminal device, and the method includes:

[0005] In response to detecting two touch points on the screen of the terminal device, obtaining the motion trajectories of the two touch points; when the motion trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, determining the screen adjustment direction according to the movement direction of the second touch point relative to the first touch point; and adjusting the display direction of the screen according to the screen adjustment direction.

[0006] In some embodiments, the method further includes: for each touch point, obtaining a rectangular bounding box corresponding to the motion trajectory of the touch point, and determining the motion area of ​​the touch point based on the rectangular bounding box; determining the touch point with the smallest motion area as the first touch point, and determining the touch point with the largest motion area as the second touch point.

[0007] In some embodiments, before detecting a touch point on the screen of the terminal device, the method further includes:

[0008] Initializing a screen display direction value according to the current display direction of the screen, wherein the screen display direction value is used to indicate the display direction of the screen;

[0009] The determining the screen adjustment direction according to the movement direction of the second touch point relative to the first touch point includes:

[0010] Obtaining the center point coordinates of the first touch point;

[0011] Determining the coordinates of the trajectory endpoint of the second touch point according to the motion trajectory of the second touch point;

[0012] determining a rotation direction of the second touch point relative to the first touch point according to the center point coordinates and the trajectory endpoint coordinates;

[0013] The screen display direction value is updated according to the rotation direction of the second touch point relative to the first touch point.

[0014] In some embodiments, the trajectory endpoint coordinates include trajectory starting point coordinates and trajectory ending point coordinates;

[0015] The step of determining the rotation direction of the second touch point relative to the first touch point according to the center point coordinates and the trajectory endpoint coordinates includes:

[0016] A first vector is determined according to the coordinates of the center point and the coordinates of the starting point of the trajectory, and a second vector is determined according to the coordinates of the starting point of the trajectory and the coordinates of the end point of the trajectory; and a rotation direction of the second touch point relative to the first touch point is determined according to the relative position of the first vector and the second vector.

[0017] In some embodiments, determining the rotation direction of the second touch point relative to the first touch point based on the relative positions of the first vector and the second vector includes: obtaining a first product of the horizontal coordinate of the first vector and the vertical coordinate of the second vector, and a second product of the vertical coordinate of the first vector and the horizontal coordinate of the second vector; if the difference between the first product and the second product is less than 0, determining that the second touch point rotates clockwise relative to the first touch point; if the difference between the first product and the second product is greater than 0, determining that the second touch point rotates counterclockwise relative to the first touch point.

[0018] In some embodiments, the method further includes: acquiring a screen lock mode, wherein the screen lock mode includes a screen direction lock mode, a screen direction semi-lock mode, and a screen direction unlock mode;

[0019] In response to the screen lock mode being the screen direction lock mode, the current display direction of the screen is maintained; in response to the screen lock mode being the screen direction semi-lock mode, the number of touch points on the screen is detected; in response to the screen lock mode being the screen direction unlock mode, the display direction of the screen is adjusted by means of a physical sensor.

[0020] In some embodiments, the method also includes: obtaining a screen lock mode, the screen lock mode including a screen direction lock mode and a screen direction unlocked mode; in response to the screen lock mode being the screen direction lock mode, maintaining the current display direction of the screen; in response to the screen lock mode being the screen direction unlocked mode, detecting the number of touch points on the screen.

[0021] In some embodiments, the method further includes: obtaining the screen lock mode from a control center or setting options of the terminal device.

[0022] In some embodiments, the side of the terminal device includes a first horizontal side and a second horizontal side that are arranged opposite to each other, and a first vertical side and a second vertical side that are respectively connected to the first horizontal side and the second horizontal side, and the screen display direction value includes a first value, a second value, a third value, and a fourth value, the first value indicates that the lower part of the screen is close to the first horizontal side, the second value indicates that the lower part of the screen is close to the first vertical side, the third value indicates that the lower part of the screen is close to the second horizontal side, and the fourth value indicates that the lower part of the screen is close to the second vertical side;

[0023] The updating of the screen display direction value according to the rotation direction of the second touch point relative to the first touch point includes:

[0024] When the screen display direction value is a first value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to a second value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to a fourth value;

[0025] When the screen display direction value is the second value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to a third value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the first value;

[0026] When the screen display direction value is the third value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to a fourth value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the second value;

[0027] When the screen display direction value is the fourth value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to the first value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the third value.

[0028] According to a second aspect of an embodiment of the present disclosure, a screen control device is provided, which is applied to a terminal device, and the device includes:

[0029] An acquisition unit, configured to acquire movement trajectories of the two touch points when two touch points are detected on the screen of the terminal device;

[0030] a determination unit, configured to determine a screen adjustment direction according to a movement direction of the second touch point relative to the first touch point when the movement trajectories of the two touch points indicate that the second touch point moves relative to the first touch point;

[0031] A control unit is used to adjust the display direction of the screen according to the screen adjustment direction.

[0032] According to a third aspect of an embodiment of the present disclosure, there is provided a non-temporary computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any method described in the first aspect are implemented.

[0033] According to a fourth aspect of an embodiment of the present disclosure, there is provided a screen control device, including:

[0034] processor;

[0035] a memory for storing processor-executable instructions;

[0036] Wherein, the processor is configured to:

[0037] In response to detecting two touch points on the screen of the terminal device, acquiring movement trajectories of the two touch points;

[0038] When the movement trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, determining the screen adjustment direction according to the movement direction of the second touch point relative to the first touch point;

[0039] The display direction of the screen is adjusted according to the screen adjustment direction.

[0040] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0041] When two touch points are detected on the screen of the terminal device, the motion trajectories of the two touch points are obtained; when the motion trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the movement direction of the second touch point relative to the first touch point, thereby adjusting the screen display direction of the terminal device by the screen adjustment direction. Without the aid of a physical sensor, the display direction of the screen can be adjusted according to the movement direction of the second touch point relative to the first touch point.

[0042] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0044] Figure 1 is a schematic diagram of rotating a picture according to an exemplary embodiment of the present disclosure;

[0045] Figure 2 is an architecture diagram of a terminal device according to an exemplary embodiment of the present disclosure;

[0046] Figure 3 is a flow chart of a screen control method according to an exemplary embodiment of the present disclosure;

[0047] Figure 4 is a schematic diagram showing the relative movement of two touch points on a screen according to an exemplary embodiment of the present disclosure;

[0048] Figure 5 is a schematic diagram showing position coordinates corresponding to touch points according to an exemplary embodiment of the present disclosure;

[0049] Figure 6 is a flow chart showing an implementation method according to an exemplary embodiment of the present disclosure;

[0050] Figure 7 is a schematic diagram of icons corresponding to different screen lock modes according to an exemplary embodiment of the present disclosure;

[0051] Figure 8 is a schematic diagram showing a method of controlling a screen according to a screen lock mode selected by a user according to an exemplary embodiment of the present disclosure;

[0052] Fig. 9 is a schematic diagram showing another method of performing screen control according to a screen lock mode selected by a user according to an exemplary embodiment of the present disclosure;

[0053] Figures 10 to 13 They are respectively schematic diagrams of screen states corresponding to different screen display direction values ​​according to an exemplary embodiment of the present disclosure;

[0054] Figures 14 to 17 They are respectively schematic diagrams of operations for switching between different screen states according to an exemplary embodiment of the present disclosure;

[0055] Fig.18 is a structural schematic diagram of a screen control device according to an exemplary embodiment of the present disclosure;

[0056] Fig.19 It is a structural diagram of a terminal device according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0057] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0058] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0059] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0060] The terminal device can adjust the display direction of the screen according to different application scenarios. The state in which the screen display direction is parallel to the short side of the terminal device is usually called the vertical screen state, and the state in which the screen display direction is parallel to the long side of the terminal device is called the horizontal screen state. In the related art, the switching between the horizontal and vertical screens can be achieved in the following ways.

[0061] Figure 1is a schematic diagram of rotating a picture according to an exemplary embodiment of the present disclosure; Figure 1 As shown, the user rotates the image in the album, that is, the user controls the image to rotate in the desired direction through the touch point 101 of the first finger and the touch point 102 of the second finger. However, this method is only applicable to adjusting the display direction of the image in the album, and is not applicable to switching the screen of the entire operating system between horizontal and vertical. After exiting the album, the screen still maintains the original horizontal and vertical state; in addition, the state of the image during rotation keeps shaking and can present different angles, causing the user to feel dizzy, and the user experience is not good.

[0062] Currently, most terminal devices use physical sensors to achieve horizontal and vertical screen switching, but if the physical sensor fails, this method will completely fail, causing the terminal device to remain in the horizontal or vertical state.

[0063] In addition to the above methods, some video applications can control the display direction of the video screen through the horizontal / vertical screen button when playing videos. For example, when watching a video, the horizontal screen button can be used to control the horizontal screen display of the video screen, but not all applications are equipped with a horizontal and vertical screen switching button, and the interface design of the horizontal and vertical screen buttons is relatively small, which is not convenient for users to operate.

[0064] In view of this, the present disclosure provides a screen control method, in the case of detecting that the screen includes two touch points, determining the screen adjustment direction according to the running tracks of the two touch points, and adjusting the display direction of the screen according to the screen adjustment direction. The method can be applied to terminal devices, such as smart phones, tablets, touch-screen TVs, vehicle-mounted terminal devices, and laptops with touch panels.

[0065] Figure 2 is an architecture diagram of a terminal device according to an exemplary embodiment of the present disclosure, such as Figure 2 As shown, the terminal device of the present disclosure includes a processor, a power module, an internal memory, an external memory, a display screen, etc., wherein the sensor module (physical sensors with other functions such as accelerometers and gyroscopes) and other devices (such as cameras, wireless communication modules, mobile communication modules, motors, etc.) are optional. It can be understood that the present disclosure is not only applicable to terminal devices without physical sensors or with failed physical sensors to complete the switching between horizontal and vertical screens, but also applicable to terminal devices with physical sensors as a supplement to the horizontal and vertical screen switching solution. The screen control method of the embodiment of the present disclosure will be described in detail below in conjunction with the accompanying drawings.

[0066] Figure 3 is a flow chart of a screen control method according to an exemplary embodiment of the present disclosure. Figure 3As shown, the exemplary embodiment method may include the following steps 301 to 303 .

[0067] In step 301, in response to detecting two touch points on the screen of the terminal device, motion trajectories of the two touch points are acquired.

[0068] When a user performs a touch operation on the screen of a terminal device, the number of touch points falling on the screen is detected. If two touch points are detected on the screen of the terminal device, the movement trajectories of the two touch points are obtained.

[0069] In the embodiments of the present disclosure, one finger may correspond to one touch point, that is, if one touch point is detected, it means that the user performs a touch operation with one finger, such as a thumb or an index finger; if two touch points are detected, it means that the user performs a touch operation with two fingers, such as a thumb and an index finger. Those skilled in the art should understand that the present disclosure does not limit the number of fingers corresponding to each touch point.

[0070] In step 302, when the movement trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the movement direction of the second touch point relative to the first touch point.

[0071] When two touch points are detected on the screen of the terminal device, the motion trajectory of each touch point is obtained. For ease of description, the touch point that is stationary relative to the screen of the two touch points is called the first touch point, and the touch point that moves relative to the screen is called the second touch point.

[0072] When the movement trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the movement direction of the second touch point relative to the first touch point on the screen, where the movement direction may include clockwise or counterclockwise.

[0073] In step 303, the display direction of the screen is adjusted according to the screen adjustment direction.

[0074] According to the indication of the screen adjustment direction, the page layout of the entire screen is redrawn, thereby adjusting the screen display direction.

[0075] The screen control method provided by the embodiment of the present disclosure, when two touch points are detected on the screen of the terminal device, the motion trajectories of the two touch points are obtained, and when the motion trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the motion direction of the second touch point relative to the first touch point. The present disclosure can adjust the display direction of the screen according to the motion direction of the second touch point relative to the first touch point without the aid of a physical sensor. The present disclosure can realize the switching of the horizontal and vertical screens when the physical sensor fails or there is no physical sensor, thereby extending the service life of the terminal device.

[0076] In the embodiment of the present disclosure, the first touch point that is stationary relative to the screen and the second touch point that is moving relative to the screen can be determined in the following manner: for each touch point, a rectangular bounding box corresponding to the movement trajectory of the touch point is obtained, and the moving area of ​​the touch point is determined according to the rectangular bounding box. When the moving area areas of the two touch points are obtained, the sizes of the moving area areas can be compared, and the touch point with the smallest moving area area is determined as the first touch point, and the touch point with the largest moving area area is determined as the second touch point.

[0077] For each touch point, the position coordinates on the motion trajectory of the touch point are obtained. Based on the position coordinates on the motion trajectory, the range of the motion area of ​​the touch point can be determined. For example, all the position coordinates can be enclosed in a minimum rectangular frame, and the width and height of the rectangular frame can be determined based on the coordinates of the upper left and lower right corners of the rectangular frame. Then, based on the width and height of the sliding area, the area of ​​the motion area can be obtained.

[0078] It should be noted that in the present disclosure, the first touch point is a touch point generated when the first finger touches the screen, and the second touch point is a touch point generated when the second finger touches the screen. Those skilled in the art should understand that in the following embodiments and drawings, the first touch point has the same meaning as that represented by the first finger, and the second touch point has the same meaning as that represented by the second finger.

[0079] Figure 4 is a schematic diagram showing the relative movement of two touch points on a screen according to an exemplary embodiment of the present disclosure, such as Figure 4 As shown, assuming that the maximum motion range of a touch point on the screen X axis is x max , the maximum range of motion on the Y axis of the screen is y max , then the motion area of ​​the touch point is a rectangle, denoted as R, and its area is S R =x max ×y max ; Similarly, the maximum motion range of another touch point on the screen X axis is x′ max, the maximum range of motion on the Y axis of the screen is y′ max , then the motion area of ​​the other touch point is a rectangle, denoted as T, and its area is S T = x′ max ×y′ max If S R >S T , the touch point generating the motion area T is determined as the first touch point, and the touch point generating the motion area R is determined as the second touch point.

[0080] In an embodiment of the present disclosure, the display direction of the screen can be indicated by a screen display direction value, that is, different screen display direction values ​​correspond to different screen display directions. Before detecting a touch point on the screen of the terminal device, the screen display direction value is initialized according to the current display direction of the screen, and then the screen display direction value is updated according to the movement direction of the second touch point relative to the first touch point.

[0081] When the user's finger touches the screen, the terminal device will record the relative position of the finger on the screen in the form of coordinates. Figure 5 As shown, the corresponding position coordinates of the first touch point 501 generated by the first finger touching the screen are 503, and the corresponding position coordinates of the first touch point 502 generated by the second finger touching the screen are 504. This implementation will determine the movement direction of the second touch point relative to the first touch point based on the center point coordinates of the first touch point and the trajectory endpoint coordinates of the second touch point.

[0082] In some embodiments, determining the screen adjustment direction according to the movement direction of the second touch point relative to the first touch point may include: obtaining the center point coordinates of the first touch point; determining the trajectory endpoint coordinates of the second touch point according to the movement trajectory of the second touch point; determining the rotation direction of the second touch point relative to the first touch point according to the center point coordinates and the trajectory endpoint coordinates; and updating the screen display direction value according to the rotation direction of the second touch point relative to the first touch point.

[0083] The trajectory endpoint coordinates may include trajectory start point coordinates and trajectory end point coordinates. Two vectors may be determined based on the center point coordinates of the first touch point and the trajectory start point coordinates and trajectory end point coordinates of the second touch point, and the relative positions of the two vectors may be used to determine the rotation direction of the second touch point relative to the first touch point.

[0084] That is to say, determining the rotation direction of the second touch point relative to the first touch point based on the center point coordinates and the trajectory endpoint coordinates may include: determining a first vector based on the center point coordinates and the trajectory starting point coordinates, and determining a second vector based on the trajectory starting point coordinates and the trajectory end point coordinates; determining the rotation direction of the second touch point relative to the first touch point based on the relative position of the first vector and the second vector.

[0085] Among them, determining the rotation direction of the second touch point relative to the first touch point based on the relative position of the first vector and the second vector can include: obtaining the first product of the horizontal coordinate of the first vector and the vertical coordinate of the second vector, and the second product of the vertical coordinate of the first vector and the horizontal coordinate of the second vector; if the difference between the first product and the second product is less than 0, determining that the second touch point rotates clockwise relative to the first touch point; if the difference between the first product and the second product is greater than 0, determining that the second touch point rotates counterclockwise relative to the first touch point.

[0086] The following examples will be Figure 4 The process of determining the rotation direction is described by taking as an example.

[0087] In this embodiment, the coordinates of the center point of T are marked as O(x 1 ,y 1 ), the position coordinates of the second touch point represented by R when it just touches the screen are the coordinates of the starting point of the track, recorded as P(x 2 ,y 2 ), the position coordinates where the second touch point stops or leaves after moving (drawing an arc) on the screen are the coordinates of the end point of the trajectory, recorded as P 1 (x 3 ,y 3 ). Then the first vector is (x 2 -x 1 ,y 2 -y 1 ), the second vector is (x 3 -x 2 ,y 3 -y 2 ), and then use the relative positions of the two vectors to determine whether the second touch point moves clockwise or counterclockwise relative to the first touch point.

[0088]

[0089] If the result of formula (1) is greater than 0, it means that the second touch point moves counterclockwise relative to the first touch point; if the result of formula (1) is less than 0, it means that the second touch point moves clockwise relative to the first touch point; if the result of formula (1) is and Collinearity is an invalid operation for the present disclosure, and in this case the number of touch points on the screen will continue to be detected.

[0090] Those skilled in the art should understand that indicating the display direction of the screen by using the screen display direction value is one of the implementation methods of the present disclosure. In addition to this, the display direction of the screen can also be determined according to the movement direction of the second touch point relative to the first touch point. For example, when the second touch point moves clockwise relative to the first touch point, the current screen display direction is rotated 90° clockwise; when the second touch point moves counterclockwise relative to the first touch point, the current screen display direction is rotated 90° counterclockwise. The present disclosure does not limit this.

[0091] When the screen is touched, the operating system of the terminal device, i.e., the processor, can obtain the coordinate data corresponding to the touch point, which can also be called the reporting data. The present disclosure controls the screen to switch between the horizontal and vertical screen states by processing the reporting data. The present disclosure makes the switching between the horizontal and vertical screen states no longer limited to a certain application, and compared with the horizontal and vertical screen buttons, the entire screen can be used as an operation area in the present disclosure, which is convenient for users to operate.

[0092] The following embodiments will be combined with Figure 6 An implementation of the present disclosure is specifically described. In the description of this embodiment, the same steps as those in any of the foregoing embodiments will be briefly described without further elaboration, and specific details can be found in any of the foregoing embodiments.

[0093] like Figure 6 As shown, first, the screen display direction value is initialized according to the display direction of the current screen to avoid sudden changes in the current horizontal or vertical screen state to cause discomfort to the user. Secondly, detect whether there are two touch points on the screen. If not, keep the current horizontal or vertical screen state of the screen, and continue to detect whether there are two touch points; if so, record the movement trajectory of the two touch points. Then, determine whether the second touch point moves relative to the first touch point based on the movement trajectory of the two touch points. If not, keep the current horizontal or vertical screen state of the screen and continue to detect whether there are touch points; if so, update the screen display direction value based on the movement direction of the second touch point relative to the first touch point. Finally, when a change in the screen display direction value is detected, redraw the page layout of the entire screen according to the indication of the screen display direction value.

[0094] In one implementation, after the rotation operation is completed and the screen is left, the screen state can be switched between horizontal and vertical to avoid dizziness caused by real-time adjustment of the horizontal and vertical states.

[0095] In order to be compatible with the related art of using physical sensors to change the horizontal and vertical screen states, this embodiment can set different screen lock modes, and different modes correspond to different implementation methods. The screen lock modes in this disclosure may include screen orientation lock mode, screen orientation semi-lock mode, and screen orientation unlock mode. Figure 7 As shown, different screen lock modes correspond to different icons. Among them, the screen orientation lock mode represents the state in which the user cannot use the physical sensor and the present disclosure to change the horizontal or vertical screen; the screen orientation semi-lock mode represents the state in which the user uses the present disclosure to change the horizontal or vertical screen, in which case the physical sensor cannot change the horizontal or vertical screen; the screen orientation unlock mode represents the state in which the user uses the data reported by the physical sensor to change the horizontal or vertical screen, in which case the present disclosure is not effective.

[0096] In some embodiments, the screen lock mode can be obtained, and in response to the screen lock mode being the screen direction lock mode, the current display direction of the screen is maintained; in response to the screen lock mode being the screen direction semi-lock mode, the number of touch points on the screen is detected, that is, the state of the horizontal or vertical screen is changed by using the present disclosure; in response to the screen lock mode being the screen direction unlock mode, the display direction of the screen is adjusted by means of a physical sensor.

[0097] The user can set the screen lock mode in the control center or settings as needed, that is, the terminal device can obtain the screen lock mode of the screen from the control center or setting options.

[0098] Figure 8 is a schematic diagram showing a screen control according to a screen lock mode selected by a user according to an exemplary embodiment of the present disclosure, such as Figure 8 As shown, when the screen lock mode is the screen orientation unlocked mode, it means that the user chooses to use the physical sensor to change the state of the horizontal or vertical screen. The terminal device monitors the data reported by the physical sensor. If the terminal device is always in a static state or the movement amplitude is less than the amplitude threshold, the current horizontal or vertical screen state is maintained. If the movement amplitude of the terminal device is detected to be greater than the amplitude threshold, it means that the direction of the terminal device is flipped. In this case, the screen direction is adjusted according to the data of the physical sensor.

[0099] When the screen lock mode is the screen orientation semi-lock mode, it means that the user chooses to use the present disclosure to change the horizontal or vertical screen state. In this case, the terminal device obtains the point reporting data of the touch screen. If two touch points are not detected on the screen, the current horizontal or vertical screen state is maintained. If two touch points are detected on the screen and it is detected that the second touch point moves relative to the first touch point, the screen orientation is adjusted according to the movement direction of the second touch point relative to the first touch point.

[0100] When the screen lock mode is the screen orientation lock mode, it means that the user chooses to lock the screen display orientation. In this case, the method of using a physical sensor or the method disclosed in the present invention to change the horizontal or vertical state of the screen is invalid, and the current horizontal or vertical state of the screen is maintained.

[0101] In some embodiments, the present disclosure can also be applied to terminal devices that do not contain physical sensors or whose physical sensors fail to function to switch between landscape and portrait screen states. Since it is not possible to use physical sensors to change the landscape and portrait screen states, the screen lock mode includes a screen orientation lock mode and a screen orientation unlock mode. When the physical sensor fails, the present disclosure can be used as a backup solution to control the screen to switch between landscape and portrait screen states, which can extend the use time of the terminal device and improve the user experience.

[0102] In this embodiment, the screen lock mode can be obtained in the control center or setting options; in response to the screen lock mode being the screen direction lock mode, the current display direction of the screen is maintained; in response to the screen lock mode being the screen direction unlock mode, the number of touch points on the screen is detected.

[0103] Fig. 9 is a schematic diagram showing another method of performing screen control according to a screen lock mode selected by a user according to an exemplary embodiment of the present disclosure, such as Fig. 9 As shown, when the screen lock mode is the screen orientation lock mode, it means that the user chooses to use the present disclosure to change the horizontal or vertical screen state. In this case, the terminal device obtains the point reporting data of the touch screen. If two touch points are not detected on the screen, the current horizontal or vertical screen state is maintained. If two touch points are detected on the screen, and it is detected that the second touch point moves relative to the first touch point, the screen direction is adjusted according to the movement direction of the second touch point relative to the first touch point.

[0104] When the screen lock mode is the screen orientation lock mode, it indicates that the user chooses to lock the screen display orientation. In this case, the current horizontal or vertical state of the screen is maintained.

[0105] The present disclosure switches the screen state by the rotation direction of the second touch point relative to the first touch point. Since the side of the terminal device includes four sides, there are two states of the horizontal and vertical screen respectively. In this embodiment, different screen display direction values ​​are used to represent different horizontal and vertical screen states. Figures 10 to 17 The switching process between different states is described.

[0106] For the sake of ease of expression, the short sides that are relatively arranged in the side periphery of the terminal device are respectively referred to as the first horizontal side and the second horizontal side, and the long sides that are respectively connected to the first horizontal side and the second horizontal side are respectively referred to as the first vertical side and the second vertical side. In addition, the first horizontal side is located at the lower part of the terminal device, and the second horizontal side is located at the lower part of the terminal device. Among them, "upper" and "lower" are based on the normal usage orientation of the terminal device. Taking a mobile phone as an example, the orientation of the normal image display of the mobile phone is used as a reference, or the orientation of the earpiece and microphone (the earpiece is at the top, and the microphone is at the bottom) is used as a reference. Fig.10 As shown, the terminal device 1000 includes a first horizontal side 1001 and a second horizontal side 1002 , and a first vertical side 1003 and a second vertical side 1004 .

[0107] The screen display direction value includes a first numerical value, a second numerical value, a third numerical value and a fourth numerical value, the first numerical value indicating that the display direction of the screen is parallel to the first horizontal side, and the lower part of the screen is close to the first horizontal side, the second numerical value indicates that the display direction of the screen is parallel to the first vertical side, and the lower part of the screen is close to the first vertical side, the third numerical value indicates that the display direction of the screen is parallel to the second horizontal side, and the lower part of the screen is close to the second horizontal side, and the fourth numerical value indicates that the display direction of the screen is parallel to the second vertical side, and the lower part of the screen is close to the second vertical side.

[0108] Fig.10 What is shown is a first vertical screen state represented by a first numerical value, which may also be referred to as a first vertical screen display direction; Fig.11 What is shown is a first horizontal screen state represented by a second numerical value, which may also be referred to as a first horizontal screen display direction; Fig.12 What is shown is a second vertical screen state represented by a third value, which may also be referred to as a second vertical screen display direction; Fig.13 The second horizontal screen state represented by the fourth value is shown, which can also be called the second horizontal screen display direction. In order to more clearly show the page layout when the screen is horizontal or vertical, Figure 10-13 In the figure, "A", "B", "C", "D", "E" and "F" represent different application programs. Figures 14 to 17It indicates that in the current screen display orientation, the user can touch the screen with two fingers, keep the first finger still, and use the second finger to draw an arc clockwise or counterclockwise relative to the first finger as needed, thereby switching the screen state between horizontal and vertical.

[0109] When the current screen display direction value is the first value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to the second value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the fourth value.

[0110] like Fig.14 As shown, in the first vertical screen state, if the second finger draws an arc counterclockwise relative to the first finger, the first vertical screen state ( Fig.10 )Switch to the first horizontal screen state ( Fig.11 ); If the second finger draws an arc clockwise relative to the first finger, the first vertical screen state ( Fig.10 )Switch to the second horizontal screen state ( Fig.13 ).

[0111] When the current screen display direction value is the second value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to the third value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the first value.

[0112] like Fig.15 As shown, in the first horizontal screen state, if the second finger draws an arc counterclockwise relative to the first finger, the first horizontal screen state ( Fig.11 )Switch to the second vertical screen state ( Fig.12 ); If the second finger draws an arc clockwise relative to the first finger, the first horizontal screen state ( Fig.11 )Switch to the first vertical screen state ( Fig.10 ).

[0113] When the current screen display direction value is the third value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to the fourth value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the second value.

[0114] like Fig.16 As shown, in the second vertical screen state, if the second finger draws an arc counterclockwise relative to the first finger, the second vertical screen state ( Fig.12 )Switch to the second horizontal screen state ( Fig.13 ); If the second finger draws an arc clockwise relative to the first finger, the second vertical screen state ( Fig.12 )Switch to the first horizontal screen state ( Fig.11 ).

[0115] When the current screen display direction value is the fourth value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to the first value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the third value.

[0116] like Fig.17 As shown, in the second horizontal screen state, if the second finger draws an arc counterclockwise relative to the first finger, the second horizontal screen state ( Fig.13 )Switch to the first vertical screen state ( Fig.10 ); If the second finger draws an arc clockwise relative to the first finger, the second horizontal screen state ( Fig.13 )Switch to the second vertical screen state ( Fig.12 ).

[0117] By implementing the horizontal and vertical screen switching using the present disclosure, the number of sensors can be reduced, thereby reducing the volume and weight of the terminal device, as well as the cost. In addition, since the processor no longer receives data from the physical sensor, power consumption can be saved.

[0118] For the aforementioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present disclosure is not limited by the described order of actions, because according to the present disclosure, certain steps can be performed in other orders or simultaneously.

[0119] Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

[0120] Corresponding to the aforementioned application function implementation method embodiment, the present disclosure also provides an application function implementation device and a corresponding terminal embodiment.

[0121] Fig.18 is a structural schematic diagram of a screen control device in an exemplary embodiment of the present disclosure, such as Fig.18 As shown, the screen control device may include:

[0122] An acquiring unit 1801 is configured to acquire movement trajectories of two touch points when two touch points are detected on the screen of the terminal device;

[0123] A determining unit 1802, configured to determine a screen adjustment direction according to a movement direction of the second touch point relative to the first touch point when the movement trajectories of the two touch points indicate that the second touch point moves relative to the first touch point;

[0124] The control unit 1803 is used to adjust the display direction of the screen according to the screen adjustment direction.

[0125] In some embodiments, before detecting a touch point on the screen of the terminal device, the determination unit 1802 is also used to initialize a screen display direction value according to the current display direction of the screen, and the screen display direction value is used to indicate the display direction of the screen; the determination unit 1802 is specifically used to: obtain the center point coordinates of the first touch point; determine the trajectory endpoint coordinates of the second touch point according to the motion trajectory of the second touch point; determine the rotation direction of the second touch point relative to the first touch point according to the center point coordinates and the trajectory endpoint coordinates; and update the screen display direction value according to the rotation direction of the second touch point relative to the first touch point.

[0126] In some embodiments, the trajectory endpoint coordinates include trajectory starting point coordinates and trajectory end point coordinates; the determination unit 1802 is specifically used to:

[0127] A first vector is determined according to the coordinates of the center point and the coordinates of the starting point of the trajectory, and a second vector is determined according to the coordinates of the starting point of the trajectory and the coordinates of the end point of the trajectory; and a rotation direction of the second touch point relative to the first touch point is determined according to the relative position of the first vector and the second vector.

[0128] In some embodiments, the determination unit 1802 is specifically used to: obtain a first product of the horizontal coordinate of the first vector and the vertical coordinate of the second vector, and a second product of the vertical coordinate of the first vector and the horizontal coordinate of the second vector; if the difference between the first product and the second product is less than 0, determine that the second touch point rotates clockwise relative to the first touch point; if the difference between the first product and the second product is greater than 0, determine that the second touch point rotates counterclockwise relative to the first touch point.

[0129] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can refer to the partial description of the method embodiments. The device embodiments described above are only schematic, wherein the units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the disclosed solution. A person of ordinary skill in the art may understand and implement it without creative work.

[0130] Accordingly, an embodiment of the present disclosure provides a terminal device, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to:

[0131] In response to detecting two touch points on the screen of the terminal device, acquiring movement trajectories of the two touch points;

[0132] When the movement trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, determining the screen adjustment direction according to the movement direction of the second touch point relative to the first touch point;

[0133] The display direction of the screen is adjusted according to the screen adjustment direction.

[0134] Fig.19 1 is a schematic diagram of a terminal device 1900 according to an exemplary embodiment. For example, the terminal device 1900 may be a user device, and may specifically be a mobile phone, a computer, a digital broadcast terminal, a message transceiver device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, a wearable device such as a smart watch, a smart glasses, a smart bracelet, a smart running shoe, etc.

[0135] Reference Fig.19 The terminal device 1900 may include one or more of the following components: a processing component 1902 , a memory 1904 , a power component 1906 , a multimedia component 1908 , an audio component 1910 , an input / output (I / O) interface 1912 , a sensor component 1914 , and a communication component 1916 .

[0136] The processing component 1902 generally controls the overall operation of the terminal device 1900, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1902 may include one or more processors 1920 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 1902 may include one or more modules to facilitate the interaction between the processing component 1902 and other components. For example, the processing component 1902 may include a multimedia module to facilitate the interaction between the multimedia component 1908 and the processing component 1902.

[0137] The memory 1904 is configured to store various types of data to support operations on the device 1900. Examples of such data include instructions for any application or method operating on the terminal device 1900, contact data, phone book data, messages, pictures, videos, etc. The memory 1904 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0138] The power supply component 1906 provides power to various components of the terminal device 1900. The power supply component 1906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the terminal device 1900.

[0139] The multimedia component 1908 includes a screen that provides an output interface between the above-mentioned terminal device 1900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The above-mentioned touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the above-mentioned touch or slide operation. In some embodiments, the multimedia component 1908 includes a front camera and / or a rear camera. When the terminal device 1900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0140] The audio component 1910 is configured to output and / or input audio signals. For example, the audio component 1910 includes a microphone (MIC), and when the terminal device 1900 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 1904 or sent via the communication component 1916. In some embodiments, the audio component 1910 also includes a speaker for outputting audio signals.

[0141] I / O interface 1912 provides an interface between processing component 1902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0142] The sensor assembly 1914 includes one or more sensors for providing various aspects of status assessment for the terminal device 1900. For example, the sensor assembly 1914 can detect the open / closed state of the terminal device 1900, the relative positioning of the components, such as the display and keypad of the terminal device 1900, and the sensor assembly 1914 can also detect the position change of the terminal device 1900 or a component of the terminal device 1900, the presence or absence of user contact with the terminal device 1900, the orientation or acceleration / deceleration of the terminal device 1900, and the temperature change of the terminal device 1900. The sensor assembly 1914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1914 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0143] The communication component 1916 is configured to facilitate wired or wireless communication between the terminal device 1900 and other devices. The terminal device 1900 can access a wireless network based on a communication standard, such as WiFi, 4G or 5G, 4G LTE, 5G NR or a combination thereof. In an exemplary embodiment, the communication component 1916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the above-mentioned communication component 1916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0144] In an exemplary embodiment, the terminal device 1900 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned methods.

[0145] In an exemplary embodiment, a non-transitory computer-readable storage medium is also provided, such as a memory 1904 including instructions, when the instructions in the storage medium are executed by a processor 1920 of a terminal device 1900, the terminal device 1900 is enabled to perform a screen control method, the method comprising:

[0146] In response to detecting two touch points on the screen of the terminal device, acquiring movement trajectories of the two touch points;

[0147] When the movement trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, determining the screen adjustment direction according to the movement direction of the second touch point relative to the first touch point;

[0148] The display direction of the screen is adjusted according to the screen adjustment direction.

[0149] The non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

[0150] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0151] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A screen control method, characterized in that: Applied to a terminal device, the method comprises: In response to detecting two touch points on the screen of the terminal device, acquiring movement trajectories of the two touch points; When the movement trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, determining the screen adjustment direction according to the movement direction of the second touch point relative to the first touch point; The display direction of the screen is adjusted according to the screen adjustment direction.

2. The method according to claim 1, characterized in that: The method further comprises: For each touch point, obtaining a rectangular bounding box corresponding to the motion trajectory of the touch point, and determining the motion region area of ​​the touch point according to the rectangular bounding box; The touch point with the smallest motion region is determined as the first touch point, and the touch point with the largest motion region is determined as the second touch point.

3. The method according to claim 1, characterized in that Before detecting a touch point on the screen of the terminal device, the method further includes: Initializing a screen display direction value according to the current display direction of the screen, wherein the screen display direction value is used to indicate the display direction of the screen; The determining the screen adjustment direction according to the movement direction of the second touch point relative to the first touch point includes: Obtaining the center point coordinates of the first touch point; Determining the coordinates of the trajectory endpoint of the second touch point according to the motion trajectory of the second touch point; determining a rotation direction of the second touch point relative to the first touch point according to the center point coordinates and the trajectory endpoint coordinates; The screen display direction value is updated according to the rotation direction of the second touch point relative to the first touch point.

4. The method according to claim 3, characterized in that The trajectory endpoint coordinates include trajectory starting point coordinates and trajectory end point coordinates; The step of determining the rotation direction of the second touch point relative to the first touch point according to the center point coordinates and the trajectory endpoint coordinates includes: Determine a first vector according to the coordinates of the center point and the coordinates of the starting point of the track, and determine a second vector according to the coordinates of the starting point of the track and the coordinates of the end point of the track; The rotation direction of the second touch point relative to the first touch point is determined according to the relative position of the first vector and the second vector.

5. The method according to claim 4, characterized in that The determining, according to the relative positions of the first vector and the second vector, a rotation direction of the second touch point relative to the first touch point includes: Obtain a first product of the abscissa of the first vector and the ordinate of the second vector, and a second product of the ordinate of the first vector and the abscissa of the second vector; If the difference between the first product and the second product is less than 0, determining that the second touch point rotates clockwise relative to the first touch point; If the difference between the first product and the second product is greater than 0, it is determined that the second touch point rotates counterclockwise relative to the first touch point.

6. The method according to claim 1, characterized in that The method further comprises: Obtaining a screen lock mode, wherein the screen lock mode includes a screen direction lock mode, a screen direction semi-lock mode, and a screen direction unlock mode; In response to the screen lock mode being the screen orientation lock mode, maintaining the current display orientation of the screen; In response to the screen lock mode being a screen direction semi-lock mode, detecting the number of touch points on the screen; In response to the screen lock mode being a screen direction unlock mode, a physical sensor is used to adjust the display direction of the screen.

7. The method according to claim 1, characterized in that The method further comprises: Get the screen lock mode, where the screen lock mode includes a screen direction lock mode and a screen direction unlock mode; In response to the screen lock mode being the screen orientation lock mode, maintaining the current display orientation of the screen; In response to the screen lock mode being a screen direction unlock mode, the number of touch points on the screen is detected.

8. The method according to claim 6 or 7, characterized in that: The method further comprises: The screen lock mode is obtained from a control center or a setting option of the terminal device.

9. The method according to claim 3, characterized in that: The side periphery of the terminal device includes a first horizontal side and a second horizontal side that are arranged opposite to each other, and a first vertical side and a second vertical side that are respectively connected to the first horizontal side and the second horizontal side, and the screen display direction value includes a first value, a second value, a third value and a fourth value, the first value indicates that the lower part of the screen is close to the first horizontal side, the second value indicates that the lower part of the screen is close to the first vertical side, the third value indicates that the lower part of the screen is close to the second horizontal side, and the fourth value indicates that the lower part of the screen is close to the second vertical side; The updating of the screen display direction value according to the rotation direction of the second touch point relative to the first touch point includes: When the screen display direction value is a first value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to a second value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to a fourth value; When the screen display direction value is the second value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to a third value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the first value; When the screen display direction value is the third value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to a fourth value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the second value; When the screen display direction value is the fourth value, if the second touch point rotates counterclockwise relative to the first touch point, the screen display direction value is updated to the first value; if the second touch point rotates clockwise relative to the first touch point, the screen display direction value is updated to the third value.

10. A screen control device, characterized in that: Applied to a terminal device, the device comprises: An acquisition unit, configured to acquire movement trajectories of the two touch points when two touch points are detected on the screen of the terminal device; a determination unit, configured to determine a screen adjustment direction according to a movement direction of the second touch point relative to the first touch point when the movement trajectories of the two touch points indicate that the second touch point moves relative to the first touch point; A control unit is used to adjust the display direction of the screen according to the screen adjustment direction.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of any method described in claims 1 to 9 are implemented.

12. A terminal device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the method according to any one of claims 1 to 9.

Images