A screen control method, device, apparatus and storage medium

Abstract

The present disclosure provides a screen control method, device, equipment and storage medium, wherein the method comprises: in the case that two touch points are detected on the screen of a terminal device, obtaining the motion trajectory of the two touch points; in the case that the motion trajectory of the two touch points indicates that the second touch point moves relative to the first touch point, determining the screen adjustment direction according to the motion direction of the second touch point relative to the first touch point, thereby realizing the adjustment of the screen display direction of the terminal device through the screen adjustment direction. Without the aid of physical sensors, the display direction of the screen can be adjusted according to the motion direction of the second touch point relative to the first touch point.

Description

Technical Field

[0001] This disclosure relates to the field of terminal equipment, and in particular to a screen control method, apparatus, device, and storage medium. Background Technology

[0002] Terminal devices can freely switch between landscape and portrait modes. For example, they can switch to landscape mode when working on the terminal device and to portrait mode when using it for entertainment. Related technologies typically use physical sensors to switch the screen display orientation, but this method is not suitable for terminal devices that lack physical sensors or whose physical sensors are malfunctioning. Summary of the Invention

[0003] In view of this, the present disclosure provides a screen control method, apparatus, device and storage medium, which can adjust the screen display orientation of terminal devices that do not have physical sensors or have physical sensors but whose physical sensors are malfunctioning.

[0004] According to a first aspect of the present disclosure, a screen control method is provided, applied to a terminal device, the method comprising:

[0005] In response to detecting two touch points on the screen of the terminal device, the motion trajectories of the two touch points are acquired; when the motion trajectories of the two touch points indicate that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the motion direction of the second touch point relative to the first touch point; and the display direction of the screen is adjusted according to the screen adjustment direction.

[0006] In some embodiments, the method further includes: for each touch point, obtaining a rectangular bounding box corresponding to the motion trajectory of the touch point, and determining the motion area of ​​the touch point based on the rectangular bounding box; determining the touch point with the smallest motion area as the first touch point, and determining the touch point with the largest motion area as the second touch point.

[0007] In some embodiments, before detecting a touch point on the screen of the terminal device, the method further includes:

[0008] Based on the current display orientation of the screen, initialize the screen display orientation value, which is used to indicate the display orientation of the screen;

[0009] Determining the screen adjustment direction based on the movement direction of the second touch point relative to the first touch point includes:

[0010] Obtain the coordinates of the center point of the first touch point;

[0011] Based on the movement trajectory of the second touch point, determine the coordinates of the trajectory endpoints of the second touch point;

[0012] The rotation direction of the second touch point relative to the first touch point is determined based on the coordinates of the center point and the coordinates of the trajectory endpoints.

[0013] Update the screen display orientation value based on the rotation direction of the second touch point relative to the first touch point.

[0014] In some embodiments, the trajectory endpoint coordinates include the trajectory start point coordinates and the trajectory end point coordinates;

[0015] Determining the rotation direction of the second touch point relative to the first touch point based on the center point coordinates and the trajectory endpoint coordinates includes:

[0016] A first vector is determined based on the coordinates of the center point and the coordinates of the starting point of the trajectory, and a second vector is determined based on the coordinates of the starting point of the trajectory and the coordinates of the ending point of the trajectory; the rotation direction of the second touch point relative to the first touch point is determined based on the relative positions of the first vector and the second vector.

[0017] In some embodiments, determining the rotation direction of the second touch point relative to the first touch point based on the relative positions of the first vector and the second vector includes: obtaining a first product of the abscissa of the first vector and the ordinate of the second vector, and a second product of the ordinate of the first vector and the abscissa of the second vector; if the difference between the first product and the second product is less than 0, then determining that the second touch point rotates clockwise relative to the first touch point; if the difference between the first product and the second product is greater than 0, then determining that the second touch point rotates counterclockwise relative to the first touch point.

[0018] In some embodiments, the method further includes: obtaining a screen lock mode, the screen lock mode including a screen orientation lock mode, a screen orientation semi-lock mode, and a screen orientation unlock mode;

[0019] In response to the screen lock mode being a screen orientation lock mode, the current display orientation of the screen is maintained; in response to the screen lock mode being a screen orientation half-lock mode, the number of touch points on the screen is detected; in response to the screen lock mode being a screen orientation unlock mode, the display orientation of the screen is adjusted using a physical sensor.

[0020] In some embodiments, the method further includes: acquiring a screen lock mode, the screen lock mode including a screen orientation lock mode and a screen orientation unlock mode; maintaining the current display orientation of the screen in response to the screen lock mode being a screen orientation lock mode; and detecting the number of touch points on the screen in response to the screen lock mode being a screen orientation unlock mode.

[0021] In some embodiments, the method further includes: obtaining the screen lock mode from the control center or settings options of the terminal device.

[0022] In some embodiments, the side panel of the terminal device includes a first horizontal edge and a second horizontal edge disposed opposite to each other, and a first vertical edge and a second vertical edge connected to the first horizontal edge and the second horizontal edge respectively. The screen display direction value includes a first value, a second value, a third value and a fourth value. The first value indicates that the lower part of the screen is close to the first horizontal edge, the second value indicates that the lower part of the screen is close to the first vertical edge, the third value indicates that the lower part of the screen is close to the second horizontal edge, and the fourth value indicates that the lower part of the screen is close to the second vertical edge.

[0023] The step of updating the screen display orientation value based on the rotation direction of the second touch point relative to the first touch point includes:

[0024] If the screen display orientation value is a first value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to a second value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to a fourth value.

[0025] If the screen display orientation value is the second value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to the third value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to the first value.

[0026] If the screen display orientation value is the third value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to the fourth value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to the second value.

[0027] If the screen display orientation value is the fourth value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to the first value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to the third value.

[0028] According to a second aspect of the present disclosure, a screen control device is provided, applied to a terminal device, the device comprising:

[0029] The acquisition unit is used to acquire the motion trajectory of the two touch points when two touch points are detected on the screen of the terminal device.

[0030] The determining unit is used to determine the screen adjustment direction based on the movement direction of the second touch point relative to the first touch point when the movement trajectory of the two touch points indicates that the second touch point moves relative to the first touch point.

[0031] A control unit is used to adjust the display orientation of the screen according to the screen adjustment orientation.

[0032] According to a third aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of any of the methods described in the first aspect above.

[0033] According to a fourth aspect of the present disclosure, a screen control device is provided, comprising:

[0034] processor;

[0035] Memory used to store processor-executable instructions;

[0036] The processor is configured as follows:

[0037] In response to detecting two touch points on the screen of the terminal device, the motion trajectories of the two touch points are acquired;

[0038] When the movement trajectory of the two touch points indicates that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the movement direction of the second touch point relative to the first touch point;

[0039] Adjust the display orientation of the screen according to the screen orientation.

[0040] The technical solutions provided in this disclosure may have the following beneficial effects:

[0041] When two touch points are detected on the screen of a terminal device, the movement trajectories of the two touch points are acquired. If the movement trajectories indicate that the second touch point is moving relative to the first touch point, the screen adjustment direction is determined based on the movement direction of the second touch point relative to the first touch point, thereby enabling adjustment of the terminal device's screen display orientation. Without the aid of physical sensors, the screen display orientation can be adjusted based on the movement direction of the second touch point relative to the first touch point.

[0042] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0043] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0044] Figure 1 This is a schematic diagram illustrating the rotation of an image according to an exemplary embodiment of the present disclosure;

[0045] Figure 2 This is an architectural diagram of a terminal device illustrated in an exemplary embodiment of this disclosure;

[0046] Figure 3 This is a flowchart illustrating a screen control method according to an exemplary embodiment of the present disclosure;

[0047] Figure 4 This is a schematic diagram illustrating the relative movement of two touch points on a screen according to an exemplary embodiment of this disclosure;

[0048] Figure 5 This is a schematic diagram illustrating the coordinates of a touch point location according to an exemplary embodiment of this disclosure;

[0049] Figure 6 This is a flowchart illustrating one implementation of the present disclosure according to an exemplary embodiment;

[0050] Figure 7 This is a schematic diagram of icons corresponding to different screen lock modes according to an exemplary embodiment of the present disclosure;

[0051] Figure 8 This is a schematic diagram illustrating screen control based on a user-selected screen lock mode according to an exemplary embodiment of the present disclosure;

[0052] Figure 9 This is a schematic diagram illustrating another screen control based on a user-selected screen lock mode according to an exemplary embodiment of this disclosure;

[0053] Figures 10 to 13 These are schematic diagrams of screen states corresponding to different screen display orientation values ​​according to an exemplary embodiment of this disclosure;

[0054] Figures 14 to 17 These are schematic diagrams illustrating the operation of switching between different screen states according to an exemplary embodiment of this disclosure;

[0055] Figure 18 This is a schematic diagram of the structure of a screen control device according to an exemplary embodiment of the present disclosure;

[0056] Figure 19 This is a schematic diagram of the structure of a terminal device according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0057] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0058] The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The singular forms “a,” “the,” and “the” as used in this disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

[0059] It should be understood that although the terms first, second, third, etc., may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are used only to distinguish information of the same type from one another. For example, without departing from the scope of this disclosure, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."

[0060] Terminal devices can adjust the screen orientation according to different application scenarios. Generally, the state where the screen orientation is parallel to the short side of the terminal device is called portrait mode, and the state where the screen orientation is parallel to the long side of the terminal device is called landscape mode. Related technologies can achieve switching between portrait and landscape modes in the following ways.

[0061] Figure 1This is a schematic diagram illustrating the rotation of an image according to an exemplary embodiment of this disclosure; as shown below. Figure 1 As shown, users rotate images in the album by using touch points 101 of their first finger and 102 of their second finger to control the rotation in the desired direction. However, this method only adjusts the display orientation of images within the album and does not work for switching the entire operating system screen between portrait and landscape modes. Exiting the album restores the original portrait / landscape orientation. Furthermore, the rotating images constantly sway and can be displayed at different angles, causing dizziness and resulting in a poor user experience.

[0062] Currently, most terminal devices use physical sensors to switch between landscape and portrait modes. However, if the physical sensors fail, this method will completely fail, causing the terminal device to remain in either landscape or portrait mode.

[0063] In addition to the methods mentioned above, some video applications allow users to control the display direction of the video screen using a landscape / portrait button. For example, when watching a video, the landscape button can be used to control the video screen to be displayed in landscape mode. However, not all applications have a landscape / portrait switching button, and the interface design of the landscape / portrait button is relatively small, making it inconvenient for users to operate.

[0064] In view of this, this disclosure provides a screen control method that, when two touch points are detected on the screen, determines the screen adjustment direction based on the trajectory of the two touch points, and adjusts the display orientation of the screen according to the screen adjustment direction. This method can be applied to terminal devices, such as smartphones, tablets, touchscreen TVs, in-vehicle terminal devices, and laptops with touchpads.

[0065] Figure 2 This is an architectural diagram of a terminal device illustrated in an exemplary embodiment of this disclosure, such as... Figure 2 As shown, the terminal device disclosed herein includes a processor, a power module, internal memory, external memory, and a display screen, among which sensor modules (physical sensors with other functions such as accelerometers and gyroscopes) and other devices (such as cameras, wireless communication modules, mobile communication modules, motors, etc.) are optional. It can be understood that this disclosure is applicable not only to terminal devices without physical sensors or with malfunctioning physical sensors for switching between portrait and landscape modes, but also to terminal devices containing physical sensors, serving as a supplement to the portrait / landscape switching solution. The screen control method of the embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0066] Figure 3 This is a flowchart illustrating a screen control method according to an exemplary embodiment of the present disclosure, such as... Figure 3As shown, the exemplary embodiment method may include steps 301 to 303.

[0067] In step 301, in response to detecting two touch points on the screen of the terminal device, the motion trajectories of the two touch points are acquired.

[0068] When a user performs a touch operation on the screen of a terminal device, the number of touch points falling on the screen is detected. If two touch points are detected on the screen of the terminal device, the motion trajectory of the two touch points is obtained.

[0069] In the embodiments of this disclosure, one finger can correspond to one touch point. That is, if one touch point is detected, it means that the user is performing a touch operation with one finger, such as the thumb or index finger; if two touch points are detected, it means that the user is performing a touch operation with two fingers, such as the thumb and index finger. Those skilled in the art should understand that this disclosure does not limit the number of fingers corresponding to each touch point.

[0070] In step 302, when the movement trajectory of the two touch points indicates that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the movement direction of the second touch point relative to the first touch point.

[0071] When two touch points are detected on the screen of a terminal device, the motion trajectory of each touch point is acquired. For ease of description, the touch point that is stationary relative to the screen is referred to as the first touch point, and the touch point that moves relative to the screen is referred to as the second touch point.

[0072] When the movement trajectory of the two touch points indicates that the second touch point moves relative to the first touch point, the screen adjustment direction is determined based on the movement direction of the second touch point relative to the first touch point on the screen. The movement direction can include clockwise or counterclockwise directions.

[0073] In step 303, the display orientation of the screen is adjusted according to the screen adjustment orientation.

[0074] Based on the screen orientation adjustment instructions, the entire screen's page layout is redrawn to achieve the screen display orientation adjustment.

[0075] The screen control method provided in this disclosure, when two touch points are detected on the screen of a terminal device, acquires the movement trajectories of the two touch points. If the movement trajectories indicate that the second touch point is moving relative to the first touch point, the screen adjustment direction is determined based on the movement direction of the second touch point relative to the first touch point. This disclosure allows for screen orientation adjustment based on the movement direction of the second touch point relative to the first touch point without the aid of physical sensors. This method enables switching between portrait and landscape modes even when physical sensors are unavailable or fail, thereby extending the lifespan of the terminal device.

[0076] In this embodiment, a first touch point stationary relative to the screen and a second touch point moving relative to the screen can be determined as follows: For each touch point, a rectangular bounding box corresponding to the movement trajectory of the touch point is obtained, and the area of ​​the movement region of the touch point is determined based on the rectangular bounding box. Having obtained the movement region areas of the two touch points, the sizes of the movement region areas can be compared, and the touch point with the smallest movement region area is determined as the first touch point, and the touch point with the largest movement region area is determined as the second touch point.

[0077] For each touch point, obtain the position coordinates on the motion trajectory of the touch point. Based on the position coordinates on the motion trajectory, the range of the motion area of ​​the touch point can be determined. For example, all position coordinates can be enclosed in a minimum rectangle. Based on the coordinates of the upper left and lower right corners of the rectangle, determine the width and height of the rectangle. Then, based on the width and height of the sliding area, obtain the area of ​​the motion area.

[0078] It should be noted that in this disclosure, the first touch point is a touch point generated when the first finger touches the screen, and the second touch point is a touch point generated when the second finger touches the screen. Those skilled in the art should understand that in the following embodiments and figures, the first touch point and the first finger represent the same meaning, and the second touch point and the second finger represent the same meaning.

[0079] Figure 4 This disclosure is a schematic diagram illustrating the relative movement of two touch points on a screen according to an exemplary embodiment, such as... Figure 4 As shown, assume that the maximum range of motion of a touch point along the X-axis of the screen is x. max The maximum range of motion on the screen's Y-axis is y max The movement area of ​​the touch point is a rectangle, denoted as R, and its area is S. R =x max ×y max Similarly, the maximum range of motion of another touch point on the screen's X-axis is x′. maxThe maximum range of motion on the Y-axis of the screen is y′. max Then the motion area of ​​the other touch point is a rectangle, denoted as T, and its area is S. T =x′ max ×y′ max If S R >S T Then the touch point that generates the motion area T is determined as the first touch point, and the touch point that generates the motion area R is determined as the second touch point.

[0080] In this embodiment of the disclosure, the display orientation of the screen can be indicated by a screen display orientation value, that is, different screen display orientation values ​​correspond to different screen display orientations. Before detecting a touch point on the screen of the terminal device, the screen display orientation value is initialized according to the current display orientation of the screen, and then the screen display orientation value is updated according to the movement direction of the second touch point relative to the first touch point.

[0081] When a user's finger touches the screen, the terminal device records the finger's relative position on the screen in the form of coordinates. For example... Figure 5 As shown, the coordinates of the first touch point 501 generated by the first finger touching the screen are 503, and the coordinates of the first touch point 502 generated by the second finger touching the screen are 504. In this embodiment, the movement direction of the second touch point relative to the first touch point will be determined based on the coordinates of the center point of the first touch point and the coordinates of the trajectory endpoint of the second touch point.

[0082] In some embodiments, determining the screen adjustment direction based on the movement direction of the second touch point relative to the first touch point may include: obtaining the center point coordinates of the first touch point; determining the trajectory endpoint coordinates of the second touch point based on the movement trajectory of the second touch point; determining the rotation direction of the second touch point relative to the first touch point based on the center point coordinates and the trajectory endpoint coordinates; and updating the screen display direction value based on the rotation direction of the second touch point relative to the first touch point.

[0083] The trajectory endpoint coordinates may include trajectory start point coordinates and trajectory end point coordinates. Based on the center point coordinates of the first touch point, and the trajectory start point coordinates and trajectory end point coordinates of the second touch point, two vectors can be determined, and the rotation direction of the second touch point relative to the first touch point can be determined using the relative position of the two vectors.

[0084] In other words, determining the rotation direction of the second touch point relative to the first touch point based on the center point coordinates and the trajectory endpoint coordinates may include: determining a first vector based on the center point coordinates and the trajectory start point coordinates, and determining a second vector based on the trajectory start point coordinates and the trajectory end point coordinates; and determining the rotation direction of the second touch point relative to the first touch point based on the relative positions of the first vector and the second vector.

[0085] Determining the rotation direction of the second touch point relative to the first touch point based on the relative positions of the first and second vectors may include: obtaining a first product of the abscissa of the first vector and the ordinate of the second vector, and a second product of the ordinate of the first vector and the abscissa of the second vector; if the difference between the first product and the second product is less than 0, then the second touch point is determined to rotate clockwise relative to the first touch point; if the difference between the first product and the second product is greater than 0, then the second touch point is determined to rotate counterclockwise relative to the first touch point.

[0086] The following examples will be based on Figure 4 The process of determining the rotation direction will be explained using an example.

[0087] In this embodiment, the center point coordinates of T are denoted as O(x1, y1), the position coordinates of the second touch point represented by R when it just touches the screen (i.e., the starting point coordinates of the trajectory) are denoted as P(x2, y2), and the position coordinates of the second touch point after it moves (draws an arc) on the screen (i.e., stops or leaves) are denoted as P1(x3, y3). Then the first vector... The second vector is (x2-x1, y2-y1). The vectors are (x3-x2, y3-y2), and the relative positions of the two vectors are used to determine whether the second touch point moves clockwise or counterclockwise relative to the first touch point.

[0088]

[0089] If the result of equation (1) is greater than 0, it indicates that the second touch point moves counterclockwise relative to the first touch point; if the result of equation (1) is less than 0, it indicates that the second touch point moves clock .... and Collinearity is an invalid operation for the purposes of this disclosure, and in this case, the number of touch points on the screen will continue to be detected.

[0090] Those skilled in the art should understand that indicating the display direction of the screen through a screen display direction value is one implementation of this disclosure. In addition, the display direction of the screen can also be determined according to the movement direction of the second touch point relative to the first touch point. For example, when the second touch point moves clockwise relative to the first touch point, the current screen display direction is rotated 90° clockwise; when the second touch point moves counterclockwise relative to the first touch point, the current screen display direction is rotated 90° counterclockwise. This disclosure is not limited in this respect.

[0091] When the screen is touched, the terminal device's operating system, i.e., the processor, can obtain the coordinate data corresponding to the touch point, also known as the reporting data. This disclosure controls the screen to switch between landscape and portrait modes by processing the reporting data. This disclosure makes the switching between landscape and portrait modes no longer limited to a specific application, and compared to landscape / portrait buttons, the entire screen can be used as an operating area in this disclosure, facilitating user operation.

[0092] The following embodiments will be combined with Figure 6 One implementation of this disclosure will be described in detail below. In the description of this embodiment, steps identical to those in any of the foregoing embodiments will be described simply and will not be detailed further; however, please refer to any of the foregoing embodiments for specific details.

[0093] like Figure 6 As shown, firstly, the screen display orientation value is initialized based on the current screen orientation to avoid user discomfort caused by sudden changes in the current landscape / portrait state. Secondly, it checks if there are two touch points on the screen. If not, the current landscape / portrait state is maintained, and the detection of two touch points continues; if there are, the movement trajectories of the two touch points are recorded. Then, based on the movement trajectories of the two touch points, it is determined whether the second touch point is moving relative to the first touch point. If not, the current landscape / portrait state is maintained, and the detection of touch points continues; if so, the screen display orientation value is updated based on the movement direction of the second touch point relative to the first touch point. Finally, if a change in the screen display orientation value is detected, the entire screen's page layout is redrawn according to the indication of the screen display orientation value.

[0094] In one implementation, the screen's landscape or portrait orientation can be switched after the rotation operation is completed and the user leaves the screen, thus avoiding dizziness caused by real-time adjustments to the landscape or portrait orientation.

[0095] To ensure compatibility with related technologies that utilize physical sensors to change screen orientation, this embodiment allows for different screen lock modes, each corresponding to a different implementation. The screen lock modes in this disclosure can include a screen orientation lock mode, a screen orientation semi-lock mode, and a screen orientation unlock mode. Examples include... Figure 7 As shown, different screen lock modes correspond to different icons. Among them, the screen orientation lock mode indicates that the user cannot use the physical sensor and this disclosure to change the screen orientation; the screen orientation half-lock mode indicates that the user uses this disclosure to change the screen orientation, in which case the physical sensor cannot change the screen orientation; the screen orientation unlock mode indicates that the user uses the data reported by the physical sensor to change the screen orientation, in which case this disclosure is not effective.

[0096] In some embodiments, a screen lock mode can be obtained. In response to the screen lock mode being a screen orientation lock mode, the current display orientation of the screen is maintained. In response to the screen lock mode being a screen orientation semi-lock mode, the number of touch points on the screen is detected, that is, the state of changing the screen orientation is changed using this disclosure. In response to the screen lock mode being a screen orientation unlock mode, the display orientation of the screen is adjusted by means of a physical sensor.

[0097] Users can set the screen lock mode in the control center or settings as needed; that is, the terminal device can obtain the screen lock mode from the control center or settings options.

[0098] Figure 8 This disclosure is a schematic diagram illustrating screen control based on a user-selected screen lock mode according to an exemplary embodiment, such as... Figure 8 As shown, when the screen lock mode is set to "screen orientation unlocked," it indicates that the user has chosen to use physical sensors to change the screen orientation. The terminal device monitors the data reported by the physical sensors. If the terminal device remains stationary or its movement is less than a threshold value, the current orientation is maintained. If the detected movement exceeds the threshold value, it indicates that the device's orientation is being rotated. In this case, the screen orientation is adjusted based on the data from the physical sensors.

[0099] When the screen lock mode is in the semi-locked orientation mode, indicating that the user has chosen to use this disclosure to change the screen orientation, the terminal device acquires touch point data from the touch screen. If no two touch points are detected on the screen, the current orientation remains unchanged. If two touch points are detected on the screen, and the second touch point is detected to be moving relative to the first touch point, the screen orientation is adjusted according to the direction of movement of the second touch point relative to the first touch point.

[0100] When the screen lock mode is set to screen orientation lock mode, it means that the user has chosen to lock the screen display orientation. In this case, the methods of changing the screen orientation using physical sensors or the methods disclosed herein will be ineffective, and the current screen orientation will be maintained.

[0101] In some embodiments, this disclosure can also be applied to terminal devices that do not contain physical sensors or whose physical sensors are malfunctioning to switch between portrait and landscape modes. Since physical sensors cannot be used to change the portrait / landscape orientation, the screen lock modes include a screen orientation locked mode and a screen orientation unlocked mode. When a physical sensor malfunctions, this disclosure can serve as a backup solution to control the screen to switch between portrait and landscape modes, thereby extending the usage time of the terminal device and improving the user experience.

[0102] In this embodiment, the screen lock mode can be obtained from the control center or settings options; in response to the screen lock mode being the screen orientation lock mode, the current display orientation of the screen is maintained; in response to the screen lock mode being the screen orientation unlock mode, the number of touch points on the screen is detected.

[0103] Figure 9 This disclosure illustrates another example of screen control based on a user-selected screen lock mode, according to an exemplary embodiment. Figure 9 As shown, when the screen lock mode is set to screen orientation lock mode, indicating that the user chooses to use this disclosure to change the screen orientation, the terminal device obtains the touch screen's reporting data. If no two touch points are detected on the screen, the current screen orientation is maintained. If two touch points are detected on the screen, and the second touch point is detected to be moving relative to the first touch point, the screen orientation is adjusted according to the direction of movement of the second touch point relative to the first touch point.

[0104] When the screen lock mode is set to screen orientation lock mode, it means that the user has chosen to lock the screen display orientation. In this case, the screen will remain in its current landscape or portrait orientation.

[0105] This disclosure switches the screen state by rotating the second touch point relative to the first touch point. Since the terminal device has four sides, there are two screen states: portrait and landscape. This embodiment uses different screen display direction values ​​to represent different portrait and landscape states. The following embodiments will be described in conjunction with the appendix. Figures 10 to 17 The process of switching between different states is explained.

[0106] For ease of description, the shorter sides of the terminal device's body that are positioned opposite each other are referred to as the first horizontal side and the second horizontal side, respectively. The longer sides connected to the first and second horizontal sides are referred to as the first vertical side and the second vertical side, respectively. Furthermore, the first horizontal side and the second horizontal side are both located at the bottom of the terminal device. The terms "top" and "bottom" are used with reference to the terminal device's normal operating orientation. For example, with a mobile phone, the orientation is based on the phone's normal image display, or on the orientation of the earpiece and microphone (earpiece at the top, microphone at the bottom). Figure 10As shown, the terminal device 1000 includes a first horizontal side 1001 and a second horizontal side 1002, as well as a first vertical side 1003 and a second vertical side 1004.

[0107] The screen display orientation value includes a first value, a second value, a third value, and a fourth value. The first value indicates that the screen display orientation is parallel to the first horizontal edge, and the lower part of the screen is close to the first horizontal edge. The second value indicates that the screen display orientation is parallel to the first vertical edge, and the lower part of the screen is close to the first vertical edge. The third value indicates that the screen display orientation is parallel to the second horizontal edge, and the lower part of the screen is close to the second horizontal edge. The fourth value indicates that the screen display orientation is parallel to the second vertical edge, and the lower part of the screen is close to the second vertical edge.

[0108] Figure 10 The first numerical value represents the first vertical screen state, which can also be called the first vertical screen display direction; Figure 11 The image shows the first landscape mode represented by the second numerical value, which can also be called the first landscape display direction; Figure 12 The third numerical value represents the second vertical screen state, which can also be called the second vertical screen display direction; Figure 13 This shows the second landscape orientation, also known as the second landscape display direction, represented by the fourth numerical value. To more clearly illustrate the page layout in both portrait and landscape modes, Figure 10-13 In the text, "A", "B", "C", "D", "E", and "F" represent different applications. The following examples will combine... Figures 14 to 17 This means that, in the current screen orientation, users can switch between portrait and landscape modes by touching the screen with two fingers. The first finger remains stationary, while the second finger draws an arc relative to the first finger, either clockwise or counterclockwise, as needed.

[0109] If the current screen display orientation value is the first value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to the second value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to the fourth value.

[0110] like Figure 14 As shown, in the first portrait mode, if the second finger draws an arc counterclockwise relative to the first finger, the first portrait mode will be... Figure 10 Switch to the first landscape mode. Figure 11 If the second finger draws an arc clockwise relative to the first finger, then the first portrait mode will be activated. Figure 10 Switch to the second landscape mode. Figure 13 ).

[0111] If the current screen display orientation value is the second value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to the third value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to the first value.

[0112] like Figure 15 As shown, in the first landscape mode, if the second finger draws an arc counterclockwise relative to the first finger, the first landscape mode will be... Figure 11 Switch to the second portrait mode. Figure 12 If the second finger draws an arc clockwise relative to the first finger, then the first landscape mode will be activated. Figure 11 Switch to the first portrait mode. Figure 10 ).

[0113] If the current screen display orientation value is the third value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value will be updated to the fourth value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value will be updated to the second value.

[0114] like Figure 16 As shown, in the second portrait mode, if the second finger draws an arc counterclockwise relative to the first finger, the second portrait mode will be activated. Figure 12 Switch to the second landscape mode. Figure 13 If the second finger draws an arc clockwise relative to the first finger, then the second portrait mode will be activated. Figure 12 Switch to the first landscape mode. Figure 11 ).

[0115] If the current screen display orientation value is the fourth value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to the first value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to the third value.

[0116] like Figure 17 As shown, in the second landscape mode, if the second finger draws an arc counterclockwise relative to the first finger, the second landscape mode will be... Figure 13 Switch to the first portrait mode. Figure 10 If the second finger draws an arc clockwise relative to the first finger, then the second landscape mode will be entered. Figure 13 Switch to the second portrait mode. Figure 12 ).

[0117] Using this disclosure to switch between portrait and landscape screens reduces the number of sensors, thereby reducing the size, weight, and cost of the terminal device. Furthermore, since the processor no longer receives data from physical sensors, power consumption is saved.

[0118] For the foregoing method embodiments, in order to simplify the description, they are all described as a series of actions. However, those skilled in the art should know that this disclosure is not limited to the described order of actions, because according to this disclosure, some steps may be performed in other orders or simultaneously.

[0119] Secondly, those skilled in the art should also know that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by this disclosure.

[0120] Corresponding to the aforementioned application function implementation method embodiments, this disclosure also provides embodiments of application function implementation apparatus and corresponding terminals.

[0121] Figure 18 This is a schematic diagram of the structure of a screen control device in an exemplary embodiment of this disclosure, as shown below. Figure 18 As shown, the screen control device may include:

[0122] The acquisition unit 1801 is used to acquire the motion trajectory of the two touch points when two touch points are detected on the screen of the terminal device.

[0123] The determining unit 1802 is used to determine the screen adjustment direction based on the movement direction of the second touch point relative to the first touch point when the movement trajectory of the two touch points indicates that the second touch point moves relative to the first touch point.

[0124] Control unit 1803 is used to adjust the display orientation of the screen according to the screen adjustment orientation.

[0125] In some embodiments, before detecting a touch point on the screen of the terminal device, the determining unit 1802 is further configured to initialize a screen display direction value according to the current display direction of the screen, the screen display direction value being used to indicate the display direction of the screen; the determining unit 1802 is specifically configured to: obtain the center point coordinates of the first touch point; determine the trajectory endpoint coordinates of the second touch point according to the movement trajectory of the second touch point; determine the rotation direction of the second touch point relative to the first touch point according to the center point coordinates and the trajectory endpoint coordinates; and update the screen display direction value according to the rotation direction of the second touch point relative to the first touch point.

[0126] In some embodiments, the trajectory endpoint coordinates include the trajectory start point coordinates and the trajectory end point coordinates; the determining unit 1802 is specifically used for:

[0127] A first vector is determined based on the coordinates of the center point and the coordinates of the starting point of the trajectory, and a second vector is determined based on the coordinates of the starting point of the trajectory and the coordinates of the ending point of the trajectory; the rotation direction of the second touch point relative to the first touch point is determined based on the relative positions of the first vector and the second vector.

[0128] In some embodiments, the determining unit 1802 is specifically configured to: obtain a first product of the abscissa of the first vector and the ordinate of the second vector, and a second product of the ordinate of the first vector and the abscissa of the second vector; if the difference between the first product and the second product is less than 0, determine that the second touch point rotates clockwise relative to the first touch point; if the difference between the first product and the second product is greater than 0, determine that the second touch point rotates counterclockwise relative to the first touch point.

[0129] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to in the description of the method embodiments. The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this disclosure according to actual needs. Those skilled in the art can understand and implement this without creative effort.

[0130] Accordingly, this disclosure provides a terminal device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to:

[0131] In response to detecting two touch points on the screen of the terminal device, the motion trajectories of the two touch points are acquired;

[0132] When the movement trajectory of the two touch points indicates that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the movement direction of the second touch point relative to the first touch point;

[0133] Adjust the display orientation of the screen according to the screen orientation.

[0134] Figure 19This is a schematic diagram illustrating the structure of a terminal device 1900 according to an exemplary embodiment. For example, the terminal device 1900 may be a user device, specifically a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, wearable device such as smartwatch, smart glasses, smart bracelet, smart running shoes, etc.

[0135] Reference Figure 19 The terminal device 1900 may include one or more of the following components: a processing component 1902, a memory 1904, a power supply component 1906, a multimedia component 1908, an audio component 1910, an input / output (I / O) interface 1912, a sensor component 1914, and a communication component 1916.

[0136] Processing component 1902 typically controls the overall operation of terminal device 1900, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 1902 may include one or more processors 1920 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 1902 may include one or more modules to facilitate interaction between processing component 1902 and other components. For example, processing component 1902 may include a multimedia module to facilitate interaction between multimedia component 1908 and processing component 1902.

[0137] Memory 1904 is configured to store various types of data to support the operation of device 1900. Examples of this data include instructions for any application or method operating on terminal device 1900, contact data, phonebook data, messages, pictures, videos, etc. Memory 1904 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0138] Power supply component 1906 provides power to various components of terminal device 1900. Power supply component 1906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to terminal device 1900.

[0139] Multimedia component 1908 includes a screen that provides an output interface between the terminal device 1900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 1908 includes a front-facing camera and / or a rear-facing camera. When the terminal device 1900 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0140] Audio component 1910 is configured to output and / or input audio signals. For example, audio component 1910 includes a microphone (MIC) configured to receive external audio signals when terminal device 1900 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 1904 or transmitted via communication component 1916. In some embodiments, audio component 1910 also includes a speaker for outputting audio signals.

[0141] I / O interface 1912 provides an interface between processing component 1902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0142] Sensor assembly 1914 includes one or more sensors for providing status assessments of various aspects of terminal device 1900. For example, sensor assembly 1914 can detect the on / off state of terminal device 1900, the relative positioning of components such as the aforementioned components (e.g., the display and keypad of terminal device 1900), changes in position of terminal device 1900 or one of its components, the presence or absence of user contact with terminal device 1900, orientation or acceleration / deceleration of terminal device 1900, and temperature changes of terminal device 1900. Sensor assembly 1914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 1914 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0143] Communication component 1916 is configured to facilitate wired or wireless communication between terminal device 1900 and other devices. Terminal device 1900 can access wireless networks based on communication standards, such as WiFi, 4G or 5G, 4G LTE, 5G NR, or combinations thereof. In one exemplary embodiment, communication component 1916 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the aforementioned communication component 1916 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0144] In an exemplary embodiment, the terminal device 1900 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0145] In an exemplary embodiment, a non-transitory computer-readable storage medium is also provided, such as a memory 1904 including instructions, which, when executed by a processor 1920 of a terminal device 1900, enables the terminal device 1900 to execute a screen control method, the method including:

[0146] In response to detecting two touch points on the screen of the terminal device, the motion trajectories of the two touch points are acquired;

[0147] When the movement trajectory of the two touch points indicates that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the movement direction of the second touch point relative to the first touch point;

[0148] Adjust the display orientation of the screen according to the screen orientation.

[0149] The non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0150] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0151] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A screen control method, characterized in that, Applied to a terminal device, the method includes: In response to detecting two touch points on the screen of the terminal device, the motion trajectories of the two touch points are acquired; When the movement trajectory of the two touch points indicates that the second touch point moves relative to the first touch point, the screen adjustment direction is determined according to the movement direction of the second touch point relative to the first touch point; Adjust the display orientation of the screen according to the screen adjustment orientation; The method further includes: For each touch point, obtain the rectangular bounding box corresponding to the motion trajectory of the touch point, and determine the area of ​​the motion region of the touch point based on the rectangular bounding box; The touch point with the smallest motion area is designated as the first touch point, and the touch point with the largest motion area is designated as the second touch point. The method for determining the area of ​​the motion region includes: enclosing all position coordinates of the touch point within a minimum rectangular frame; determining the width and height of the rectangular frame based on the vertex position coordinates of the rectangular frame; and obtaining the area of ​​the motion region based on the width and height.

2. The method according to claim 1, characterized in that, Before detecting a touch point on the screen of the terminal device, the method further includes: Based on the current display orientation of the screen, initialize the screen display orientation value, which is used to indicate the display orientation of the screen; Determining the screen adjustment direction based on the movement direction of the second touch point relative to the first touch point includes: Obtain the coordinates of the center point of the first touch point; Based on the movement trajectory of the second touch point, determine the coordinates of the trajectory endpoints of the second touch point; The rotation direction of the second touch point relative to the first touch point is determined based on the coordinates of the center point and the coordinates of the trajectory endpoints. Update the screen display orientation value based on the rotation direction of the second touch point relative to the first touch point.

3. The method according to claim 2, characterized in that, The trajectory endpoint coordinates include the trajectory start point coordinates and the trajectory end point coordinates; Determining the rotation direction of the second touch point relative to the first touch point based on the center point coordinates and the trajectory endpoint coordinates includes: A first vector is determined based on the coordinates of the center point and the coordinates of the starting point of the trajectory, and a second vector is determined based on the coordinates of the starting point of the trajectory and the coordinates of the ending point of the trajectory. The rotation direction of the second touch point relative to the first touch point is determined based on the relative positions of the first vector and the second vector.

4. The method according to claim 3, characterized in that, Determining the rotation direction of the second touch point relative to the first touch point based on the relative positions of the first vector and the second vector includes: Obtain the first product of the x-coordinate of the first vector and the y-coordinate of the second vector, and the second product of the y-coordinate of the first vector and the x-coordinate of the second vector. If the difference between the first product and the second product is less than 0, then the second touch point is determined to rotate clockwise relative to the first touch point; If the difference between the first product and the second product is greater than 0, then the second touch point is determined to rotate counterclockwise relative to the first touch point.

5. The method according to claim 1, characterized in that, The method further includes: Obtain the screen lock mode, which includes screen orientation lock mode, screen orientation semi-lock mode and screen orientation unlock mode; In response to the screen lock mode being screen orientation lock mode, the current display orientation of the screen is maintained; In response to the screen lock mode being a screen orientation semi-lock mode, the number of touch points on the screen is detected; In response to the screen lock mode being an unlocked screen orientation mode, the display orientation of the screen is adjusted using a physical sensor.

6. The method according to claim 1, characterized in that, The method further includes: Obtain the screen lock mode, which includes a screen orientation lock mode and a screen orientation unlock mode; In response to the screen lock mode being screen orientation lock mode, the current display orientation of the screen is maintained; In response to the screen lock mode being an unlocked screen orientation mode, the number of touch points on the screen is detected.

7. The method according to claim 5 or 6, characterized in that, The method further includes: The screen lock mode is obtained from the control center or settings options of the terminal device.

8. The method according to claim 2, characterized in that, The side panel of the terminal device includes a first horizontal edge and a second horizontal edge arranged opposite to each other, and a first vertical edge and a second vertical edge connected to the first horizontal edge and the second horizontal edge respectively. The screen display direction value includes a first value, a second value, a third value and a fourth value. The first value indicates that the lower part of the screen is close to the first horizontal edge, the second value indicates that the lower part of the screen is close to the first vertical edge, the third value indicates that the lower part of the screen is close to the second horizontal edge, and the fourth value indicates that the lower part of the screen is close to the second vertical edge. The step of updating the screen display orientation value based on the rotation direction of the second touch point relative to the first touch point includes: If the screen display orientation value is a first value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to a second value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to a fourth value. If the screen display orientation value is the second value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to the third value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to the first value. If the screen display orientation value is the third value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to the fourth value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to the second value. If the screen display orientation value is the fourth value, and the second touch point rotates counterclockwise relative to the first touch point, the screen display orientation value is updated to the first value; if the second touch point rotates clockwise relative to the first touch point, the screen display orientation value is updated to the third value.

9. A screen control device, characterized in that, Applied to a terminal device, the device includes: The acquisition unit is used to acquire the motion trajectory of the two touch points when two touch points are detected on the screen of the terminal device. The determining unit is configured to determine the screen adjustment direction based on the movement direction of the second touch point relative to the first touch point when the movement trajectory of the two touch points indicates that the second touch point moves relative to the first touch point. A control unit is used to adjust the display orientation of the screen according to the screen adjustment orientation; For each touch point, obtain the rectangular bounding box corresponding to the motion trajectory of the touch point, and determine the area of ​​the motion region of the touch point based on the rectangular bounding box; The touch point with the smallest motion area is designated as the first touch point, and the touch point with the largest motion area is designated as the second touch point. The method for determining the area of ​​the motion region includes: enclosing all position coordinates of the touch point within a minimum rectangular frame; determining the width and height of the rectangular frame based on the vertex position coordinates of the rectangular frame; and obtaining the area of ​​the motion region based on the width and height.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 8.

11. A terminal device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to perform the method according to any one of claims 1 to 8.

Images