Split-screen control method, device, and storage medium

By intercepting non-stylus events and detecting stylus events in the terminal creation window, responding to stylus instructions to determine the split screen position for splitting the screen, the problem of cumbersome terminal split screen operation is solved, and the user experience and system stability are improved.

CN115700459BActive Publication Date: 2025-10-03BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202211348832.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-31
Publication Date
2025-10-03
Estimated Expiration
2042-10-31

AI Technical Summary

Technical Problem

When the terminal and the stylus are running at the same time, the user needs to control the terminal screen with his fingers to enter the split-screen mode, which is cumbersome and affects the user experience.

Method used

By creating a window in the terminal to intercept non-stylus touch events and detect stylus touch events, responding to the stylus control instructions to determine the split-screen position, and performing split-screen operations, the global system gesture event monitoring is avoided.

Benefits of technology

It reduces the possibility of accidentally triggering split-screen operations, improves the convenience and user experience of split-screen control, reduces system power consumption, and improves system stability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115700459B_ABST
    Figure CN115700459B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a split-screen control method, device and storage medium. The split-screen control method is applied to a terminal, and the terminal has the function of responding to a control instruction triggered by a stylus, including: in response to receiving a control instruction triggered by a stylus, and determining that the control instruction is a control instruction for triggering a split screen, creating a window, the window is used to intercept non-stylus touch events and detect stylus touch events; based on the touch events of the stylus detected by the window, determining the split-screen position of the terminal; based on the split-screen position, splitting the terminal. The split-screen control method provided by the embodiment of the present disclosure can reduce false touches caused by gesture control, reduce system power consumption, and improve system stability.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of control, and in particular to a split-screen control method, device, and storage medium. Background Art

[0002] The stylus pen, when used with physical buttons, can realize various functions on the terminal, such as page up (Page Up), page down (Page Down), etc., which can improve the convenience of users in using the terminal and facilitate users to control the terminal to execute corresponding commands.

[0003] In related technologies, splitting the terminal screen to display different application user interfaces can meet the user's needs for viewing and operating different applications simultaneously. The split-screen mode is entered by swiping to a designated position on the top of the screen. However, when the terminal and the stylus are running simultaneously, the user still needs to control the terminal screen with their finger to enter the split-screen mode, which is cumbersome and affects the user experience. Summary of the Invention

[0004] To overcome the problems existing in the related art, the present disclosure provides a split-screen control method, device and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a split-screen control method is provided, which is applied to a terminal having a function of responding to control instructions triggered by a stylus pen. The split-screen control method includes:

[0006] In response to receiving a control instruction triggered by a stylus pen and determining that the control instruction is a control instruction for triggering screen splitting, creating a window for intercepting non-stylus pen touch events and detecting stylus pen touch events;

[0007] Determining a split-screen position of the terminal based on a touch event of the stylus detected by the window;

[0008] The terminal is split into two screens based on the split-screen positions.

[0009] In one embodiment, the stylus includes a button, and determining that the control instruction is a control instruction for triggering a split screen includes:

[0010] In response to detecting a control instruction indicating that the key is pressed, caching the control instruction indicating that the key is pressed and suppressing reporting of the control instruction;

[0011] Monitoring the duration of the button being pressed;

[0012] If the duration is greater than the preset duration, it is determined that a control instruction of a long press of the button is detected, and the control instruction of the long press of the button is determined as a control instruction for triggering split screen.

[0013] In one embodiment, determining the split-screen position of the terminal based on the touch event of the stylus detected by the window includes:

[0014] In response to detecting a touch event of the stylus based on the window, recording a touch reporting point corresponding to the touch event;

[0015] Based on the touch reporting point, the split screen position of the terminal is determined.

[0016] In one embodiment, determining the split screen position of the terminal based on the touch reporting point includes:

[0017] In response to the touch event being a sliding operation event, recording all touch reporting points from the start of the touch reporting point to the detection of the end of the touch reporting point;

[0018] Fitting the sliding trajectory of the stylus on the terminal into a straight line based on the recorded touch points;

[0019] The position of the straight line is determined as the split-screen position of the terminal.

[0020] In one embodiment, fitting the sliding trajectory of the stylus on the terminal into a straight line based on the recorded touch points includes:

[0021] Screening the touch points that meet the fitting condition from the recorded touch point reports, wherein the touch points that meet the fitting condition include a touch point report having a first target coordinate and a first target coordinate of the starting touch point report having an absolute value of a difference less than a threshold value, and a touch point report having a second target coordinate and a second target coordinate of the starting touch point report having an increasing or decreasing change relationship;

[0022] Wherein, the first target coordinate is a horizontal coordinate, and the second target coordinate is a vertical coordinate, or the first target coordinate is a vertical coordinate, and the second target coordinate is a horizontal coordinate;

[0023] Based on the touch points that meet the fitting conditions, the sliding trajectory of the stylus pen on the terminal is fitted into a straight line.

[0024] In one embodiment, the starting touch reporting point is a reporting point within a set distance from the edge of the terminal screen.

[0025] In one embodiment, the determining the split screen position of the terminal based on the touch reporting point further includes:

[0026] In response to the touch event being a touch operation, determining a current touch area corresponding to the touch reporting point;

[0027] Based on the relationship between the touch area and the split-screen position, the split-screen position corresponding to the current touch area is determined.

[0028] In one embodiment, the split screen position includes a split screen position for up and down split screen and / or a split screen position for left and right split screen.

[0029] In one embodiment, the method further comprises:

[0030] The function corresponding to the control instruction for prohibiting the button from being pressed is triggered.

[0031] In one embodiment, the method further comprises:

[0032] In response to detecting a control instruction that does not trigger screen splitting, the window is removed.

[0033] In one embodiment, the method further includes: based on the split-screen position, displaying an animation that matches the split-screen position.

[0034] According to a second aspect of an embodiment of the present disclosure, a split-screen control device is provided, which is applied to a terminal having a function of responding to control instructions triggered by a stylus pen. The split-screen control device includes:

[0035] a determining unit configured to, upon receiving a control instruction triggered by a stylus pen, determine that the control instruction is a control instruction for triggering screen splitting, and create a window configured to intercept non-stylus pen touch events and detect stylus pen touch events;

[0036] a processing unit, configured to determine a split-screen position of the terminal based on a touch event of the stylus detected by the window;

[0037] The screen splitting unit is used to split the screen of the terminal based on the split screen position.

[0038] In one embodiment, the stylus includes a button, and the determining unit determines that the control instruction is a control instruction for triggering split screen in the following manner:

[0039] In response to detecting a control instruction indicating that the key is pressed, caching the control instruction indicating that the key is pressed and suppressing reporting of the control instruction;

[0040] Monitoring the duration of the button being pressed;

[0041] If the duration is greater than the preset duration, it is determined that a control instruction of a long press of the button is detected, and the control instruction of the long press of the button is determined as a control instruction for triggering split screen.

[0042] In one embodiment, the determining unit determines the split-screen position of the terminal based on the touch event of the stylus detected by the window in the following manner:

[0043] In response to detecting a touch event of the stylus based on the window, recording a touch reporting point corresponding to the touch event;

[0044] Based on the touch reporting point, the split screen position of the terminal is determined.

[0045] In one embodiment, the determining unit determines the split screen position of the terminal based on the touch reporting point in the following manner:

[0046] In response to the touch event being a sliding operation event, recording all touch reporting points from the start of the touch reporting point to the detection of the end of the touch reporting point;

[0047] Fitting the sliding trajectory of the stylus on the terminal into a straight line based on the recorded touch points;

[0048] The position of the straight line is determined as the split-screen position of the terminal.

[0049] In one embodiment, the determining unit fits the sliding trajectory of the stylus on the terminal into a straight line based on the recorded touch points in the following manner:

[0050] Screening the touch points that meet the fitting condition from the recorded touch point reports, wherein the touch points that meet the fitting condition include a touch point report having a first target coordinate and a first target coordinate of the starting touch point report having an absolute value of a difference less than a threshold value, and a touch point report having a second target coordinate and a second target coordinate of the starting touch point report having an increasing or decreasing change relationship;

[0051] Wherein, the first target coordinate is a horizontal coordinate, and the second target coordinate is a vertical coordinate, or the first target coordinate is a vertical coordinate, and the second target coordinate is a horizontal coordinate;

[0052] Based on the touch points that meet the fitting conditions, the sliding trajectory of the stylus pen on the terminal is fitted into a straight line.

[0053] In one embodiment, the starting touch reporting point is a reporting point within a set distance from the edge of the terminal screen.

[0054] In one embodiment, the determining unit determines the split screen position of the terminal based on the touch reporting point, and is further configured to:

[0055] In response to the touch event being a touch operation, determining a current touch area corresponding to the touch reporting point;

[0056] Based on the relationship between the touch area and the split-screen position, the split-screen position corresponding to the current touch area is determined.

[0057] In one embodiment, the split screen position includes a split screen position for up and down split screen and / or a split screen position for left and right split screen.

[0058] In one embodiment, the determining unit is further configured to prohibit a function corresponding to a control instruction of pressing the key from being triggered.

[0059] In one embodiment, the processing unit is further configured to: remove the window in response to detecting a control instruction that does not trigger screen splitting.

[0060] In one embodiment, the processing unit is further configured to: based on the split-screen position, display an animation that matches the split-screen position.

[0061] According to a third aspect of an embodiment of the present disclosure, a split-screen control device is provided, including:

[0062] processor;

[0063] a memory for storing processor-executable instructions;

[0064] The processor is configured to: execute the method described in the first aspect or any one of the embodiments of the first aspect.

[0065] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the method described in the first aspect or any one of the embodiments of the first aspect.

[0066] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: in response to receiving a control instruction triggered by a stylus pen and determining that the control instruction is a control instruction that triggers split screen, a system-level window is created. The window is used to intercept non-stylus pen touch events and detect stylus pen touch events, thereby eliminating the need for global system gesture event monitoring, reducing power consumption, and improving system stability. Based on the touch events of the stylus pen detected by the window, the split screen position of the terminal is determined. The user can determine the position where the screen needs to be split by controlling the stylus pen as needed, thereby improving the convenience of the user's split screen control. The terminal is split according to the split screen position to achieve the function of controlling the terminal split screen with the stylus pen, thereby improving the user experience.

[0067] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0069] Figure 1 The figure is a flow chart of a split-screen control method according to an exemplary embodiment.

[0070] Figure 2 A flowchart of a method for determining that a control instruction is a control instruction that triggers screen splitting is shown according to an exemplary embodiment.

[0071] Figure 3 The present invention is a flowchart showing a method for determining a split-screen position of a terminal according to an exemplary embodiment.

[0072] Figure 4 The present invention is a flowchart showing a method for determining a split-screen position of a terminal according to an exemplary embodiment.

[0073] Figure 5 The present invention is a flowchart showing a method for fitting a sliding trajectory of a stylus pen on a terminal into a straight line according to an exemplary embodiment.

[0074] Figure 6 The present invention is a flowchart showing a method for determining a split-screen position of a terminal according to an exemplary embodiment.

[0075] Figure 7 The figure is a flow chart of a split-screen control method according to an exemplary embodiment.

[0076] Figure 8A 、 8B 8C is a schematic diagram of a split-screen control method according to an exemplary embodiment.

[0077] Figure 9A 、 9B 9C is a schematic diagram of a split-screen control method according to an exemplary embodiment.

[0078] Figure 10 The figure is a block diagram of a split-screen control device according to an exemplary embodiment.

[0079] Figure 11 The present invention is a block diagram showing a device for split-screen control according to an exemplary embodiment. DETAILED DESCRIPTION

[0080] Exemplary embodiments are described in detail herein, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numerals in different drawings represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present disclosure.

[0081] The present disclosure provides a split-screen control method for use in a scenario where a terminal has a function of responding to control instructions triggered by a stylus pen, wherein the terminal may be a tablet computer.

[0082] In related technologies, styluses are paired with physical buttons. Depending on the configuration, the physical buttons can perform different functions. For example, some styluses are equipped with Page Up and Page Down buttons that can perform page-turning operations, allowing users to conveniently control the terminal with the stylus. However, physical buttons can only perform functions similar to Page Up and Page Down, which are relatively simple.

[0083] Split-screen technology allows users to enter split-screen mode by swiping two fingers from the top of the device screen to a specified location. However, relying solely on user finger operations can lead to accidental touches. For example, when using some applications, users may use two fingers, resulting in a split-screen display on the device, which is not what they expected. This triggers commands that do not match user expectations, resulting in a poor user experience when using applications.

[0084] In view of this, an embodiment of the present disclosure provides a split-screen control method, which is applied to a terminal with the function of responding to control instructions triggered by a stylus. In response to receiving a control instruction triggered by a stylus, if the control instruction is a control instruction for triggering a split screen, the terminal creates a window for intercepting non-stylus touch events, and the window can also detect stylus touch events. The terminal determines the split-screen position of the terminal based on the touch event of the stylus detected by the window, and splits the terminal. The stylus triggers the terminal's control instruction to trigger the split screen, which can greatly reduce accidental touches and reduce the operations of triggering the split screen, thereby improving the user experience.

[0085] Figure 1 FIG. 1 is a flow chart of a split screen control method according to an exemplary embodiment. Figure 1 As shown, the method is applied to a terminal, and the terminal has a function of responding to control instructions triggered by a stylus pen, and includes the following steps.

[0086] In step S11 , in response to receiving a control instruction triggered by a stylus pen and determining that the control instruction is a control instruction for triggering screen splitting, a window is created.

[0087] In step S12, the split screen position of the terminal is determined based on the touch event of the stylus pen detected by the window.

[0088] In step S13, the terminal is split into two screens based on the split screen positions.

[0089] The window is used to intercept non-stylus pen touch events and detect stylus pen touch events.

[0090] In the disclosed embodiment, the terminal determines whether a touch command from a stylus pen triggers a split-screen control command. If so, a window is created to intercept non-stylus pen touch events (MotionEvents) and detect stylus pen touch events. Based on the stylus pen touch events detected by this window, the terminal determines the split-screen position for the terminal, and the terminal splits the screen at that position.

[0091] In the disclosed embodiments, the control command triggered by the stylus can be a control command triggered by any preset key of the stylus, for example, a control command triggered by long pressing the Page Down key or Page Up key of the stylus. The window can be a system-level window created by WindowsManger.addView.

[0092] The split-screen control method provided by the disclosed embodiments adds a window at the system level of the terminal to intercept non-stylus touch events and detect stylus touch events. Compared to triggering split-screen through user gestures, this avoids adding a global gesture listener to the system, which would result in frequent calls to system resources. This reduces the consumption of system resources and avoids accidental touches by users when triggering split-screen control commands through a stylus.

[0093] The split-screen control method provided by the embodiment of the present disclosure determines the split-screen position of the terminal through a stylus, and when the stylus triggers the control instruction of the split-screen, it can be triggered by the button of the stylus.

[0094] Figure 2 A flow chart of a method for determining that a control instruction is a control instruction that triggers split screen is shown according to an exemplary embodiment. Figure 2 As shown, the stylus includes a button, and determining that the control instruction is a control instruction for triggering split screen includes the following steps.

[0095] In step S21 , in response to detecting a control instruction indicating that a key is pressed, the control instruction indicating that the key is pressed is cached, and reporting of the control instruction is suppressed.

[0096] In step S22, the duration of the button being pressed is monitored.

[0097] In step S23, if the duration is greater than the preset duration, it is determined that a control instruction of a key being long pressed is detected, and the control instruction of the key being long pressed is determined as a control instruction for triggering split screen.

[0098] In the disclosed embodiment, the stylus includes a button. When the terminal detects that the stylus has pressed the button, the control instruction sent by the button is cached and the control instruction is suppressed from being reported. The control instruction of the stylus button is continuously detected, and the duration of the stylus button being pressed is monitored. If the duration is greater than the preset duration, the control instruction of the stylus button being long pressed is determined, and the control instruction of the button being long pressed is determined as the control instruction for triggering split screen. A window is added to the terminal system to determine the position of the terminal split screen, and the original control instruction of this button is deleted, so that the terminal executes the split screen control instruction and does not execute the original control instruction. If the duration is less than the preset duration, it is determined that the stylus button executes the original control instruction, and the terminal executes the control of the original control instruction.

[0099] In an exemplary embodiment, taking the case where a stylus is long-pressed on the Page Down button to trigger a split-screen control instruction, with a preset duration of 300ms (time unit, milliseconds) as an example, if a control instruction sent by Page Down is detected, the Page Down instruction is cached, and the Page Down instruction is suppressed from being reported. The duration of the Page Down press is monitored. If it exceeds 300ms, it is determined that the Page Down button triggered a long press to execute the split-screen instruction, and the Page Down instruction is deleted, and the page down instruction is not executed. If it is detected that the button is pressed for less than 300ms, the Page Down instruction is triggered, and the terminal controls the page down.

[0100] The split-screen control method provided by the embodiment of the present disclosure can monitor the duration of time the stylus key is pressed, thereby distinguishing between long press and click events of the stylus key, preventing command conflicts, and thus realizing different control commands of the stylus key on the terminal, thereby improving the user experience.

[0101] In the split-screen control method provided by the embodiment of the present disclosure, a long press of a stylus button is determined to trigger the split-screen control of the terminal, and the split-screen position of the terminal also needs to be determined.

[0102] Figure 3 FIG. 1 is a flow chart showing a method for determining a split screen position of a terminal according to an exemplary embodiment. Figure 3 As shown, determining the split screen position of the terminal based on the touch event of the stylus detected by the window includes the following steps.

[0103] In step S31 , in response to detecting a touch event of the stylus based on the window, a touch reporting point corresponding to the touch event is recorded.

[0104] In step S32, the split screen position of the terminal is determined based on the touch point reporting.

[0105] In the disclosed embodiment, when a window detects a touch event from a stylus and determines it is a split-screen control command, the touch reporting point corresponding to the touch event is recorded. The reporting point of the split-screen control triggered by the stylus is used as the starting reporting point and is recorded until the stylus is lifted from the terminal screen or the stylus triggers the end of the touch event. During this period, all reporting points of the stylus are reporting points corresponding to the touch event. Based on the touch reporting point, the terminal's split-screen position is determined.

[0106] In another exemplary embodiment, the terminal records the touch reporting point corresponding to the touch event, and directly determines the split screen position according to the position of the touch reporting point.

[0107] After the window is created, if a user's gesture command is detected, the gesture command will not be processed.

[0108] Through the split-screen control method provided by the embodiment of the present disclosure, the user can control the position of the stylus to determine the split-screen position of the terminal, so that the split-screen position of the terminal meets the user's needs and improves the user experience.

[0109] In the split-screen control method provided in the embodiment of the present disclosure, the split-screen position of the terminal can be determined based on the touch point reporting. In one implementation, the stylus slides on the terminal screen to form a sliding track to determine the split-screen position of the terminal.

[0110] Figure 4 FIG. 1 is a flow chart showing a method for determining a split screen position of a terminal according to an exemplary embodiment. Figure 4 As shown, based on the touch reporting point, determining the split screen position of the terminal includes the following steps.

[0111] In step S41 , in response to the touch event being a sliding operation event, all touch reporting points from the start of the touch reporting point to the detection of the end of the touch reporting point are recorded.

[0112] In step S42, based on the recorded touch points, the sliding trajectory of the stylus on the terminal is fitted into a straight line.

[0113] In step S43, the position of the straight line is determined as the split-screen position of the terminal.

[0114] In the disclosed embodiment, if a stylus is detected sliding across the terminal screen, the touch event is determined to be a sliding operation event. The touch reporting point that triggered the touch event is recorded as the starting touch reporting point until the ending touch reporting point is detected. During this period, all points passed by the stylus are recorded as touch reporting points. The touch reporting points are fitted to form the sliding trajectory of the stylus on the terminal, and the fitting result is a straight line. The position of the straight line is determined as the terminal's split-screen position, and the terminal executes the split-screen instruction based on the split-screen position.

[0115] The termination touch reporting point is determined by a termination touch instruction. The termination touch instruction may be that the touch pen is detected to be lifted up on the terminal, or a key of the touch pen is no longer in a pressed state, and the termination touch reporting point is considered to be detected.

[0116] Through the split-screen control method provided by the embodiments of the present disclosure, the user can slide the stylus on the terminal to determine the position of the terminal split screen. Thus, the user can determine the split screen position according to their needs, improving the user experience and efficiency.

[0117] The split-screen control method provided by the embodiment of the present disclosure can determine the split-screen position of the terminal according to the sliding trajectory of the stylus on the terminal. The sliding trajectory needs to be fitted, and the fitting result is a straight line.

[0118] Figure 5 FIG. 1 is a flow chart showing a method for fitting a sliding track of a stylus pen on a terminal into a straight line according to an exemplary embodiment. Figure 5 As shown, based on the recorded touch points, fitting the sliding trajectory of the stylus on the terminal into a straight line includes the following steps.

[0119] In step S51, the touch points that meet the fitting conditions are screened from the recorded touch points.

[0120] In step S52, based on the touch points that meet the fitting conditions, the sliding trajectory of the stylus pen on the terminal is fitted into a straight line.

[0121] In the embodiment of the present disclosure, the touch point reporting that meets the fitting conditions includes the absolute value of the difference between the first target coordinates and the first target of the starting touch point reporting being less than the threshold, and the second target coordinates and the second coordinates of the starting touch point satisfying an increasing or decreasing change relationship.

[0122] The first target coordinate is the horizontal coordinate, and the second target coordinate is the vertical coordinate, or the first target coordinate is the vertical coordinate, and the second target coordinate is the horizontal coordinate.

[0123] Among them, the role of the threshold is to prevent jitter, and the fitting condition can fit the touch points into a straight line, and the terminal splits the screen according to the fitted straight line.

[0124] In an exemplary embodiment, taking the touch reporting point as Point (x, y), the upper left corner of the screen as the coordinate origin (0, 0), the threshold as 200 pixels, and x as 1000 pixels as an example, the note reporting point Point (x, y) where the stylus passes on the terminal screen is recorded. When the stylus is lifted from the terminal screen or the stylus button is lifted, the sliding trajectory of the stylus is calculated. The touch reporting point that triggers the touch event is used as the starting touch reporting point, and the starting touch reporting point x is determined to be 1000 pixels and y is 0 pixels. The recorded touch reporting points are judged, and the ones with increasing y values ​​and the absolute value of the difference between the x coordinate of the corresponding pixel touch reporting point and 1000 is selected to be less than 200 pixels. All touch reporting points that meet the fitting conditions are screened out and fitted. The fitting result is a straight line.

[0125] Through the split-screen control method provided by the embodiment of the present disclosure, the sliding trajectory of the stylus is fitted to prevent jitter, the terminal split-screen position is determined, and the accuracy of the terminal split-screen position is improved.

[0126] In the embodiment of the present disclosure, the starting touch reporting point is a reporting point within a set distance from the edge of the terminal screen.

[0127] In an exemplary embodiment, taking the set distance as 50 pixels as an example, when the stylus is pressed on the terminal screen (MotionEvent.Action_Down), it is determined that the touch point is within 50 pixels of the screen edge, and the sliding trajectory of the stylus is detected and calculated.

[0128] The split-screen control method provided by the embodiments of the present disclosure can accurately detect the sliding trajectory of the stylus pen.

[0129] Figure 6 FIG. 1 is a flow chart showing a method for determining a split screen position of a terminal according to an exemplary embodiment. Figure 6 As shown, based on the touch reporting point, determining the split screen position of the terminal includes the following steps.

[0130] In step S61 , in response to the touch event being a touch operation, a current touch area corresponding to the touch reporting point is determined.

[0131] In step S62, based on the relationship between the touch area and the split-screen position, the split-screen position corresponding to the current touch area is determined.

[0132] In the disclosed embodiment, if a touch event is detected but no stylus sliding track is present, the touch event is determined to be a touch operation, and the current touch area corresponding to the touch point is determined. Based on the relationship between the touch area and the split-screen position, the split-screen position corresponding to the current touch area is determined.

[0133] The relationship between the touch area and the split-screen position can be that the terminal screen is divided into four areas: upper, lower, left, and right. The touch reporting point is determined to be located in the upper left, lower left, upper right, and lower right areas based on the coordinates of the touch reporting point. If the touch area where the touch reporting point is located is the upper left or upper right, the left-right split screen / upper-lower split screen is performed. If the touch area where the touch reporting point is located is the lower left or lower right, the upper-lower split screen / left-right split screen is performed.

[0134] A one-to-one correspondence between the touch area and the split-screen position is preset. In the embodiment of the present disclosure, a one-to-one correspondence between any touch area and the split-screen position can be achieved.

[0135] The split-screen control method provided by the embodiment of the present disclosure can determine the split-screen area according to the touch points reported by the stylus on the terminal screen, thereby splitting the screen and improving the convenience of the user's split-screen operation.

[0136] In the embodiment of the present disclosure, the split screen position includes a split screen position for top-bottom split screen and / or a split screen position for left-right split screen.

[0137] In the embodiment of the present disclosure, the function corresponding to the control instruction of prohibiting the key from being pressed is triggered.

[0138] In the disclosed embodiment, in response to detecting a control instruction that does not trigger screen splitting, the window is removed, allowing the terminal to execute the control instruction originally triggered by the stylus without conflicting with the original control instruction, while reducing global system event monitoring, lowering power consumption, and improving system stability.

[0139] In the disclosed embodiment, an animation that matches the split-screen position is displayed according to the split-screen position, thereby improving the user experience.

[0140] Figure 7 FIG. 1 is a flow chart of a split screen control method according to an exemplary embodiment. Figure 7 As shown, it is determined whether the stylus button is pressed. If so, a window is added and a touch event is detected. If not, the split-screen control is ended. It is determined whether the stylus is sliding on the terminal screen. If so, and the starting touch reporting point is a reporting point within a set distance from the edge of the terminal screen, the touch reporting point of this touch event is recorded, filtered, and it is determined that the filtered touch reporting points all meet the fitting conditions, and fitting is performed. The straight line obtained by fitting is used as the position of the split screen, and the terminal splits the screen according to the split screen position. The split-screen control method provided by the embodiment of the present disclosure can reduce false touches, and adds animation effects, improves user experience, reduces global system monitoring events (such as gesture monitoring), reduces system power consumption, and thus improves system stability.

[0141] Figure 8A 、 8B8C is a schematic diagram showing a split screen control method according to an exemplary embodiment. Figure 8A As shown, the stylus triggers the touch event of the terminal and records the current touch reporting point as the starting touch reporting point. Figure 8B As shown, taking the stylus pen sliding left and right on the terminal as an example, the stylus pen performs a sliding operation event on the terminal screen, triggering the terminal's split-screen control. According to the sliding track of the stylus pen on the terminal screen, the split-screen position is generated, determined as the upper and lower split screens, and an animation matching the split-screen position is displayed at the split-screen position. Figure 8C , which is a schematic diagram of the terminal splitting the screen into upper and lower parts according to the sliding trajectory of the stylus.

[0142] Among them, it can be understood that when the stylus is slid on the terminal screen, the split screen position of the terminal is the sliding trajectory of the stylus, and the screen can be split using any touch point on the terminal screen that meets the fitting conditions as the starting touch point.

[0143] Figure 9A 、 9B 9C is a schematic diagram showing a split screen control method according to an exemplary embodiment. Figure 9A As shown in , the stylus triggers the touch event of the terminal and records the current touch point. Figure 9B As shown, taking the touch point at the lower right and the lower right touch area corresponding to the left and right split screen as an example, the terminal determines that the current touch point corresponds to the left and right split screen based on the current touch area corresponding to the current touch point and the relationship between the touch area and the split screen position. The terminal screen then performs the left and right split screen operation and displays an animation that matches the split screen position at the split screen position. Figure 9C As shown in FIG, it is a schematic diagram of the terminal completing the split-screen operation according to the relationship between the touch area where the touch reporting point is located and the split-screen position.

[0144] Based on the same concept, an embodiment of the present disclosure also provides a split-screen control device.

[0145] It is understandable that the charging control device provided in the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to realize the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0146] Figure 10FIG. 1 is a block diagram of a split screen control device according to an exemplary embodiment. Figure 10 The split-screen control device 100 includes a determination unit 101, a processing unit 102, and a split-screen unit 103.

[0147] The determining unit 101 is configured to, upon receiving a control instruction triggered by a stylus pen, determine that the control instruction is a control instruction for triggering screen splitting, and create a window for intercepting non-stylus pen touch events and detecting stylus pen touch events;

[0148] The processing unit 102 is configured to determine a split screen position of the terminal based on a touch event of the stylus pen detected by the window;

[0149] The screen splitting unit 103 is used to split the screen of the terminal based on the split screen position.

[0150] In one embodiment, the stylus includes a button, and the determining unit 101 determines that the control instruction is a control instruction for triggering split screen in the following manner:

[0151] In response to detecting a control instruction that a key is pressed, caching the control instruction that the key is pressed and suppressing reporting of the control instruction;

[0152] Monitor how long a button is pressed;

[0153] If the duration is greater than the preset duration, it is determined that a control instruction of a key being long pressed is detected, and the control instruction of the key being long pressed is determined as a control instruction for triggering split screen.

[0154] In one embodiment, the determining unit 101 determines the split screen position of the terminal based on the touch event of the stylus detected by the window in the following manner:

[0155] In response to detecting a touch event of the stylus based on the window, recording a touch reporting point corresponding to the touch event;

[0156] Determine the split screen position of the terminal based on the touch point reporting.

[0157] In one embodiment, the determining unit 101 determines the split screen position of the terminal based on the touch point reporting method as follows:

[0158] In response to the touch event being a sliding operation event, recording all touch reporting points from the start of the touch reporting point to the detection of the end of the touch reporting point;

[0159] Based on the recorded touch points, the sliding trajectory of the stylus on the terminal is fitted into a straight line;

[0160] The position of the straight line is determined as the split-screen position of the terminal.

[0161] In one embodiment, the determining unit 101 fits the sliding trajectory of the stylus on the terminal into a straight line based on the recorded touch points in the following manner:

[0162] Screening the touch points that meet the fitting condition from the recorded touch points, wherein the touch points that meet the fitting condition include a touch point that has an absolute value of a difference between the first target coordinate and the first target coordinate of the starting touch point that is less than a threshold value, and a touch point that has a second target coordinate that satisfies an increasing or decreasing relationship with the second target coordinate of the starting touch point;

[0163] Wherein, the first target coordinate is the horizontal coordinate and the second target coordinate is the vertical coordinate, or the first target coordinate is the vertical coordinate and the second target coordinate is the horizontal coordinate;

[0164] Based on the touch points that meet the fitting conditions, the sliding trajectory of the stylus pen on the terminal is fitted into a straight line.

[0165] In one embodiment, the initial touch reporting point is a reporting point within a set distance from the edge of the terminal screen.

[0166] In one embodiment, the determining unit 101 determines the split screen position of the terminal based on the touch point reporting, and is further configured to:

[0167] In response to the touch event being a touch operation, determining a current touch area corresponding to the touch reporting point;

[0168] Based on the relationship between the touch area and the split-screen position, the split-screen position corresponding to the current touch area is determined.

[0169] In one embodiment, the split screen position includes a split screen position for top-bottom split screen and / or a split screen position for left-right split screen.

[0170] In one embodiment, the determining unit 101 is further configured to: prohibit a function corresponding to a control instruction of a key being pressed from being triggered.

[0171] In one embodiment, the processing unit 102 is further configured to: remove the window in response to detecting a control instruction that does not trigger screen splitting.

[0172] In one embodiment, the processing unit 102 is further configured to: based on the split-screen position, display an animation that matches the split-screen position.

[0173] Figure 11 2 is a block diagram of an apparatus 200 for split-screen control according to an exemplary embodiment. For example, the apparatus 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0174] Reference Figure 11, apparatus 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0175] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0176] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0177] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 200.

[0178] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0179] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC) that is configured to receive external audio signals when the device 200 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, the audio component 210 further includes a speaker for outputting audio signals.

[0180] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0181] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200. The sensor assembly 214 can also detect changes in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200, and temperature changes of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 214 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0182] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0183] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.

[0184] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as the memory 204 including instructions, which can be executed by the processor 220 of the apparatus 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0185] It is understood that in this disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of related objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include the plural forms, unless the context clearly indicates otherwise.

[0186] It will be further understood that the terms "first," "second," and the like are used to describe various types of information, but such information should not be limited to these terms. These terms are used solely to distinguish information of the same type from one another and do not indicate a particular order or level of importance. In fact, the terms "first," "second," and the like are fully interchangeable. For example, first information could be referred to as second information, and similarly, second information could be referred to as first information without departing from the scope of this disclosure.

[0187] It is further understood that, unless otherwise specified, “connection” includes a direct connection where there are no other components between the two elements, and also includes an indirect connection where there are other elements between the two elements.

[0188] It is further understood that although operations are described in a particular order in the drawings in the embodiments of the present disclosure, this should not be construed as requiring that the operations be performed in the particular order shown or in a serial order, or that all of the operations shown be performed to obtain the desired results. In certain circumstances, multitasking and parallel processing may be advantageous.

[0189] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein.

[0190] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A split-screen control method, characterized in that: Applied to a terminal having a function of responding to control instructions triggered by a stylus pen, the split-screen control method includes: In response to receiving a control instruction triggered by a stylus pen and determining that the control instruction is a control instruction for triggering screen splitting, creating a window for intercepting non-stylus pen touch events and detecting stylus pen touch events; Determining a split-screen position of the terminal based on a touch event of the stylus detected by the window; The determining the split-screen position of the terminal based on the touch event of the stylus detected by the window includes: In response to detecting a touch event of the stylus based on the window, recording a touch reporting point corresponding to the touch event; In response to the touch event being a sliding operation event, recording all touch reporting points from the start of the touch reporting point to the detection of the end of the touch reporting point; Screening the touch points that meet the fitting condition from the recorded touch point reports, wherein the touch points that meet the fitting condition include a touch point report having a first target coordinate and a first target coordinate of the starting touch point report having an absolute value of a difference less than a threshold value, and a touch point report having a second target coordinate and a second target coordinate of the starting touch point report having an increasing or decreasing change relationship; Wherein, the first target coordinate is a horizontal coordinate, and the second target coordinate is a vertical coordinate, or the first target coordinate is a vertical coordinate, and the second target coordinate is a horizontal coordinate; Fitting the sliding trajectory of the stylus on the terminal into a straight line based on the touch points that meet the fitting conditions; Determining the position of the straight line as the split-screen position of the terminal; The terminal is split into two screens based on the split-screen positions.

2. The method according to claim 1, characterized in that The stylus includes a button, and determining that the control instruction is a control instruction for triggering split screen includes: In response to detecting a control instruction indicating that the key is pressed, caching the control instruction indicating that the key is pressed and suppressing reporting of the control instruction; Monitoring the duration of the button being pressed; If the duration is greater than the preset duration, it is determined that a control instruction of a long press of the button is detected, and the control instruction of the long press of the button is determined as a control instruction for triggering split screen.

3. The method according to claim 1, characterized in that The starting touch reporting point is a reporting point within a set distance from the edge of the terminal screen.

4. The method according to claim 1, wherein The determining of the split screen position of the terminal based on the touch reporting point further includes: In response to the touch event being a touch operation, determining a current touch area corresponding to the touch reporting point; Based on the relationship between the touch area and the split-screen position, the split-screen position corresponding to the current touch area is determined.

5. The method according to claim 1, wherein The split screen position includes a split screen position for up and down split screen and / or a split screen position for left and right split screen.

6. The method according to claim 2, characterized in that The method further comprises: The function corresponding to the control instruction for prohibiting the button from being pressed is triggered.

7. The method according to claim 1, characterized in that The method further comprises: In response to detecting a control instruction that does not trigger screen splitting, the window is removed.

8. The method according to claim 1, characterized in that The method further comprises: Based on the split screen position, an animation matching the split screen position is displayed.

9. A split-screen control device, characterized in that: Applied to a terminal having a function of responding to control instructions triggered by a stylus pen, the split-screen control device includes: a determining unit configured to, upon receiving a control instruction triggered by a stylus pen, determine that the control instruction is a control instruction for triggering screen splitting, and create a window configured to intercept non-stylus pen touch events and detect stylus pen touch events; a processing unit, configured to determine a split-screen position of the terminal based on a touch event of the stylus detected by the window; The processing unit determines the split-screen position of the terminal based on the touch event of the stylus detected by the window in the following manner: In response to detecting a touch event of the stylus based on the window, recording a touch reporting point corresponding to the touch event; In response to the touch event being a sliding operation event, recording all touch reporting points from the start of the touch reporting point to the detection of the end of the touch reporting point; Screening the touch points that meet the fitting condition from the recorded touch point reports, wherein the touch points that meet the fitting condition include a touch point report having a first target coordinate and a first target coordinate of the starting touch point report having an absolute value of a difference less than a threshold value, and a touch point report having a second target coordinate and a second target coordinate of the starting touch point report having an increasing or decreasing change relationship; Wherein, the first target coordinate is a horizontal coordinate, and the second target coordinate is a vertical coordinate, or the first target coordinate is a vertical coordinate, and the second target coordinate is a horizontal coordinate; Fitting the sliding trajectory of the stylus on the terminal into a straight line based on the touch points that meet the fitting conditions; Determining the position of the straight line as the split-screen position of the terminal; The screen splitting unit is used to split the screen of the terminal based on the split screen position.

10. The device according to claim 9, characterized in that The stylus includes a button, and the determining unit determines that the control instruction is a control instruction for triggering split screen in the following manner: In response to detecting a control instruction indicating that the key is pressed, caching the control instruction indicating that the key is pressed and suppressing reporting of the control instruction; Monitoring the duration of the button being pressed; If the duration is greater than the preset duration, it is determined that a control instruction of a long press of the button is detected, and the control instruction of the long press of the button is determined as a control instruction for triggering split screen.

11. The device according to claim 9, characterized in that The starting touch reporting point is a reporting point within a set distance from the edge of the terminal screen.

12. The device according to claim 9, characterized in that The determining unit determines the split screen position of the terminal based on the touch reporting point, and is further configured to: In response to the touch event being a touch operation, determining a current touch area corresponding to the touch reporting point; Based on the relationship between the touch area and the split-screen position, the split-screen position corresponding to the current touch area is determined.

13. The device according to claim 9, characterized in that The split screen position includes a split screen position for up and down split screen and / or a split screen position for left and right split screen.

14. The device according to claim 10, characterized in that The determining unit is further configured to: The function corresponding to the control instruction for prohibiting the button from being pressed is triggered.

15. The device according to claim 9, characterized in that The processing unit is further configured to: In response to detecting a control instruction that does not trigger screen splitting, the window is removed.

16. The device according to claim 9, characterized in that The processing unit is further configured to: Based on the split screen position, an animation matching the split screen position is displayed.

17. A split-screen control device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the method according to any one of claims 1 to 8.

18. A storage medium, characterized in that The storage medium stores instructions, and when the instructions in the storage medium are executed by a processor of the terminal, the terminal is enabled to execute the method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Screen splitting operation method and device

    CN104035704A

  • Method and apparatus for providing multiple applications

    CN105518609A

  • Handwriting board

    CN109791454A