Business processing method, electronic device, and storage medium
Patent Information
- Application Number
- CN202410388447.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-29
- Publication Date
- 2026-10-20
- Estimated Expiration
- 2044-03-29
AI Technical Summary
[0003]目前,在电子设备分屏显示多个应用程序的应用界面时,例如电子设备的显示屏左右分屏,并在左右分屏分别显示应用A和应用B的应用界面时,显示屏只有一个输入焦点,即输入焦点只能在左右分屏切换出现,导致用户只能在应用A和应用B间切换操作,具有一定的局限性
[0036]第五方面,提供了一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机执行上述第一方面所述的业务处理方法。
Smart Images

Figure CN120762557B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to a business processing method, electronic device and storage medium. Background Technology
[0002] With the development of electronic technology and the increasing number of applications installed on electronic devices, more and more electronic devices, such as mobile phones and tablets, now support split-screen functionality, allowing multiple application interfaces to be displayed on the screen.
[0003] Currently, when multiple application interfaces are displayed on an electronic device in a split-screen manner, such as when the screen of an electronic device is split into left and right sides and the application interfaces of application A and application B are displayed on the left and right sides respectively, the screen only has one input focus. That is, the input focus can only appear when switching between the left and right screens, which means that users can only switch between application A and application B, which has certain limitations. Summary of the Invention
[0004] This application provides a business processing method, an electronic device, and a storage medium that can simultaneously respond to input operations applied to different split-screen windows, thereby supporting multiple users to use the device simultaneously through different split-screen windows. The technical solution is as follows:
[0005] Firstly, a business processing method is provided, applied in an electronic device. The method includes: displaying a first split-screen window and a second split-screen window in a split-screen manner on a display interface, wherein the first split-screen window displays the application interface of a first application, and the second split-screen window displays the application interface of a second application; receiving a first input operation applied to the application interface of the first application in the first split-screen window, and a second input operation applied to the application interface of the second application in the second split-screen window. In response to the first input operation, a first input event corresponding to the first input operation is sent to the first application; and in response to the second input operation, a second input event corresponding to the second input operation is sent to the second application, so that the first application responds to the first input event and the second application responds to the second input event.
[0006] Thus, when the first input operation and the second input operation are triggered simultaneously, such as when one user is operating the first application in the first split-screen window while another user is operating the second application in the second split-screen window, the first application and the second application can respond to the input operations of the two users respectively. This achieves the effect of responding to input operations that are simultaneously applied to different split-screen windows, enabling electronic devices to support two users operating in different split-screen windows at the same time.
[0007] The first and second split-screen windows can be left and right split-screen windows divided horizontally, or top and bottom split-screen windows divided vertically, or any other split-screen method. This embodiment does not limit the specific split-screen window used in this application. For example, the display screen of an electronic device can be divided into three or more split-screen windows, with the first and second split-screen windows being any two of these windows.
[0008] The input device of this electronic device can be a touchscreen, or an external input device such as a keyboard, mouse, or gamepad. The first input operation and the second input operation are input operations performed through the input device. Taking a touchscreen as an example, the first and second input operations can be touch operations on the touchscreen, which can include clicks, presses, or swipes.
[0009] The first application and the second application can be any two applications installed on the electronic device.
[0010] As an embodiment of this application, the first application is any application in the main system desktop or main system (also known as main space), and the second application is any application in the subsystem desktop or subsystem (also known as parallel space). The subsystem is a subsystem application running under the main system of the electronic device.
[0011] Thus, in scenarios where the main space and parallel spaces are displayed in a split-screen manner, the business processing method provided in this application embodiment makes it easier for users to use electronic devices simultaneously through the independent main space and parallel spaces without affecting each other, further improving the user experience.
[0012] As an embodiment of this application, before the electronic device displays the first interface, it further includes: displaying a second interface, the second interface including a first split-screen window and a second split-screen window displayed in a split-screen manner, the first split-screen window including a main system desktop, and the second split-screen window including a subsystem desktop; in response to a launch operation of a first application in the main system desktop, displaying the application interface of the first application on the main system desktop; in response to a launch operation of a second application in the subsystem desktop, displaying the application interface of the second application on the subsystem desktop.
[0013] As one embodiment of this application, before the electronic device displays the second interface, it further includes: displaying a third interface, the third interface including a main system desktop, the main system desktop including icons of subsystem applications; and displaying the second interface in response to a trigger operation on the icons of the subsystem applications. For example, the main system desktop is first displayed in full screen, and then, in response to a user's trigger operation on the icons of the subsystem applications on the main system desktop, the main system desktop and the subsystem desktop are displayed in a split-screen manner. For example, the split-screen display is performed in a left-right split-screen manner, with the main system desktop displayed in the left split-screen and the subsystem desktop displayed in the right split-screen.
[0014] As one embodiment of this application, the operating system of the electronic device includes an input subsystem, which includes a first input processing module and a second input processing module. Responding to a first input operation, a first input event corresponding to the first input operation is sent to a first application; and responding to a second input operation, a second input event corresponding to the second input operation is sent to a second application. This includes: responding to the first input operation, generating a first input event corresponding to the first input operation through the first input processing module and sending the first input event to the first application; and responding to the second input operation, generating a second input event corresponding to the second input operation through the second input processing module and sending the second input event to the second application.
[0015] In this embodiment, by setting two independent input processing modules (a first input processing module and a second input processing module) in the input subsystem of the electronic device, the input information of the input operation applied to the first split-screen window can be sent to the first input processing module for processing, and the input information of the input operation applied to the second split-screen window can be sent to the second input processing module for processing. That is, through these two input processing modules, the input operations of the two split-screen windows can be responded to separately, thereby supporting the response to input operations triggered simultaneously on the two split-screen windows, so that two users can operate simultaneously in the two split-screen windows.
[0016] As an embodiment of this application, when it is determined that the position of the first input operation is located in the first screen area where the first split-screen window is located, a first input event corresponding to the first input operation can be generated by the first input processing module; when it is determined that the position of the second input operation is located in the second screen area where the second split-screen window is located, a second input event corresponding to the second input operation can be generated by the second input processing module.
[0017] In other words, for user input operations, first determine which split-screen window the input operation is applied to, and then send the input operation to the input processing module corresponding to that split-screen window for processing.
[0018] As one embodiment of this application, the input subsystem also includes an overall input processing module.
[0019] If it is determined that the position of the first input operation is located in the first screen area where the first split-screen window is located, the first input processing module generates a first input event corresponding to the first input operation, including: obtaining the first input information corresponding to the first input operation through the overall input processing module, wherein the first input information includes at least the first view coordinates corresponding to the position of the first input operation; if the overall input processing module determines that the position of the first input operation is located in the first screen area based on the first view coordinates, then the first input processing module generates a first input event based on the first input information.
[0020] If the location of the second input operation is determined to be within the second screen area where the second split-screen window is located, the second input processing module generates a second input event corresponding to the second input operation, including: obtaining the second input information corresponding to the second input operation through the overall input processing module, wherein the second input information includes at least the second view coordinates corresponding to the location of the second input operation; if the overall input processing module determines that the location of the second input operation is within the second screen area based on the second view coordinates, then the second input processing module generates a second input event based on the second input information.
[0021] In this embodiment, a first input processing module and a second input processing module are added to the existing separate input processing module to process the input information from the two split-screen windows respectively. Additionally, processing logic is added to the overall input processing module to determine which split-screen window the input operation is applied to, thus identifying which split-screen window the input information originates from and sending the input information from different split-screen windows to different input processing modules to support simultaneous response to input operations on both split-screen windows.
[0022] As an embodiment of this application, the first input operation is a first touch operation, the second input operation is a second touch operation, and the operating system further includes a touch screen driver, a touch screen algorithm processing module, a first input driver node, and a second input driver node.
[0023] When it is determined that the location of the first touch operation is within the first screen area where the first split-screen window is located, the first input processing module generates a first input event corresponding to the first touch operation, including: obtaining the first original touch information of the first touch operation reported by the touch screen driver through the touch screen algorithm processing module, wherein the first original touch information includes at least the first screen coordinates corresponding to the location of the first touch operation; processing the first original touch information through the touch screen algorithm processing module to obtain first input information, wherein the first input information includes at least the first view coordinates corresponding to the first screen coordinates; if the touch screen algorithm processing module determines that the location of the first touch operation is within the first screen area based on the first view coordinates, then the first input information is sent to the first input processing module through the first input driver node; and generating a first input event through the first input processing module based on the first input information.
[0024] If the location of the second touch operation is determined to be within the second screen area where the second split-screen window is located, the second input processing module generates a second input event corresponding to the second touch operation. This includes: obtaining the second original touch information of the second touch operation reported by the touch screen driver through the touch screen algorithm processing module, wherein the second original touch information includes at least the second screen coordinates corresponding to the location of the first touch operation; generating second input information based on the second original touch information through the touch screen algorithm processing module, wherein the second input information includes at least the second view coordinates corresponding to the second screen coordinates; if the touch screen algorithm processing module determines that the location of the second touch operation is within the second screen area based on the second view coordinates, then sending the second input information to the second input processing module through the second input driver node; and generating a second input event based on the second input information through the second input processing module.
[0025] In this embodiment, the current single input driver node of the touchscreen is split into two independent input driver nodes to acquire and store the input information of the two split-screen windows respectively. In addition, the touchscreen algorithm processing module adds processing logic to determine which split-screen window the input operation is applied to based on the input information, so as to identify which split-screen window the input information comes from and output the input information of different split-screen windows to different input driver nodes to support simultaneous response to input operations on two split-screen windows.
[0026] As an embodiment of this application, the first input operation is a first touch operation, the second input operation is a second touch operation, and the operating system further includes a touch screen driver, a first touch screen virtual driver, a second touch screen virtual driver, a first touch screen algorithm processing module, a second touch screen algorithm processing module, a first input driver node, and a second input driver node.
[0027] When it is determined that the location of the first touch operation is within the first screen area where the first split-screen window is located, the first input processing module generates a first input event corresponding to the first touch operation, including: obtaining the first raw touch information generated by the first touch operation through the touch screen driver, the first raw touch information including at least the first screen coordinates corresponding to the location of the first touch operation; if the touch screen driver determines that the location of the first touch operation is within the first screen area based on the first screen coordinates, then the first raw touch information is processed by the first touch screen algorithm processing module to obtain the first input information, the first input information including at least the first view coordinates corresponding to the first screen coordinates; the first input information is sent to the first input processing module through the first input driver node; and the first input processing module generates the first input event based on the first input information.
[0028] When it is determined that the location of the second touch operation is within the second screen area where the second split-screen window is located, the second input processing module generates a second input event corresponding to the second touch operation. This includes: obtaining second raw touch information generated by the second touch operation through the touchscreen driver, wherein the second raw touch information includes at least the second screen coordinates corresponding to the location of the second touch operation; if the touchscreen driver determines that the location of the second touch operation is within the second screen area based on the second screen coordinates, then processing the second raw touch information through the second touchscreen algorithm processing module to obtain second input information, wherein the second input information includes at least the second view coordinates corresponding to the second screen coordinates; sending the second input information to the second input processing module through the second input driver node; and generating a second input event based on the second input information through the second input processing module.
[0029] In this embodiment, two independent virtual touchscreen drivers are added to the existing single touchscreen driver to report input information from the two split-screen windows respectively. Furthermore, the touchscreen driver's algorithm logic includes processing logic to determine which split-screen window the input operation applies to based on the input information generated by the touchscreen. This identifies which split-screen window the input information originates from and sends the input information from different split-screen windows to different virtual touchscreen drivers, thus supporting simultaneous response to input operations on both split-screen windows.
[0030] As one embodiment of this application, before sending the first input event to the first application through the first input processing module, the method further includes: if the first input operation is determined to act on the application interface of the first application based on the first view coordinates corresponding to the position of the first input operation, then sending the first input event to the first application. Before sending the second input event to the second application through the second input processing module, the method further includes: if the second input operation is determined to act on the application interface of the second application based on the second view coordinates corresponding to the position of the second input operation, then sending the second input event to the second application.
[0031] As one embodiment of this application, the electronic device is a foldable screen device, and the screen splitting method includes at least: left-right splitting or top-bottom splitting.
[0032] As one embodiment of this application, the display screen of the electronic device is a touch screen, and the first input operation and the second input operation are touch operations. The touch operation includes at least: a click operation, a press operation, or a swipe operation.
[0033] Secondly, a business processing apparatus is provided, which has the function of implementing the business processing method behavior described in the first aspect above. The business processing apparatus includes at least one module, which is used to implement the business processing method provided in the first aspect above.
[0034] Thirdly, a service processing apparatus is provided, comprising a processor and a memory. The memory stores programs that support the service processing apparatus in executing the service processing method provided in the first aspect, and stores data related to implementing the service processing method described in the first aspect. The processor is configured to execute the programs stored in the memory. The service processing apparatus may further include a communication bus for establishing a connection between the processor and the memory.
[0035] Fourthly, a computer-readable storage medium is provided, wherein instructions are stored therein, which, when executed on a computer, cause the computer to perform the business processing method described in the first aspect.
[0036] Fifthly, a computer program product containing instructions is provided, which, when run on a computer, causes the computer to perform the business processing method described in the first aspect above.
[0037] The technical effects achieved by the second, third, fourth, and fifth aspects mentioned above are similar to those achieved by the corresponding technical means in the first aspect mentioned above, and will not be repeated here. Attached Figure Description
[0038] Figure 1 This is a schematic diagram of a split-screen display on a foldable phone provided in an embodiment of this application;
[0039] Figure 2 This is a schematic diagram of a split-screen display on a candybar mobile phone provided in an embodiment of this application;
[0040] Figure 3 This is a schematic diagram illustrating input focus switching in a split-screen display scenario provided in an embodiment of this application;
[0041] Figure 4 This is an example of an operation diagram of a split-screen display scenario for a foldable phone provided in this application.
[0042] Figure 5 This is a schematic diagram of a user interface involving parallel space provided in this application example;
[0043] Figure 6 This is a schematic diagram of another user interface involving parallel space provided in the example of this application;
[0044] Figure 7 This is a schematic diagram of yet another user interface involving parallel spaces provided in the examples of this application;
[0045] Figure 8 This is a schematic diagram illustrating a scenario where two users simultaneously use a mobile phone through its main space and parallel space, as provided in this application example.
[0046] Figure 9 This is a schematic diagram of a scenario where a mobile phone can run two games simultaneously in parallel space, as provided in an embodiment of this application.
[0047] Figure 10 This is a schematic diagram illustrating a scenario where two users simultaneously play games through the main space and parallel space of a mobile phone, as provided in an embodiment of this application.
[0048] Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0049] Figure 12 This is a schematic diagram of a software system for an electronic device provided in an embodiment of this application;
[0050] Figure 13 This is a schematic diagram of a software system for another electronic device provided in an embodiment of this application;
[0051] Figure 14 This is a schematic diagram of a response flow for dual-screen input operation provided in an embodiment of this application;
[0052] Figure 15This is a block diagram of a software system for an electronic device provided in an embodiment of this application;
[0053] Figure 16 This is a block diagram of a software system for another electronic device provided in an embodiment of this application;
[0054] Figure 17 This is a block diagram of a software system for another electronic device provided in an embodiment of this application;
[0055] Figure 18 This is a schematic flowchart illustrating a business processing method provided in an embodiment of this application;
[0056] Figure 19 This is a schematic flowchart of another business processing method provided in the embodiments of this application;
[0057] Figure 20 This is a schematic flowchart illustrating another business processing method provided in the embodiments of this application. Detailed Implementation
[0058] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limiting purposes, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details.
[0059] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.
[0060] It should also be understood that in the embodiments of this application, "one or more" refers to one, two, or more; "and / or" describes the relationship between the associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following associated objects have an "or" relationship.
[0061] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," "fourth," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.
[0062] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0063] Currently, an increasing number of electronic devices, such as mobile phones and tablets, support split-screen functionality. For these devices, multiple application interfaces can be displayed on the screen in a split-screen manner. Split-screen methods generally include left-right split-screen (dividing the display area into left and right sections) or top-bottom split-screen (dividing the display area into top and bottom sections), and other methods are also possible; this application does not limit these methods. For example, taking a mobile phone as an example, a left-right split-screen method is used when the phone is held in portrait mode, and a top-bottom split-screen method is used when the phone is held in landscape mode.
[0064] For example, please refer to foldable screen phones. Figure 1 , Figure 1 This is a schematic diagram illustrating a split-screen display on a foldable phone according to an embodiment of this application. Figure 1 As shown, the foldable phone uses a split-screen method, dividing the display interface into a left half screen and a right half screen. The left half screen displays the application interface of application A, and the right half screen displays the application interface of application B.
[0065] For example, please refer to the following: Figure 2 , Figure 2 This is a schematic diagram illustrating a split-screen display on a candybar mobile phone according to an embodiment of this application. For example... Figure 2 As shown, the candybar phone uses a split-screen method, dividing the display screen into an upper half and a lower half. The upper half displays the application interface of application A, and the lower half displays the application interface of application B.
[0066] It should be understood that, Figure 1 The foldable phone shown can also be split-screen in a top-to-bottom split-screen mode. Figure 1 (Not shown), and this foldable phone can also be other electronic devices such as tablets. Additionally, Figure 2 The candybar phone shown can also split the screen vertically. Figure 2 (not shown), and the candybar phone can also be a foldable screen phone that can be folded up and down, but this application embodiment does not limit this.
[0067] It should also be understood that, Figure 1 and Figure 2 This example illustrates the concept of two split-screen elements (either side-by-side or top-bottom) evenly distributed on the display (with both screens being the same size). In practice, side-by-side or top-bottom split-screen elements can be used in other layouts, or they can be initially evenly distributed and then adjusted based on user actions. For instance, users can adjust the size of the side-by-side split-screen by dragging the vertical bar between the two screens horizontally, or adjust the size of the top-bottom split-screen by dragging the horizontal bar between them vertically.
[0068] The electronic device described in this application can be a tablet computer, a laptop computer, a smart screen, a foldable screen phone, or a non-foldable screen phone, etc., and there are no restrictions. For ease of explanation, a foldable screen phone is used as an example for illustration in this application.
[0069] In split-screen display scenarios on foldable phones, there might be situations where two users share the phone. For example, User 1 and User 2 might use the foldable phone together. User 1 operates application A on the left half of the screen, while User 2 operates application B on the right half. However, since the display currently only has one input focus, the input focus can only switch between the left and right halves of the screen, not both simultaneously. This means that User 1 and User 2 can only switch between operations, unable to simultaneously operate application A and application B on their respective halves, thus preventing them from using the foldable phone together and resulting in a poor user experience. Please refer to [reference needed]. Figure 3 , Figure 3 This is a schematic diagram of a split-screen display for another foldable phone provided in an embodiment of this application. For example... Figure 3 As shown in Figure a, when User 1 clicks on the left half of the screen (Application A, the video application), the input focus appears on the left half and is handled by Application A. If User 2 clicks on the right half of the screen (Application B, the calculator application) while User 1 is interacting with Application A, as shown in Figure a... Figure 3 As shown in Figure b, the input focus will switch to the right half of the screen and be handled by application B. At this time, application A can no longer respond to user 1's operation, which means that user 1 and user 2 cannot operate application A and application B in the corresponding split-screen window at the same time, that is, they cannot use the foldable screen phone at the same time.
[0070] In this embodiment, when the display screen of an electronic device is divided into two split-screen windows (a first split-screen window and a second split-screen window), if a first input operation is received on the application interface of a first application in the first split-screen window, and a second input operation is received on the application interface of a second application in the second split-screen window, the electronic device can respond to the first input operation by sending a first input event corresponding to the first input operation to the first application, and respond to the second input operation by sending a second input event corresponding to the second input operation to the second application, so that the first application responds to the first input event and the second application responds to the second input event. Thus, when the first and second input operations are triggered simultaneously, for example, when one user is operating the first application in the first split-screen window while another user is operating the second application in the second split-screen window, the first application and the second application can respond to the input operations of these two users respectively, allowing two users to operate simultaneously in the two split-screen windows of the electronic device, thereby supporting simultaneous use by two users.
[0071] The first and second split-screen windows can be left and right split-screen windows divided horizontally, or top and bottom split-screen windows divided vertically, or any other split-screen method. This embodiment does not limit the specific split-screen window used in this application. For example, the display screen of an electronic device can be divided into three or more split-screen windows, with the first and second split-screen windows being any two of these windows.
[0072] The input device of this electronic device can be a touchscreen, or an external input device such as a keyboard, mouse, or gamepad. The first input operation and the second input operation are input operations performed through the input device. Taking a touchscreen as an example, the first and second input operations can be touch operations on the touchscreen, which can include clicks, presses, or swipes.
[0073] Please refer to Figure 4 , Figure 4 This is an operational diagram illustrating a split-screen display scenario on a foldable phone, as provided in this application. Figure 4As shown, the foldable phone's display is divided into a left and right half-screen. The left half-screen displays the interface of application A (video application), and the right half-screen displays the interface of application B (calculator application). User 1 uses application A on the left half-screen, and user 2 uses application B on the right half-screen. If user 1 performs a touch operation on application A on the left half-screen, and user 2 performs a touch operation on application B on the right half-screen, the electronic device's display can have two input focuses simultaneously. That is, the electronic device can send the input event corresponding to user 1's touch operation to application A, and the input event corresponding to user 2's touch operation to application B. This allows application A to respond to user 1's touch operation, and application B to respond to user 2's touch operation, thus enabling two users to operate the foldable phone simultaneously through two split-screen windows.
[0074] It should be understood that in the split-screen display scenario of electronic devices, the business processing method provided in this application embodiment can be applied not only to the scenario where different users share electronic devices based on different split-screen windows, but also to the scenario where the same user uses both hands to operate in different split-screen windows at the same time. For example, a user can use their left hand to operate in the left half of the screen and their right hand to operate in the right half of the screen. This application embodiment does not limit the application scenario of operating different split-screen windows at the same time.
[0075] In this embodiment of the application, application A and application B can be any two applications installed on the electronic device.
[0076] As an example, an electronic device may have a dual system (main system and subsystem). This embodiment of the application can be applied to scenarios where the electronic device displays the dual system in a split-screen manner. For example, application A may be the system desktop (or main space desktop) of the main system or any application within the main system, while application B may be the system desktop (or parallel space desktop) of the subsystem or any application within the subsystem.
[0077] As electronic devices offer increasingly more functions, people are becoming more reliant on them, using them for work, daily life, and other activities. For example, users can store data (e.g., documents, videos, audio, images, etc.) on their devices or process that data. Among the stored data are important or confidential records. To ensure the security of these important and confidential data, more secure storage methods are needed.
[0078] In response, some electronic devices incorporate a dual-system architecture. One system can be used for everyday tasks, while the other can be used as a privacy-focused system. For example, an electronic device may include a main system (or main space) and a subsystem (or parallel space). The subsystem provides a new space (system) within the electronic device, separate from the main system, for storing highly confidential data.
[0079] Parallel space can be viewed as another subsystem (second system) within an electronic device, separate from the main space. Parallel space consists of subsystem applications installed within the main system's storage space; that is, the operation of these subsystem applications depends on the support of the main system. Therefore, parallel space is a private space within the main system, existing only in the form of an application. Subsystems have independent storage space. Furthermore, subsystems are not completely parallel to the main system; rather, they are subsystem applications running at the application layer of the main system. Subsystem applications possess system functions; for example, when a subsystem application is launched, it can display its main interface (or subsystem desktop or parallel space desktop), which can display icons of multiple applications installed within the subsystem application (e.g., games, instant messaging, or camera applications). Of course, subsystems also have independent storage space, which can store user data that is inaccessible under the main system but accessible only after entering the subsystem.
[0080] Parallel spaces can store data such as pictures, videos, and audio. In addition, applications can be installed and run in parallel spaces, such as communication applications, camera applications, and game applications.
[0081] In addition, to enhance the security level of data within the parallel space, user identity verification can be performed upon entry. Therefore, a password or biometric feature, such as fingerprint or facial recognition, can be set for entry. The password for the parallel space can be different from or the same as the password for the main space; similarly, the biometric feature for the parallel space can be the same as or different from the biometric feature for the main space, allowing for selection based on specific needs in practical applications.
[0082] The term "parallel space" is used for illustrative purposes only. In practical applications, parallel space can also be referred to as parallel system, twin system application, twin security system, clone system, second system, security system, etc. In the embodiments of this application, it is described as "parallel space".
[0083] If a user has already created a parallel space, they can activate it to experience its various functions. For example, if a parallel space has been created, the main space desktop can display the "Parallel Space" application icon, and the user can enter the parallel space through the "Parallel Space" application icon on the main space desktop.
[0084] In one embodiment, such as Figure 5 As shown in Figure 'a', the electronic device's display shows the main desktop, which contains an icon for the "Parallel Space" application. When a user needs to open or enter Parallel Space, they can click the "Parallel Space" icon. In response to the user clicking the "Parallel Space" icon on the main system desktop, if the user has not enabled password, fingerprint, or facial recognition verification to enter Parallel Space, the electronic device can enter Parallel Space and display both the main space and Parallel Space in a split-screen format. Figure 5 As shown in b, the electronic device's display screen shows the main desktop and the parallel desktop in a split-screen manner to facilitate user operation.
[0085] It should be understood that Figure 5 This example illustrates how an electronic device can directly display both the main desktop and the parallel desktop in a split-screen manner after entering the parallel space. In other embodiments, after entering the parallel space, the electronic device can first display the parallel desktop and then split the screen based on the user's split-screen operation.
[0086] It should also be understood that Figure 5 This example only shows the main desktop and the parallel desktop in the left half of the screen when displaying the main desktop and the parallel desktop in the right half of the screen. In other embodiments, the parallel desktop can also be displayed in the left half of the screen and the main desktop in the right half of the screen. This application does not limit this.
[0087] In another embodiment, such as Figure 6 As shown in Figure 'a', the electronic device's display shows the main desktop, which contains an icon for the "Parallel Space" application. When a user needs to open or enter Parallel Space, they can click the "Parallel Space" icon. In response to the user clicking the "Parallel Space" icon on the main system desktop, if the user has not enabled password, fingerprint, or facial recognition verification to enter Parallel Space, the electronic device can enter Parallel Space, and the display shows... Figure 6 The parallel desktop shown in Figure b has a function bar at the top, which users can use to split the screen. For example, as shown in Figure b... Figure 6 As shown in Figure b, if a user clicks on the function bar, such as... Figure 6As shown in Figure c, the function bar expands to display a "Split Screen" control. Users can click the "Split Screen" control, and in response to this click, the electronic device will split the screen, as shown below. Figure 6 As shown in Figure d, the display screen is split into two windows, with the main desktop displayed in the left window and the parallel desktop displayed in the right window.
[0088] It should be understood that users can also trigger split-screen processing on electronic devices through other split-screen operations. For example, users can bring up the smart multi-window application bar by swiping the screen from the outside to the inside from the left or right side of the screen and pausing. The smart multi-window application bar includes application icons for at least one application (e.g., launched applications and / or frequently used applications). Split-screen can be initiated by long-pressing and dragging the application icon in the application bar to the screen. This application embodiment does not limit the split-screen operation.
[0089] In addition, if the user has enabled the verification function such as password, fingerprint and facial recognition to enter the parallel space, the electronic device will first enter the verification interface such as password, fingerprint or facial recognition, and then enter the parallel space after the user is verified.
[0090] In another embodiment, such as Figure 7 As shown in Figure 'a', the electronic device's display shows the main desktop, which contains an icon for the "Parallel Space" application. To open or enter Parallel Space, the user must click the "Parallel Space" application icon. In response to the user clicking the "Parallel Space" application icon on the main system desktop, if the user has enabled facial recognition or fingerprint verification, the electronic device performs facial or fingerprint recognition and displays the following during the verification process: Figure 7 The verification interface shown in 'b' prompts the user that their electronic device is performing facial recognition or fingerprint verification. Of course, if the user has set up password verification, [further details are needed]. Figure 7 In the verification interface shown as b, the user can also enter a password by clicking the "Use Password" option, allowing the electronic device to verify the password. After the electronic device verifies the user's identity, it enters a parallel space and displays the main space and parallel space in a split-screen format, as shown below. Figure 7 As shown in c, the electronic device's display screen shows the main desktop and the parallel desktop in a split-screen manner.
[0091] After an electronic device displays a main desktop and a parallel desktop in a split-screen mode, different users can share the electronic device through the two spaces without affecting each other. For example, please refer to... Figure 8User 1 operates within the main desktop space on the left half of the screen, while User 2 operates within the parallel desktop space on the right half of the screen. Through the method provided in this application embodiment, User 1 and User 2 can operate simultaneously within the main desktop space and the parallel desktop space, respectively, thus improving the user experience.
[0092] For example, User 1 launches application A on the main desktop, and User 2 launches application B on the parallel desktop. User 1 and User 2 can operate simultaneously in the two spaces. That is, while User 1 is operating application A on the main desktop, User 2 can be operating application B in the parallel desktop. Application A can be any application on the main desktop, and application B can be any application on the parallel desktop.
[0093] As an example, both application A and application B are game applications, meaning that the electronic device can run games simultaneously in the main space and parallel space. In the scenario of running games simultaneously, the electronic device can support user 1 and user 2 to play games in different spaces at the same time through the business processing method provided in the embodiments of this application.
[0094] Please refer to Figure 9 , Figure 9 This is a schematic diagram illustrating a scenario where an electronic device can run two games simultaneously in parallel space, as provided in an embodiment of this application. Figure 9 As shown in Figure a, the electronic device's display shows a main desktop and a parallel desktop in a split-screen configuration. The main desktop includes the application icon for Game 1, and the parallel desktop includes the application icon for Game 2. If User 1 clicks the application icon for Game 1, and User 2 clicks the application icon for Game 2, the electronic device can launch Game 1 in the main desktop and display its application interface on the main desktop, and launch Game 2 in the parallel desktop and display its application interface on the parallel desktop, in response to these actions. Users 1 and 2 can then operate Game 1 and Game 2 respectively. For example, as shown... Figure 9 As shown in Figure b, if User 1 clicks the button for Game 1 and User 2 also clicks the button for Game 2 at the same time, then through the method provided in this embodiment, the electronic device can send the input event corresponding to User 1's click operation to Game 1 and the input event corresponding to User 2's click operation to Game 2. This allows Game 1 to respond to User 1's click operation and Game 2 to respond to User 2's click operation, satisfying the needs of different users playing games simultaneously in different spaces on the electronic device. Figure 10 As shown, user 1 plays game 1 in the main space, while user 2 can play game 2 in the parallel space, realizing dual-client gaming based on different spaces and improving the user's gaming experience.
[0095] It should be understood that Game 1 and Game 2 can be the same game application or different game applications, and this application embodiment does not limit this. For example, Game 1 and Game 2 can be the same game application logged in with different user accounts, allowing different users to play the same game simultaneously on the same electronic device using their respective user accounts, thus meeting the needs of different users to run two games on the same electronic device and improving the user experience.
[0096] It should also be understood that, Figure 9 Figure a in the middle and Figure 10 This example only shows the application interface of Game 1 partially displayed on the main desktop and the application interface of Game 2 partially displayed on the parallel desktop. In other implementations, the application interface of Game 1 or Game 2 can also be displayed in full screen on the corresponding desktop. This application embodiment does not limit this.
[0097] The business processing method provided in this application is applied to electronic devices that support split-screen functionality, such as foldable screen devices or other electronic devices. Foldable screen devices can be foldable smartphones or electronic devices such as tablets and laptops with foldable screens. The electronic devices in this application can also be referred to as terminals or terminal devices, etc., and this application does not limit the terminology used.
[0098] Before providing a detailed explanation of the business processing methods provided in the embodiments of this application, the terminals involved in the embodiments of this application will be described first.
[0099] Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. See also... Figure 11The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0100] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0101] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0102] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0103] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from this memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0104] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0105] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.
[0106] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0107] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0108] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with networks and other devices through wireless communication technology.
[0109] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0110] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is an integer greater than 1.
[0111] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0112] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's image sensor. The light signal is converted into an electrical signal, and the image sensor transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimizations on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be integrated into the camera 193.
[0113] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is an integer greater than 1.
[0114] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP performs Fourier transforms on the frequency energy.
[0115] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.
[0116] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0117] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions, such as saving music, video, and other files on the external memory card.
[0118] Internal memory 121 can be used to store computer-executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created by electronic device 100 during use (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0119] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D and application processor.
[0120] Audio module 170 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. Speaker 170A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. Electronic device 100 can listen to music or hands-free calls through speaker 170A. Receiver 170B, also called a "handpiece," is used to convert audio electrical signals into sound signals. When electronic device 100 answers a phone call or voice message, the receiver 170B can be brought close to the user's ear to hear the voice. Microphone 170C, also called a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting sound signals into microphone 170C. Electronic device 100 can have at least one microphone 170C. Headphone jack 170D is used to connect wired headphones. The headphone jack 170D can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, or a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.
[0121] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the touch operation intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than the pressure threshold is applied to the SMS application icon, a command to view an SMS message is executed. When a touch operation with an intensity greater than or equal to the pressure threshold is applied to the SMS application icon, a command to create a new SMS message is executed.
[0122] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch display." Touch sensor 180K detects touch operations applied to or near it. Touch sensor 180K can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.
[0123] In order to enable electronic devices to support simultaneous operation by two users, the software system of the electronic device has been improved in this application embodiment. The improvement ideas of the software system in this application embodiment will be explained below.
[0124] Please refer to Figure 12 , Figure 12 This is a schematic diagram of a software system for an electronic device provided in an embodiment of this application. For example... Figure 12 As shown, current electronic devices include an input subsystem for managing input devices. However, the input event handling layer of this subsystem only includes one input processing module for handling input events. All input events from input devices are queued and processed by this module, thus supporting only one input focus. When the input focus switches from the main desktop (left half of the screen) to the parallel desktop (right half of the screen), and application B in the parallel desktop handles the input focus, application A in the main desktop cannot handle the input focus. This prevents the electronic device from supporting simultaneous operation by two users in two split-screen windows.
[0125] In this embodiment, to enable the electronic device to support simultaneous use by two users, two independent input processing modules (a first input processing module and a second input processing module) are provided in the input subsystem. When the electronic device's display screen is divided into a first split-screen window and a second split-screen window, the first input processing module processes input information applied to the first split-screen window, and the second input processing module processes input information applied to the second split-screen window. Since these two input processing modules are independent, they can individually respond to input operations in the two split-screen windows, thus supporting separate responses to simultaneously triggered input operations applied to the two split-screen windows, allowing two users to operate simultaneously in the two split-screen windows.
[0126] For example, when the display screen of an electronic device is divided into a first split-screen window and a second split-screen window, if a first input operation is received on the application interface of the first application in the first split-screen window, and a second input operation is received on the application interface of the second application in the second split-screen window, the electronic device can respond to the first input operation by generating a first input event corresponding to the first input operation through the first input processing module and sending the first input event to the first application; and respond to the second input operation by generating a second input event corresponding to the second input operation through the second input processing module and sending the second input event to the second application, so that the first application responds to the first input event and the second application responds to the second input event.
[0127] Please refer to Figure 13 , Figure 13 This is a schematic diagram of a software system for another electronic device provided in an embodiment of this application. For example... Figure 13 As shown, the electronic device includes an input subsystem, which contains two independent input processing modules: a first input processing module and a second input processing module. Taking an example where the electronic device's display screen is split horizontally, with the left half showing the main desktop and the right half showing a parallel desktop, the input information from application A on the main desktop (left half) can be sent to the first input processing module for processing, while the input information from application B on the parallel desktop (right half) can be sent to the second input processing module for processing.
[0128] In combination with the above Figure 13 Please refer to Figure 4 , Figure 14 This is a schematic diagram illustrating a response flow for dual-screen input operations provided in an embodiment of this application. For example... Figure 14 As shown, assuming user 1 performs input operations such as clicking and swiping on the main desktop space in the left half of the screen, for example, operating application A on the main desktop space, and user 2 performs input operations such as clicking and swiping on the parallel desktop space in the right half of the screen, for example, operating application B on the parallel desktop space, then the electronic device can process user 1's input operation on the left half of the screen and user 2's input operation on the right half of the screen according to the left and right screen area division. For user 1's input operation on the left half of the screen, the first input processing module obtains the input information of the input operation and generates a corresponding input event, which is sent to application A so that application A responds to user 1's input operation and displays it; for user 2's input operation on the right half of the screen, the second input processing module obtains the input information of the input operation and generates a corresponding input event, which is sent to application B so that application B responds to user 2's input operation and displays it.
[0129] The input operations described in this application embodiment can be touch operations on the touch screen of an electronic device, or input operations performed through external input devices such as a keyboard, mouse, or gamepad. This application embodiment does not limit the specific type of input operation. For ease of explanation, the software system of the electronic device 100 will be described in detail below, taking the display screen of the electronic device as a touch screen and the input operation on the split screen as a touch operation as an example.
[0130] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses a layered Android system as an example to illustrate the software system of electronic device 100. A layered architecture divides the software into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system can be divided into four layers, from top to bottom: the application layer, the application framework layer, the hardware abstraction layer (HAL), and the kernel layer.
[0131] Based on the above-described layered architecture, this application provides three software systems capable of implementing the aforementioned business processing methods. The following will combine... Figures 15-17 These three software systems will be described in detail.
[0132] 1) The first type of software system
[0133] Please refer to Figure 15 , Figure 15 This is a block diagram of a software system for an electronic device 100 provided in an embodiment of this application. See also... Figure 15 The layered architecture divides the software into four layers, from top to bottom: the application layer, the application framework layer, the hardware abstraction layer, and the kernel layer.
[0134] The application layer can include a series of application packages. For example... Figure 15 As shown, the application package may include a main space desktop application and a parallel space desktop application. In one possible application scenario, application A is installed in the main space, and the application interface of application A can be displayed on the main space desktop. Application B is installed in the parallel space, and the application interface of application B can be displayed on the parallel space desktop. Application A and application B can be applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS, games, etc., and this application embodiment does not limit them.
[0135] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. For example... Figure 15 As shown, the application framework layer may include an input subsystem. Besides two independent input processing modules—a first input processing module and a second input processing module—the input subsystem also includes an overall input processing module. The first input processing module processes input information on the first split-screen window, and the second input processing module processes input information on the second split-screen window. The overall input processing module obtains input information from the lower layer of the electronic device (e.g., by reading the input driver node in the HAL layer to obtain touch information from the touchscreen), and determines which split-screen window the input operation applies to based on this information. If it applies to the first split-screen window, the input information is sent to the first input processing module for processing; if it applies to the second split-screen window, the input information is sent to the second input processing module for processing.
[0136] Additionally, the application framework layer may also include a window manager, content provider, view system, resource manager, etc. Figure 16 (Not shown in the image). The window manager manages windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture screenshots. The content provider stores and retrieves data, making it accessible to applications. This data can include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system is used to build the application's display interface, which can consist of one or more views, such as a view displaying SMS notification icons, a view displaying text, and a view displaying images. The resource manager provides applications with various resources, such as localized strings, icons, images, layout files, video files, etc.
[0137] The Hardware Abstraction Layer (HAL) is used to abstract hardware. For example, it can encapsulate drivers in the driver layer and provide interfaces for the application framework layer to call, shielding the underlying hardware implementation details. Figure 15 As shown, the HAL layer can include a touchscreen algorithm processing module and an input driver node. The touchscreen algorithm processing module is used to verify and correct the raw input information reported by the lower-level touchscreen driver. For example, by correcting the raw input information, it checks whether the touch position of the touch operation is correct and whether the pressure is sufficient. If the raw input information passes verification, it is further corrected to convert the raw input information into standard input information, such as converting the screen coordinates corresponding to the touch position in the raw input information into view coordinates. The input driver node is the driver node corresponding to the touchscreen driver. It can acquire and store the standard input information output by the touchscreen algorithm processing module. The touchscreen input data can be obtained by reading the input driver node.
[0138] The kernel layer is the layer between hardware and software. At a minimum, the kernel layer contains the touchscreen driver, and may also include display drivers, audio drivers, sensor drivers, etc. The touchscreen driver can report the raw touch information generated by the user's touch operations on the touchscreen.
[0139] Figure 15 The software system shown primarily improves upon the application framework layer by adding a first input processing module and a second input processing module to handle input information from the two split-screen windows respectively, based on the existing separate input processing module. Furthermore, the overall input processing module incorporates logic to determine which split-screen window the input operation is applied to, thus identifying which split-screen window the input information originates from and sending the input information from different split-screen windows to different input processing modules to support simultaneous responses to input operations on both split-screen windows.
[0140] 2) The second type of software system
[0141] Please refer to Figure 16 , Figure 16 This is a block diagram of the software system of another electronic device 100 provided in an embodiment of this application. See also... Figure 16 The layered architecture divides the software into four layers, from top to bottom: the application layer, the application framework layer, the hardware abstraction layer, and the kernel layer.
[0142] The application layer can include a series of application packages. For example... Figure 16 As shown, the application package may include a main space desktop application and a parallel space desktop application. In one possible application scenario, application A is installed in the main space, and the application interface of application A can be displayed on the main space desktop. Application B is installed in the parallel space, and the application interface of application B can be displayed on the parallel space desktop. Application A and application B can be applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS, games, etc., and this application embodiment does not limit them.
[0143] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. For example... Figure 15 As shown, the application framework layer may include an input subsystem, which includes two independent input processing modules: a first input processing module and a second input processing module. The first input processing module processes input information on the first split-screen window, and the second input processing module processes input information on the second split-screen window.
[0144] Additionally, the application framework layer may also include a window manager, content provider, view system, resource manager, etc. Figure 16 (Not shown in the image). The window manager manages windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture screenshots. The content provider stores and retrieves data, making it accessible to applications. This data can include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system is used to build the application's display interface, which can consist of one or more views, such as a view displaying SMS notification icons, a view displaying text, and a view displaying images. The resource manager provides applications with various resources, such as localized strings, icons, images, layout files, video files, etc.
[0145] The Hardware Abstraction Layer (HAL) is used to abstract hardware. For example, it can encapsulate drivers in the driver layer and provide interfaces for the application framework layer to call, shielding the underlying hardware implementation details. Figure 16 As shown, the HAL layer may include a touchscreen algorithm processing module and two independent input driver nodes (a first input driver node and a second input driver node). The touchscreen algorithm processing module is used to verify and correct the raw input information reported by the lower-level touchscreen driver. For example, by correcting the raw input information, it checks whether the touch position of the touch operation is correct and whether the pressure is sufficient. If the raw input information passes the verification, it is corrected again to convert the raw input information into standard input information, such as converting the screen coordinates corresponding to the touch position in the raw input information into view coordinates. In addition, after generating the standard input information, the touchscreen algorithm processing module can also determine which split-screen window the input operation is applied to based on the standard input information. If it is applied to the first split-screen window, the standard input information is sent to the first input driver node; if it is applied to the second split-screen window, the standard input information is sent to the second input driver node. The first input driver node and the second input driver node are both driver nodes corresponding to the touchscreen driver, but these two input driver nodes are responsible for acquiring and storing input information from different split-screen windows. For example, the first input driver node is used to acquire and store the input information on the first split-screen window output by the touchscreen algorithm processing module. The input data on the first split-screen window can be obtained by reading the first input driver node. The second input driver node is used to acquire and store the input information on the second split-screen window output by the touchscreen algorithm processing module. The input data on the second split-screen window can be obtained by reading the second input driver node.
[0146] The kernel layer is the layer between hardware and software. At a minimum, the kernel layer contains the touchscreen driver, and may also include display drivers, audio drivers, sensor drivers, etc. The touchscreen driver can report the raw touch information generated by the user's touch operations on the touchscreen.
[0147] Figure 16 The software system shown primarily improves upon the HAL layer by splitting the current single touchscreen input driver node into two independent input driver nodes to separately acquire and store input information from the two split-screen windows. Furthermore, the touchscreen algorithm processing module adds logic to determine which split-screen window the input operation applies to, thus identifying which split-screen window the input information originates from and outputting the input information from different split-screen windows to different input driver nodes, supporting simultaneous responses to input operations on both split-screen windows.
[0148] 3) The third type of software system
[0149] Please refer to Figure 17 , Figure 17 This is a block diagram of a software system for another electronic device 100 provided in an embodiment of this application. See also... Figure 17 The layered architecture divides the software into four layers, from top to bottom: the application layer, the application framework layer, the HAL layer, and the kernel layer.
[0150] The application layer can include a series of application packages. For example... Figure 17 As shown, the application package may include a main space desktop application and a parallel space desktop application. In one possible application scenario, application A is installed in the main space, and the application interface of application A can be displayed on the main space desktop. Application B is installed in the parallel space, and the application interface of application B can be displayed on the parallel space desktop. Application A and application B can be applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS, games, etc., and this application embodiment does not limit them.
[0151] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. For example... Figure 15 As shown, the application framework layer may include an input subsystem, which includes two independent input processing modules: a first input processing module and a second input processing module. The first input processing module processes input information on the first split-screen window, and the second input processing module processes input information on the second split-screen window.
[0152] Additionally, the application framework layer may also include a window manager, content provider, view system, resource manager, etc. Figure 16 (Not shown in the image). The window manager manages windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture screenshots. The content provider stores and retrieves data, making it accessible to applications. This data can include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system is used to build the application's display interface, which can consist of one or more views, such as a view displaying SMS notification icons, a view displaying text, and a view displaying images. The resource manager provides applications with various resources, such as localized strings, icons, images, layout files, video files, etc.
[0153] The Hardware Abstraction Layer (HAL) is used to abstract hardware. For example, it can encapsulate drivers in the driver layer and provide interfaces for the application framework layer to call, shielding the underlying hardware implementation details. Figure 17 As shown, the HAL layer can include two independent touchscreen algorithm processing modules (a first touchscreen algorithm processing module and a second touchscreen algorithm processing module) and two independent input driver nodes (a first input driver node and a second input driver node). The first and second touchscreen algorithm processing modules are responsible for processing the raw input information on the first and second split-screen windows, respectively. For example, the first touchscreen algorithm processing module verifies and corrects the raw input information on the first split-screen window reported by the lower-level first touchscreen virtual driver to output corresponding standard input information and sends the output standard input information to the first input driver node. The second touchscreen algorithm processing module verifies and corrects the raw input information on the second split-screen window reported by the lower-level second touchscreen virtual driver to output corresponding standard input information and sends the output standard input information to the second input driver node. Both the first and second input driver nodes are driver nodes corresponding to the touchscreen driver, but these two input driver nodes are responsible for acquiring and storing input information on different split-screen windows. The first input driver node acquires and stores the input information on the first split-screen window output by the first touchscreen algorithm processing module; the input data on the first split-screen window can be obtained by reading the first input driver node. The second input driver node is used to acquire and store the input information on the second split-screen window output by the second touch screen algorithm processing module. The input data on the second split-screen window can be obtained by reading the second input driver node.
[0154] The kernel layer is the layer between hardware and software. The kernel layer contains at least a touchscreen driver and two independent virtual touchscreen drivers (a first virtual touchscreen driver and a second virtual touchscreen driver). The touchscreen driver can obtain the raw touch information generated by the user's touch operations on the touchscreen and determine which split-screen window the touch operation applied to. If it applied to the first split-screen window, the raw touch information is sent to the first virtual touchscreen driver; if it applied to the second split-screen window, the raw touch information is sent to the second virtual touchscreen driver. The first and second virtual touchscreen drivers are virtual drivers created to simulate the touchscreen driver and are used to report the raw touch information generated on the first and second split-screen windows, respectively.
[0155] Figure 17 The software system shown primarily improves upon the kernel layer by adding two independent virtual touchscreen drivers to the existing single touchscreen driver. These drivers report input information from the two split-screen windows separately. Furthermore, the touchscreen driver's algorithm logic incorporates processing logic to determine which split-screen window the input operation applies to based on the touchscreen-generated input information. This identifies which split-screen window the input information originates from and sends the input information from different split-screen windows to different virtual touchscreen drivers, enabling simultaneous responses to input operations on both split-screen windows.
[0156] The specific implementation process of the business processing method provided in the embodiments of this application is described below with reference to the accompanying drawings.
[0157] First, in conjunction with the above... Figure 15 The business processing method provided in the embodiments of this application is illustrated with examples. Please refer to... Figure 18 , Figure 18 This is a schematic flowchart illustrating a business processing method provided in an embodiment of this application, which can be executed by an electronic device. The hardware structure diagram of the electronic device can be as follows: Figure 1 As shown, the software structure block diagram of an electronic device can be as follows: Figure 15 As shown, but the embodiments of this application are not limited thereto. The method includes the following steps:
[0158] A1. The electronic device displays a main desktop and a parallel desktop in a split-screen manner on the screen corresponding to the touch screen. The main desktop includes the application interface of application A, and the parallel desktop includes the application interface of application B.
[0159] This application embodiment is applied to a split-screen display scenario. The electronic device can display a first split-screen window and a second split-screen window on the display screen, with the main desktop located in the first split-screen window and the parallel desktop located in the second split-screen window. For example, the display screen can display a left and right half-screen in a left-right split-screen manner, with the main desktop displayed on the left half-screen and the parallel desktop displayed on the right half-screen.
[0160] In this context, Application A is any application in the main space, and Application B is any application in the parallel space. For example, both Application A and Application B are game applications, enabling the simultaneous running of two games.
[0161] Please refer to Figure 5 Before the electronic device displays the main desktop and parallel desktop in split-screen mode, the main desktop, which includes the icon for the "Parallel Space" application, can be displayed first. Users can click the "Parallel Space" application icon; in response, the electronic device launches the Parallel Space application and directly displays the main desktop and parallel desktop in split-screen mode.
[0162] Alternatively, after launching the Parallel Space application on an electronic device, the Parallel Space desktop can be displayed in full screen initially, and then, based on the user's split-screen operation, the main Space desktop and the Parallel Space desktop can be displayed in split-screen mode. For example, please refer to... Figure 6 Split-screen operation can be achieved by clicking the top function bar of the parallel space desktop, triggering the display of the "split-screen" control, and then clicking the "split-screen" control. It should be understood that split-screen operation can also be other operations, such as first swiping the screen from the outside to the inside from the left or right side of the screen and pausing to bring up the smart multi-window application bar, and then long-pressing and dragging the icon of the application to be split-screened from the application bar to the screen, etc.
[0163] After displaying the main desktop and parallel desktops in split-screen mode, the user can launch application A from the main desktop, and application A's interface will be displayed on the main desktop in response to the user's launch action. The user can also launch application B from the parallel desktop, and application B's interface will be displayed on the parallel desktop in response to the user's launch action.
[0164] It should be understood that the application interface of application A can be displayed in full screen or partially on the main desktop, and application B can also be displayed in full screen or partially on the parallel desktop. This application embodiment does not limit this.
[0165] As an example, please refer to Figure 9In Figure a, the left half of the screen's main desktop includes the application icon for Game 1 (Application A), while the right half of the screen's parallel desktop includes the application icon for Game 2 (Application B). User 1 can click the application icon for Game 1, and simultaneously, User 2 can click the application icon for Game 2. For responses to the actions of User 1 and User 2, please refer to... Figure 9 In Figure b, the electronic device displays the application interface of Game 1 on the main desktop and the application interface of Game 2 on the parallel desktop.
[0166] As an example, when an electronic device displays the main desktop and the parallel desktop in a split-screen manner, the parallel desktop can obtain the area location information of the screen area 1 corresponding to the split-screen window where the parallel desktop is located, and store the area location information of the screen area 1 in a preset storage space, so that a specific module can read the area location information of the screen area 1 from the preset storage space, and then determine whether the position of the input operation is located in the screen area 1 based on the area location information of the screen area 1.
[0167] Furthermore, the parallel space desktop also obtains the area location information of screen area 2 corresponding to the split-screen window of the main space desktop, and stores the area location information of screen area 2 in a preset storage space, so that the preset storage space stores both the area location information of screen area 1 and the area location information of screen area 2.
[0168] A2, User 1 clicks on the application interface of application A on the main desktop.
[0169] User 1 can perform touch operations on the application interface of application A, such as clicking or swiping. This embodiment of the application uses user 1 performing a clicking operation as an example for illustration.
[0170] A3, User 2 simultaneously clicks on the application interface of application B on the Parallel Space desktop.
[0171] User 2 can perform touch operations on the application interface of application B, such as clicking or swiping. This embodiment of the application uses user 2 performing a clicking operation as an example for illustration.
[0172] A4, the touch screen reports to the touch screen driver the original touch information 1 generated by the touch operation of user 1 and the original touch information 2 generated by the touch operation of user 2. The original touch information 1 includes screen coordinates 1 and the original touch information 2 includes screen coordinates 2.
[0173] After user 1 clicks on the application interface of application A, the touchscreen can generate corresponding raw touch information 1 and report the generated raw touch information 1. The raw touch information 1 may include touch position 1, touch force 1, touch time 1, and touch direction 1, etc. Among them, the touch position 1 in the raw touch information 1 is generally screen coordinates, which are position coordinates relative to the screen, that is, position coordinates on the screen.
[0174] Similarly, after user 2 clicks on the application interface of application A, the touchscreen can generate corresponding raw touch information 2 and report the generated raw touch information 2. The raw touch information 2 may include touch position 2, touch force 2, touch time 2, and touch direction 2, etc. Among them, the touch position 2 in the raw touch information 2 is generally screen coordinates, which are position coordinates relative to the screen, that is, position coordinates on the screen.
[0175] A5, the touch screen driver sends raw touch information 1 and raw touch information 2 to the touch screen algorithm processing module.
[0176] After receiving the original touch information 1 and original touch information 2 reported by the touch screen driver, the touch screen can continue to report the original touch information 1 and original touch information 2 to the touch screen algorithm processing module.
[0177] A6, the touch screen algorithm processing module verifies and corrects the original touch information 1 to generate input information 1 including view coordinates 1, and verifies and corrects the original touch information 2 to generate input information 2 including view coordinates 2.
[0178] Input information 1 is the standard format input information generated after verifying and correcting the original touch information 1; Input information 2 is the standard format input information generated after verifying and correcting the original touch information 2.
[0179] View coordinates 1 are obtained by transforming screen coordinates 1, and view coordinates 2 are obtained by transforming screen coordinates 2. View coordinates are relative to the view, that is, the position coordinates on the view. In one possible implementation, the View.getLocationOnScreen method can be used to convert screen coordinates to view coordinates.
[0180] After receiving the original touch information 1 and original touch information 2, the touchscreen algorithm processing module can verify and correct them respectively. For example, it can verify whether the touch position 1, touch force 1, touch time 1, and touch direction 1 in the original touch information 1 are within a reasonable error range. If not, it means that the original touch information 1 has failed the verification, and processing stops. If yes, it means that the original touch information 1 has passed the verification, and then it is corrected. Correcting the original touch information 1 means converting the original touch information 1 into input information in a standard format. For example, the process of correcting the original touch information 1 may include converting the screen coordinates 1 in the original touch information 1 into view coordinates 1 to obtain standard input information, i.e., input information 1. The method of verifying and correcting the original touch information 2 is the same as that of verifying and correcting the original touch information 1, and will not be described again in this embodiment.
[0181] A7, the touch screen algorithm processing module writes input information 1 and input information 2 into the input driver node respectively.
[0182] The input driver node is the driver node corresponding to the touchscreen driver. It is used to store the touchscreen input information, which can be read and used by the upper layer. Therefore, the touchscreen algorithm processing module can first write the output input information into the input driver node so that the upper layer can obtain the touchscreen input information by reading the input driver node.
[0183] A8, the input driver node sends input information 1 and input information 2 to the overall input processing module.
[0184] For example, the overall input processing module reads input information 1 and input information 2 from the input driver node.
[0185] A9. After receiving input information 1 and input information 2, the overall input processing module determines that the user 1's touch operation is applied to the screen area 1 corresponding to the main space desktop based on the view coordinate 1 in input information 1, and determines that the user 2's touch operation is applied to the screen area 2 corresponding to the main space coordinate based on the view coordinate 2 in input information 2.
[0186] As an example, a preset storage space stores the location information of screen area 1. The overall input processing module can retrieve the location information of screen area 1 from the preset storage space in advance, and then determine whether user 1's touch operation is applied to screen area 1 based on the view coordinates 1 in input information 1 and the location information of screen area 1. For example, if view coordinates 1 is within screen area 1, it is determined that user 1's touch operation is applied to screen area 1; otherwise, it is determined that user 1's touch operation is not applied to screen area 1, such as directly determining that user 1's touch operation is applied to screen area 2.
[0187] Similarly, it can be determined whether user 2's touch operation is applied to screen area 2 based on the view coordinates 2 and the area location information of screen area 1 in input information 2. For example, if view coordinates 2 are located within screen area 1, then it is determined that user 2's touch operation is applied to screen area 1; otherwise, it is determined that user 2's touch operation is applied to screen area 2. In this embodiment, user 1's touch operation is applied to screen area 1, and user 2's touch operation is applied to screen area 2 as an example.
[0188] Furthermore, the preset storage space stores the location information of screen area 1 and screen area 2. The overall input processing module can retrieve the location information of screen area 1 and screen area 2 from the preset storage space in advance. Then, based on the view coordinates 1 in input information 1 and the location information of screen area 1 and screen area 2, it determines whether the user's touch operation is applied to screen area 1 or screen area 2. For example, if view coordinates 1 is located within screen area 1, it is determined that the user's touch operation is applied to screen area 1; if view coordinates 2 is located within screen area 2, it is determined that the user's touch operation is applied to screen area 2.
[0189] Similarly, based on the view coordinates 2 in input information 2, and the location information of screen area 1 and screen area 2, it can be determined whether user 2's touch operation is applied to screen area 1 or screen area 2. For example, if view coordinates 2 are located within screen area 1, then user 2's touch operation is applied to screen area 1; if view coordinates 2 are located within screen area 2, then user 2's touch operation is applied to screen area 2.
[0190] After determining that user 1's touch operation is applied to screen area 1 corresponding to the main desktop based on view coordinates 1 in input information 1, the overall input processing module can send input information 1 to the first input processing module for processing. The specific processing procedure will be explained in detail in steps A10-A13 below. After determining that user 2's touch operation is applied to screen area 2 corresponding to the parallel desktop based on view coordinates 2 in input information 2, the overall input processing module can send input information 2 to the second input processing module for processing. The specific processing procedure will be explained in detail in steps A14-A17 below.
[0191] In other words, the input information generated by input operations applied to different split-screen windows is sent to different input processing modules for processing, so as to achieve simultaneous response to the two input operations.
[0192] A10, the overall input processing module sends input information 1 to the first input processing module.
[0193] A11, the first input processing module generates input event 1 based on input information 1.
[0194] After receiving input information 1, the first input processing module can generate input event 1 that conforms to the standard input event format based on input information 1.
[0195] In addition, the first input processing module can also determine the user 1's touch operation on the application interface of application A based on the view coordinates 1 in the input information 1, so as to send the generated input event 1 to application A for processing.
[0196] A12, the first input processing module sends input event 1 to application A.
[0197] A13, use A to respond to input event 1.
[0198] After application A responds to input event 1, it can refresh the application interface based on the display control data of the response, thereby realizing the response to user 1's touch operation in the foreground.
[0199] A14, the overall input processing module sends input information 2 to the second input processing module.
[0200] A15, the second input processing module generates input event 2 based on input information 2.
[0201] After receiving input information 2, the second input processing module can generate input event 2 that conforms to the standard input event format based on input information 2.
[0202] In addition, the second input processing module can also determine the user 2's touch operation on the application interface of application B based on the view coordinates 2 in the input information 2, so as to send the generated input event 2 to application B for processing.
[0203] A16, The second input processing module sends input event 2 to application B.
[0204] A17, Application B responds to input event 2.
[0205] After application B responds to input event 2, it can refresh the application interface based on the display control data of the response, thereby realizing the response to user 2's touch operation in the foreground.
[0206] It should be noted that the same processing steps for the input operations of user 1 and user 2 can be executed simultaneously or sequentially, but the execution time difference is very small and can be almost ignored. In terms of user experience, the electronic device responds to both at the same time, thereby improving the user experience.
[0207] The following is in conjunction with the above. Figure 16 The business processing methods provided in the embodiments of this application are illustrated with examples.
[0208] Please refer to Figure 19 , Figure 19 This is a schematic flowchart illustrating another business processing method provided in this application embodiment, which can be executed by an electronic device. The hardware structure diagram of the electronic device can be as follows: Figure 1 As shown, the software structure block diagram of an electronic device can be as follows: Figure 16 As shown, but the embodiments of this application are not limited thereto. The method may include the following steps:
[0209] B1, the electronic device displays the main desktop and the parallel desktop in a split-screen manner on the display screen corresponding to the touch screen. The main desktop includes the application interface of application A, and the parallel desktop includes the application interface of application B.
[0210] This application embodiment is applied to a split-screen display scenario. The electronic device can display a first split-screen window and a second split-screen window on the display screen, with the main desktop located in the first split-screen window and the parallel desktop located in the second split-screen window. For example, the display screen can display a left and right half-screen in a left-right split-screen manner, with the main desktop displayed on the left half-screen and the parallel desktop displayed on the right half-screen.
[0211] In this context, Application A is any application in the main space, and Application B is any application in the parallel space. For example, both Application A and Application B are game applications, enabling the simultaneous running of two games.
[0212] Please refer to Figure 5 Before the electronic device displays the main desktop and parallel desktop in split-screen mode, the main desktop, which includes the icon for the "Parallel Space" application, can be displayed first. Users can click the "Parallel Space" application icon; in response, the electronic device launches the Parallel Space application and directly displays the main desktop and parallel desktop in split-screen mode.
[0213] Alternatively, after launching the Parallel Space application on an electronic device, the Parallel Space desktop can be displayed in full screen initially, and then, based on the user's split-screen operation, the main Space desktop and the Parallel Space desktop can be displayed in split-screen mode. For example, please refer to... Figure 6 Split-screen operation can be achieved by clicking the top function bar of the parallel space desktop, triggering the display of the "split-screen" control, and then clicking the "split-screen" control. It should be understood that split-screen operation can also be other operations, such as first swiping the screen from the outside to the inside from the left or right side of the screen and pausing to bring up the smart multi-window application bar, and then long-pressing and dragging the icon of the application to be split-screened from the application bar to the screen, etc.
[0214] After displaying the main desktop and parallel desktops in split-screen mode, the user can launch application A from the main desktop, and application A's interface will be displayed on the main desktop in response to the user's launch action. The user can also launch application B from the parallel desktop, and application B's interface will be displayed on the parallel desktop in response to the user's launch action.
[0215] It should be understood that the application interface of application A can be displayed in full screen or partially on the main desktop, and application B can also be displayed in full screen or partially on the parallel desktop. This application embodiment does not limit this.
[0216] As an example, please refer to Figure 9 In Figure a, the left half of the screen's main desktop includes the application icon for Game 1 (Application A), while the right half of the screen's parallel desktop includes the application icon for Game 2 (Application B). User 1 can click the application icon for Game 1, and simultaneously, User 2 can click the application icon for Game 2. For responses to the actions of User 1 and User 2, please refer to... Figure 9 In Figure b, the electronic device displays the application interface of Game 1 on the main desktop and the application interface of Game 2 on the parallel desktop.
[0217] As an example, when an electronic device displays the main desktop and the parallel desktop in a split-screen manner, the parallel desktop can obtain the area location information of the screen area 1 corresponding to the split-screen window where the parallel desktop is located, and store the area location information of the screen area 1 in a preset storage space, so that a specific module can read the area location information of the screen area 1 from the preset storage space, and then determine whether the position of the input operation is located in the screen area 1 based on the area location information of the screen area 1.
[0218] Furthermore, the parallel space desktop also obtains the area location information of screen area 2 corresponding to the split-screen window of the main space desktop, and stores the area location information of screen area 2 in a preset storage space, so that the preset storage space stores both the area location information of screen area 1 and the area location information of screen area 2.
[0219] B2, User 1 clicks on the application interface of application A on the main desktop.
[0220] User 1 can perform touch operations on the application interface of application A, such as clicking or swiping. This embodiment of the application uses user 1 performing a clicking operation as an example for illustration.
[0221] B3, User 2 simultaneously clicks on the application interface of application B on the parallel space desktop.
[0222] User 2 can perform touch operations on the application interface of application B, such as clicking or swiping. This embodiment of the application uses user 2 performing a clicking operation as an example for illustration.
[0223] B4, the touch screen reports to the touch screen driver the original touch information 1 generated by the touch operation of user 1 and the original touch information 2 generated by the touch operation of user 2. The original touch information 1 includes screen coordinates 1 and the original touch information 2 includes screen coordinates 2.
[0224] After user 1 clicks on the application interface of application A, the touchscreen can generate corresponding raw touch information 1 and report the generated raw touch information 1. The raw touch information 1 may include touch position 1, touch force 1, touch time 1, and touch direction 1, etc. Among them, the touch position 1 in the raw touch information 1 is generally screen coordinates, which are position coordinates relative to the screen, that is, position coordinates on the screen.
[0225] Similarly, after user 2 clicks on the application interface of application A, the touchscreen can generate corresponding raw touch information 2 and report the generated raw touch information 2. The raw touch information 2 may include touch position 2, touch force 2, touch time 2, and touch direction 2, etc. Among them, the touch position 2 in the raw touch information 2 is generally screen coordinates, which are position coordinates relative to the screen, that is, position coordinates on the screen.
[0226] B5, the touch screen driver sends raw touch information 1 and raw touch information 2 to the touch screen algorithm processing module.
[0227] After receiving the original touch information 1 and original touch information 2 reported by the touch screen driver, the touch screen can continue to report the original touch information 1 and original touch information 2 to the touch screen algorithm processing module.
[0228] B6, the touch screen algorithm processing module verifies and corrects the original touch information 1, generates input information 1 including view coordinates 1, and determines the screen area 1 corresponding to the main space desktop based on the view coordinates 1 in the input information 1.
[0229] Input information 1 is the standard-formatted input information generated after verifying and correcting the original touch information 1. View coordinates 1 are obtained by transforming screen coordinates 1. In one possible implementation, the View.getLocationOnScreen method can be used to convert screen coordinates to view coordinates.
[0230] After receiving the original touch information 1, the touchscreen algorithm processing module can perform verification and correction on the original touch information 1. The specific implementation method of verification and correction can be found above. Figure 18 The relevant descriptions in step A6 are not repeated here in the embodiments of this application.
[0231] In addition, in this embodiment of the application, after verifying and correcting the original touch information 1, it is also possible to determine which screen area in each split screen the user 1’s touch operation is applied to based on the view coordinates 1 in the generated input information 1.
[0232] As an example, the preset storage space stores the location information of screen area 1. The touch screen algorithm processing module can obtain the location information of screen area 1 from the preset storage space in advance, and then determine whether the user 1's touch operation is applied to screen area 1 or screen area 2 based on the view coordinates 1 in the input information 1 and the location information of screen area 1.
[0233] As another example, the preset storage space stores the location information of screen area 1 and screen area 2. The touch screen algorithm processing module can obtain the location information of screen area 1 and screen area 2 from the preset storage space in advance, and then determine whether the user's touch operation is applied to screen area 1 or screen area 2 based on the view coordinates 1 in the input information 1 and the location information of screen area 1 and screen area 2.
[0234] B7, the touch screen algorithm processing module verifies and corrects the original touch information 2, generates input information 2 including view coordinates 2, and determines the screen area 2 corresponding to the parallel space desktop based on the view coordinates 2 in the input information 2.
[0235] Input information 2 is the standard-format input information generated after verifying and correcting the original touch information 2. View coordinates 2 are obtained by transforming screen coordinates 2. In one possible implementation, the View.getLocationOnScreen method can be used to convert screen coordinates to view coordinates.
[0236] After receiving the original touch information 2, the touchscreen algorithm processing module can perform verification and correction on it. The specific implementation of the verification and correction can be found above. Figure 18 The relevant descriptions in step A6 are not repeated here in the embodiments of this application.
[0237] In addition, in this embodiment of the application, after verifying and correcting the original touch information 2, it is also possible to determine which screen area in each split screen the user 2's touch operation is applied to based on the view coordinates 2 in the generated input information 2.
[0238] As an example, the preset storage space stores the location information of screen area 1. The touch screen algorithm processing module can obtain the location information of screen area 1 from the preset storage space in advance, and then determine whether the user 2's touch operation is applied to screen area 1 or screen area 2 based on the view coordinates 2 in the input information 2 and the location information of screen area 1.
[0239] As another example, the preset storage space stores the location information of screen area 1 and screen area 2. The touch screen algorithm processing module can obtain the location information of screen area 1 and screen area 2 from the preset storage space in advance, and then determine whether the user's touch operation is applied to screen area 1 or screen area 2 based on the view coordinates 2 in the input information 2 and the location information of screen area 1 and screen area 2.
[0240] After determining that user 1's touch operation is applied to screen area 1, the touchscreen algorithm processing module can write the corresponding input information 1 to the first input driver node. After determining that user 2's touch operation is applied to screen area 2, it can write the corresponding input information 2 to the second input driver node.
[0241] That is, in the embodiments of this application, the touch screen algorithm processing module can determine which split screen area the input information of the touch screen is located in, and write the input information of different split screen areas into different input driver nodes respectively.
[0242] B8, the touch screen algorithm processing module writes input information 1 into the first input driver node.
[0243] B9, the touch screen algorithm processing module writes input information 2 into the second input driver node.
[0244] The first input driver node and the second input driver node are both driver nodes corresponding to the touch screen driver, used to store input information of different split-screen areas for the upper layer to read and use.
[0245] B10, the first input driver node sends input information 1 to the first input processing module.
[0246] For example, the first input processing module can read input information 1 from the first input driving node.
[0247] B11, the first input processing module generates input event 1 based on input information 1.
[0248] After receiving input information 1, the first input processing module can generate input event 1 that conforms to the standard input event format based on input information 1.
[0249] In addition, the first input processing module can also determine the user 1's touch operation on the application interface of application A based on the view coordinates 1 in the input information 1, so as to send the generated input event 1 to application A for processing.
[0250] B12, the first input processing module sends input event 1 to application A.
[0251] B13, Application A responds to input event 1.
[0252] After application A responds to input event 1, it can refresh the application interface based on the display control data of the response, thereby realizing the response to user 1's touch operation in the foreground.
[0253] B14, the second input driver node sends input information 2 to the second input processing module.
[0254] For example, the second input processing module can read input information 2 from the second input driver node.
[0255] B15, the second input processing module generates input event 2 based on input information 2.
[0256] After receiving input information 2, the second input processing module can generate input event 2 that conforms to the standard input event format based on input information 2.
[0257] In addition, the second input processing module can also determine the user 2's touch operation on the application interface of application B based on the view coordinates 2 in the input information 2, so as to send the generated input event 2 to application B for processing.
[0258] B16, the second input processing module sends input event 2 to application B.
[0259] B17, use B to respond to input event 2.
[0260] After application B responds to input event 2, it can refresh the application interface based on the display control data of the response, thereby realizing the response to user 2's touch operation in the foreground.
[0261] It should be noted that the same processing steps for the input operations of user 1 and user 2 can be executed simultaneously or sequentially, but the execution time difference is very small and can be almost ignored. In terms of user experience, the electronic device responds to both at the same time, thereby improving the user experience.
[0262] The following is in conjunction with the above. Figure 17 The business processing methods provided in the embodiments of this application are illustrated with examples.
[0263] Please refer to Figure 20, Figure 20 This is a schematic flowchart illustrating another business processing method provided in this application embodiment, which can be executed by an electronic device. The hardware structure diagram of the electronic device can be as follows: Figure 1 As shown, the software structure block diagram of an electronic device can be as follows: Figure 17 As shown, but the embodiments of this application are not limited thereto. The method may include the following steps:
[0264] C1, the electronic device displays the main desktop and the parallel desktop in a split-screen manner on the screen corresponding to the touch screen. The main desktop includes the application interface of application A, and the parallel desktop includes the application interface of application B.
[0265] This application embodiment is applied to a split-screen display scenario. The electronic device can display a first split-screen window and a second split-screen window on the display screen, with the main desktop located in the first split-screen window and the parallel desktop located in the second split-screen window. For example, the display screen can display a left and right half-screen in a left-right split-screen manner, with the main desktop displayed on the left half-screen and the parallel desktop displayed on the right half-screen.
[0266] In this context, Application A is any application in the main space, and Application B is any application in the parallel space. For example, both Application A and Application B are game applications, enabling the simultaneous running of two games.
[0267] Please refer to Figure 5 Before the electronic device displays the main desktop and parallel desktop in split-screen mode, the main desktop, which includes the icon for the "Parallel Space" application, can be displayed first. Users can click the "Parallel Space" application icon; in response, the electronic device launches the Parallel Space application and directly displays the main desktop and parallel desktop in split-screen mode.
[0268] Alternatively, after launching the Parallel Space application on an electronic device, the Parallel Space desktop can be displayed in full screen initially, and then, based on the user's split-screen operation, the main Space desktop and the Parallel Space desktop can be displayed in split-screen mode. For example, please refer to... Figure 6 Split-screen operation can be achieved by clicking the top function bar of the parallel space desktop, triggering the display of the "split-screen" control, and then clicking the "split-screen" control. It should be understood that split-screen operation can also be other operations, such as first swiping the screen from the outside to the inside from the left or right side of the screen and pausing to bring up the smart multi-window application bar, and then long-pressing and dragging the icon of the application to be split-screened from the application bar to the screen, etc.
[0269] After displaying the main desktop and parallel desktops in split-screen mode, the user can launch application A from the main desktop, and application A's interface will be displayed on the main desktop in response to the user's launch action. The user can also launch application B from the parallel desktop, and application B's interface will be displayed on the parallel desktop in response to the user's launch action.
[0270] It should be understood that the application interface of application A can be displayed in full screen or partially on the main desktop, and application B can also be displayed in full screen or partially on the parallel desktop. This application embodiment does not limit this.
[0271] As an example, please refer to Figure 9 In Figure a, the left half of the screen's main desktop includes the application icon for Game 1 (Application A), while the right half of the screen's parallel desktop includes the application icon for Game 2 (Application B). User 1 can click the application icon for Game 1, and simultaneously, User 2 can click the application icon for Game 2. For responses to the actions of User 1 and User 2, please refer to... Figure 9 In Figure b, the electronic device displays the application interface of Game 1 on the main desktop and the application interface of Game 2 on the parallel desktop.
[0272] As an example, when an electronic device displays the main desktop and the parallel desktop in a split-screen manner, the parallel desktop can obtain the area location information of the screen area 1 corresponding to the split-screen window where the parallel desktop is located, and store the area location information of the screen area 1 in a preset storage space, so that a specific module can read the area location information of the screen area 1 from the preset storage space, and then determine whether the position of the input operation is located in the screen area 1 based on the area location information of the screen area 1.
[0273] Furthermore, the parallel space desktop also obtains the area location information of screen area 2 corresponding to the split-screen window of the main space desktop, and stores the area location information of screen area 2 in a preset storage space, so that the preset storage space stores both the area location information of screen area 1 and the area location information of screen area 2.
[0274] C2, User 1 clicks on the application interface of application A on the main desktop.
[0275] User 1 can perform touch operations on the application interface of application A, such as clicking or swiping. This embodiment of the application uses user 1 performing a clicking operation as an example for illustration.
[0276] C3, User 2 simultaneously clicks on the application interface of application B on the Parallel Space desktop.
[0277] User 2 can perform touch operations on the application interface of application B, such as clicking or swiping. This embodiment of the application uses user 2 performing a clicking operation as an example for illustration.
[0278] C4, the touch screen reports to the touch screen driver the original touch information 1 generated by the touch operation of user 1 and the original touch information 2 generated by the touch operation of user 2. The original touch information 1 includes screen coordinates 1 and the original touch information 2 includes screen coordinates 2.
[0279] After user 1 clicks on the application interface of application A, the touchscreen can generate corresponding raw touch information 1 and report the generated raw touch information 1. The raw touch information 1 may include touch position 1, touch force 1, touch time 1, and touch direction 1, etc. Among them, the touch position 1 in the raw touch information 1 is generally screen coordinates, which are position coordinates relative to the screen, that is, position coordinates on the screen.
[0280] Similarly, after user 2 clicks on the application interface of application A, the touchscreen can generate corresponding raw touch information 2 and report the generated raw touch information 2. The raw touch information 2 may include touch position 2, touch force 2, touch time 2, and touch direction 2, etc. Among them, the touch position 2 in the raw touch information 2 is generally screen coordinates, which are position coordinates relative to the screen, that is, position coordinates on the screen.
[0281] C5, the touch screen driver determines that the touch operation of user 1 is applied to the screen area 1 corresponding to the main space desktop based on the screen coordinate 1 in the original touch information 1, and determines that the touch operation of user 2 is applied to the screen area 2 corresponding to the parallel space desktop based on the screen coordinate 2 in the original touch information 2.
[0282] As an example, a preset storage space stores the location information of screen area 1. The touchscreen driver can retrieve the location information of screen area 1 from the preset storage space in advance. Then, based on screen coordinates 1 and the location information of screen area 1 in the original touch information 1, it determines whether user 1's touch operation is applied to screen area 1 or screen area 2. Similarly, based on screen coordinates 2 and the location information of screen area 2 in the original touch information 2, it determines whether user 2's touch operation is applied to screen area 1 or screen area 2.
[0283] As another example, a preset storage space stores the location information of screen area 1 and screen area 2. The touchscreen driver can retrieve the location information of screen area 1 and screen area 2 from the preset storage space in advance. Then, based on the screen coordinates 1 in the original touch information 1 and the location information of screen area 1 and screen area 2, it determines whether user 1's touch operation is applied to screen area 1 or screen area 2. Similarly, based on the screen coordinates 2 in the original touch information 2 and the location information of screen area 1 and screen area 2, it determines whether user 2's touch operation is applied to screen area 1 or screen area 2.
[0284] After determining that user 1's touch operation is applied to screen area 1, the touchscreen driver can send the corresponding raw touch information 1 to the first touchscreen virtual driver. Similarly, after determining that user 2's touch operation is applied to screen area 2, the corresponding raw touch information 2 can be sent to the second touchscreen virtual driver.
[0285] That is, in the embodiments of this application, the touch screen driver can determine which split-screen area the input information of the touch screen is located in, and send the input information of different split-screen areas to different touch screen virtual drivers for processing.
[0286] C6, the touchscreen driver sends raw touch information 1 to the first touchscreen virtual driver.
[0287] C7, the touchscreen driver sends raw touch information 2 to the second touchscreen virtual driver.
[0288] In this embodiment, different touchscreen virtual drivers can also send input information from different screen regions to different touchscreen algorithm processing modules for processing. Furthermore, after processing the received input information, different touchscreen algorithm processing modules can write the processed input information from different screen regions to different input driver nodes.
[0289] C8, the first touch screen virtual driver sends raw touch information 1 to the first touch screen algorithm processing module.
[0290] C9, after receiving the original touch information 1, the first touch screen algorithm processing module verifies and corrects the original touch information 1 and generates input information 1 including view coordinates 1.
[0291] Input information 1 is the standard-formatted input information generated after verifying and correcting the original touch information 1. View coordinates 1 are obtained by transforming screen coordinates 1. In one possible implementation, the View.getLocationOnScreen method can be used to convert screen coordinates to view coordinates.
[0292] After receiving the original touch information 1, the first touchscreen algorithm processing module can perform verification and correction on the original touch information 1. The specific implementation method for verification and correction can be found above. Figure 18 The relevant descriptions in step A6 are not repeated here in the embodiments of this application.
[0293] C10, the first touch screen algorithm processing module writes input information 1 into the first input driver node.
[0294] C11, the second touch screen virtual driver sends raw touch information 2 to the second touch screen algorithm processing module.
[0295] C12, after receiving the original touch information 2, the second touch screen algorithm processing module verifies and corrects the original touch information 2 and generates input information 2 including view coordinates 2.
[0296] Input information 2 is the standard format input information generated after verifying and correcting the original touch information 2. View coordinates 2 are obtained by transforming the screen coordinates 2.
[0297] After receiving the original touch information 2, the second touchscreen algorithm processing module can perform verification and correction on the original touch information 2. The specific implementation method for verification and correction can be found above. Figure 18 The relevant descriptions in step A6 are not repeated here in the embodiments of this application.
[0298] C13, the second touch screen algorithm processing module writes input information 2 into the second input driver node.
[0299] The first input driver node and the second input driver node are both driver nodes corresponding to the touch screen driver, used to store input information of different split-screen areas for the upper layer to read and use.
[0300] C14, the first input driver node sends input information 1 to the first input processing module.
[0301] For example, the first input processing module can read input information 1 from the first input driving node.
[0302] C15, the first input processing module generates input event 1 based on input information 1.
[0303] After receiving input information 1, the first input processing module can generate input event 1 that conforms to the standard input event format based on input information 1.
[0304] In addition, the first input processing module can also determine the user 1's touch operation on the application interface of application A based on the view coordinates 1 in the input information 1, so as to send the generated input event 1 to application A for processing.
[0305] C16, the first input processing module sends input event 1 to application A.
[0306] C17, Application A responds to input event 1.
[0307] After application A responds to input event 1, it can refresh the application interface based on the display control data of the response, thereby realizing the response to user 1's touch operation in the foreground.
[0308] C18, the second input driver node sends input information 2 to the second input processing module.
[0309] For example, the second input processing module can read input information 2 from the second input driver node.
[0310] C19, the second input processing module generates input event 2 based on input information 2.
[0311] After receiving input information 2, the second input processing module can generate input event 2 that conforms to the standard input event format based on input information 2.
[0312] In addition, the second input processing module can also determine the user 2's touch operation on the application interface of application B based on the view coordinates 2 in the input information 2, so as to send the generated input event 2 to application B for processing.
[0313] C20, the second input processing module sends input event 2 to application B.
[0314] C21, Application B responds to input event 2.
[0315] After application B responds to input event 2, it can refresh the application interface based on the display control data of the response, thereby realizing the response to user 2's touch operation in the foreground.
[0316] It should be noted that the same processing steps for the input operations of user 1 and user 2 can be executed simultaneously or sequentially, but the execution time difference is very small and can be almost ignored. In terms of user experience, the electronic device responds to both at the same time, thereby improving the user experience.
[0317] This application also provides a chip coupled to a memory, which is used to read and execute computer programs or instructions stored in the memory to perform the methods in the above embodiments.
[0318] This application also provides an electronic device including a chip for reading and executing computer programs or instructions stored in a memory, causing the methods in the various embodiments to be performed.
[0319] This embodiment also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the business processing method described in the above embodiment.
[0320] This embodiment also provides a computer program product. The computer-readable storage medium stores program code. When the computer program product is run on a computer, it causes the computer to perform the above-mentioned related steps to implement the business processing method in the above embodiment.
[0321] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the business processing methods in the above-described method embodiments.
[0322] In this embodiment, the electronic device, computer-readable storage medium, computer program product or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0323] This application does not specifically limit the structure of the execution subject of the method provided in this application embodiment. As long as a program containing the code of the method provided in this application embodiment can be run to perform video processing according to the method provided in this application embodiment, it is acceptable. For example, the execution subject of the method provided in this application embodiment can be an electronic device, or a functional module in an electronic device that can call and execute a program.
[0324] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0325] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0326] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0327] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium and includes several instructions that cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium may include, but is not limited to, various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.
[0328] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A business processing method, characterized in that, Applied in electronic devices, the operating system of the electronic device includes an input subsystem, the input subsystem including a first input processing module and a second input processing module, the first input processing module and the second input processing module being independent of each other, the method including: The first interface is displayed, which includes a first split-screen window and a second split-screen window displayed in a split-screen manner. The first split-screen window displays the application interface of a first application, and the second split-screen window displays the application interface of a second application. The first input processing module is used to process input information of input operations performed on the first split-screen window, and the second input processing module is used to process input information of input operations performed on the second split-screen window. The first application is the main system desktop or any application in the main system, and the second application is the subsystem desktop or any application in the subsystem. The subsystem is a subsystem application running under the main system of the electronic device. Simultaneously, it receives a first input operation applied to the application interface of the first application in the first split-screen window, and a second input operation applied to the application interface of the second application in the second split-screen window, wherein both the first input operation and the second input operation are touch operations; In response to the first input operation, when the location of the first input operation is within the first screen area where the first split-screen window is located, the first input processing module sends the first input event corresponding to the first input operation to the first application. In response to the second input operation, when the location of the second input operation is within the second screen area where the second split-screen window is located, the second input processing module sends the second input event corresponding to the second input operation to the second application, so that the first application responds to the first input event and the second application responds to the second input event.
2. The method as described in claim 1, characterized in that, Before displaying the first interface, the following are included: The second interface is displayed, which includes a first split-screen window and a second split-screen window displayed in a split-screen manner. The first split-screen window includes the main system desktop, and the second split-screen window includes the subsystem desktop. The first interface for display includes: In response to the launch operation of the first application in the main system desktop, the application interface of the first application is displayed on the main system desktop; In response to the launch operation of the second application in the subsystem desktop, the application interface of the second application is displayed on the subsystem desktop.
3. The method as described in claim 1, characterized in that, Sending the first input event corresponding to the first input operation to the first application through the first input processing module includes: The first input processing module generates a first input event corresponding to the first input operation and sends the first input event to the first application. The step of sending the second input event corresponding to the second input operation to the second application through the second input processing module includes: The second input processing module generates a second input event corresponding to the second input operation and sends the second input event to the second application.
4. The method as described in claim 1, characterized in that, The input subsystem also includes an overall input processing module; When the location of the first input operation is within the first screen area where the first split-screen window is located, the first input processing module sends the first input event corresponding to the first input operation to the first application, including: The first input information corresponding to the first input operation is obtained through the overall input processing module. The first input information includes at least the first view coordinates corresponding to the position where the first input operation is performed. If the overall input processing module determines that the location of the first input operation is in the first screen area based on the first view coordinates, then the first input event is sent to the first application through the first input processing module. When the location of the second input operation is within the second screen area where the second split-screen window is located, the second input processing module sends the second input event corresponding to the second input operation to the second application, including: The overall input processing module obtains the second input information corresponding to the second input operation, and the second input information includes at least the second view coordinates corresponding to the position where the second input operation is performed. If the overall input processing module determines, based on the second view coordinates, that the location of the second input operation is within the second screen area, then the second input processing module sends the second input event to the second application.
5. The method as described in claim 1, characterized in that, The first input operation is a first touch operation, the second input operation is a second touch operation, and the operating system further includes a touch screen driver, a touch screen algorithm processing module, a first input driver node, and a second input driver node; When the location of the first input operation is within the first screen area where the first split-screen window is located, the first input processing module sends the first input event corresponding to the first input operation to the first application, including: The touch screen algorithm processing module obtains the first original touch information of the first touch operation reported by the touch screen driver. The first original touch information includes at least the first screen coordinates corresponding to the position of the first touch operation. The first original touch information is processed by the touch screen algorithm processing module to obtain the first input information, which includes at least the first view coordinates corresponding to the first screen coordinates. If the touch screen algorithm processing module determines that the location of the first touch operation is in the first screen area based on the first view coordinates, then the first input information is sent to the first input processing module through the first input driving node. The first input processing module generates the first input event based on the first input information and sends the first input event to the first application. When the location of the second input operation is within the second screen area where the second split-screen window is located, the second input processing module sends the second input event corresponding to the second input operation to the second application, including: The touch screen algorithm processing module obtains the second original touch information of the second touch operation reported by the touch screen driver. The second original touch information includes at least the second screen coordinates corresponding to the position of the first touch operation. The touch screen algorithm processing module generates second input information based on the second original touch information. The second input information includes at least the second view coordinates corresponding to the second screen coordinates. If the touch screen algorithm processing module determines that the location of the second touch operation is in the second screen area based on the second view coordinates, then the second input information is sent to the second input processing module through the second input driving node. The second input processing module generates the second input event based on the second input information and sends the second input event to the second application.
6. The method as described in claim 1, characterized in that, The first input operation is a first touch operation, the second input operation is a second touch operation, and the operating system further includes a touch screen driver, a first touch screen virtual driver, a second touch screen virtual driver, a first touch screen algorithm processing module, a second touch screen algorithm processing module, a first input driver node, and a second input driver node; When the location of the first input operation is within the first screen area where the first split-screen window is located, the first input processing module sends the first input event corresponding to the first input operation to the first application, including: The first original touch information generated by the first touch operation is obtained through the touch screen driver. The first original touch information includes at least the first screen coordinates corresponding to the position of the first touch operation. If the location of the first touch operation is determined to be in the first screen area by the touch screen driver based on the first screen coordinates, then the first original touch information is processed by the first touch screen algorithm processing module to obtain the first input information, wherein the first input information includes at least the first view coordinates corresponding to the first screen coordinates. The first input information is sent to the first input processing module through the first input driver node; The first input processing module generates the first input event based on the first input information and sends the first input event to the first application. When the location of the second input operation is within the second screen area where the second split-screen window is located, the second input processing module sends the second input event corresponding to the second input operation to the second application, including: The second original touch information generated by the second touch operation is obtained through the touch screen driver. The second original touch information includes at least the second screen coordinates corresponding to the position of the second touch operation. If the location of the second touch operation is determined to be in the second screen area by the touch screen driver based on the second screen coordinates, then the second original touch information is processed by the second touch screen algorithm processing module to obtain the second input information. The second input information includes at least the second view coordinates corresponding to the second screen coordinates. The second input information is sent to the second input processing module through the second input driver node; The second input processing module generates the second input event based on the second input information and sends the second input event to the second application.
7. The method as described in claim 1, characterized in that, Before sending the first input event corresponding to the first input operation to the first application through the first input processing module, the method further includes: If the first input operation is determined to be applied to the application interface of the first application by the first input processing module based on the first view coordinates corresponding to the position of the first input operation, the first input event is sent to the first application. Before sending the second input event corresponding to the second input operation to the second application through the second input processing module, the method further includes: If the second input processing module determines that the second input operation is applied to the application interface of the second application based on the second view coordinates corresponding to the position of the second input operation, the second input event is sent to the second application.
8. The method according to any one of claims 1-7, characterized in that, The electronic device is a foldable screen device, and the screen splitting method includes at least: left-right screen splitting or top-bottom screen splitting.
9. The method according to any one of claims 1-7, characterized in that, The screen of the electronic device is a touch screen, and the touch operation includes at least: a click operation, a press operation, or a swipe operation.
10. An electronic device, characterized in that, The electronic device includes: one or more processors, and memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 9.
11. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 9.
Citation Information
Patent Citations
Display method of folding screen and related device
CN112860359A
Method and device for simultaneously operating dual systems
CN112905243A
