Enabling split-screen display on a computing device

Abstract

Described herein is a split-screen technology that allows a user to simultaneously view and interact with the user interfaces of two or more applications. Each of the two or more applications is displayed in a respective portion of two or more sections. A user can activate split-screen mode by opening the split-screen application and selecting the applications to use. Once in split-screen mode, the user can customize the layout by resizing each portion and / or moving applications between portions. Also, once in split-screen mode, the user can share content from one application to another by selecting and dragging the content. Split-screen split mode can also be implemented on foldable devices. Folding the device can be used as a trigger to initiate split-screen mode, and the fold line can be used as a boundary between the portions.

Description

[Technical field]

[0001] The present disclosure relates generally to split screen modes on mobile user devices, and more specifically to techniques for displaying content from multiple applications within separate portions of a user device's display. [Background technology]

[0002] In recent decades, the amount of time spent on screens has increased exponentially. The increase in time spent on screens is related to the increase in the amount of content available to view on screens. In fact, many people have switched from performing everyday tasks in other ways to performing these tasks on screens. For example, instead of going to a bank to perform their usual business, people use banking-related applications to perform the same tasks.

[0003] Another important factor is the increase in screen size and quality. These improvements transform traditional face-to-face activities into on-screen activities. For example, people now do not go to a yoga studio to train, but instead can attend online lessons that are clearly visible on a large screen. So, the technological state has improved significantly and we have changed a lot in our reliance on screens to perform tasks. Summary of the Invention

[0004] [Brief description of the drawings]

[0005] The technology described herein can be better understood by reference to the following specific example portions in conjunction with the accompanying drawing figures, where like reference numbers indicate identical or functionally similar elements. [Figure 1] 1 shows example displays including variations of split screen applications. [Figure 2A]An example menu is shown where a split screen application is located on the display. [Figure 2B] 4 shows an example of a launch menu for selected split-screen applications. [Figure 3A] Here is an example of a custom split screen mode. [Figure 3B] Indicates that the application should move down in split screen mode. [Figure 4A] Here are some examples of where to display the menu presentation in split screen mode. [Figure 4B] An example of a menu in split screen mode is shown below. [Figure 5A] An example of full screen mode is shown below. [Figure 5B] 13 shows an example of split screen mode after exiting full screen mode. [Figure 6] 1 shows an example of content sharing in split screen mode. [Figure 7] 13 shows another example of content sharing in split screen mode. [Figure 8] Here is an example of an alarm generated when content from one application is shared with another application. [Figure 9A] 13 shows an example of how to select content to be displayed in split screen mode from the main screen of a user device. [Figure 9B] 13 shows an example of how a split-screen application icon might look when updated on a user device's main screen. [Figure 9C] Another example shows how to select content to be displayed in split screen mode from the main screen of a user device. [Figure 10A] An example of the initial menu when activating split screen mode is shown below. [Figure 10B] Here's an example of split-screen mode when the user selects "Launch two screens". [Figure 10C] Here's an example of how the split-screen application icon updates when the user selects "Save two screens." [Figure 11A]1 shows an example of a display having multiple split screen applications. [Figure 11B] 1 shows an example of a saved preferences menu. [Figure 12] 13 shows an example of the split screen mode display of saved preferences. [Figure 13A] 13 shows an example layout for bidirectional split-screen mode. [Figure 13B] Here's an example of a three-way split-screen mode layout: [Figure 13C] Here is an example of a 4-way split-screen mode layout. [Figure 14] 1 shows an example of a foldable phone. [Figure 15] FIG. 2 shows a functional block diagram of an exemplary device for implementing split screen mode. [Figure 16] 1 shows a flowchart of a method for implementing a split screen mode. [Figure 17] 1 depicts a high-level block diagram illustrating an example of a mobile system in which at least some operations associated with the techniques described herein may be implemented. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0006] References in the description to "an embodiment," "one embodiment," or the like mean that the particular feature, function, structure, or characteristic described is included in at least one embodiment of the disclosure. Appearances of such phrases in this specification do not necessarily all refer to the same embodiment. On the contrary, referenced embodiments are not necessarily mutually exclusive.

[0007] As mentioned above, time spent on screens has skyrocketed in recent years. The upward trend can be attributed, at least in part, to the increase in capabilities, available content, screen quality, and screen size of popular mobile devices. Users have begun to use their devices for a variety of everyday tasks, such as banking, entertainment, reading, and other activities that did not previously involve time spent on screens. For example, electronic and audio versions of books are available for purchase from online bookstores.

[0008] The increase in time spent on screens has prompted companies to develop more content, allowing users to perform more everyday activities on their devices. For example, banks now have applications that allow online check deposits, money transfers, and other activities traditionally required for banking. In another example, newspapers and magazines have traditionally been copied texts. Now, applications are simulating some of the copied text equivalents.

[0009] Increased time spent on screens also creates problems. Generally, users expect applications to be able to simulate a traditional user experience. For example, this can include simulating the abilities available during a traditional experience, the ability to multitask, and the ability to share content from one source to another. For example, a traditional experience at a bank involves a teller, a calculator, and a user's current bank balance table. To simulate this experience on a device, the bank can develop an application through which the user can access their bank records. However, to perform a transaction, the user may need to access other applications (e.g., a calculator) or the user may need to call a customer service agent. So, to more closely simulate the traditional experience, the user may need to access multiple applications simultaneously.

[0010] In another example, a traditional yoga lesson may include an in-person instructor and music and / or video. In some cases, the yoga instructor may play music or the user may play music and / or video through earphones. An application-based version of a yoga lesson may include a video stream of the yoga instructor that may include background music. However, to simulate the traditional experience and provide the user with the option to listen to their own music, the user would need to have simultaneous access to a music streaming application or video stream.

[0011] Another problem is the need to multitask during screen time. With current technology, users may be limited to operating one application at a time on their mobile devices. However, users may typically want to perform multiple tasks at once. For example, a user may want to simultaneously play a training video and watch a television program. In another example, a user may want to use a browser to search for nearby restaurants while video chatting with a friend. Currently, to perform multitasking, users must open and close different applications at different times.

[0012] Another problem related to the problem of simulating a traditional experience is the need to share content from one source to another. Traditionally, if a user wants to share content from one source to another, the user can copy the content. For example, if a user wants to copy a calendar event from a wall calendar to an email, the user can simply enter the calendar event while inspecting the calendar. Thus, the user can double-check that the content is copied correctly. On mobile devices, this is made more difficult because the user must open a calendar application, memorize the content of the calendar event, open an email application, and type out the content based on memory. In some cases, the user may be able to use copy and paste functionality, but when complex content (e.g., multimedia files) is present, copying and pasting is not as useful.

[0013] Thus, the techniques described herein may be used to modify a user device's display to simultaneously display content from multiple applications while maintaining the functionality of the applications and allowing content to be shared between the applications. More specifically, one or more embodiments of the disclosed techniques may include a split screen display mode that modifies a user device's display by splitting the display into two or more portions and displaying content from each application in a different portion of the two or more portions. The split screen mode may be activated, for example, by opening a split screen application on the user device. In some embodiments, applications that are to be displayed in the split screen mode may be dragged near the split screen application's icon, and once the split screen application is opened, the applications may be selected from a menu or saved as a preference.

[0014] In some examples, the number of portions (e.g., applications) can be changed. For example, a user device can include one split screen application designated for two-way split and another split screen application for three-way split. In another example, a user device can include a split screen application to enable a split screen mode. When a split screen application is opened, a menu can be launched prompting the user to select the number of portions or applications to display.

[0015] In the following description, some embodiments are described from the user side of a split screen application implemented as a smart application ("application"). For example, a user may download a split screen application on their respective device. However, the split screen mode is not limited to being implemented as an application. For example, the split screen mode may be built into an operating system.

[0016] Additionally, the following description uses the example of a mobile device to illustrate various aspects of the technology for purposes of explanation only, but the technology described herein is not limited in its applicability to mobile devices or any other particular type of device, for example, other electronic devices or systems (e.g., laptops or tablets) can employ these technologies in a similar manner.

[0017] Split Screen Applications FIG. 1 illustrates an example display 100 that includes a variation of a split screen application. Display 100 includes a split screen application 102 and a hidden menu 104. Split screen application 102 is an example of two applications with a default number of parts. In particular, one split screen application has two parts by default and another split screen application has three parts by default. The default values ​​indicate to the user how many parts are available in the corresponding split screen mode and further indicate how many applications can be displayed simultaneously when the corresponding split screen application is opened. For example, when opening a "two split" application, the user can see two applications simultaneously.

[0018] Additionally, in some embodiments, the pictorial representation of the split screen application may show a default layout for each section. For example, a "split-in-three" icon may be depicted having a section marked "1" on the left half of the display, and the right half split into "2" and "3". The depicted layout may be the default layout for the split screen application. However, in some embodiments, the user may be able to change the layout. For example, when a user opens the "split-in-three" application, the user may be presented with an option menu of different split-in-three layouts to choose from. In another example, the user may be able to resize the sections. For example, the user may resize section "1" to be the same as section "2" and resize section "3" to occupy the freed space left by resizing section "1".

[0019] Although FIG. 1 depicts split screen application 102 as being located on a screen (e.g., a main screen) of display 100, split screen application 102 may be located elsewhere. For example, split screen application 102 may reside in a hidden menu 104. Hidden menu 104 may be hidden from view except for a portion that overhangs an edge of display 100, or may be automatically hidden on an edge. A user may view a majority of hidden menu 104 by proximate hidden menu 104, for example, using a slide gesture, tap, or other gesture. Once a majority of hidden menu 104 is displayed, split screen application 102 within hidden menu 104 may be displayed to a user.

[0020] In some embodiments, a portion of the hidden menu 104 may always be displayed and activated on the display 100. In other words, a portion of the hidden menu 104 may be displayed regardless of activity displayed on the display 100. Similarly, regardless of activity, a user may activate the hidden menu 104 to display a larger portion of the hidden menu 104. For example, a user may see a browser on the display 100 and the user may activate the hidden menu 104 to open one of the split screen applications 102, without having to close the browser to find the split screen applications 102.

[0021] Thus, the split screen mode can be activated by opening the application. However, although only two variations are shown in FIG. 1, other variations are available as well. For example, a four-part split screen application can be used, which is one-quarter of the display 100. The four-part split screen application can have a default layout that splits the display 100 in two directions, vertically and horizontally, to generate the four parts. Also, the hidden menu 104 is shown as an example for finding another position of the split screen application 102, but other positions are possible. For example, another auto-hide menu can be displayed by a slide gesture from the bottom of the display 100 and / or from the top of the display 100. The split screen application 10 can be present in its menu.

[0022] Menu for launching split screen mode FIG. 2A illustrates an example of a menu 202 where a split screen application is located on display 200. As discussed above, the split screen application can reside anywhere on the user device, where the application is located within menu 202, for example. In some implementations, menu 202 may be a partially hidden menu that is fully displayed when a user performs a gesture (e.g., a two-finger drag gesture). In FIG. 2A, menu 202 is fully displayed and the user can select a split screen application (e.g., three-way). Once the user selects a particular split screen application, a launch menu can be displayed, as shown in FIG. 2B.

[0023] 2B illustrates an example of a launch menu 204. The launch menu 204 may, for example, include a layout of parts for a user to select, including applications to be included in split screen mode, a search bar for the user to search for applications on the device, and a launch button to initialize split screen mode. In some examples, the launch menu 204 may include a list of applications that the user frequently uses, has previously used in split screen mode, and / or has recently used. For example, in FIG. 2B, the user may have recently used a clock application, previously used a notes application in split screen mode, and frequently used a maps application.

[0024] Once the user has selected applications to use in screenshot mode, the user may select "START." In some embodiments, the user may select only the number of applications indicated by the split screen application variation selected by the user. For example, in FIG. 2B, the user may select three applications because the user selected a three part variation. If the user attempts to select more or less than three, an error message may be displayed indicating that the appropriate number has been selected. Once the user has selected the appropriate number, the user may select "START" to enter split screen mode.

[0025] Custom in split screen mode 3A illustrates an example of customization of a split screen mode 300. The split screen mode includes a first application 302, a second application 304, and a third application 306 displayed in three portions (e.g., 1, 2, and 3) of the display. Each application displays a user interface corresponding to the respective portion. For example, in FIG. 3A, before the user performs a drag gesture, the first application 302 displays its user interface in portion 1, the second application 304 displays its content in portion 2, and the third application 306 displays its content in portion 3.

[0026] In some examples, the layout and size of parts 1, 2, and 3 can be changed. For example, a user can drag the bottom border of part 1 up to align it with the bottom border of part 2. In another example, the size of each part can be linked to the size of the application displayed in that part. For example, a first application 302 is displayed within part 1. A user can resize first application 302 using known methods (e.g., dragging the border of the application), and the size of part 1 can be automatically adjusted.

[0027] In some embodiments, when a user adjusts the size of a portion and / or application, the size of the other portions and / or applications may be automatically adjusted to fill the entire display. For example, if a user adjusts the size of portion 1 to be the same as the size of portion 2, the size of portion 3 may be changed to fill the newly created space. Similarly, when a user enlarges portion 2, the size of portions 1, 3, or both may be automatically adjusted to prevent the portions from overlapping.

[0028] Once applications 302, 304, 306 are displayed within portions 1, 2, and 3, respectively, the user may select and move them. For example, FIG. 3A shows the user capturing (e.g., long pressing) and moving the third application 306. In some implementations, when the user drags an application near another portion and / or application (e.g., portion 2 and second application 304), the other portion and / or application may automatically relocate to the previous portion of the dragged application. For example, in FIG. 3A, the user has dragged the third application 306 from portion 3 near the second application 304 and portion 2.

[0029] 3B illustrates moving applications in split screen mode 300. When a user drags a third application 306 near part 2, the second application 304 is automatically relocated to part 3, leaving part 2 empty. The user can then place the third application 306 in part 2. In some embodiments, when applications are relocated to different sized parts, they may automatically adjust in size. For example, when a user drags a third application 306 from part 3 to part 1, the size of the third application 306 may automatically adjust to the size of part 1, and the size of the first application 302 may automatically adjust to part 3.

[0030] The user can activate this repositioning ability by using other common gestures. For example, the user can click on the title bar of the application or perform a long press elsewhere in the application. In another example, the user can flick towards a portion to activate the repositioning. For example, the user can press and flick the third application 306 towards portion 2 with one or more fingers. This causes the second application 304 and the third application 306 to swap positions.

[0031] 4A shows an example of the location of a prompt for a populated menu in split screen mode 400. Split screen mode 400 includes a prompt 402, a title bar 404, and a menu 406. The prompt 402 may be located on the title bar 404 of an application. In some embodiments, for each application in split screen mode 400, the title bar 404 may include similar options and titles. For example, the title bar 404 may include the title of the application (e.g., Inbox) and the prompt 402.

[0032] The prompt 402 may be triggered by a common gesture (e.g., a regular press near or on the prompt 402). When presented, the menu 406 is populated. FIG. 4B shows an example of the menu 406 in split screen mode 400. The menu 406 may include various options related to the split screen mode. For example, the menu 406 includes options to close an application, open a new application, adjust the size of an application (e.g., enlarge it), and enter a different split screen mode.

[0033] Additionally, some options in menu 406 may only affect the corresponding application, while other options may affect the entire split screen mode 400. For example, if the user selects to expand an application, the entire screen may display only that specific application. Or, if the user selects to close an application, only the selected application may be closed (e.g., removed from split screen mode 400). Similarly, if the user selects a different variation of entering split screen mode, the entire current display may change to reflect the change. For example, in FIG. 4B, the current display includes three parts. If the user selects to enter a two part split screen, the user may be prompted to select an application and close it, and the display may change to display the remaining two applications on the same part of the display.

[0034] FIG. 5A illustrates an example of a full screen mode 500A. The full screen mode 500A includes an exit prompt 502. As described in connection with FIG. 4B, if the user selects to scale the application, the application may be resized to fit the entire display. Once in full screen mode 500A, the user may select to exit full screen mode 500A. FIG. 5B illustrates an example of a split screen mode 500B after the user selects to exit full screen mode 500A. If the user selects to exit full screen mode 500A, the display may return to split screen mode 500B containing the same applications and layout previously displayed. For example, if the user selects to transition from three-way mode to full screen mode 500A, the user returns to the same display after exiting full screen mode 500A.

[0035] Content sharing 6 illustrates an example of content sharing in split screen mode 600. Split screen mode 600 includes a calendar 602, an email 604, and a map 606. In some embodiments, a user can transfer content from an application in split screen mode 600 to another application in split screen mode 600. Content can include any data associated with an application. For example, content can be digital, text, multimedia, and / or metadata. For example, a calendar invite for a weekly meeting in email 604 can be dragged into calendar 602.

[0036] In some examples, the user may be prompted to select a method for integrating the shared content into the target application. For example, if the user drags a map from maps 606 to calendar 602, the user may be prompted to select whether the map should be stored in the new calendar event as the location of the event. In another example, if the user drags a map from 606 to email 604, the user may be prompted to select a method for continuing. The next step may include, for example, opening a new email window or adding the map as an email attachment. In some examples, the default method may be selected during the first exchange between the two applications. For example, in FIG. 6, if this is the first instance shared between email 604 and calendar 602, the user may be prompted to select a default behavior for future instances. The user may be prompted to select from multiple options (e.g., adding content to an existing calendar event or creating a new calendar event).

[0037] Once content is placed at a destination, the appearance of split screen mode 600 can change to indicate that the destination has received the content. Figure 7 shows the changes in split screen mode 700 when content is placed at a destination. For example, the destination can change color to highlight the shared content or the destination can change size to indicate that it has received the content.

[0038] 8 illustrates an example of an alarm 802 on a display 800 when content from one application is received by another application. In some embodiments, the alert may include an indication that the content was successfully sent. For example, the alert 802 may include a content segment and a check mark. In some embodiments, if the shared content was not successfully transferred, the alert 802 may include, for example, an "X" or may prompt the user to try again.

[0039] Split screen icon appearance FIG. 9A illustrates an example of how content to be displayed in split screen mode may be selected from a main screen 900 of a user device. The main screen 900 includes a two-split icon 902. In some examples, a user may select another application (e.g., photos) and drag it near the two-split icon 902 to use the other application in split screen mode. When the other application is placed on or near the two-split icon 902, the user may receive an indication that the other application will be displayed when split screen mode is activated. In some examples, the appearance of the split screen application icon may be updated with an indicator 904, as shown in FIG. 9B.

[0040] For example, indicator 904 may be filled on the edge of bi-split icon 902 to indicate the number of applications that will be displayed when split screen mode is active. For example, in FIG. 9B, a user has dragged an application (e.g., Photos) for use in split screen mode. Thus, indicator 904 displays "1." If another application (e.g., Notes) is dragged and placed near or on bi-split icon 902, the indicator may reflect that change.

[0041] For example, FIG. 9C illustrates another example of how an indicator may be updated after selecting another application. In particular, the updated indicator 906 displays a "2" after the notes application is dragged and placed near or on the two-split icon. In some embodiments, once the maximum number of applications is selected, the user may not be able to drag or drop another application. For example, the split screen mode that is activated when the two-split icon 902 is opened may have a maximum of two applications that may be displayed simultaneously. Thus, if the user attempts to drag or drop a third application, this action may not be accepted. In some embodiments, if the user selects more than the maximum number, the user may be prompted to select a delete application. For example, in FIG. 9C, if the user attempts to drag or drop the health application near or on the two-split icon, the user may be prompted to delete the photo application or the notes application.

[0042] Activate split screen mode and save preferences 10A illustrates an example of a menu 1002 that opens when split screen mode is activated on display 1000. When a user activates (e.g., clicks on) a split screen application, the menu 1002 may be populated and open. The opening menu 1002 may include, for example, the number of portions to select for the user, options for the application to display in split screen mode, and / or options for the user to continue by saving or activating split screen mode.

[0043] In some embodiments, the user may select the number of portions. For example, in FIG. 10A, the user has selected to have two screens (e.g., portions). In another example, a drop-down menu may be used to select a different number of portions. Once the number of portions is selected, the user may select applications to use in split screen mode, for example, by using a drop-down menu or an application list (e.g., similar to launch 204). As previously discussed, the maximum number of selectable applications may be the same as the number of portions selected. If the user selects more or fewer applications than the number of portions, the user may be prompted to edit their selection.

[0044] After selecting an application, the user can choose to activate split screen mode or save the selection as a default setting. FIG. 10B illustrates an example of split screen mode when the user selects "Activate Two Screens." In some embodiments, when the user selects to activate split screen mode, the selection made by the user in the opened menu 1002 is reflected in the split screen view 1004. In FIG. 10B, for example, "Kitchen Recipes" and "TV" are simultaneously displayed in the split screen view 1004.

[0045] Or, the user may choose to save the selection as a default setting. FIG. 10C illustrates an example of the updated appearance of the split screen application icon when the user selects "Save Two Screens." In some embodiments, if the user selects to save two screens, the selection the user made upon opening menu 1002 may be saved as the default or preferred option. In other words, each time the split screen application is opened, it may reflect the selection made upon opening menu 1002 (e.g., split screen view 1004).

[0046] In some embodiments, when a user selects to save a selection on the open menu 1002, a custom icon can be generated. The save option allows a user to generate multiple applications for each preference. For example, icon 1006 can be marked "cooking" which can indicate that the user prefers split screen view 1004 when cooking. In another example, a user can save different preferences for each activity (e.g., working out or reading). For example, a user can save "health" or "music" as the user's default settings when working out, rather than "kitchen recipes" or "television."

[0047] The appearance of the custom icon may include a collage of visual prompts associated with the selected applications. For example, in FIG. 10C, icon 1006 may be a custom icon generated based on a user's selection. As shown in FIG. 10A, the user's selection is a kitchen recipes application and a television application. FIG. 10A also shows a collage of visual prompts showing each selected application. The visual prompts may be incorporated into the appearance of icon 1006. In this case, the left side of icon 1006 includes visual prompts associated with the kitchen recipes application, and the right side of icon 1006 includes visual prompts associated with the television application. Similarly, when a different number of applications are selected, a custom icon may be generated using an icon that includes visual prompts associated with the selected applications. For example, when four applications are selected, the newly generated custom icon may be divided into quadrants that include visual prompts associated with one of the four selected applications.

[0048] In some embodiments, the custom icon may be a shortcut that has the appearance of an application and can automatically launch a split screen mode (as described herein) where the user selected application is the default setting. For example, if the user selects icon 1006, the system may open the split screen mode depicted in FIG. 10B. In other words, each time icon 1006 is launched, the corresponding split screen mode will include the selected application. In FIG. 10B, the user has selected to save a split screen view with a kitchen recipes application and a television application. Thus, when icon 1006 is launched, the corresponding split screen mode will include a kitchen recipes application and a television application.

[0049] FIG. 11A illustrates an example of a display 1100 having multiple split screen applications. The display 1100 includes a three-split icon 1102. In some embodiments, when a user selects the three-split icon 1102, the user may be prompted to select from a list of previously saved preferences for split screen displays. FIG. 11B illustrates an example of a saved preferences menu 1104. The saved preferences menu 1104 includes a list of split screen layouts and applications that the user has previously saved. For example, the user may have several previously saved preferences (e.g., yoga, exercise, travel). In some embodiments, the user may also choose to create a new preference. If the user selects this option, the user may be prompted to select a layout and application in a different menu (e.g., similar to the launch menu 204 and open menu 1002).

[0050] When a user selects a preference, the split screen mode for that preference can be displayed. Figure 12 shows an example of a display 1200 of a split screen mode for a saved preference 1202. The user may have selected, for example, a "yoga" preference. Thus, the display 1200 includes yoga videos, health applications, and digital books. If the user selects a different preference, the applications, layout, number of splits, and other factors can change to reflect the preference.

[0051] Layout In general, the layout of the split screen mode can be changed according to user preferences, and the size of the split screen mode layout can be adjusted. The number of portions in the split screen mode can determine how many applications can be used. For example, a two-screen split cannot accommodate more than two applications. FIG. 13A shows an example of a display 1300 having a layout of a two-screen split mode 1302. In some embodiments, the two-screen split mode 1302 can be split horizontally such that the top half of the display 1300 is one portion and the bottom is another portion. In some embodiments, the size of each portion can be changed, for example, by clicking and dragging the border of the portion.

[0052] Similarly, Figure 13B illustrates an example layout for a three-screen split mode 1304. As previously discussed, the three portions of the three-screen split mode 1304 can be varied. For example, the largest portion can be located at the top of the display 1300 or on the left side of the display 1300. In some embodiments, the display 1300 can be split vertically or horizontally into three equal portions. For example, each of the three portions can extend from the left to the right side of the display 1300 such that each portion is below or above the other portions.

[0053] 13C shows an example layout of a 4-screen split mode 1306. The 4-screen split mode 1306 can also be modified to change the size of the 4-screen split mode 1306 depending on preferences. For example, the portions can be stacked on top of each other or adjacent to each other. In another example, the vertical boundary between the left side of the display 1300 and the right side of the display 1300 can be moved so that two portions are larger than the other two portions. Similarly, the horizontal boundary can be moved so that the top two portions are larger or smaller than the bottom two portions.

[0054] Foldable Phone FIG. 14 illustrates an example of a foldable phone 1400. In some cases, the techniques disclosed herein can be implemented on a foldable phone 1400 having a folding joint 1402. In some embodiments, the folding joint 1402 can be used as a spacer between each part in a split screen mode. For example, in a two-part screen split, the folding joint 1402 can form a fold line that extends vertically downward from the folding joint 1402. The fold line can provide a first part on the left side of the screen and a second part on the right side of the screen.

[0055] In some embodiments, the degree to which foldable phone 1400 is folded affects the split screen mode. For example, if foldable phone 1400 is folded such that the user can see the entire screen without turning the phone, the split screen mode can be displayed on the entire screen. Conversely, if foldable phone 1400 is folded such that one side of the foldable device touches the other side, the split screen mode can be displayed on only one side. For example, if a user holds foldable phone 1400 and folds it completely, one side of the screen may abut against the user's hand and the other side of the screen may be facing the user. Thus, the split screen mode can be displayed on the side facing the user.

[0056] In some embodiments, user preferences can dictate the layout of a split screen mode on foldable phone 1400. For example, a user can save a preferred layout (e.g., using saved preferences menu 1104) for use with foldable phone 1400. For example, preferences can be based on activation. A user can save a preference called "Laptop Computer" where foldable phone 1400 is folded to simulate a laptop computer. In the laptop layout, a user can display a keyboard application on one half of the screen and a notes application on the other half. Similarly, a user can have another preference marked "Gaming" where one half of the screen has video game controls (such as arrow keys) and the other half of the screen displays the game.

[0057] In some embodiments, actuation of folding joint 1402 can be used as a trigger for initiating a split screen mode. For example, when a user folds foldable phone 1400, the user can be prompted to select from the options described in connection with opening activation menu 204 and / or menu 1002. Thus, the split screen modes described herein can be implemented on foldable phone 1400.

[0058] Exemplary System Components FIG. 15 shows a functional block diagram of an example split screen implementation device 1500 that may be used to implement the screen separation techniques described herein.

[0059] An exemplary split-screen implementation device 1500 may be implemented and executed within a user's mobile device (e.g., a foldable phone 1400). As shown in FIG. 15, the split-screen implementation device 1500 may include a screen 1510, a touch detection system 1520, a display system 1530, and a folding system 1540. It should be noted that the components shown in FIG. 15 are merely exemplary. For simplicity, some known components such as a central processor unit (CPU), memory modules, communication circuits, etc. are not shown. One or more systems, subsystems, components, and / or modules described herein may be implemented to include software applications, or software applications, but any suitable combination of these systems / subsystems / modules may be implemented as hardware or firmware components to achieve the same or similar functions. Similarly, the exemplary components in FIG. 15 are shown to facilitate discussion herein. Components may be combined or divided depending on the actual implementation.

[0060] According to some embodiments, split screen implementation device 1500 may be activated when a user receives an indication that they wish to activate split screen mode. In some embodiments, an application programming interface (API) may be implemented in device 1500 such that it may receive software function calls (e.g., from a software application) as instructions. In some embodiments, device 1500 may be implemented as part of a set of functions provided to an operating system (OS), as a system software library, or the like. In some embodiments, device 1500 may be a separate piece of software residing in memory.

[0061] When the device 1500 receives an instruction to enter split screen mode, the device 1500 determines a next step. In general, the next step described herein may depend on the type of instruction provided by the user. In some examples, the next step may include generating a menu (e.g., the launch menu 204, the open menu 1002, or the saved preferences menu 1104). In some examples, the next step may include displaying a saved layout, as shown in FIG. 12.

[0062] The touch detection system 1520 can provide detailed information about the type of command provided by the user. The touch detection system 1520 can detect which portion of the screen 1510 the user touches or selects. The device 1500 can determine the next step depending on the location of the user's contact. In particular, the selection detector 1524 can determine when the user makes a selection. The drag detector 1522 can determine when the user clicks and drags content. The edge detector 1526 can detect usage activity and content near the edges of the screen (e.g., hidden menus 104).

[0063] In general, the display system 1530 can analyze data from the touch detection system 1520 and generate appropriate instructions to display content on the screen 1510. For example, if the device 1500 determines that a menu should be displayed based on the location of the user's touch, the display system 1530 can generate instructions to display the menu on the screen 1510. In another example, if the user touches an area of ​​the screen 1510 near a split screen application (e.g., split screen application 102), the device 1500 can instruct the display system 1530 to generate a menu. Or, if the user selects a saved layout (e.g., icon 1006), the display system 1530 can generate the saved layout. In another example, if the drag detector 1522 detects that the user has dragged an application near a split screen icon, the device 1500 can instruct the display system 1530 to change the appearance of the icon to include an indicator (e.g., indicator 904).

[0064] A folding system 1540 that is part of a foldable device can be used to provide input to the device 1500. A folding detector 1542 can detect when a user folds a folding device. Data from the folding system 1540 can be used, for example, to determine how a split screen mode is displayed. For example, the folding detector 1542 can provide data that the user has folded such that some data on the device is not visible to the user. The folding system 1540 can provide this data to the device 1500. The device 1500 can instruct the display system 1530 to change the display such that only the portion of the screen 1510 visible to the user displays the split screen mode. For example, the folding system 1540 can determine that only the right screen 1514 or only the left screen 1512 is visible to the user, and thus the display system 1530 can provide instructions accordingly.

[0065] method 16 shows a flowchart illustrating an example method 1600 for implementing a split screen mode. The method 1600 can be implemented by various components of a device (e.g., the split screen implementation device 1500) capable of executing instructions to adapt the device's screen to display content based on user input. For example, the device can be any device that includes a processor and a memory having instructions executable by the processor.

[0066] First, at block 1610, the device may detect an instruction to initiate a split screen mode based on two or more applications being dragged to a designated area on the device's screen to be included in the split screen mode. In some examples, the designated area on the device screen may be an icon on the main screen or in an application menu that represents the split screen mode, e.g., block 1612. In another example, at block 1614, the predefined shape may be located at an edge or corner of the screen (e.g., hidden menu 104). In some examples, if the device is a foldable device, detecting the instruction to initiate the split screen mode may be based on a folding action of the foldable device.

[0067] Furthermore, when the device detects that the application has been dragged into the designated area, the device may display an interface having at least two icons, each icon representing a different variation of the split screen mode, to allow the user to select a desired variation. Each variation of the split screen mode may have a different number of display portions for the split screen display. For example, the available variations of the split screen mode may include a first variation having two display portions for the split screen display and a second variation having three display portions for the split screen display.

[0068] Next, in block 1620, in response to the instruction to activate the split screen mode, the device may cause a respective user interface to be displayed in a different display portion of the device screen for each of the set of applications selected from the two or more applications. For example, the display portions may be separated from adjacent display portions via a fold line based on the location of the fold line of the foldable device. In some examples, after receiving the instruction to activate the split screen mode, the device may trigger an interface to be displayed on the screen before causing each application to display its user interface, where the user selection interface prompts a user of the device to select which of the two or more applications to include in the set of applications. The user selection interface may be triggered, for example, when a predetermined number of applications are dragged into the designated area. For example, the predetermined number may be two or three, or may be based on a split screen application variation (e.g., split screen application 102).

[0069] In some examples, when the device detects that the user has selected a set of applications, the device can prompt the user to save the set of applications as a default set. If the user selects and saves the set of applications as a default setting, in some examples, the device can generate a custom icon. The appearance of the custom icon can include a collage of visual prompts (e.g., icon 1006 of FIG. 10C) that indicate each application in the set of applications. Additionally, when the user launches (e.g., opens) the custom icon, the device can display the set of applications in a split-screen mode.

[0070] In some examples, a user may provide input of a desired change including a size, shape, and / or position of the display portion. The display portion may then be adjusted based on the input. In some examples, the input includes changing the display portion to enter or exit full screen. In some examples, the input includes dragging a screen splitter line that separates the display portion from an adjacent display portion. Based on the dragging of the screen splitter line, the device may adjust the adjacent display portion to complement and adjust the display portion. In some examples, the input includes dragging a first display portion and dropping it onto a second display portion. The device may then swap the display position and size between the first display portion and the second display portion.

[0071] In some examples, the device can receive a drag of an object from a user from a first display portion to a second display portion, where each display portion corresponds to a different application. In response to the drag of the object, the device can also cause information of the object to be communicated from an application associated with the first display portion to another application associated with the second display portion. The communicated information of the object can include an indication of where the object is located in a specific position within the second display portion. Additionally, the device can detect that a drag operation is being performed over a designated area, thereby allowing the user to adjust the position of the designated area relative to the screen.

[0072] Computer System and Device Architecture 17 is a block diagram illustrating an example of a computing system 1700 in which at least some of the operations described herein may be implemented. For example, some components of the computing system 1700 may be used to implement a computing device (e.g., the foldable device 1400 of FIG. 14) that includes a split-screen implementation device (e.g., the split-screen implementation device 1500 of FIG. 15).

[0073] The computing system 1700 includes one or more central processing units (also referred to as "processors") 1702, main memory 1706, non-volatile memory 1710, network adapter 1712 (e.g., a network interface), video display 1718, input / output devices 1720, control devices 1722 (e.g., keyboard and pointing device), drives 1724 including storage media 1726, and signal generators 1730. The bus 1716 is illustrated as an abstraction representing one or more physical buses and / or point-to-point connections connected through appropriate bridges, adapters, or controllers. Thus, the bus 1716 may include a system bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express bus, a SuperTransport or Industry Standard Architecture (ISA) bus, a Small Computer System Interface (SCSI) bus, a Universal Serial Bus (USB), an IIC (I2C) bus, or an Institute of Electrical, Gas and Electronics Engineers (IEEE) standard 1394 bus (also known as “Firewire”).

[0074] Computing system 1700 shares a similar computer processor architecture with a personal computer, a tablet computer, a mobile phone, a game console, a music player, a wearable electronic (e.g., a watch or health tracker), a network-connected ("smart") device (e.g., a television or home assistant device), a virtual / augmented reality system (e.g., a head-mounted display), or other electronic device that can execute (sequentially or otherwise) instructions that specify one or more operations performed by computing system 1700.

[0075] Although main memory 1706, non-volatile memory 1710, and storage medium 1726 (also referred to as "machine-readable medium") are depicted as single media, the terms "machine-readable medium" and "storage medium" should be considered to include a single medium or multiple media (e.g., centralized / distributed databases and / or associated caches and servers) that store one or more sets of instructions 1728. The terms "machine-readable medium" and "storage medium" should be considered to include any medium that can store, encode, or carry instructions for execution by computing system 1700.

[0076] Generally, the routines executed to implement embodiments of the disclosed content are implemented as part of an operating system or as a specific application, component, program, object, module, or sequence of instructions (collectively referred to as a "computer program"). A computer program generally includes one or more instructions (e.g., instructions 1704, 1708, 1728) configured at various times in various memories and storage devices within a computing device. The one or more instructions, when read and executed by one or more processors 1702, cause the computing system 1700 to perform operations to execute elements related to various aspects of the published content.

[0077] Moreover, while the embodiments are described in the context of a fully-functional computing device, those skilled in the art will appreciate that the embodiments may be distributed as program products in a variety of forms, and the disclosure applies regardless of the particular type of machine-readable or computer-readable medium used in the actual distribution of effects.

[0078] Other examples of machine-readable storage devices, machine-readable media, or computer-readable media include volatile and non-volatile memory 1710, floppy disks and other removable disks, hard disk drives, optical disks (e.g., compact disk-read only memory (CD-ROM), digital versatile disks (DVD)), and transmission-type media such as digital and analog communications links.

[0079] The network adapter 1712 enables the computing system 1700 to coordinate data within a network 1714 to entities external to the computing system 1700 via any communication protocol supported by the computing system 1700 and the external entities. The network adapter 1712 may include a network adapter card, a wireless network interface card, a router, an access point, a wireless router, a switch, a multi-layer switch, a protocol converter, a gateway, a bridge, a bridge router, a hub, a digital media receiver, and / or a repeater.

[0080] Network adapter 1712 may include a firewall that controls and / or manages the authorization of data within an access / proxy computer network and tracks different trust levels between different machines and / or applications. A firewall may be any number of modules having any combination of hardware and / or software components that can enforce a set of predefined access rights (e.g., to regulate the process of traffic and resource sharing between these entities) between a particular set of machines and applications, between machines and / or between applications. A firewall may also manage access rights with access control lists and / or access control lists that detail the permissions that apply to access and operation privileges to individuals, machines, and / or objects, and the circumstances under which the authorization privileges are valid.

[0081] The techniques described herein may be implemented with programmable circuitry (e.g., one or more microprocessors), software and / or firmware, dedicated hardwired (i.e., non-programmable) circuitry, or a combination of these forms. The dedicated circuitry may be in the form of one or more application specific integrated circuits (ASICs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), etc.

[0082] remarks The foregoing description of various embodiments of the subject matter for which protection is sought has been provided for purposes of illustration and description. The foregoing description is not intended to exhaust the subject matter for which protection is sought or to limit the subject matter for which protection is sought to the precise form disclosed. Many modifications and variations will become apparent to those skilled in the art. By selecting and describing the embodiments in order to best explain the principles of the invention and its practical application, those skilled in the relevant art will be able to appreciate the subject matter for which protection is sought, its various embodiments, and various modifications suited to the particular use envisaged.

[0083] Although the specific embodiments describe the specific embodiments and best modes envisioned, the technology can be implemented in many ways, regardless of how detailed the specific embodiments are shown. The embodiments can vary considerably in terms of implementation details, while still being covered by the specification. Specific terms used in describing some features or aspects of the various embodiments should not be considered to suggest that the terms are redefined herein and are limited to any particular feature, characteristic, or aspect of the technology to which the terms relate. In general, the terms used in the appended claims should not be interpreted as limiting the technology to the specific embodiments disclosed in the specification, unless those terms are expressly defined herein. Thus, the actual scope of the technology covers not only the disclosed embodiments, but also all equivalent ways of implementing the embodiments or embodiments.

[0084] The language used herein has been selected primarily for purposes of readability and instruction; it may not have been selected to delineate or limit the subject matter. Accordingly, it is intended that the scope of the technology be limited not by its specific embodiments, but by any claims issued thereon in the application. Accordingly, the disclosure of various embodiments is intended to illustrate the scope of the technology as set forth in the appended claims, rather than to limit the scope of the technology.

Claims

1. Based on two or more applications being dragged by a user of a device to a designated area of ​​a screen of the device to be included in a split-screen mode, the device detects an instruction to activate the split-screen mode; and in response to the instruction to initiate the split screen mode, for each of the two or more applications, displaying a respective user interface on a different display portion of a screen of the device; The designated area is an on-screen icon representing the screen split mode.

13. A method for split-screen display of multiple applications, comprising:

2. and in response to the two or more applications being dragged to the designated area, presenting the two or more applications to a user of the device to save as a default set. The method for split-screen display of multiple applications according to claim 1 .

3. generating a custom icon in response to the user selecting to save the two or more applications as the default set. The method for split-screen display of multiple applications according to claim 2.

4. The custom icon is configured to enter the split screen mode with the applications saved as the default set upon launch. The method for split-screen display of multiple applications according to claim 3.

5. The appearance of the custom icon includes a collage of visual prompts representing each application within the two or more applications. The method for split-screen display of multiple applications according to claim 3.

6. The icon is one of at least two icons displayed on the screen; Each icon of the at least two icons represents a different variation of the split screen mode. The method for split-screen display of multiple applications according to claim 1 .

7. Each variation of the split screen mode has a different number of display portions for the split screen display. The method for split-screen display of multiple applications according to claim 6.

8. receiving input from the user, the input including a desired change to a size, shape and / or position of a display portion; adjusting the displayed portion based on the input; The input includes dragging a first display portion and dropping it onto a second display portion; The adjustment includes swapping a position and a size of a display between the first display portion and the second display portion. The method for split-screen display of multiple applications according to claim 1 .

9. receiving a drag of an object from the user from a first display portion to a second display portion, each display portion corresponding to a different application; In response to the dragging of the object, an application associated with the first display portion communicates information about the object to another application associated with the second display portion. The method for split-screen display of multiple applications according to claim 1 .

10. The communicated information about the object includes an indication that the object is to be located at a particular position within the second display portion. The method for split-screen display of multiple applications according to claim 9.

11. The device includes a foldable display having a fold line, and at least one screen dividing line separating a display portion from an adjacent display portion is at the fold line. The method for split-screen display of multiple applications according to claim 1 .

12. A device comprising a processor and a memory, instructions stored in said memory; The instructions, when executed by the processor, cause the device to: detecting an instruction to activate the split screen mode based on two or more applications being dragged by a user of the device into a designated area of ​​a screen of the device for inclusion in the split screen mode; in response to the instructions to activate the split screen mode, causing each of the two or more applications to display a corresponding user interface on a different display portion of a screen of the device; The designated area is an on-screen icon representing the screen split mode. A device characterized in that

13. A non-transitory computer-readable medium containing instructions, comprising: When the instructions are executed on a computer system, the computer system detecting an instruction to activate the split screen mode based on two or more applications being dragged by a user of the device to a designated area of ​​a screen of the device to be included in the split screen mode; in response to the instructions to activate the split screen mode, causing each of the two or more applications to display a corresponding user interface on a different display portion of a screen of the device; The designated area is an on-screen icon representing the screen split mode. A non-transitory computer-readable medium comprising:

Images