Triggering split screen mode for companion generative AI application in mobile device

Abstract

Techniques involve triggering a split screen mode of a computing environment in response to an indication that a display aspect of the computing environment has changed. In the first part of the split-screen mode, displaying an interface for the main application; in a second portion of the split screen mode, an interface for the companion application is displayed. In some implementations, an icon representing the companion application is displayed in the second portion prior to displaying the interface for the companion application; the user may point to or click the icon to launch the companion application.

Description

[0001] Cross Reference to Related Applications

[0002] This application is a continuation of and claims priority to U.S. Non-Provisional Patent Application No. 18 / 235,148, filed August 17, 2023, entitled “TRIGGERING DIVIDED SCREEN MODES FOR COMPANION GENERATIVE AI APPLICATIONS IN MOBILE DEVICES,” the disclosure of which is incorporated by reference herein in its entirety. TECHNICAL FIELD

[0003] This specification generally relates to using generative AI models in mobile devices. BACKGROUND

[0004] Generative artificial intelligence (GAI) applications have rapidly come into use in many software platforms, such as large language models (LLMs) used in conjunction with search applications. For example, a user can take a photo of an object that the user is not familiar with. The user can then use the photo in a search application that supports an LLM to obtain information about the object. As other examples, GAI can be used to generate images from user prompts or provide conversational-type responses to user prompts. SUMMARY

[0005] This improvement is directed to a companion application that provides generative AI assistance for various applications (e.g., search, social media, productivity tools) and is triggered under certain conditions. For example, the companion application can be configured to perform generative artificial intelligence (GAI), including large language model (LLM) operations, to service an application, such as a search application, operating system, document authoring application (e.g., formatting a text document, spreadsheet, slide presentation document, etc.), browser, etc., which is referred to as a host application. Depending on the form factor of the device, the companion application can be triggered in various ways. For example, in a foldable smartphone device, when the user unfolds the phone, a selectable icon can be surfaced, and in response to the user’s selection of the icon, the screen can be divided, with the companion application running in a portion of the divided screen. The foldable phone can remove the companion application user interface. Similarly, if the display is rotated from portrait mode to landscape mode, a selectable icon can be surfaced, and upon rotating back to portrait mode, the companion application user interface is removed. As another example, a selectable icon can be surfaced in response to the user bringing a first device in proximity to a second device, e.g., such as bringing a smart watch, smart glasses, or smart phone in proximity to a tablet or laptop computer. In such implementations, selection of the icon can open the companion application on the first device. Surfacing a selectable icon to launch the companion application reduces user input for finding and launching the companion application. Additionally, because the companion application occupies display space of the host application, implementations intelligently surface the selectable icon of the companion application; for example, surfacing the selectable icon when the display aspect has changed. Changes in the display aspect include changes in the width of the display area, e.g., unfolding the phone, rotating to landscape mode, bringing the first device in proximity to the second device. In some implementations, the selectable icon is optional, and in such implementations, the companion app can open automatically in a portion of the divided screen.

[0006] In one general aspect, a method includes receiving an indication that a display aspect of a computing environment has changed, the computing environment including a display of a host application. The method also includes, in response to the indication, triggering a divided screen mode of the computing environment, the divided screen mode including a first portion and a second portion. The method further includes displaying an interface of the host application in the first portion. The method further includes displaying an interface of a companion application in the second portion.

[0007] In another general aspect, a computer program product includes a non-transitory storage medium including code that, when executed by processing circuitry, causes the processing circuitry to perform a method. The method includes receiving an indication that a display aspect of a computing environment has changed, the computing environment including a display of a primary application. The method also includes triggering a split-screen mode of the computing environment in response to the indication, the split-screen mode including a first portion and a second portion. The method further includes displaying an interface of the primary application in the first portion. The method further includes displaying an interface of a companion application in the second portion.

[0008] In another general aspect, an electronic device includes a memory and processing circuitry coupled to the memory. The processing circuitry is configured to receive an indication that a display aspect of a computing environment has changed, the computing environment including a display of a primary application. The processing circuitry is also configured to trigger a split-screen mode of the computing environment in response to the indication, the split-screen mode including a first portion and a second portion. The processing circuitry is further configured to display an interface of the primary application in the first portion. The processing circuitry is further configured to display an interface of a companion application in the second portion.

[0009] The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features will be apparent from the description and drawings, and from the claims. BRIEF DESCRIPTION OF DRAWINGS

[0010] Figures 1A-1C is an illustration showing an example trigger of a split-screen mode in a foldable phone according to implementations described herein.

[0011] Figures 2A-2C is an illustration showing an example trigger of a split-screen mode in a mobile device according to implementations described herein.

[0012] Figures 3A-3C is an illustration showing an example trigger of a split-screen mode in a mobile device via a desktop computer according to implementations described herein.

[0013] Figure 4 is an illustration showing an example electronic environment for performing implementations described herein.

[0014] Figure 5 is a flowchart showing an example method for triggering a companion application in a device according to implementations described herein. DETAILED DESCRIPTION

[0015] Generative artificial intelligence (GAI) has rapidly come into use on many software platforms. As one example, GAI used in large language models (LLMs) can be integrated with search applications.

[0016] A technical problem with GAI applications is that such applications are not necessarily integrated into the software applications with which they work. Thus, it can be difficult to use them in conjunction with a separate software application on a device. For example, a user can wish to use the output of a GAI module with another application, but this is difficult because the user must close the other application in order to use the GAI output.

[0017] At least one technical solution to the above technical problem involves triggering a split screen mode of a computing environment in response to an indication that a display aspect of the computing environment has changed. In a first portion of the split screen mode, an interface for a primary application is displayed; in a second portion of the split screen mode, an interface for a companion application is displayed. In some implementations, an icon representing the companion application is displayed in the second portion prior to displaying the interface for the companion application; a user can point to or click on the icon to launch the companion application.

[0018] In the context of the technical solution, the companion application is an application that provides GAI features, while the primary application involves other non-GAI features. In some implementations, the primary application provides input for the companion application. For example, a camera application provides a photo for input into a GAI companion application. In some implementations, the companion application provides input for the primary application. For example, a GAI-enabled search application can generate search results for input into a map application.

[0019] A technical advantage of this technical solution is that the user does not need to close the primary application in order to use the companion application. Instead, the user can view the interface of both applications simultaneously.

[0020] Another technical problem with GAI functionality is that the user interface (e.g., especially the prompt interface for conversational LLMs) can occupy a large area of the display, making it difficult for the user to use / view the interface of the primary application. The intelligent surfacing of the companion application based on changes in display aspects provides a technical solution that minimizes disruption of the interface of the primary application. Triggering the companion application based on changes in display aspects provides a better experience for the user because the changes in display aspects enable the system to provide the companion application interface alongside the primary application interface, where the primary application interface is presented as it was prior to the change in display aspects. In other words, when the display aspect changes, the interface of the primary application can be moved into the first portion of the split screen, while the second portion of the split screen is left for the companion application. This intelligent surfacing reduces the user input required to utilize the companion application while minimizing disruption of the primary application.

[0021] In one example, a person can wish to perform a search for an object that does not yet exist; the person can unfold a foldable smartphone that is currently executing a search application (e.g., a search web application running in a browser tab, etc.), which causes selectable icons to appear. In response to selection of an icon, a companion application can open in a portion of the unfolded display, enabling the person to describe the object to the companion application (e.g., via textual or voice prompts), which causes the companion application to generate an image of the object. The companion application then provides the image to the search application running concurrently with the companion application. In another example, a person currently executing a word processing application can wish to summarize a meeting. The person can rotate a tablet computer (or bring their phone close to a laptop, etc.), which causes a companion app to open with the word processing application. The person can ask (e.g., via a prompt) the companion to analyze a recording of the meeting and enter a summary of the meeting into the word processing application. The companion application can bring generative AI assistance to any application.

[0022] Figures 1A-1C is an illustration showing example triggers for split screen mode in foldable device 100. Foldable device 100 is a mobile device that operates in two modes: folded and unfolded. When foldable device 100 is unfolded to the unfolded mode, the aspect ratio of foldable device 100 changes based on the transition of foldable device 100 from the folded mode to the unfolded mode. In the unfolded mode, as shown in Figure 1A In the folded mode, foldable device 100 can have an aspect ratio typical of mobile devices. The aspect ratio of a typical mobile device has a limited display area. In this folded mode, foldable device 100 can display either the primary application or the companion application, but not both in their entirety. In Figure 1A In, foldable device 100 displays the entirety of primary application 110 in the folded mode.

[0023] Figure 1Bis an illustration showing the foldable device 100 in an open mode. When the foldable device 100 is unfolded, an indication of the change from the folded mode to the open mode is sent to the processing circuitry of the foldable device 100. The change from the folded mode to the open mode is an example of a change in display aspect. Upon receiving the indication, the processing circuitry can trigger a split screen mode of the foldable device 100. In some implementations, the split is at the fold of the foldable device 100. On a first portion of the split screen mode, an interface of the primary application 110 is displayed. On a second portion of the split screen mode, a selectable control is displayed, e.g., a prompt 120 for a companion application. In some implementations, the prompt 120 takes the form of an icon that, when selected by the user, launches the companion application 130 in the second portion, i.e., displays a prompt interface for the companion application 130 in the second portion. In some implementations, the prompt 120 is the prompt interface. The prompt interface for the companion application 130 includes an input field (e.g., a text input box, a file drop location, etc.) in which the user can provide a prompt to a model associated with the companion application 130.

[0024] Figure 1C is an illustration showing the foldable device 100 in an open mode but with the prompt 120 having been replied to. Thus, the foldable device 100 is in a split screen mode with a first portion displaying an interface for the primary application 110 and a second portion displaying an interface for the companion application 130.

[0025] In some implementations, the companion application 130 is configured to generate an output that can be provided as input to the primary application 110. In some implementations, the companion application runs as part of an operating system under which the primary application 110 runs. In some implementations, the companion application 130 can be closed or sent to the background in response to the device 100 changing from the open mode to the folded mode.

[0026] Figures 2A-2C is an illustration showing an example trigger of a split screen mode in the mobile device 200. The mobile device 200 can be in one of two modes defined by the aspect ratio of the screen: portrait or landscape. The aspect ratio is an example of a display aspect. When the mobile device 200 is rotated, the aspect ratio of the mobile device 200, i.e., the display aspect, changes based on the mobile device 200 transitioning from the portrait mode to the landscape mode. In the portrait mode, the length of the screen is greater than the width; in the landscape mode, the width of the screen is greater than the length. In a conventional mobile device, one application is displayed at a time, regardless of whether the mobile device 200 is in the portrait mode or the landscape mode. In the split screen mode, two applications are displayed at the same time. Figure 2A In, the mobile device 200 is shown displaying the primary application 210 in the portrait mode.

[0027] Figure 2Bis an illustration showing mobile device 200 in landscape mode. When mobile device 200 switches from portrait mode to landscape mode, an indication is sent to the processing circuitry of mobile device 200. Upon receiving the indication, the processing circuitry triggers split screen mode for mobile device 200. In some implementations, the split is at or near the center of the screen of mobile device 200. In some implementations, the split can be uneven. In some implementations, the split can be between the center of the screen and a quarter of the screen. On a first portion of the split screen mode, the interface of primary application 210 is displayed. On a second portion of the split screen mode, selectable controls are displayed, e.g., for companion application prompt 220. In some implementations, prompt 220 takes the form of an icon that, when touched by a user, launches companion application 230.

[0028] Figure 2C is an illustration showing mobile device 200 in landscape mode but with prompt 220 having been responded to. Thus, mobile device 200 is in split screen mode with a first portion displaying the interface for primary application 210 and a second portion displaying the interface for companion application 230. In some implementations, companion application 230 can be closed or sent to the background in response to device 200 changing from landscape mode to portrait mode.

[0029] In some implementations, companion application 230 is configured to generate input to be provided to primary application 210. In some implementations, companion application 230 is configured to run a GAI model on the input to produce output. In some implementations, companion application runs as part of the operating system under which primary application 210 runs.

[0030] Figures 3A-3C is an illustration showing an example trigger of split screen mode in mobile device 305 via personal computer 300. As shown in Figure 3A desktop computer (or laptop computer, tablet computer, etc.) 300 displays an interface for primary application 310.

[0031] Figure 3Bis an illustration showing a trigger of a split screen mode between personal computer 300 and mobile device 305. In this case, the trigger is accomplished via an indication that a contact event (e.g., a tap) has been triggered by mobile device 305 with the monitor of personal computer 300. This contact event is an example of a change in a display aspect. This indication is sent to the processing circuitry of the desktop computer, and in response, the processing circuitry of the desktop computer sends a command to mobile device 305 to display a selectable control, e.g., prompt 320. That is, the indication causes mobile device 305 to become a companion device to personal computer 300. In some implementations, mobile device 305 is paired with personal computer 300 via a wireless link (e.g., a Bluetooth connection). Thus, personal computer 300 and mobile device 305 form a split screen mode, with personal computer 300 forming a first portion of the split screen mode - displaying an interface for primary application 310, and mobile device 305 forming a second portion of the split screen mode - displaying prompt 320 for companion application 330.

[0032] Figure 3C is an illustration showing a split screen mode of personal computer 300 and mobile device 305. In the split screen mode, the first portion includes the screen of personal computer 300 - displaying an interface for primary application 310; the second portion includes the screen of mobile device 305 - displaying an interface for companion application 330.

[0033] In some implementations, companion application 330 is configured to generate input to be provided to primary application 310. In some implementations, companion application 330 is configured to run a GAI model on this input to produce an output. In some implementations, the output of companion application 330 can be input back to primary application 310 by tapping the screen of personal computer 300 with mobile device 305.

[0034] Figure 4 is an illustration showing an example electronic environment for triggering a split screen mode in response to an indication that a display aspect of a computing environment has changed. Processing circuitry 420 includes a network interface 422, one or more processing units 424, and a non-transitory memory (storage medium) 426.

[0035] In some implementations, one or more of the components of processing circuitry 420 can be or can include a processor (e.g., processing units 424) configured to process instructions stored in memory 426 as a computer program product. As Figure 4 depicted in FIG. 4, examples of such instructions include indication manager 430 and split screen manager 440. Further, as shown in FIG. 4, memory 426 is configured to store various data, which is described in terms of respective services and managers using such data. Figure 4 depicted in FIG. 4, examples of such instructions include indication manager 430 and split screen manager 440. Further, as shown in FIG. 4, memory 426 is configured to store various data, which is described in terms of respective services and managers using such data.

[0036] Indication manager 430 is configured to receive indications that a display aspect of the computing environment has changed, including the display of the main application. Indication data 432 includes an expression of the indication sent to processing circuitry system 420.

[0037] Split-screen manager 440 is configured to enter split-screen mode upon receiving instruction data 432, as expressed in split-screen data 442. Split-screen data 442 includes main application data 443 and accompanying application data 444. In some implementations, accompanying application data includes selectable controls (e.g., prompts) associated with the accompanying application. In this case, the accompanying application is launched in response to processing circuitry 420 receiving a selection of the selectable control.

[0038] Components of the processing circuitry system 420 (e.g., modules, processing units 424) may be configured to operate on one or more platforms (e.g., one or more similar or different platforms), which may include one or more types of hardware, software, firmware, operating systems, runtime libraries, etc. In some implementations, components of the processing circuitry system 420 may be configured to operate within a device cluster (e.g., a server farm). In such implementations, the functionality and processing of the components of the processing circuitry system 420 may be distributed across several devices in the device cluster.

[0039] The components of the processing circuitry system 420 can be, or may include, any type of hardware and / or software configured to process private data from the wearable device in a discrete computing architecture. In some implementations, Figure 4 One or more portions of the components shown in the components of the processing circuitry system 420 may be or may include hardware-based modules (e.g., digital signal processors (DSPs), field-programmable gate arrays (FPGAs), memory), firmware modules, and / or software-based modules (e.g., modules of computer code, a set of computer-readable instructions executable at a computer). For example, in some implementations, one or more portions of the components of the processing circuitry system 420 may be or may include software modules configured for execution by at least one processor (not shown) to cause the processor to perform methods as disclosed herein. In some implementations, the functionality of the components may be included in... Figure 4 Among the different modules and / or different components shown are functional combinations of two components shown as a single component.

[0040] The network interface 422 includes, for example, a wireless adapter and the like for converting electronic and / or optical signals received from the network into electronic formats for use by the processing circuitry 420. The set of processing units 424 includes one or more processing chips and / or assemblies. The memory 426 includes both volatile memory (e.g., RAM) and non-volatile memory such as one or more ROMs, disk drives, solid state drives, and the like. The set of processing units 424 and the memory 426 together form processing circuitry configured and arranged to perform the various methods and functions described herein.

[0041] Although not shown, in some implementations, components of the processing circuitry 420 (or portions thereof) can be configured to operate within, for example, a data center (e.g., a cloud computing environment), a computer system, one or more server / host devices, and the like. In some implementations, components of the processing circuitry 420 (or portions thereof) can be configured to operate within a network. Thus, components of the processing circuitry 420 (or portions thereof) can be configured to function within various types of network environments that can include one or more devices and / or one or more server devices. For example, the network can be or can include a local area network (LAN), a wide area network (WAN), and the like. The network can be or can include a wireless network and / or a wireless network implemented using, for example, gateway devices, bridges, switches, and the like. The network can include one or more segments and / or can have portions based on various protocols such as Internet Protocol (IP) and / or proprietary protocols. The network can include at least a portion of the Internet.

[0042] In some implementations, one or more of the components of the processing circuitry 420 can be or can include a processor configured to process instructions stored in memory. For example, the indication manager 430 (and / or portions thereof) and the split screen manager 440 (and / or portions thereof) are examples of such instructions.

[0043] In some implementations, the memory 426 can be any type of memory such as random access memory, disk drive memory, flash memory, and the like. In some implementations, the memory 426 can be implemented as more than one memory component (e.g., more than one RAM component or disk drive memory) associated with the components of the processing circuitry 420. In some implementations, the memory 426 can be a database memory. In some implementations, the memory 426 can be or can include non-local memory. For example, the memory 426 can be or can include memory shared by multiple devices (not shown). In some implementations, the memory 426 can be associated with a server device (not shown) within a network and configured to serve the components of the processing circuitry 420. As such, the memory 426 can be or can include a cloud-based memory.Figure 4 As shown, the memory 426 is configured to store various data, including indication data 432 and split screen data 442.

[0044] Figure 5 is a flowchart illustrating an example method 500 for triggering a split screen mode in a device. The method 500 can be performed using the processing circuitry 420 of the device 400. Figure 4 The method 500 can be performed using the processing circuitry 420 of the device 400.

[0045] At 502, the indication manager 430 receives an indication that a display aspect of a computing environment has changed, the computing environment including a display of a primary application, as described herein.

[0046] At 504, the split screen manager 440 triggers a split screen mode of the computing environment including a first portion and a second portion in response to the indication, as described herein.

[0047] At 506, the split screen manager 440 displays an interface for the primary application in the first portion, as described herein.

[0048] At 508, the split screen manager 440 displays an interface for a companion application in the second portion, as described herein.

[0049] The specific structural and functional details disclosed herein are merely representative for purposes of describing the example embodiments. However, example embodiments can be embodied in many alternative forms and should not be construed as limited to the embodiments set forth herein.

[0050] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of embodiments. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes," and / or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof.

[0051] It will be appreciated that when one element is referred to as being “coupled” to another element, “connected” to another element, or “responsive to” or “sensitive to” another element, it can be directly coupled to, connected to, or responsive to or sensitive to the other element, or there can be one or more intermediate elements between the one element and the other element. In contrast, when an element is referred to as being “directly coupled” to another element, “directly connected” to another element, or “directly responsive to” or “directly sensitive to” another element, there are no intermediate elements present. As used herein, the term “and / or” includes any and all combinations of one or more of the associated listed items.

[0052] To facilitate description, spatially relative terms, such as “below”, “under”, “lower”, “above”, “upper” and the like, can be used herein for describing the relationship between one element or feature to another element or feature as shown in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientations depicted in the figures. For example, if a device is inverted in the figures, elements described as “below” or “under” other elements or features can be oriented “above” the other elements or features. Thus, the term “below” can include both an above orientation as well as a below orientation. The device can be otherwise oriented (rotated 70 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.

[0053] Example embodiments of concepts are described herein with reference to cross-sectional illustrations that are schematic illustrations of idealized embodiments (and intermediate structures) of the example embodiments. As such, variations from the shapes of the illustrations as a result, for example, of manufacturing techniques and / or tolerances, are to be expected. Thus, the example embodiments of the concepts described herein are not to be construed as being limited to the particular shapes of regions illustrated herein but are to include deviations in shapes that result from, for example, manufacturing. The regions illustrated in the figures are schematic in nature and their shapes are not intended to illustrate the actual shape of a region of a device and are not intended to limit the scope of the example embodiments.

[0054] It will be understood that, although the terms “first”, “second”, etc. can be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. Thus, a “first” element could be termed a “second” element without departing from the teachings of example embodiments.

[0055] The terminology used herein, including the technical and scientific terminology, has a meaning that is consistent with that understood by a person of ordinary skill in the art to which these concepts belong. Further, it should be understood that terms, including common technical and scientific terms in the art, unless specifically defined herein, shall be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and / or the

[0056] While certain features of the described implementations have been illustrated as described herein, many modifications, substitutions, changes and equivalents will now occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the scope of the implementations. It should be understood that they have been presented by way of example only, not limitation, and various changes in form and details can be made. Any portion of the apparatus and / or methods described herein can be combined in any combination, except mutually exclusive combinations. The implementations described herein can include various combinations and / or sub-combinations of the functions, components and / or features of the different implementations described.

Claims

1. A method comprising: receiving an indication that a display aspect of a computing environment has changed, the computing environment comprising a display of a primary application; and in response to the indication: triggering a split screen mode of the computing environment, the split screen mode comprising a first portion and a second portion, displaying an interface for the primary application in the first portion, and triggering an interface for a companion application in the second portion.

2. The method of claim 1, further comprising, in response to the indication: displaying a selectable control associated with the companion application; and receiving a selection of the selectable control, wherein, launching the companion application occurs in response to receiving the selection of the selectable control.

3. The method of any one of claims 1 or 2, wherein, the companion application is configured to generate input to be provided to the primary application.

4. The method of claim 3, wherein, the companion application is configured to run a generative artificial intelligence model to produce output for input into the primary application.

5. The method of claim 4, wherein, the companion application runs as part of an operating system.

6. The method of any one of claims 1 to 5, wherein, the display aspect comprises an aspect ratio.

7. The method of claim 6, wherein, the computing environment comprises a foldable device, and the aspect ratio changes based on the foldable device transitioning from a folded mode to an open mode.

8. The method of any one of claims 6 or 7, wherein, the computing environment comprises a mobile device, and the aspect ratio changes based on the mobile device transitioning from a portrait mode to a landscape mode.

9. The method of any one of claims 1 to 8, wherein, the computing environment comprises a personal computer and a mobile device, and receiving the indication that the display aspect has changed comprises receiving a contact event that causes the mobile device to become a companion device, wherein the first portion is a display of the personal computer and the second portion is a display of the mobile device.

10. A computer program product comprising a non-transitory storage medium, the computer program product comprising code that, when executed by processing circuitry, causes the processing circuitry to perform a method comprising: receiving an indication that a display aspect of a computing environment has changed, the computing environment comprising a display of a primary application; and in response to the indication: triggering a split screen mode of the computing environment, the split screen mode comprising a first portion and a second portion, displaying an interface for the primary application in the first portion, and triggering an interface for a companion application in the second portion.

11. The computer program product of claim 10, wherein, the method further comprising, in response to the indication: displaying a selectable control associated with the companion application; and receiving a selection of the selectable control, wherein launching the companion application occurs in response to receiving the selection of the selectable control.

12. The computer program product of any one of claims 10 or 11, wherein, the companion application is configured to generate input to be provided to the primary application.

13. The computer program product of claim 12, wherein, the companion application is configured to run a generative artificial intelligence model to produce output for input into the primary application.

14. The computer program product of claim 13, wherein, the companion application runs as part of an operating system.

15. The computer program product of any one of claims 10 to 14, wherein, the display aspect comprises an aspect ratio.

16. The computer program product of claim 15, wherein, the computing environment comprises a foldable device, and the aspect ratio changes based on the foldable device transitioning from a folded mode to an open mode.

17. The computer program product of any one of claims 15 or 16, wherein, the computing environment comprises a mobile device, and the aspect ratio changes based on the mobile device transitioning from a portrait mode to a landscape mode.

18. The computer program product of any one of claims 10 to 17, wherein, The computing environment includes a personal computer and a mobile device, and receiving the indication that the display aspect has changed includes receiving a contact event that causes the mobile device to be a companion device, wherein the first portion is a display of the personal computer and the second portion is a display of the mobile device.

19. An electronic device, the electronic device comprising: a memory; and processing circuitry coupled to the memory, the processing circuitry configured to: receive an indication that a display aspect of a computing environment has changed, the computing environment including a display of a primary application; and in response to the indication: trigger a split screen mode of the computing environment, the split screen mode including a first portion and a second portion, display an interface for the primary application in the first portion, and trigger an interface for a companion application in the second portion.

20. The electronic device of claim 19, wherein, the processing circuitry is further configured to, in response to the indication: display a selectable control associated with the companion application; and receive a selection of the selectable control, wherein launching the companion application occurs in response to receiving the selection of the selectable control.

21. The electronic device of either of claims 19 or 20, wherein, the companion application is configured to generate input to be provided to the primary application.

22. The method of claim 21, wherein, the companion application is configured to run a generative artificial intelligence model on the input to produce output.

23. The electronic device of claim 22, wherein, the companion application runs as part of an operating system under which the primary application runs. the companion application is configured to generate input to be provided to the primary application. the companion application is configured to run a generative artificial intelligence model on the input to produce output. the companion application runs as part of an operating system under which the primary application runs.

Images