Cross-screen switching method for display interface

Abstract

The invention belongs to the technical field of display, and provides a display interface cross-screen switching method, which is applied to a processor, and comprises the following steps: in response to an input video conference creation operation, respectively displaying corresponding conference interfaces on a first screen and a second screen, the conference interface of the first screen comprises a first parent layout and a first child layout borne by the first parent layout, the conference interface of the second screen comprises a second parent layout and a second child layout borne by the second parent layout, and a constraint layout mode of the first parent layout and the second parent layout is set as a child layout size unlimited mode; in response to an input cross-screen switching operation, zooming the first sub-layout according to a first zooming coefficient to obtain a first zoomed sub-layout, and zooming the second sub-layout according to a second zooming coefficient to obtain a second zoomed sub-layout; the first scaled sub-layout is migrated from the first parent layout to the second parent layout, and the second scaled sub-layout is migrated from the second parent layout to the first parent layout.

Description

Technical Field

[0001] This application belongs to the field of display technology, and more specifically, relates to a method for cross-screen switching of display interfaces. Background Technology

[0002] In the field of dual-screen display technology, Android and other electronic devices often connect to external displays via HDMI interfaces to enable the main screen and secondary screen to display video conference content simultaneously (such as the main screen displaying the meeting participants' images and the secondary screen displaying shared documents, etc.), and support switching between the two screens to meet the display needs of different usage scenarios.

[0003] However, taking Android devices as an example, when there is a difference in resolution between the two screens (e.g., the main screen is 4K resolution and the secondary screen is 1080P resolution), the relevant technology uses a method of directly switching the displayed content. Due to the different physical pixel mapping rules of the Android system for interface size units (e.g., 200 pixels on the 4K main screen and 100 pixels on the 1080P secondary screen), the actual display size of the elements differs by multiples. The displayed image after the cross-screen switch exceeds the screen boundary or is not fully displayed, which greatly affects the information display effect and user operation experience during the meeting, and seriously affects the user interaction experience and content display effect. Summary of the Invention

[0004] The purpose of this application is to provide a method for switching display interfaces across screens, aiming to solve the technical problem of display errors caused by switching between display content on two screens in a dual-screen display scenario.

[0005] To achieve the above objectives, according to the first aspect of this application, a method for cross-screen switching of a display interface is provided, applied to a processor, wherein the processor can communicatively connect to a first screen and a second screen; the method includes:

[0006] In response to the input of a video conference creation operation, the corresponding conference interface is displayed on the first screen and the second screen respectively. The conference interface on the first screen includes a first parent layout and a first child layout contained in the first parent layout. The conference interface on the second screen includes a second parent layout and a second child layout contained in the second parent layout. The constraint layout mode of the first parent layout and the second parent layout is set to the child layout size unlimited mode.

[0007] In response to a cross-screen switching operation, the first sub-layout is scaled according to a first scaling factor to obtain a first scaled sub-layout, and the second sub-layout is scaled according to a second scaling factor to obtain a second scaled sub-layout.

[0008] The first scaled child layout is moved from the first parent layout to the second parent layout, and the second scaled child layout is moved from the second parent layout to the first parent layout.

[0009] In one possible implementation, the first sub-layout carries at least one first grandchild layout, the second sub-layout carries at least one second grandchild layout, the display size of the first grandchild layout and the second grandchild layout are both fixed values, the first grandchild layout is the layout corresponding to the first participant window, and the second grandchild layout is the layout corresponding to the second participant window.

[0010] In one possible implementation, the first scaling factor represents the ratio of the resolution of the second screen to the resolution of the first screen, and the second scaling factor represents the ratio of the resolution of the first screen to the resolution of the second screen.

[0011] In one possible implementation, the first sub-layout is drawn based on the coordinate zero point of the first parent layout, and the second sub-layout is drawn based on the coordinate zero point of the second parent layout; the first sub-layout is scaled according to a first scaling factor to obtain a first scaled sub-layout, and the second sub-layout is scaled according to a second scaling factor to obtain a second scaled sub-layout, including:

[0012] The layout parameters of the first child layout are set according to the layout parameters of the first parent layout, and the display size of the first child layout is scaled according to the first scaling factor with the zero point of the coordinate axis of the first parent layout as the fulcrum, so as to obtain the first scaled child layout.

[0013] The layout parameters of the second child layout are set according to the layout parameters of the second parent layout. The display size of the second child layout is scaled according to the second scaling factor, with the zero point of the coordinate axis of the second parent layout as the fulcrum, to obtain the second scaled child layout.

[0014] In one possible implementation, the first child layout is drawn based on the coordinate axis zero point of the first parent layout, and the second child layout is drawn based on the coordinate axis zero point of the second parent layout.

[0015] The process of scaling a first sub-layout according to a first scaling factor to obtain a first scaled sub-layout, and scaling a second sub-layout according to a second scaling factor to obtain a second scaled sub-layout, includes:

[0016] Using the zero point of the coordinate axis of the first parent layout as the fulcrum, the display size of the first child layout is scaled according to the first scaling factor to obtain the first scaled child layout;

[0017] Using the zero point of the coordinate axis of the second parent layout as the fulcrum, the display size of the second child layout is scaled according to the second scaling factor to obtain the second scaled child layout;

[0018] After scaling the first sub-layout according to a first scaling factor to obtain a first scaled sub-layout, and scaling the second sub-layout according to a second scaling factor to obtain a second scaled sub-layout, the method further includes:

[0019] The layout parameters of the first scaled child layout are set according to the layout parameters of the first parent layout, and the layout parameters of the second scaled child layout are set according to the layout parameters of the second parent layout.

[0020] In one possible implementation, the method further includes:

[0021] In response to the input cross-screen switching and restoration operation, the first scaling factor and the second scaling factor are set to 1 respectively, so that the first scaled sub-layout and the second scaled sub-layout are restored to the first sub-layout and the second sub-layout respectively.

[0022] Move the first child layout from the second parent layout to the first parent layout, and move the second child layout from the first parent layout to the second parent layout.

[0023] One possible implementation involves migrating the first scaled child layout from the first parent layout to the second parent layout, and migrating the second scaled child layout from the second parent layout to the first parent layout, including:

[0024] The first scaled child layout, which is removed from the first parent layout, is added to the second parent layout with the layout parameters of the first scaled child layout.

[0025] The second scaled child layout, which is removed from the second parent layout, is added to the first parent layout with the layout parameters of the second scaled child layout.

[0026] In one possible implementation, the method further includes:

[0027] In response to the input of a virtual collaboration tool creation operation, a virtual collaboration canvas is created in the third grandchild layout of the first child layout;

[0028] In response to the input of a virtual collaboration tool sharing operation, the virtual collaboration canvas is moved from the third grandchild layout of the first child layout to the third child layout of the first parent layout.

[0029] A virtual collaboration canvas is displayed in the third child layout of the first parent layout, where the display size of the virtual collaboration canvas is the same as that of the first parent layout.

[0030] In one possible implementation, after the virtual collaboration canvas is displayed in the third child layout of the first parent layout, the method further includes:

[0031] In response to the input cross-screen switching operation, the display size of the virtual collaboration canvas is scaled according to the first scaling factor to obtain the scaled virtual collaboration canvas.

[0032] The scaled virtual collaboration canvas is moved from the third child layout of the first parent layout to the fourth child layout of the second parent layout.

[0033] The virtual collaborative canvas is displayed in the fourth child layout of the second parent layout.

[0034] In one possible implementation, the method further includes:

[0035] In response to the exit sharing operation input, if the fourth child layout of the second parent layout displays the virtual collaboration canvas, then after moving the virtual collaboration canvas from the fourth child layout to the third child layout, move the virtual collaboration canvas from the third child layout to the third grandchild layout of the first child layout.

[0036] If the third child layout of the first parent layout displays a virtual collaboration canvas, then the virtual collaboration canvas is moved from the third child layout to the third grandchild layout of the first child layout.

[0037] According to a second aspect of this application, a method for cross-screen switching of a display interface is provided, characterized in that it is applied to a processor, the processor being communicatively connected to a first screen and a second screen; the method includes:

[0038] In response to the input of a video conference creation operation, the corresponding conference interface is displayed on the first screen and the second screen respectively. The conference interface on the first screen includes a first parent layout and a first child layout contained in the first parent layout. The conference interface on the second screen includes a second parent layout and a second child layout contained in the second parent layout. The constraint layout mode of the first parent layout and the second parent layout is set to the child layout size unlimited mode.

[0039] In response to cross-screen switching operations, the first child layout is moved from the first parent layout to the second parent layout, and the second child layout is moved from the second parent layout to the first parent layout.

[0040] The first sub-layout is scaled according to the first scaling factor to obtain the first scaled sub-layout, and the second sub-layout is scaled according to the second scaling factor to obtain the second scaled sub-layout.

[0041] According to a third aspect of this application, an electronic device is provided, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the electronic device performs the method as described in any one of the above.

[0042] According to a fourth aspect of this application, a computer-readable storage medium is provided that stores a computer program, which, when executed by a processor, implements the method as described in any one of the above.

[0043] According to a fifth aspect of this application, a computer program product is provided that, when the computer program product is run on an electronic device, causes the electronic device to perform the method of any one of the first aspects above.

[0044] It is understandable that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here.

[0045] The cross-screen switching method for display interfaces provided in this application breaks the traditional size constraint of the parent layout on the child layout by setting both the first and second parent layouts to a mode where the child layout size is unlimited. Based on this, the first and second child layouts are scaled using a first scaling factor and a second scaling factor, respectively. Then, the scaled child layout is migrated from the first parent layout to the second parent layout, and the scaled child layout is migrated from the second parent layout to the first parent layout. This enables dynamic adaptation to the target screen when switching between dual screens with different resolutions, avoiding display abnormalities such as layout stretching, squeezing, or exceeding the display area after switching between dual screens due to resolution differences. Attached Figure Description

[0046] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0047] Figure 1 This is a flowchart illustrating a cross-screen switching method for a display interface provided in an embodiment of this application;

[0048] Figure 2 This is a flowchart illustrating a cross-screen switching method for a display interface provided in an embodiment of this application;

[0049] Figure 3 This is a schematic diagram of a first screen and a second screen of a conference interface provided in an embodiment of this application;

[0050] Figure 4 This is a schematic diagram of a first parent layout and a second parent layout provided in an embodiment of this application;

[0051] Figure 5 This is a schematic diagram of a process for migrating a first sub-layout to a second parent layout and vice versa, provided in an embodiment of this application.

[0052] Figure 6 This is a schematic diagram of a first scaled sub-layout and a second scaled sub-layout provided in an embodiment of this application;

[0053] Figure 7 This is a schematic diagram of the interaction flow of a cross-screen switching method for a display interface provided in an embodiment of this application;

[0054] Figure 8 This is a schematic diagram of the interaction flow of another cross-screen switching method for display interfaces provided in this application embodiment;

[0055] Figure 9 This is a flowchart illustrating another method for cross-screen switching of a display interface provided in an embodiment of this application;

[0056] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0057] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0058] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0059] It should also be understood that, in the description of this application, unless otherwise stated, the " / " used in the specification and appended claims indicates that the related objects are in an "or" relationship. For example, A / B can mean A or B. The "and / or" in this application is merely a description of the relationship between the related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. Furthermore, in the description of this application, unless otherwise stated, "multiple" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0060] Furthermore, to facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, but are only used for distinguishing descriptions, and the terms "first" and "second" do not necessarily imply that they are different, nor should they be construed as indicating or implying relative importance.

[0061] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0062] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0063] In the field of dual-screen display technology, Android and other electronic devices often connect to external displays via HDMI interfaces to enable the main screen and secondary screen to display video conference content simultaneously (such as the main screen displaying the meeting participants' images and the secondary screen displaying shared documents, etc.), and support switching between the two screens to meet the display needs of different usage scenarios.

[0064] However, taking Android devices as an example, when there is a difference in the resolution of the two screens (for example, the main screen is 4K resolution and the secondary screen is 1080P resolution), the relevant technology adopts the method of directly switching the displayed content. Due to the different physical pixel mapping rules of the Android system for interface size units (for example, 200 pixels on the 4K main screen and 100 pixels on the 1080P secondary screen), the actual display size of the elements will differ by multiples.

[0065] For example, the pixel density of a 4K main screen is twice that of a 1080P secondary screen. When switching between the main and secondary screens, the display size of the same interface element may be disordered. For instance, when switching from a 1080P secondary screen to a 4K main screen, it needs to be enlarged by 4 times, or when switching from a 4K main screen to a 1080P secondary screen, it needs to be shrunk by 4 times. This causes the displayed image to exceed the screen boundary or be incomplete after the screen switch, which greatly affects the information display effect and user operation experience during the meeting, and seriously affects the user interaction experience and content display effect.

[0066] This application provides an example of a method for cross-screen switching of a display interface. Please refer to [link / reference]. Figure 1 As shown, Figure 1 This illustration shows a schematic flowchart of a cross-screen switching method for a display interface provided in this application. It is provided as an example and not a limitation. This method can be applied to or run in a processor, which can communicatively connect to a first screen and a second screen. The method includes:

[0067] S101, in response to the input of the video conference creation operation, displays the corresponding conference interface on the first screen and the second screen respectively.

[0068] S102, in response to the input cross-screen switching operation, the first sub-layout is scaled according to the first scaling factor to obtain the first scaled sub-layout, and the second sub-layout is scaled according to the second scaling factor to obtain the second scaled sub-layout.

[0069] S103, migrate the first scaled child layout from the first parent layout to the second parent layout, and migrate the second scaled child layout from the second parent layout to the first parent layout.

[0070] In some embodiments, the conference interface of the first screen includes a first parent layout and a first child layout carried by the first parent layout, and the conference interface of the second screen includes a second parent layout and a second child layout carried by the second parent layout. The constraint layout modes of the first parent layout and the second parent layout are both set to the child layout size unlimited mode.

[0071] In some embodiments, the cross-screen switching method for display interfaces provided in this implementation is applied to a processor that can communicatively connect a first screen and a second screen. This processor runs in an electronic device, such as an Android device, for example, a conference terminal device running the Android system. This method is suitable for conference video scenarios with dual-screen displays (the first and second screens have different resolutions, such as 1080P for the first screen and 4K for the second screen), meeting users' needs for switching the displayed content between the first and second screens, and improving the efficiency and display experience of screen switching operations in dual-screen conference video scenarios.

[0072] In some embodiments, when a user triggers a video conference creation operation on an Android device (such as a meeting box, smartphone, or tablet), the processor responds to the video conference creation operation by first identifying the connected first screen (such as the main screen) and second screen (such as the secondary screen) through the system display management service (DisplayManager), and then rendering the corresponding meeting interface on the first screen and the second screen respectively, for example... Figure 3 As shown, the first screen displays the main speaker's view, while the second screen displays the shared video feed.

[0073] In some embodiments, the first screen and the second screen respectively render the corresponding meeting interface, which specifically includes UI elements such as buttons, text boxes, images, lists, and icons, thus constituting the basic visual components of the meeting interface.

[0074] In some embodiments, the first screen of the meeting interface includes a first parent layout and a first child layout, and the second screen includes a second parent layout and a second child layout. Both the first parent layout and the second parent layout use ConstraintLayout to support unlimited child layout size, such as... Figure 4 As shown, this allows the drawing size of child layouts to exceed the physical boundaries of the parent layout, providing the basic conditions for cross-screen scaling.

[0075] In some embodiments, when a user triggers a cross-screen switching operation on an Android device (such as a meeting box or tablet), the processor responds to the cross-screen switching operation by first obtaining the resolution parameters of the first screen and the second screen, and calculating a first scaling factor (e.g., the ratio of the height pixel value of the second screen to the height pixel value of the first screen, used to scale the first sub-layout to fit the second screen) and a second scaling factor (the ratio of the height pixel value of the first screen to the height pixel value of the second screen, used to scale the second sub-layout to fit the first screen).

[0076] It should be noted that the first scaling factor is used to ensure that the first scaled sub-layout can be displayed normally on the second screen, and the second scaling factor is used to ensure that the second scaled sub-layout can be displayed normally on the first screen.

[0077] Next, the first sub-layout is scaled according to a first scaling factor, and the second sub-layout is scaled according to a second scaling factor, resulting in a first scaled sub-layout and a second scaled sub-layout adapted to the target screen's display ratio, respectively. After completing the scaling of the first and second sub-layouts, the processor moves the first scaled sub-layout out of the first parent layout and into the second parent layout, while simultaneously moving the second scaled sub-layout out of the second parent layout and into the first parent layout.

[0078] In another embodiment, such as Figure 5The diagram illustrates the switching of sub-layouts between the first screen (i.e., screen one) and the second screen (i.e., screen two). The processor first moves the first sub-layout out of the first parent layout and into the second parent layout, simultaneously moving the second sub-layout out of the second parent layout and into the first parent layout. Next, the processor performs scaling on the first sub-layout according to a first scaling factor and on the second sub-layout according to a second scaling factor, as shown below. Figure 6 As shown, a first scaled sub-layout and a second scaled sub-layout adapted to the target screen's display ratio are obtained. For example, the second sub-layout migrated to the first screen is enlarged according to the second scaling factor, and the first sub-layout migrated to the second screen is shrunk according to the first scaling factor.

[0079] It should be noted that for the grandchild layouts nested within the first and second sub-layouts (such as the participant window), they can be adjusted and migrated synchronously with their respective sub-layouts without the need for additional adaptation logic for multi-level layouts, thus improving the efficiency and stability of cross-screen switching.

[0080] This application embodiment breaks the traditional size constraint of the parent layout on the child layout by setting both the first and second parent layouts to an unlimited child layout size mode. Based on this, the first and second child layouts are scaled using a first scaling factor and a second scaling factor respectively. Then, the scaled child layout is migrated from the first parent layout to the second parent layout, and the scaled child layout is migrated from the second parent layout to the first parent layout. This enables dynamic adaptation to the target screen when switching between dual screens with different resolutions, avoiding display abnormalities such as layout stretching, compression, or exceeding the display area after switching between dual screens due to resolution differences.

[0081] In one possible implementation, the first sub-layout carries at least one first grandchild layout, the second sub-layout carries at least one second grandchild layout, the display size of the first grandchild layout and the second grandchild layout are both fixed values, the first grandchild layout is the layout corresponding to the first participant window, and the second grandchild layout is the layout corresponding to the second participant window.

[0082] In some embodiments, the first sub-layout carries at least one first grandchild layout, and the second sub-layout carries at least one second grandchild layout. The first grandchild layout corresponds to the participant video window displayed on the first screen (such as the main venue speaker's screen), and the second grandchild layout corresponds to the participant video window displayed on the second screen (such as the sub-venue participant's screen).

[0083] In some embodiments, the display size of each sub-layout is a fixed value (e.g., 200px wide and 150px high), which is converted to physical pixel values ​​based on the screen resolution during initial rendering.

[0084] In some embodiments, when performing a cross-screen switch, the first sub-layout scales by a first scaling factor (e.g., scaling by 0.5 times when switching / migrating from a 4K screen to a 1080P screen), causing the display size of all its first grandchild layouts to shrink synchronously (e.g., from 400×300px to 200×150px) to adapt to the display ratio of the 1080P screen. Similarly, the second grandchild layout within the second sub-layout is scaled up by a second scaling factor (e.g., scaling up by 2 times when switching / migrating from a 1080P screen to a 4K screen), for example, from 200×150px to 400×300px, to match the resolution requirements of the 4K screen. Since the fixed size of the grandchild layouts is indirectly adapted through the overall scaling of the sub-layouts, the layout disorder problem caused by handling the size of each grandchild layout individually in related technologies can be avoided, ensuring that the participant window maintains a fixed ratio and is not stretched or deformed after a cross-screen switch.

[0085] In this embodiment, the hierarchical scaling of sub-layouts and grandchild layouts effectively solves the adaptation problem of fixed-size grandchild layouts when switching between screens. Regardless of the resolution difference between the two screens, the fixed display size of the grandchild layout maintains the visual proportions through the overall scaling of the sub-layouts. For example, a 200×150px participant window on a 4K screen, after being scaled by 0.5 times on a 1080P screen, still displays at a visual size of 100px×75px, matching the resolution of the 1080P screen, thus avoiding display abnormalities such as windows being too large or too small due to direct migration.

[0086] It should be understood that, since there is no need to set up adaptation logic for each sub-layout individually, the overall adaptation of multi-level layouts can be achieved simply by uniformly scaling and migrating the sub-layouts. This reduces the complexity and computational overhead of cross-screen switching and improves the real-time performance of cross-screen switching. Furthermore, the fixed-size participant windows maintain clear display boundaries and proportions after crossing screens, avoiding image cropping or distortion caused by resolution differences, and ensuring the integrity of the meeting video content and the viewing experience.

[0087] In one possible implementation, the first scaling factor represents the ratio of the resolution of the second screen to the resolution of the first screen, and the second scaling factor represents the ratio of the resolution of the first screen to the resolution of the second screen.

[0088] In some embodiments, a first scaling factor and a second scaling factor are calculated based on the numerical relationship between the resolutions of the two screens. Regardless of the resolution difference between the two screens (the first screen and the second screen) (e.g., 2K and 4K, 1080P and 720P), the corresponding scaling factor can be generated by calculating the resolution ratio in real time, without the need for preset fixed scaling rules. This ensures that the display size of the first sub-layout after cross-screen switching is strictly matched with the resolution of the target screen.

[0089] Specifically, the first scaling factor is the ratio of the resolution of the second screen to the resolution of the first screen (for example, calculated in height pixels; if the resolution of the first screen is 3840×2160 and the resolution of the second screen is 1920×1080, then the first scaling factor is 1080 / 2160=0.5), used to scale the first sub-layout to fit the display ratio of the second screen; the second scaling factor is the ratio of the resolution of the first screen to the resolution of the second screen (e.g., 2160 / 1080=2.0), used to scale the second sub-layout to fit the display ratio of the first screen.

[0090] In some embodiments, the scaled sub-layouts, based on a first scaling factor and a second scaling factor, present the correct visual size on the target screen. For example, when the first sub-layout (layout at 4K resolution) is scaled by a first scaling factor of 0.5, all control sizes become 50% of their initial size, thus adapting to the resolution of a 1080P screen; while the second sub-layout is scaled by a second scaling factor of 2.0 to match the display requirements of a 4K screen.

[0091] Furthermore, in this embodiment, the first scaling factor and the second scaling factor are reciprocals of each other, ensuring the symmetry of size transformation during sub-layout switching between the two screens, avoiding layout display imbalance caused by inconsistent scaling factor calculation logic, and ensuring that the target screen is adapted proportionally after sub-layout switching between the two screens, avoiding layout disorder caused by mismatched screen resolutions.

[0092] In one possible implementation, the first sub-layout is drawn based on the coordinate zero point of the first parent layout, and the second sub-layout is drawn based on the coordinate zero point of the second parent layout; the first sub-layout is scaled according to a first scaling factor to obtain a first scaled sub-layout, and the second sub-layout is scaled according to a second scaling factor to obtain a second scaled sub-layout, including:

[0093] The layout parameters of the first child layout are set according to the layout parameters of the first parent layout, and the display size of the first child layout is scaled according to the first scaling factor with the zero point of the coordinate axis of the first parent layout as the fulcrum, so as to obtain the first scaled child layout.

[0094] The layout parameters of the second child layout are set according to the layout parameters of the second parent layout. The display size of the second child layout is scaled according to the second scaling factor, with the zero point of the coordinate axis of the second parent layout as the fulcrum, to obtain the second scaled child layout.

[0095] In some embodiments, both the first and second screens are drawn with child layouts based on the zero point of the parent layout's coordinate axis (i.e., the origin of the top-left corner). Specifically, the first child layout is drawn with its initial position in the first parent layout starting from the zero point (0,0) of the first parent layout's coordinate axis, and the layout parameters (such as width, height, and margins) of the first child layout are dynamically set according to the local parameters of the first parent layout (for example, if the width of the first parent layout is 3840px, then the first child layout fills the width of the parent layout by default). Similarly, the second child layout is drawn with its initial position in the second parent layout starting from the zero point (0,0) of the second parent layout's coordinate axis and matches the layout parameters of the second parent layout.

[0096] When performing cross-screen scaling, the processor first sets the layout parameters of the first child layout based on the current layout parameters (such as width, height, and constraint rules) of the first parent layout, ensuring that the first child layout directly inherits the layout logic of the first parent layout. Then, using the zero point of the first parent layout's coordinate axis as the fulcrum, the processor scales the first child layout by a first scaling factor (e.g., 0.5), keeping the starting point of the first child layout unchanged while reducing its overall size by the first scaling factor. Similarly, the second child layout first matches the layout parameters of the second parent layout, meaning it directly inherits the layout logic of the second parent layout, and then uses the zero point of the second parent layout as the fulcrum to scale the second child layout by a second scaling factor, keeping the starting point of the second child layout unchanged while increasing its overall size by the second scaling factor. For example, on a 4K screen, the first child layout (3840px wide) becomes 1920px wide after being scaled by 0.5, and its top-left corner remains at the (0,0) point of the second parent layout.

[0097] In this embodiment, the zero point of the parent layout's coordinate axis is used as the drawing and scaling fulcrum. This ensures that the top-left corner of the child layout remains fixed after cross-screen switching, avoiding display misalignment caused by scaling fulcrum offset (such as the child layout being offset in the target screen), and guaranteeing the consistency of the relative positions of meeting interface elements (such as participant windows and operation buttons). Each child layout first sets its own layout parameters according to the layout parameters of the initial parent layout, and then performs scaling processing to ensure that the child layout matches the size rules of the initial parent layout during initial rendering and scaling. For example, if the parent layout is set to a 16:9 aspect ratio, the child layout will still maintain this ratio after scaling processing, avoiding display distortion caused by mismatched layout parameters.

[0098] In one possible implementation, the first sub-layout is drawn based on the coordinate zero point of the first parent layout, and the second sub-layout is drawn based on the coordinate zero point of the second parent layout; the first sub-layout is scaled according to a first scaling factor to obtain a first scaled sub-layout, and the second sub-layout is scaled according to a second scaling factor to obtain a second scaled sub-layout, including:

[0099] Using the zero point of the coordinate axis of the first parent layout as the fulcrum, the display size of the first child layout is scaled according to the first scaling factor to obtain the first scaled child layout.

[0100] Using the zero point of the coordinate axis of the second parent layout as the fulcrum, the display size of the second child layout is scaled according to the second scaling factor to obtain the second scaled child layout.

[0101] In one possible implementation, after scaling the first sub-layout according to a first scaling factor to obtain a first scaled sub-layout, and scaling the second sub-layout according to a second scaling factor to obtain a second scaled sub-layout, the method further includes:

[0102] The layout parameters of the first scaled child layout are set according to the layout parameters of the first parent layout, and the layout parameters of the second scaled child layout are set according to the layout parameters of the second parent layout.

[0103] In the above implementation, the drawing of both the first and second sub-layouts is based on the zero point of the parent layout's coordinate axis (i.e., the origin of the top-left corner). For example, the first sub-layout is drawn with the (0,0) point as its starting point in the first parent layout, and its initial position and size are based on the coordinate system of the first parent layout; similarly, the second sub-layout is drawn with the (0,0) point of the second parent layout as its origin. When cross-screen scaling is performed, the processor uses this zero point as the fulcrum for scaling operations. For example, when the first sub-layout is scaled by a first scaling factor, the position of the top-left corner (0,0) point of the first sub-layout remains unchanged, and the overall display size is scaled proportionally to ensure that the position of the sub-layout in the target parent layout is accurate after the first scaling.

[0104] After scaling the child layout, the processor further adjusts the layout parameters of the scaled child layout based on the layout parameters of the original parent layout. Specifically, the layout parameters of the first parent layout (such as width and height dimensions, margin constraints, alignment rules, etc.) are applied to the first scaled child layout; similarly, the second scaled child layout sets its own layout parameters based on the layout parameters of the second parent layout. For example, if the aspect ratio of the first parent layout is 16:9, the first scaled child layout will inherit this ratio parameter to avoid display distortion caused by resolution differences.

[0105] In this embodiment, the zero point of the parent layout's coordinate axis is used as the drawing and scaling fulcrum for processing the corresponding child layout. This ensures that the upper left corner position of the child layout remains fixed after cross-screen switching, avoiding screen misalignment caused by fulcrum offset. For the grandchild layouts nested within the first and second child layouts (such as the participant window), due to the fulcrum scaling and layout parameter inheritance mechanism of the child layout, the position and display size of the grandchild layouts within the child layout can be adjusted synchronously with the child layout. This eliminates the need for additional multi-level adaptation logic, improving the efficiency and stability of cross-screen switching.

[0106] One possible implementation involves migrating the first scaled child layout from the first parent layout to the second parent layout, and migrating the second scaled child layout from the second parent layout to the first parent layout, including:

[0107] The first scaled child layout, which is removed from the first parent layout, is added to the second parent layout with the layout parameters of the first scaled child layout.

[0108] The second scaled child layout, which is removed from the second parent layout, is added to the first parent layout with the layout parameters of the second scaled child layout.

[0109] In some embodiments, after the scaling of the sub-layout is completed, the processor performs a layout migration operation. Specifically, when migrating the first scaled sub-layout, the first scaled sub-layout is first removed from the first parent layout. At this time, the first scaled sub-layout has already completed the display size adaptation based on the first scaling factor and maintains the layout attributes (such as aspect ratio and margin constraints) that match the parameters of the first parent layout.

[0110] Subsequently, the processor directly adds the first child layout to the second parent layout with the inherited layout parameters. The second parent layout accepts the first child layout according to its own coordinate system and display rules, ensuring that the first child layout is correctly displayed in the second screen according to the scaled display size.

[0111] Similarly, after moving the second scaled child layout out of the second parent layout (e.g., scaling it from 1920px wide to 3840px wide on a 1080P screen), add the second scaled child layout to the first parent layout with inherited layout parameters (e.g., width 3840px, height 2160px), so that the second scaled child layout is presented completely and proportionally in the first screen.

[0112] In this embodiment, by retaining the layout parameters of the scaled child layout and directly applying them to the target parent layout, it is ensured that the layout attributes of the child layout, such as size, margins, and alignment, remain unchanged before and after migration, and the displayed content will not be squeezed due to changes in the parent layout. Furthermore, the scaled child layout directly inherits the layout parameters of the initial parent layout for migration. When the scaled child layout is added to the target screen's parent layout with the inherited layout parameters, there is no need to recalculate or adjust the layout attributes, improving the response speed of cross-screen switching. Especially in meeting scenarios, it can quickly complete the switching and exchange of content displayed on two screens, reducing user waiting time.

[0113] In one possible implementation, the method further includes:

[0114] S104, in response to the input cross-screen switching and restoration operation, the first scaling factor and the second scaling factor are set to 1 respectively, so that the first scaled sub-layout and the second scaled sub-layout are restored to the first sub-layout and the second sub-layout respectively.

[0115] S105, migrate the first child layout from the second parent layout to the first parent layout, and migrate the second child layout from the first parent layout to the second parent layout.

[0116] In some embodiments, when the processor receives a cross-screen switching restore operation instruction, it performs a rollback operation for cross-screen layout switching / migration. This can meet the needs of users who frequently switch displayed content in meeting scenarios, support quick rollback to a stable interface, reduce the operational threshold for users in the process of switching between multiple screens, and reduce the risk of meeting interruption.

[0117] First, both the first and second scaling factors are set to 1. At this point, the scaling operation on both the first and second scaled sub-layouts is canceled, and their display sizes are restored to their initial states before the scaling process. For example, if the first sub-layout is scaled by 0.5x when switching from a 4K screen to a 1080P screen, resetting the first scaling factor to 1 restores its original size to match the 4K screen. The second sub-layout undergoes the same restoration operation. Therefore, the scaling up or down operation of the first and second sub-layouts during cross-screen switching can be undone, returning them to their initial display sizes before the scaling process and cross-screen switching.

[0118] In some embodiments, after restoring the display sizes of the first and second sub-layouts respectively, the processor moves the first sub-layout out of the second parent layout and migrates it to the first parent layout; simultaneously, it moves the second sub-layout out of the first parent layout and migrates it back to the second parent layout. During the migration of the first and second sub-layouts back to their initial parent layouts, each sub-layout automatically adjusts its display position and size according to the layout parameters (such as resolution and layout constraints) of the initial parent layout, ensuring that each layout element returns to its initial display state when the video conference was created. For example, if the first sub-layout was initially located at the top left corner of the first parent layout, this positional relationship is maintained after migration, so that the conference interface restores its complete display effect before the cross-screen switching.

[0119] In this embodiment, by setting both the first and second scaling factors to 1, the display sizes of the first and second sub-layouts are restored, and the first and second sub-layouts are migrated back to their initial parent layouts. This achieves fully reversible cross-screen switching, allowing users to restore the initial meeting interface layout at any time, avoiding display errors caused by accidental operations or changes in requirements, and improving interactive flexibility. Furthermore, the size, position, and proportion of the sub-layouts after restoration are completely consistent with their initial state, ensuring the continuity and integrity of the meeting screen. For example, the display position and size of the participant window before cross-screen switching remain unchanged after restoration, avoiding the tedious operation of repeatedly adjusting the layout.

[0120] In one possible implementation, the method further includes:

[0121] In response to the input of a virtual collaboration tool creation operation, a virtual collaboration canvas is created in the third grandchild layout of the first child layout.

[0122] In response to the input of a virtual collaboration tool sharing operation, the virtual collaboration canvas is moved from the third grandchild layout of the first child layout to the third child layout of the first parent layout.

[0123] A virtual collaboration canvas is displayed in the third child layout of the first parent layout, where the display size of the virtual collaboration canvas is the same as that of the first parent layout.

[0124] In some embodiments, when a user initiates a virtual collaboration tool creation operation in the meeting interface (such as clicking the "Share Whiteboard" button), the processor creates a virtual collaboration canvas (e.g., a whiteboard) in the third grandchild layout of the first sub-layout (a hierarchy dedicated to hosting collaboration tools). This virtual collaboration canvas is initially blank, with a display size consistent with the fixed display size of the third grandchild layout (e.g., a preset 600px × 400px), and supports collaborative operations such as annotation and drawing in the blank area.

[0125] In some embodiments, when a user further triggers a sharing operation of the virtual collaboration tool, the processor moves the virtual collaboration canvas out of the third grandchild layout of the first child layout and migrates it to the third child layout of the first parent layout. During the migration process, the display size of the virtual collaboration canvas is dynamically adjusted to be the same as that of the first parent layout (for example, if the first parent layout is a 4K screen, the display size of the virtual collaboration canvas will be expanded to 3840×2160px) to avoid misalignment or distortion of the annotation content due to resolution differences, so as to achieve a full-screen display effect.

[0126] At this point, the virtual collaboration canvas is elevated to the top level of the first parent layout, ensuring coverage of other child layouts (such as the participant window). Meanwhile, the virtual collaboration canvas remains aligned with the coordinate system of the first parent layout, so that annotations or writing on the virtual collaboration canvas can be accurately mapped to the meeting sharing area.

[0127] For example, if a user draws a straight line from coordinates (100, 100) to (500, 500) on the virtual collaboration canvas, the line will maintain the same relative position and size proportions after being moved to the first parent layout. No repositioning or adjustment is needed, improving collaboration efficiency and reducing meeting interruptions. Simultaneously, the first parent layout will adjust the display hierarchy of other child layouts to ensure the virtual collaboration canvas is displayed first, without affecting the overall layout stability of the meeting interface.

[0128] In this embodiment, when a user triggers a virtual collaboration tool sharing operation, the virtual collaboration canvas is moved to the top layer of the parent layout and matched to the display size, ensuring that the shared content is visible to all participants in the meeting interface. This is especially suitable for scenarios such as presentations and drawing annotations, ensuring that the virtual collaboration canvas can be displayed first on the first screen without disrupting the layout integrity of other meeting elements (such as participant windows), and achieving visual harmony for parallel display of multiple tasks.

[0129] In one possible implementation, after the virtual collaboration canvas is displayed in the third child layout of the first parent layout, the method further includes:

[0130] In response to the input cross-screen switching operation, the display size of the virtual collaboration canvas is scaled according to the first scaling factor to obtain the scaled virtual collaboration canvas.

[0131] The scaled virtual collaboration canvas is moved from the third child layout of the first parent layout to the fourth child layout of the second parent layout.

[0132] The virtual collaborative canvas is displayed in the fourth child layout of the second parent layout.

[0133] In some embodiments, after the virtual collaboration canvas is displayed in full screen in the third child layout of the first parent layout, if the user triggers a cross-screen switching operation, the processor will adapt the virtual collaboration canvas according to the resolution difference between the first screen and the second screen.

[0134] First, the virtual collaboration canvas is scaled according to a first scaling factor (i.e., the ratio of the resolution of the second screen to the resolution of the first screen). For example, if the first screen is 4K resolution (3840×2160px) and the second screen is 1080P resolution (1920×1080px), and the first scaling factor is 0.5, then the display size of the virtual collaboration canvas will be proportionally reduced from 3840×2160px to 1920×1080px, ensuring that the virtual collaboration canvas fits the display area of ​​the second screen.

[0135] After scaling the virtual collaboration canvas, the processor moves it out of the third child layout of the first parent layout and migrates it to the fourth child layout of the second parent layout. Finally, the scaled virtual collaboration canvas is displayed in the fourth child layout of the second parent layout, ensuring that participants can clearly view the shared content on screens of different resolutions, and that annotations, drawings, and other operations remain intact and undistorted.

[0136] In this embodiment, when the virtual collaboration canvas is being displayed on the first screen, if the user triggers a cross-screen switching operation, the sub-layout scaling migration logic is reused based on the first scaling factor to simplify the cross-screen migration process of the virtual collaboration canvas. This controls the display size of the virtual collaboration canvas to accurately match the resolution of the target screen, ensuring that the display ratio and annotation position of the shared content remain consistent when the user switches between displays of different resolutions. This avoids content misalignment or loss due to resolution differences, ensuring the continuity of meeting collaboration and meeting the real-time display requirements in meeting scenarios.

[0137] In one possible implementation, the method further includes:

[0138] In response to the input exit sharing operation, if the fourth child layout of the second parent layout displays the virtual collaboration canvas, then after moving the virtual collaboration canvas from the fourth child layout to the third child layout, move the virtual collaboration canvas from the third child layout to the third grandchild layout of the first child layout.

[0139] If the third child layout of the first parent layout displays a virtual collaboration canvas, then the virtual collaboration canvas is moved from the third child layout to the third grandchild layout of the first child layout.

[0140] In some embodiments, when a user initiates an exit sharing operation, the processor performs a reverse migration process based on the current position of the virtual collaboration canvas. If the virtual collaboration canvas is currently located in the fourth child layout of the second parent layout (i.e., cross-screen switching has been completed), the processor first moves the virtual collaboration canvas out of the fourth child layout and migrates it to the third child layout of the first parent layout. During this process, the display size of the virtual collaboration canvas is automatically adjusted according to the resolution parameters of the first parent layout (e.g., from 1080P screen size to 4K screen size).

[0141] Subsequently, the virtual collaboration canvas is moved from the third child layout to the third grandchild layout of the first child layout, returning to the hierarchy when the virtual collaboration canvas was initially created, and the display size of the virtual collaboration canvas is also restored to the preset fixed value of the third grandchild layout (such as 600px × 400px).

[0142] In other embodiments, if the virtual collaboration canvas has not undergone cross-screen switching or has already switched back to the first screen (i.e., the current virtual collaboration canvas is located in the third child layout of the first parent layout), then the virtual collaboration canvas is directly migrated to the third grandchild layout of the first child layout, completing the size shrinkage and hierarchy degradation. This ensures that the virtual collaboration canvas can smoothly return from the full-screen sharing state to the initial hierarchy, and that all user operation data is not lost. It also supports repeated switching of sharing modes during the meeting, improving collaboration flexibility.

[0143] Furthermore, in some embodiments, the processor retains all user operation traces (such as annotations and drawings) on the virtual collaboration canvas during the migration process. For example, graphics drawn by a user on the virtual collaboration canvas while sharing in full screen will still be displayed in the third-level layout's virtual collaboration canvas at the same scale after exiting sharing, with only the display size adjusting as the layout hierarchy changes.

[0144] In this embodiment, after the user exits canvas sharing, the virtual collaboration canvas is migrated back to the initial sub-layout, that is, the relative position of the virtual collaboration canvas and other meeting elements (such as the participant window) is restored to the initial state. This not only maintains the visual consistency of the meeting interface, but also improves the response speed of the meeting interface, especially in multi-tasking meeting scenarios.

[0145] The following describes an optional implementation method for the cross-screen switching method of the display interface provided in this application. Please refer to [link / reference]. Figure 7 As shown, Figure 7 This illustration shows an interactive flow diagram of a cross-screen switching method for a display interface provided in this application. Taking an Android device as an example, when a user triggers a video conference creation operation on an Android device (a conference terminal device running the Android system, such as a conference box or smart tablet), the core component Activity (control center) in the processor actively calls the system display management service DisplayManager to obtain the display list of the current device. The Activity iterates through the display list; if it detects that only the main screen (the first screen, such as the built-in display of the Android device) exists in the display list, it maintains the single-screen conference mode; if it detects a secondary screen (the second screen, such as an external display connected via HDMI), it enters a dual-screen video conference scenario.

[0146] When the processor detects that the Android device is connected to the secondary screen, the Activity obtains the secondary screen's resolution (physical resolution, such as 1920×1080 for the main screen and 3840×2160 for the secondary screen) from the DisplayManager based on the secondary screen's display object, and creates an independent Presentation object for the secondary screen (a rendering container dedicated to the secondary screen, which can be understood as a dedicated Activity for the secondary screen). Based on the received display object, the Presentation draws UI elements separately on the corresponding secondary screen (such as the meeting sharing screen, speaker screen), decoupling it from the content displayed on the main screen.

[0147] Since the Activity has a local record of the main screen resolution, after obtaining the resolution of the secondary screen, it first calculates the resolution ratio of the two screens to obtain the first scaling factor corresponding to the main screen and the second scaling factor corresponding to the secondary screen.

[0148] The Activity defines separate parent layouts (firstParent and secondParent) for the main screen and the secondary screen, respectively, to house their respective child layouts that render meeting content independently according to their respective resolutions (e.g., the main screen displays the member list, and the secondary screen displays the shared whiteboard). Furthermore, the constraint layout mode of the first and second parent layouts is set to unlimited child layout size mode, allowing child layouts to break through the physical size limitations of the parent layout when scaling across screens, thus preventing UI elements from being squeezed and deformed during screen transitions.

[0149] Before the user triggers a dual-screen switching operation, the Activity draws UI elements separately on the main screen to display the corresponding video conference screen. When the user triggers a dual-screen switching operation (swapping the content displayed on both screens, such as switching the shared screen from the secondary screen to the main screen), the Activity inverts the stored switching state isReplaced and passes it to replace. At this time, replace is true, and the Activity checks whether the resolution ratio mSecondScale of the primary and secondary screens is not equal to 1.

[0150] If the resolution ratio mSecondScale is not equal to 1, the Activity scales the first child layout of the main screen according to mSecondScale, with the top left corner (0,0) of the first parent layout of the main screen as the fulcrum; the Activity scales the second child layout of the secondary screen according to 1 / mSecondScale, with the top left corner (0,0) of the second parent layout of the secondary screen as the fulcrum.

[0151] The Activity moves the second child layout of the secondary screen out of the second parent layout of the secondary screen and adds the second child layout of the secondary screen to the first parent layout of the primary screen. At the same time, the Activity moves the first child layout of the primary screen out of the primary parent layout of the primary screen and adds the first child layout of the primary screen to the second parent layout of the secondary screen, to ensure that the content of the two screens is swapped and the display size of the UI elements is adapted to the target screen.

[0152] Afterwards, the Activity sends the display object of the child layout after the secondary screen is switched to the Presentation. The Presentation then draws UI elements separately on the secondary screen based on the display object, while the Activity draws UI elements separately on the primary screen.

[0153] After the content displayed on the main screen and the secondary screen is swapped, each screen adapts to the current screen resolution and displays the corresponding video conference screen after the sub-layout is switched. For example, the video sharing screen displayed on the secondary screen in the initial state is clearly displayed on the main screen after the switch; the list of meeting members displayed on the main screen in the initial state is displayed in full on the secondary screen after the switch, making the cross-screen switching experience in the dual-screen display scenario of Android devices smoother.

[0154] When the Activity responds to a user-triggered cross-screen switching restore operation, it sets the resolution ratio of the main and secondary screens to 1, restoring the main screen's child layouts and the secondary screen's child layouts to their original sizes before scaling. Then, it adds the first child layout that was moved from the secondary screen's parent layout back into the main screen's parent layout, and the second child layout that was moved from the main screen's parent layout back into the main screen's parent layout.

[0155] The following describes an optional implementation method for the cross-screen switching method of the display interface provided in this application. Please refer to [link / reference]. Figure 8 As shown, Figure 8 The diagram illustrates the interactive flow of a cross-screen switching method for a display interface provided in this application. The user, as the initiator of the interactive flow, can perform operations such as creating virtual collaboration tools, sharing, cross-screen switching, and exiting sharing.

[0156] Taking an Android device as an example, after a video conference is started, when a user triggers the creation of a virtual collaboration tool (whiteboard), for example, when the user triggers the activation of the whiteboard function, the Activity creates a whiteboard instance (i.e., a virtual canvas) in a grandchild layout of the main screen's child layout. The display size is the same as the parent layout of the main screen, and it is displayed at the level of the grandchild layout of the main screen by default. If the user initiates a whiteboard sharing operation, the Activity first moves the whiteboard out of the grandchild layout of the main screen's child layout, and then adds it to the top layer of the parent layout of the main screen, so that the whiteboard is highlighted in full screen on the main screen.

[0157] If a user triggers a cross-screen switching operation between the main screen and the secondary screen, before switching the whiteboard from the main screen to the secondary screen, the Activity obtains the resolution ratio (mSecondScale) between the main screen and the secondary screen, scales the display size of the whiteboard according to this resolution ratio to fit the secondary screen, then moves the scaled whiteboard out from the parent layout of the main screen and adds it to the top layer of the parent layout of the secondary screen. At the same time, it uses Presentation to display the whiteboard in full screen on the top layer of the parent layout of the secondary screen, thus completing the cross-screen switching.

[0158] If a user triggers the exit whiteboard sharing operation, there are two scenarios: If the whiteboard is still displayed on the top layer of the parent layout of the secondary screen, the Activity first moves the whiteboard from the parent layout of the secondary screen back to the parent layout of the main screen, and then further moves the whiteboard back to the grandchild layout of the child layout of the main screen, restoring the initial state of the collaboration tool. Alternatively, the full-screen display can be maintained. If the whiteboard is displayed on the top layer of the parent layout of the main screen, the Activity directly moves the whiteboard from the parent layout of the main screen back to the grandchild layout of the child layout of the main screen, restoring the initial state of the collaboration tool.

[0159] The above embodiments enable the complete operation and implementation process of virtual collaboration tools (such as virtual canvases and whiteboards) from creation to exiting sharing, ensuring the integrity of display effects and collaborative content when switching between dual screens, solving the technical problem of UI element size display disorder in dual-screen display scenarios, and covering the scenario requirements of whiteboard collaboration in video conferencing.

[0160] According to the embodiments of this application, please refer to Figure 9 As shown, Figure 9 This application provides a schematic flowchart of a cross-screen switching method for a display interface, which is applied to a processor and can communicatively connect to a first screen and a second screen. The method includes:

[0161] S901, in response to the input of a video conference creation operation, displays the corresponding conference interface on the first screen and the second screen respectively.

[0162] S902, in response to the cross-screen switching operation of the input, migrates the first child layout from the first parent layout to the second parent layout, and migrates the second child layout from the second parent layout to the first parent layout.

[0163] S903, the first sub-layout is scaled according to the first scaling factor to obtain the first scaled sub-layout, and the second sub-layout is scaled according to the second scaling factor to obtain the second scaled sub-layout.

[0164] In some embodiments, the conference interface of the first screen includes a first parent layout and a first child layout carried by the first parent layout, and the conference interface of the second screen includes a second parent layout and a second child layout carried by the second parent layout. The constraint layout mode of the first parent layout and the second parent layout is set to the child layout size unlimited mode.

[0165] In some embodiments, the cross-screen switching method for display interfaces provided in this implementation is applied to a processor that can communicatively connect a first screen and a second screen. This processor runs in an electronic device, such as an Android device, for example, a conference terminal device running the Android system. This method is suitable for conference video scenarios with dual-screen displays (the first and second screens have different resolutions, such as 1080P for the first screen and 4K for the second screen), meeting users' needs for switching the displayed content between the first and second screens, and improving the efficiency and display experience of screen switching operations in dual-screen conference video scenarios.

[0166] In some embodiments, when a user triggers a video conference creation operation on an Android device (such as a meeting box, smartphone, or tablet), the processor responds to the video conference creation operation by first identifying the connected first screen (such as the main screen) and second screen (such as the secondary screen) through the system display management service (DisplayManager), and then rendering the corresponding meeting interface on the first screen and the second screen respectively. For example, the meeting interface on the first screen is the main speaker's screen, and the meeting interface on the second screen is the screen of the participants in the branch venue, etc.

[0167] In some embodiments, the meeting interface of the first screen includes a first parent layout and a first child layout, and the second screen includes a second parent layout and a second child layout. Both the first parent layout and the second parent layout adopt constrained layout and are configured to have unlimited child layout size, that is, the drawing size of the child layout is allowed to exceed the physical boundary of the parent layout, providing the basic conditions for cross-screen scaling.

[0168] In some embodiments, when a user triggers a cross-screen switching operation on an Android device (such as a meeting box or tablet), the processor responds to the cross-screen switching operation by first performing a layout migration operation. Specifically, the first child layout is first moved out of the first parent layout and migrated to the second parent layout, while the second child layout is simultaneously moved out of the second parent layout and migrated to the first parent layout. During the migration process, each child layout maintains its original size (i.e., no scaling is performed), and only the parent layout container is changed. For example, if the display size of the first child layout in the first screen is 3840×2160px (adapted to 4K screens), after migrating to the second parent layout of the second screen, it will initially maintain that display size.

[0169] After the layout migration is complete, the processor scales the first sub-layout according to a first scaling factor (e.g., the ratio of the second screen's resolution to the first screen's resolution), adapting the first sub-layout's display size to the second screen's aspect ratio for correct display. For example, if the second screen has a 1080P resolution and the first scaling factor is 0.5, the first sub-layout scales from 3840×2160px to 1920×1080px. Similarly, the processor scales the second sub-layout according to a second scaling factor (e.g., the ratio of the first screen's resolution to the second screen's resolution), ensuring the second sub-layout displays correctly on the first screen.

[0170] The above implementation method migrates the child layout first and then performs scaling, which supports rapid migration of child layouts between different parent layouts. Combined with subsequent scaling operations, it achieves seamless switching of displayed content. It is especially suitable for the frequent content exchange between the main screen and the secondary screen in video conferencing scenarios. It can avoid the complex parameter passing of the scaled child layout during the migration process, reduce system computing overhead, and improve the response speed of cross-screen switching.

[0171] In this embodiment, by setting both the first and second parent layouts to a mode with unlimited child layout sizes, the traditional size constraint of the parent layout on the child layout is broken. Based on this, the first child layout is first migrated from the first parent layout to the second parent layout, and the second child layout is migrated from the second parent layout to the first parent layout. Then, the first and second child layouts are scaled using a first scaling factor and a second scaling factor, respectively, so that the visual size of the first and second child layouts matches the resolution of the target screen. This enables dynamic adaptation to the target screen when switching between dual screens with different resolutions, avoiding technical problems such as layout stretching, squeezing, or display abnormalities exceeding the display area after dual-screen switching due to resolution differences.

[0172] Furthermore, it should be noted that the first and second sub-layouts retain their original sizes during the migration process, allowing for better adaptation to the constraints of different parent layouts. Scaling is performed within the target parent layout to ensure that the displayed size of the migrated sub-layouts perfectly matches the target screen, avoiding display deviations caused by pre-scaling.

[0173] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0174] This application also provides an electronic device, which includes one or more processors and a memory;

[0175] The memory is coupled to one or more processors. The memory is used to store computer program code, which includes computer instructions. One or more processors call the computer instructions to cause the electronic device to execute the cross-screen switching method of the display interface described above.

[0176] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device 1000 can be a mobile phone, smart screen, tablet computer, wearable electronic device, in-vehicle electronic device, augmented reality (AR) device, virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), projector, or a communication device such as a server, storage device, or base station, or a smart car, etc. This application embodiment does not impose any limitations on the specific type of electronic device.

[0177] The memory 1001 can be used to store computer software programs 1002 and modules. The processor 1003 executes various functional applications and data processing of the electronic device by running the software programs and modules stored in the memory 1001. The memory 1001 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device (such as audio data, telephone directory, etc.). In addition, the memory 1001 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0178] The processor 1003 may include one or more processors such as a central processing unit (CPU), an application processor (AP), and a baseband processor. The processor can serve as the nerve center and command center of the wireless router. The processor 1003 can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The memory 1001 can be used to store executable program code, including instructions. The processor 1003 executes various functional applications and data processing of the network device by running the instructions stored in the memory. The memory 1001 may include a program storage area and a data storage area, such as storing data for audio signals to be played. For example, the memory may be Double Data Rate Synchronous Dynamic Random Access Memory (DDR) or Flash memory.

[0179] This application also provides a computer-readable storage medium storing computer instructions; when the computer-readable storage medium is used on an electronic device, it causes the electronic device to execute the aforementioned cross-screen switching method for display interfaces.

[0180] The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or can include one or more data storage devices such as servers or data centers that can be integrated with media. The available medium can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media, or semiconductor media (e.g., solid-state disks (SSDs)).

[0181] This application also provides a computer program product containing computer instructions, which, when run on an electronic device, enables the electronic device to execute the aforementioned cross-screen switching method for display interfaces.

[0182] The computer storage medium and computer program product provided in the above embodiments of this application are used to execute the methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects corresponding to the methods provided above, and will not be repeated here.

[0183] In the above embodiments, implementation can also be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line, DSL) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer, or a data storage device such as a server or data center that integrates one or more available media. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), random access memory (RAM), flash memory, hard disk drive (HDD), or solid-state drive (SSD), etc., and the storage medium can also include combinations of the above types of memory.

[0184] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0185] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments claimed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0186] In the embodiments provided in this application, it should be understood that the disclosed apparatus / network devices and methods can be implemented in other ways. For example, the apparatus / network device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0187] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0188] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for cross-screen switching of a display interface, characterized in that, The method is applied to a processor, which is communicatively connected to a first screen and a second screen; the method includes: In response to the input of a video conference creation operation, the corresponding conference interface is displayed on the first screen and the second screen respectively. The conference interface on the first screen includes a first parent layout and a first child layout carried by the first parent layout. The conference interface on the second screen includes a second parent layout and a second child layout carried by the second parent layout. The constraint layout mode of the first parent layout and the second parent layout is set to the child layout size unlimited mode. In response to a cross-screen switching operation, the first sub-layout is scaled according to a first scaling factor to obtain a first scaled sub-layout, and the second sub-layout is scaled according to a second scaling factor to obtain a second scaled sub-layout. The first scaled child layout is moved from the first parent layout to the second parent layout, and the second scaled child layout is moved from the second parent layout to the first parent layout.

2. The method according to claim 1, characterized in that, The first sub-layout carries at least one first grandchild layout, and the second sub-layout carries at least one second grandchild layout. The display size of the first grandchild layout and the second grandchild layout is a fixed value. The first grandchild layout is the layout corresponding to the first participant window, and the second grandchild layout is the layout corresponding to the second participant window.

3. The method according to claim 1, characterized in that, The first scaling factor represents the ratio of the resolution of the second screen to the resolution of the first screen, and the second scaling factor represents the ratio of the resolution of the first screen to the resolution of the second screen.

4. The method according to claim 1, characterized in that, The first sub-layout is drawn based on the coordinate axis zero point of the first parent layout, and the second sub-layout is drawn based on the coordinate axis zero point of the second parent layout; the step of scaling the first sub-layout according to a first scaling factor to obtain a first scaled sub-layout, and scaling the second sub-layout according to a second scaling factor to obtain a second scaled sub-layout, includes: The layout parameters of the first child layout are set according to the layout parameters of the first parent layout, and the display size of the first child layout is scaled according to the first scaling factor with the zero point of the coordinate axis of the first parent layout as the fulcrum, so as to obtain the first scaled child layout. The layout parameters of the second child layout are set according to the layout parameters of the second parent layout, and the display size of the second child layout is scaled according to the second scaling factor with the zero point of the coordinate axis of the second parent layout as the fulcrum, so as to obtain the second scaled child layout.

5. The method according to claim 1, characterized in that, The first sub-layout is drawn based on the coordinate axis zero point of the first parent layout, and the second sub-layout is drawn based on the coordinate axis zero point of the second parent layout; The step of scaling the first sub-layout according to a first scaling factor to obtain a first scaled sub-layout, and scaling the second sub-layout according to a second scaling factor to obtain a second scaled sub-layout, includes: Using the zero point of the coordinate axis of the first parent layout as the fulcrum, the display size of the first child layout is scaled according to the first scaling factor to obtain the first scaled child layout. Using the zero point of the coordinate axis of the second parent layout as the fulcrum, the display size of the second child layout is scaled according to the second scaling factor to obtain the second scaled child layout; After scaling the first sub-layout according to a first scaling factor to obtain a first scaled sub-layout, and scaling the second sub-layout according to a second scaling factor to obtain a second scaled sub-layout, the method further includes: The layout parameters of the first scaled child layout are set according to the layout parameters of the first parent layout, and the layout parameters of the second scaled child layout are set according to the layout parameters of the second parent layout.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: In response to the input cross-screen switching and restoration operation, the first scaling factor and the second scaling factor are set to 1 respectively, so that the first scaled sub-layout and the second scaled sub-layout are restored to the first sub-layout and the second sub-layout respectively. The first child layout is moved from the second parent layout to the first parent layout, and the second child layout is moved from the first parent layout to the second parent layout.

7. The method according to any one of claims 1 to 5, characterized in that, The method further includes: In response to the input of a virtual collaboration tool creation operation, a virtual collaboration canvas is created in the third grandchild layout of the first child layout; In response to an input virtual collaboration tool sharing operation, the virtual collaboration canvas is migrated from the third grandchild layout of the first child layout to the third child layout of the first parent layout. The virtual collaboration canvas is displayed in a third child layout of the first parent layout, wherein the display size of the virtual collaboration canvas is the same as the display size of the first parent layout.

8. The method according to claim 7, characterized in that, After the virtual collaborative canvas is displayed in the third child layout of the first parent layout, the method further includes: In response to the input cross-screen switching operation, the display size of the virtual collaboration canvas is scaled according to the first scaling factor to obtain the scaled virtual collaboration canvas. The scaled virtual collaborative canvas is moved from the third child layout of the first parent layout to the fourth child layout of the second parent layout. The virtual collaboration canvas is displayed in the fourth child layout of the second parent layout.

9. The method according to claim 8, characterized in that, The method further includes: In response to the input exit sharing operation, if the fourth child layout of the second parent layout displays the virtual collaboration canvas, then after migrating the virtual collaboration canvas from the fourth child layout to the third child layout, the virtual collaboration canvas is then migrated from the third child layout to the third grandchild layout of the first child layout. If the virtual collaboration canvas is displayed in the third child layout of the first parent layout, then the virtual collaboration canvas is moved from the third child layout to the third grandchild layout of the first child layout.

10. A method for cross-screen switching of a display interface, characterized in that, The method is applied to a processor, which is communicatively connected to a first screen and a second screen; the method includes: In response to the input of a video conference creation operation, the corresponding conference interface is displayed on the first screen and the second screen respectively. The conference interface on the first screen includes a first parent layout and a first child layout carried by the first parent layout. The conference interface on the second screen includes a second parent layout and a second child layout carried by the second parent layout. The constraint layout mode of the first parent layout and the second parent layout is set to the child layout size unlimited mode. In response to a cross-screen switching operation, the first child layout is moved from the first parent layout to the second parent layout, and the second child layout is moved from the second parent layout to the first parent layout; The first sub-layout is scaled according to a first scaling factor to obtain a first scaled sub-layout, and the second sub-layout is scaled according to a second scaling factor to obtain a second scaled sub-layout.

Images