Screen display method and device, computer device, and storage medium

Abstract

The application belongs to the technical field of multi-screen interaction, and relates to a screen display method and device, computer equipment and a storage medium, comprising the following steps: in response to a display event triggered by movement of a first display screen, acquiring state information of the first display screen according to the display event; identifying a plurality of started applications in a second display screen, the first display screen being connected with the second display screen; determining a first application to be started in the first display screen and a first display parameter of the first application in the first display screen according to the state information and application information of the plurality of started applications; and starting the first application in the first display screen according to the first display parameter and displaying content of the first application. According to the application, software can be automatically identified and started after a secondary screen is started, and user experience and work efficiency of multi-screen cooperation are improved.

Description

Technical Field

[0001] This application relates to the field of multi-screen interaction technology, and in particular to a screen display method, apparatus, computer device and storage medium. Background Technology

[0002] With the increasing demand for efficient operation in scenarios such as multitasking, video editing, and programming development, multi-screen extension has become an important way to optimize workflows and improve efficiency. The application of secondary screen extension functions on various devices is becoming more and more widespread, driving secondary screen extension technology to gradually become the focus of industry attention.

[0003] Current mainstream secondary screen expansion technologies mostly achieve multi-screen layouts by connecting external monitors via cables or by using physically pluggable secondary screen designs. Although some devices support basic hot-swapping functionality, they can only complete the initial recognition of monitor connection. Users still need to manually enable multi-screen mode, adjust desktop coordinate allocation, and set window display rules. The entire process relies on manual operation.

[0004] In view of the above, this application is hereby submitted. Summary of the Invention

[0005] The purpose of this application is to provide a screen display method, apparatus, computer device, and storage medium to solve the technical problem that the software to be opened cannot be automatically identified and launched after the secondary screen is turned on.

[0006] To address the aforementioned technical problems, this application provides a screen display method, employing the following technical solution: In response to a display event triggered by the movement of the first display screen, the state information of the first display screen is obtained based on the display event; Identify multiple running applications on the second display screen, wherein the first display screen is a display screen connected to the second display screen; Based on the status information and the application information of multiple launched applications, determine the first application to be launched on the first display screen and the first display parameters of the first application on the first display screen; Based on the first display parameters, the first application is launched on the first display screen, and the content of the first application is displayed.

[0007] Furthermore, determining the first application to be opened on the first display screen and the first display parameters of the first application on the first display screen based on the status information and the application information of multiple launched applications includes: Based on the application information, the multiple launched applications are sorted to obtain an application list; Filter the target application from the application list, and determine the first application based on the target application and the status information; Based on the first application, a first display parameter is determined on the first display screen.

[0008] Furthermore, the step of sorting the multiple launched applications according to the application information to obtain an application list includes: The activity level of each launched application is determined based on the application information. Based on the activity level, the launched applications are sorted to obtain the application list.

[0009] Furthermore, determining the first application based on the target application and the state information includes: Based on the status information, determine the direction of movement of the first display screen; The first application is determined based on the direction of movement and the target application.

[0010] Furthermore, the step of launching the first application on the first display screen and displaying the content of the first application according to the first display parameters includes: Based on the first display parameters, determine the coordinates of the first application in the first display screen; Launch the first application on the first display screen and display the content of the first application at the coordinates.

[0011] Furthermore, determining the coordinates of the first application on the first display screen based on the first display parameters includes: Obtain the first physical position of the first display screen and the second physical position of the second display screen; A virtual coordinate system is constructed based on the first physical location and the second physical location; Based on the first display parameters and the virtual coordinate system, determine the coordinates of the first application in the first display screen.

[0012] Furthermore, launching the first application on the first display screen according to the first display parameters includes: Based on the first display parameters and the status information, an instruction to launch the first application is generated; According to the instruction, the opening interface of the first application is invoked; The first application is launched on the first display screen according to the launch interface.

[0013] To address the aforementioned technical problems, this application also provides a screen display device, which employs the following technical solution: A screen display device, comprising: The acquisition module is used to acquire the status information of the first display screen in response to a display event triggered by the movement of the first display screen; An identification module is used to identify multiple launched applications on a second display screen, wherein the first display screen is a display screen connected to the second display screen. The determining module is used to determine, based on the status information and the application information of multiple launched applications, the first application to be opened on the first display screen and the first display parameters of the first application on the first display screen. The startup module is used to launch the first application on the first display screen according to the first display parameters and display the content of the first application.

[0014] To address the aforementioned technical problems, this application also provides a computer device that employs the following technical solution: A computer device includes a memory and a processor, the memory storing computer-readable instructions, the processor executing the computer-readable instructions to implement the steps of the screen display method described above.

[0015] To address the aforementioned technical problems, this application also provides a computer-readable storage medium, employing the technical solution described below: A computer-readable storage medium storing computer-readable instructions that, when executed by a processor, implement the steps of the screen display method described above.

[0016] Compared with the prior art, this application has the following main advantages: The screen display method disclosed in this application can quickly capture the real-time state of the display screen by responding to display events triggered by the movement of the first display screen and obtaining its state information; then it can identify multiple running applications on the connected second display screen to ensure that the applications running on the first display screen are appropriate for the user's current usage scenario; then it can determine the first application to be launched and the first display parameters by combining the state information and the application information of the launched applications, so that the application allocation is both accurately adapted to the state of the second display screen and meets the user's usage needs; finally, the first application is launched and displayed on the first display screen according to the first display parameters, realizing seamless content presentation without interfering with the existing operation of the second display screen, and significantly improving the convenience and user experience of multi-screen collaboration. Attached Figure Description

[0017] To more clearly illustrate the solutions in this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is an exemplary system architecture diagram to which this application can be applied; Figure 2 This is a flowchart of one embodiment of the screen display method according to this application; Figure 3 This is a schematic diagram of the structure of one embodiment of the screen display device according to this application; Figure 4 This is a schematic diagram of the structure of one embodiment of the computer device according to this application. Detailed Implementation

[0019] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains; the terminology used herein in the specification of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "comprising" and "having," and any variations thereof, in the specification, claims, and foregoing drawings of this application are intended to cover non-exclusive inclusion. The terms "first," "second," etc., in the specification, claims, or foregoing drawings of this application are used to distinguish different objects, not to describe a particular order.

[0020] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a mutually exclusive, independent, or alternative embodiment. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0021] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

[0022] like Figure 1As shown, the system architecture 100 may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired or wireless communication links, or fiber optic cables, etc.

[0023] Users can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 via the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as web browser applications, shopping applications, search applications, instant messaging tools, email clients, social platform software, etc.

[0024] The first terminal device 101, the second terminal device 102, and the third terminal device 103 can be various electronic devices with displays and support web browsing, including but not limited to smartphones, tablets, e-book readers, MP3 (Moving Picture Experts Group Audio Layer Ⅲ) players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptops, and desktop computers, etc.

[0025] Server 105 can be a server that provides various services, such as a backend server that supports the pages displayed on the first terminal device 101, the second terminal device 102, and the third terminal device 103.

[0026] It should be noted that the screen display method provided in the embodiments of this application is generally executed by a terminal device, and correspondingly, the screen display device is generally disposed in the terminal device.

[0027] It should be understood that Figure 1 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of terminal devices, networks, and servers can be included.

[0028] Continue to refer to Figure 2 A flowchart of an embodiment of the screen display method according to this application is shown. The screen display method includes the following steps: Step S201: In response to a display event triggered by the movement of the first display screen, obtain the status information of the first display screen according to the display event.

[0029] In this embodiment, the screen display method operates on an electronic device (e.g., Figure 1 The terminal device shown can send or receive data via wired or wireless connection. It should be noted that the aforementioned wireless connection methods may include, but are not limited to, 3G / 4G / 5G connections, Wi-Fi connections, Bluetooth connections, WiMAX connections, Zigbee connections, UWB (ultra-wide band) connections, and other currently known or future wireless connection methods.

[0030] In this embodiment, the first display screen is generally an auxiliary display screen that can be moved and expanded through preset methods, such as popping out from a guide rail or external expansion; it can also be called a secondary screen. A display event refers to a system-recognizable interactive signal generated by the hardware layer and converted by the system layer when the first display screen undergoes physical movement (such as popping out, retracting, or placing in place). This event can also be detected through the system's plug-and-play functionality. Status information is the basic information of the first display screen, such as the unique identifier of the second display screen, its physical movement direction, operating status, and configuration information. Specifically, when the user pulls the built-in first display screen outward along the guide rail for office needs, the physical displacement of the first display screen triggers a Hall sensor inside the right guide rail. After detecting the change in the position of the metal contact, the sensor generates an electrical signal. This hardware electrical signal is converted by the sensor driver program to generate a recognizable display access event. This event is the trigger signal for the movement of the first display screen, and the event data carries the initial hardware information of the first display screen. Next, the hardware information is parsed to obtain the status information of the second display screen, such as the identifier of the first display screen, its movement direction, and whether it is ready.

[0031] Step S202: Identify multiple running applications on the second display screen, wherein the first display screen is a display screen connected to the second display screen.

[0032] In this embodiment, the second display screen refers to the main display screen connected to the first display screen, also known as the main screen. It is generally a fixed or built-in display device used by the user for daily operation, such as the built-in screen of a laptop or a fixed main display screen connected to a desktop computer. Each of the four physical rails (left, right, top, and bottom) of the second display screen corresponds to a pop-out first display screen. Each rail integrates a Hall sensor or microswitch, and each first display screen is equipped with a unique identifier. This identifier can be implemented through the Extended Display Identification Data (EDID) protocol or a built-in chip, ensuring that the system can distinguish between different physical first display screens.

[0033] For example, the screen management service of the second display screen calls multiple sets of Windows system Application Programming Interfaces (APIs) to complete application identification and information extraction layer by layer. Specifically, it iterates through all the current top-level windows on the second display screen, obtains the handle (unique window identifier) ​​of each window, excludes windows minimized to the system tray and without interface interaction, such as antivirus software daemons running in the background, and initially filters out running applications that meet the criteria.

[0034] Step S203: Based on the status information and the application information of multiple launched applications, determine the first application to be launched on the first display screen and the first display parameters of the first application on the first display screen.

[0035] In this embodiment, the state information of the first display screen determines the corresponding application for the direction. For example, if the first display screen moves to the left of the second display screen, it mainly displays the auxiliary tools or reference documents corresponding to the first display screen; if it moves to the right, it serves as an extension of the main content in the second display screen. The running application information of the second display screen determines the range of candidate applications. The two are combined to filter out the application to be opened that best meets the user's current needs and its corresponding display parameters. For example, if the running application in the second display screen is an active office application or document editing application, and its associated need might be to quickly look up literature to assist in document writing, then the first application can be determined to be OneNote or a browser as an auxiliary to the second display screen. The first display parameter refers to the display mode in the first display screen, such as windowed or full-screen, window size, display position, content loading, etc.

[0036] Step S204: Based on the first display parameters, launch the first application on the first display screen and display the content of the first application.

[0037] In this embodiment, the appropriate application launch interface is called according to the first display parameter. If the first application is a native system application, the operating system-level launch interface is called; if it is a third-party application, the launch interface provided by its developer is called. Simultaneously, the first display parameter is passed as a core configuration item of the launch command, directly specifying the application's launch target as the first display screen. After the application launches, its display state is automatically adjusted according to the first display parameter to ensure that the application window is presented at the set size and its position is completely within the effective display area of ​​the first display screen, while simultaneously loading the application's corresponding target content.

[0038] This application can quickly capture the real-time status of a display screen by responding to display events triggered by the movement of the first display screen and obtaining its status information. It can then identify multiple running applications on the connected second display screen to ensure that the applications running on the first display screen are appropriate for the user's current usage scenario. By combining the status information and the application information of the running applications, it determines the first application to be launched and the first display parameters, so that the application allocation is both accurately adapted to the status of the second display screen and meets the user's usage needs. Finally, the first application is launched and displayed on the first display screen according to the first display parameters, achieving seamless content presentation without interfering with the existing operation of the second display screen, and significantly improving the convenience and user experience of multi-screen collaboration.

[0039] In some optional implementations of this embodiment, the step of determining the first application to be opened on the first display screen and the first display parameters of the first application on the first display screen based on the status information and the application information of multiple launched applications includes: Based on the application information, the multiple launched applications are sorted to obtain an application list; Filter the target application from the application list, and determine the first application based on the target application and the status information; Based on the first application, a first display parameter is determined on the first display screen.

[0040] In this embodiment, application information for each launched application is extracted, including its running status, function type, and relevance to the user's current operation. Then, based on applications closely related to the user's core operations and functionally compatible with the first display screen, all launched applications are arranged in an orderly manner to form a clear application list, ensuring clear priority for subsequent filtering. The status information includes the movement direction of the first display screen; the target application is filtered from the application list based on this movement direction.

[0041] Next, based on the status information, a list of candidate applications to be launched can be compiled. Specifically, applications that need to run continuously on the second display, conflict with the auxiliary functions of the first display, or are hardware incompatible are excluded. Candidate applications whose functions can assist the main screen operation and are adapted to the hardware status of the first display are retained. Then, combined with the status information of the first display (such as hardware readiness and display area constraints), the feasibility of the candidate applications is verified, and finally, the candidate application with the best adaptability is selected as the first application. Based on the functional characteristics of the first application, such as whether it needs to display complete content or whether it needs to interact quickly, and combined with the status information of the first display, such as resolution and effective display area, the appropriate first display parameters are determined. The first display parameters include a display mode (windowed or full-screen) that matches the application's usage scenario, a window size that matches the display specifications, a position range within the effective display area, and not interfering with main screen operation.

[0042] This application generates a list of launched applications by sorting them according to application information, providing a clear priority for subsequent screening and avoiding blind matching; then it filters out applications that are essential to the main screen or have conflicting functions, retains auxiliary candidates, and determines the first application with the best compatibility by combining the status information of the first display screen; finally, it sets the display parameters according to the application characteristics and screen status, without interfering with the main screen, effectively improving the accuracy and user experience of multi-screen collaboration.

[0043] In some optional implementations of this embodiment, the step of sorting the multiple launched applications according to the application information to obtain an application list includes: The activity level of each launched application is determined based on the application information. Based on the activity level, the launched applications are sorted to obtain the application list.

[0044] In this embodiment, application information for each launched application is extracted on the second display screen. Then, from the application information of each launched application, the running status, recent interactions, and usage frequency on the second display screen are extracted for determining activity levels. Specifically, the running status is prioritized to identify whether it is currently an active window. If the application is in a window that the user is currently operating (such as a document software where text is being typed, or a browser page being viewed), it is marked as a high-activity basic level; if it is only running in the background (not currently being operated), it is marked as a medium / low-activity basic level. Recent interactions show the application's recent usage time. Even background applications have higher activity levels than background applications that have not been interacted with for a long time if the user has switched or clicked within a short period. Usage frequency is the number of times the application is opened or switched by the user within a short period. A higher switching frequency indicates a higher user dependence on the application, and the activity level is correspondingly higher.

[0045] Next, the launched applications are sorted according to their activity level, with priority given to those with higher activity levels, and then sorted by the most recent interaction time within the same level, ultimately forming a list of applications arranged by activity level.

[0046] This application determines the activity level of each launched application by analyzing application information, and then generates an application list by sorting the applications by activity level. It prioritizes applications that the user is currently using and that have been frequently interacting with recently, while excluding applications that have been idle for a long time, making the list's priority clear and explicit. This provides a basis for subsequent selection of target applications, aligns with users' real-time usage habits, and effectively improves the adaptability and efficiency of application matching in multi-screen collaboration.

[0047] In some optional implementations of this embodiment, the step of determining the first application based on the target application and the state information includes: Based on the status information, determine the direction of movement of the first display screen; The first application is determined based on the direction of movement and the target application.

[0048] In this embodiment, based on the status information obtained from the display event, the identifier of the first display screen is extracted from the status information. This identifier is a unique identity credential for each secondary screen, which can be generated through the EDID protocol (such as DISP-L-001, DISP-R-002) or stored by the chip built into the secondary screen. The movement direction information of the first display screen is also extracted from the status information.

[0049] Specifically, based on the determined direction of movement, a preset direction and function adaptation strategy is invoked. For example, when the direction of movement is left, it adapts to auxiliary tool applications, such as reference documents and toolbars; when the direction is right, it adapts to content extension applications, such as information retrieval pages and data charts; when the direction is up, it adapts to preview and monitoring applications, such as timeline previews and data dashboards; and when the direction is down, it adapts to log detail applications, such as terminal windows and participant lists.

[0050] For example, the target application corresponds to the function of the movement direction. Based on the current movement direction, there will be candidate applications matching that direction. The most suitable application among these candidate applications is the target application, which becomes the first application. For instance, when the current movement direction is left, candidate applications could be a code editor's reference code window, a PDF document reader, or OneNote. However, considering the target application, such as Word, the first application can be determined as OneNote or a browser from the candidate applications. This relationship between direction and the application being used can also be customized by the user.

[0051] This application determines the movement direction of the first display screen through status information, then invokes a preset function adaptation strategy according to the direction, and selects the first application in conjunction with the target application. This not only ensures that the first application matches the assisted positioning of the corresponding direction, but also fits the needs of the target application on the main screen, and supports personalized user settings, effectively improving the accuracy and flexibility of multi-screen collaboration.

[0052] In some optional implementations of this embodiment, the step of launching the first application on the first display screen and displaying the content of the first application according to the first display parameters includes: Based on the first display parameters, determine the coordinates of the first application in the first display screen; Launch the first application on the first display screen and display the content of the first application at the coordinates.

[0053] In this embodiment, the requirements of the first display parameters are first read, such as the display mode (full-screen or fixed window), window size specifications, and the screen edges to be aligned with. Then, combined with the effective display range of the first display screen, i.e., the boundary area where the screen can normally display content, the coordinates of the first application are deduced and determined in reverse. If the parameter specifies full-screen display, the coordinates directly correspond to the complete display range of the first display screen; if the parameter specifies windowed display, a reasonable position is planned within the effective range of the first display screen according to the set window size, such as centering or aligning with the right edge, ultimately forming a coordinate range (including the position boundaries of the upper left and lower right corners of the window), ensuring that the coordinates fall completely within the first display screen and do not exceed the boundaries. Next, the application startup interface is called, and the determined coordinates are passed in as a forced display constraint, explicitly instructing the first application to load the window within this coordinate range after startup. During application startup, the window position is monitored in real time. If a slight offset occurs, the window is automatically calibrated to the specified coordinates. After the window stabilizes, the target content of the first application is loaded, ensuring that the content completely fills the window area corresponding to the coordinates, and the entire process does not interfere with the normal operation of the second display screen, realizing the positioning and display of the first application on the first display screen.

[0054] This application determines the coordinates of a first application on the first display screen using first display parameters, ensuring that the coordinates fit within the effective range of the screen and do not exceed the boundaries; then, the application is launched according to the coordinates and the offset is calibrated in real time, allowing the content to completely fill the coordinate area. The entire process achieves precise positioning and display of the first application on the first display screen without interfering with the operation of the second display screen, effectively improving the display stability and user experience of multi-screen collaboration.

[0055] In some optional implementations of this embodiment, the step of determining the coordinates of the first application on the first display screen based on the first display parameters includes: Obtain the first physical position of the first display screen and the second physical position of the second display screen; A virtual coordinate system is constructed based on the first physical location and the second physical location; Based on the first display parameters and the virtual coordinate system, determine the coordinates of the first application in the first display screen.

[0056] In this embodiment, the second physical position can be determined by using the lower left corner of the second display screen as the physical reference point to determine the reference orientation of the second display screen in physical space. The first physical position can be determined by using a Hall sensor inside the guide rail of the second display screen to detect the physical pop-up state of the first display screen (completely popped up to the end of the guide rail), and by combining the sensor position to determine the pop-up direction of the first display screen, thereby determining the relative physical orientation with the second display screen. A virtual coordinate system is constructed with the physical reference point of the second display screen (main screen) as the origin. This can be defined as an X-axis extending horizontally to the right along the main screen (i.e., from the lower left corner to the lower right corner of the main screen), and a Y-axis extending vertically upward along the main screen (i.e., from the lower left corner to the upper left corner of the main screen). The overall range of the main screen in the virtual coordinate system is determined by combining the physical size and resolution of the main screen. If the secondary screen is located to the right of the main screen, its virtual coordinate range needs to be extended along the positive X-axis, starting from the lower right corner of the main screen, and combined with the resolution of the secondary screen to determine the virtual coordinate range of the secondary screen. By combining the size of the first application window in the first display parameters and determining that its position is in the center of the first display screen, its specific coordinates can be obtained.

[0057] This application ensures that the coordinate system conforms to the actual placement of the two screens by determining the physical positions of the first and second displays; then, it constructs a unified virtual coordinate system based on this, providing a precise benchmark for coordinate calculations; finally, it determines the application coordinates by combining the parameters of the first display. This allows the first application coordinates to accurately fall within the first display screen and meet display requirements, improving the positioning accuracy and display stability of multi-screen collaboration.

[0058] In some optional implementations of this embodiment, the step of launching the first application on the first display screen according to the first display parameters includes: Based on the first display parameters and the status information, an instruction to launch the first application is generated; According to the instruction, the opening interface of the first application is invoked; According to the opening interface, the first application is opened on the first display screen to obtain the target display content.

[0059] In this embodiment, parameters from the first display parameters and status information are extracted. For example, the unique identifier of the secondary screen and the virtual coordinate range are obtained from the status information to determine the target device and spatial boundary for application startup. The window size, display position, and display mode are obtained from the first display parameters to determine the display form of the application. These parameters are then integrated into a structured startup instruction, which includes the application's executable path, screen identifier, and display configuration parameters to ensure that the instruction can locate the startup object and display requirements. Next, the startup interface of the first application is called according to the startup instruction. The corresponding interface is matched according to the type of the first application. If the first application is a native system application, such as a terminal or preview tool, the system-level startup interface provided by the operating system is called, and the startup instruction is passed in as a parameter. The interface automatically associates with the screen identifier to prevent the startup signal from pointing to the main screen. If it is a third-party application, such as a browser or document tool, the application's own developer interface is called, and the key parameters in the startup instruction are also passed in. If the third-party application requires external call permissions, permission verification is performed, such as reading the user's preset authorization configuration in advance. Finally, the first application is launched on the first display screen through the startup interface, and the target display content is obtained. After enabling the interface parsing command, a dedicated connection is first established with the display driver of the first display screen to direct the application's rendering output channel to the first display screen, preventing the application from briefly flashing on the main screen. Then, the window is initialized according to the display parameters in the command, and the interface can be loaded in windowed mode. After the window is initialized, the interface will trigger the loading of application function modules (such as loading the command line interaction module in the terminal or loading the preset webpage in the browser). Finally, the application stably displays the corresponding content on the first display screen (such as the command input interface in the terminal or the reference webpage in the browser), thus obtaining the target display content of the first application, without affecting the application currently running on the main screen.

[0060] This application generates structured startup instructions by integrating the status and display parameters of the first display screen, thus identifying the display requirements of the first display screen and applications. It matches system-level or third-party interfaces according to application type, automatically verifying permissions for strong adaptability. It also targets and renders applications to the secondary screen, avoiding interference from main screen flickering. This improves application startup accuracy and compatibility while ensuring normal use of the main screen and optimizing the multi-screen collaboration experience.

[0061] In this embodiment, after the displacement signals of multiple secondary screens (excluding the main screen) are captured by sensors and transmitted to the system, the screen management service updates the secondary screen status table, marking the ready status and virtual coordinates of all pop-up secondary screens. Simultaneously, the automatic allocation function in single-secondary-screen mode is not activated; only a unified virtual desktop space across multiple screens is maintained to ensure that users can perform cross-screen movement operations on the main screen application window. Next, operation commands for moving application windows in the main screen are received. These operation commands can be triggered through various user interaction methods. For example, the user can drag an application window (such as a browser window or document editing window) on the main screen towards a screen edge (e.g., drag it to the left edge of the main screen); or press a preset shortcut key to specify moving the current main screen application window to the corresponding secondary screen; on some touch-enabled devices, users can also generate movement commands by swiping the main screen window with two fingers. The operating system listens to these interactions in real time, parses and captures the corresponding operation commands. Finally, based on the target secondary screen direction in the operation command and the virtual coordinates in the secondary screen status table, the corresponding target secondary screen is determined (e.g., if the command points to the left, the left secondary screen with coordinates [-1920,0)-(0,1080) is matched); then the window management API is called to migrate the application window to be moved from the main screen to the target secondary screen according to the command. If it is a mouse drag operation, the window will smoothly transition to the target secondary screen with the drag action and automatically adjust the window size to adapt to the secondary screen resolution; if it is a shortcut key operation, the window will be instantly positioned to the preset position of the target secondary screen (e.g., centered display) while retaining the original content state of the window (e.g., the currently opened webpage in the browser, the currently edited page of the document), and finally the application window is clearly displayed on the target secondary screen, realizing the user's need to allocate multi-screen content as needed.

[0062] This application empowers users by not forcibly and automatically assigning content when multiple secondary screens are triggered simultaneously. It supports various window movement commands such as mouse drag, shortcut keys, and touch, adapting to different operating habits. When migrating windows, the transition is smooth, the resolution of the secondary screen is automatically adapted, and the original content state of the application is preserved, meeting the needs of complex multi-screen collaboration and effectively improving the flexibility and user experience of multi-screen operation.

[0063] The embodiments of this application can acquire and process relevant data based on artificial intelligence technology. Artificial intelligence (AI) refers to the theories, methods, technologies, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results.

[0064] Foundational technologies for artificial intelligence generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies mainly encompass computer vision, robotics, biometrics, speech processing, natural language processing, and machine learning / deep learning.

[0065] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing related hardware through computer-readable instructions. These computer-readable instructions can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above methods. The aforementioned storage medium can be a non-volatile storage medium such as a magnetic disk, optical disk, or read-only memory (ROM), or random access memory (RAM).

[0066] It should be understood that although the steps in the flowcharts of the accompanying figures are shown sequentially as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the accompanying figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0067] Further reference Figure 3 As a response to the above Figure 2 The implementation of the method shown in this application provides an embodiment of a screen display device, which is similar to... Figure 2 Corresponding to the method embodiments shown, this device can be specifically applied to various electronic devices.

[0068] like Figure 3 As shown, the screen display device 300 described in this embodiment includes: an acquisition module 301, an identification module 302, a determination module 303, a startup module 304, and a verification module 305. Wherein: The acquisition module 301 is used to acquire the status information of the first display screen in response to a display event triggered by the movement of the first display screen; The identification module 302 is used to identify multiple running applications on the second display screen, wherein the first display screen is a display screen connected to the second display screen; The determining module 303 is used to determine, based on the status information and the application information of multiple launched applications, the first application to be opened on the first display screen and the first display parameters of the first application on the first display screen. The startup module 304 is used to launch the first application on the first display screen according to the first display parameters and display the content of the first application.

[0069] The screen display device provided in this application can quickly capture the real-time status of the display screen by responding to display events triggered by the movement of the first display screen and obtaining its status information; then it can identify multiple running applications on the connected second display screen to ensure that the applications running on the first display screen are appropriate for the user's current usage scenario; then it can determine the first application to be launched and the first display parameters by combining the status information and the application information of the launched applications, so that the application allocation is both accurately adapted to the status of the second display screen and meets the user's usage needs; finally, the first application is launched and displayed on the first display screen according to the first display parameters, realizing seamless content presentation without interfering with the existing operation of the second display screen, and significantly improving the convenience and user experience of multi-screen collaboration.

[0070] In some optional implementations of this embodiment, the determining module 303 is further configured to: Based on the application information, the multiple launched applications are sorted to obtain an application list; Filter the target application from the application list, and determine the first application based on the target application and the status information; Based on the first application, a first display parameter is determined on the first display screen.

[0071] The screen display device provided in this application generates a list by sorting launched applications according to application information, providing clear priorities for subsequent screening and avoiding blind matching; it then filters out applications that are necessary for the main screen or have conflicting functions, retains auxiliary candidates, and determines the first application with the best compatibility by combining the status information of the first display screen; finally, it sets the display parameters according to the application characteristics and screen status, without interfering with the main screen, effectively improving the accuracy and user experience of multi-screen collaboration.

[0072] In some optional implementations of this embodiment, the determining module 303 is further configured to: The activity level of each launched application is determined based on the application information. Based on the activity level, the launched applications are sorted to obtain the application list.

[0073] The screen display device provided in this application determines the activity level of each launched application based on application information, and then generates an application list by sorting the applications by activity level. This prioritizes applications that the user is currently operating on or that have been frequently interacting with recently, while excluding applications that have been idle for a long time, making the list priority clear and unambiguous. This provides a basis for subsequent selection of target applications, aligns with users' real-time usage habits, and effectively improves the adaptability and efficiency of application matching in multi-screen collaboration.

[0074] In some optional implementations of this embodiment, the determining module 303 is further configured to: Based on the status information, determine the direction of movement of the first display screen; The first application is determined based on the direction of movement and the target application.

[0075] The screen display device provided in this application determines the movement direction of the first display screen through status information, and then calls a preset function adaptation strategy according to the direction, and selects the first application in combination with the target application. This not only makes the first application fit the assisted positioning of the corresponding direction, but also fits the needs of the target application on the main screen, and supports user personalization settings, effectively improving the accuracy and flexibility of multi-screen collaboration.

[0076] In some optional implementations of this embodiment, the startup module 304 is further configured to: Based on the first display parameters, determine the coordinates of the first application in the first display screen; Launch the first application on the first display screen and display the content of the first application at the coordinates.

[0077] The screen display device provided in this application determines the coordinates of a first application on the first display screen using first display parameters, ensuring that the coordinates fit within the effective range of the screen and do not exceed the boundaries; then, the application is launched according to the coordinates and the offset is calibrated in real time, allowing the content to completely fill the coordinate area. The entire process achieves precise positioning and display of the first application on the first display screen without interfering with the operation of the second display screen, effectively improving the display stability and user experience of multi-screen collaboration.

[0078] In some optional implementations of this embodiment, the startup module 304 is further configured to: Obtain the first physical position of the first display screen and the second physical position of the second display screen; A virtual coordinate system is constructed based on the first physical location and the second physical location; Based on the first display parameters and the virtual coordinate system, determine the coordinates of the first application in the first display screen.

[0079] The screen display device provided in this application ensures that the coordinate system conforms to the actual placement of the two screens by using the physical positions of the first and second screens; then, a unified virtual coordinate system is constructed based on this to provide a precise benchmark for coordinate calculation; finally, the application coordinates are determined by combining the first display parameters. This allows the first application coordinates to fall precisely within the first screen and meet display requirements, improving the positioning accuracy and display stability of multi-screen collaboration.

[0080] In some optional implementations of this embodiment, the startup module 304 is further configured to: Based on the first display parameters and the status information, an instruction to launch the first application is generated; According to the instruction, the opening interface of the first application is invoked; According to the opening interface, the first application is opened on the first display screen to obtain the target display content.

[0081] The screen display device provided in this application generates structured startup instructions by integrating the status and display parameters of the first display screen, thus locating the first display screen and application display requirements; it matches system-level or third-party interfaces according to application type, automatically verifies permissions, and has strong adaptability; it also renders applications to the secondary screen in a targeted manner, avoiding interference from flashing on the main screen. This improves the accuracy and compatibility of application startup, ensures the normal use of the main screen, and optimizes the multi-screen collaboration experience.

[0082] To address the aforementioned technical problems, embodiments of this application also provide a computer device. Please refer to [link / reference needed]. Figure 4 , Figure 4 This is a basic structural block diagram of the computer device in this embodiment.

[0083] The computer device 4 includes a memory 41, a processor 42, and a network interface 43 that are interconnected via a system bus. It should be noted that only the computer device 4 with components 41, 42, and 43 is shown in the figure; however, it should be understood that it is not required to implement all the shown components, and more or fewer components can be implemented alternatively. Those skilled in the art will understand that the computer device described here is a device capable of automatically performing numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes, but is not limited to, microprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), embedded devices, etc.

[0084] The computer device can be a desktop computer, laptop, handheld computer, or cloud server, etc. The computer device can interact with the user via a keyboard, mouse, remote control, touchpad, or voice control.

[0085] The memory 41 includes at least one type of readable storage medium, including flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 41 may be an internal storage unit of the computer device 4, such as the hard disk or memory of the computer device 4. In other embodiments, the memory 41 may also be an external storage device of the computer device 4, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the computer device 4. Of course, the memory 41 may also include both the internal storage unit and its external storage device of the computer device 4. In this embodiment, the memory 41 is typically used to store the operating system and various application software installed on the computer device 4, such as computer-readable instructions for screen display methods. In addition, the memory 41 can also be used to temporarily store various types of data that have been output or will be output.

[0086] In some embodiments, the processor 42 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip. The processor 42 is typically used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is used to execute computer-readable instructions stored in the memory 41 or to process data, such as executing computer-readable instructions for the screen display method.

[0087] The network interface 43 may include a wireless network interface or a wired network interface, which is typically used to establish communication connections between the computer device 4 and other electronic devices.

[0088] The computer device provided in this application can quickly capture the real-time status of the display screen by responding to display events triggered by the movement of the first display screen and obtaining its status information; then it can identify multiple running applications on the connected second display screen to ensure that the applications running on the first display screen are appropriate for the user's current usage scenario; and then, by combining the status information and the application information of the running applications, it can determine the first application to be launched and the first display parameters, so that the application allocation is both accurately adapted to the status of the second display screen and meets the user's usage needs; finally, the first application is launched and displayed on the first display screen according to the first display parameters, achieving seamless content presentation without interfering with the existing operation of the second display screen, and significantly improving the convenience and user experience of multi-screen collaboration.

[0089] This application also provides another embodiment, namely, providing a computer-readable storage medium storing computer-readable instructions that can be executed by at least one processor to cause the at least one processor to perform the steps of the screen display method described above.

[0090] The computer-readable storage medium provided in this application can quickly capture the real-time state of the display screen by responding to a display event triggered by the movement of the first display screen and obtaining its state information; then it can identify multiple running applications on the connected second display screen to ensure that the applications running on the first display screen are appropriate for the user's current usage scenario; and then, by combining the state information and the application information of the running applications, it can determine the first application to be launched and the first display parameters, so that the application allocation is both accurately adapted to the state of the second display screen and meets the user's usage needs; finally, the first application is launched and displayed on the first display screen according to the first display parameters, achieving seamless content presentation without interfering with the existing operation of the second display screen, and significantly improving the convenience and user experience of multi-screen collaboration.

[0091] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0092] Obviously, the embodiments described above are only some embodiments of this application, not all embodiments. The accompanying drawings show preferred embodiments of this application, but do not limit the patent scope of this application. This application can be implemented in many different forms; rather, these embodiments are provided to provide a more thorough and comprehensive understanding of the disclosure of this application. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing specific embodiments, or make equivalent substitutions for some of the technical features. Any equivalent structures made using the content of this application's specification and drawings, directly or indirectly applied to other related technical fields, are similarly within the scope of patent protection of this application.

Claims

1. A screen display method, characterized in that, include: In response to a display event triggered by the movement of the first display screen, the state information of the first display screen is obtained based on the display event; Identify multiple running applications on the second display screen, wherein the first display screen is a display screen connected to the second display screen; Based on the status information and the application information of multiple launched applications, determine the first application to be launched on the first display screen and the first display parameters of the first application on the first display screen; Based on the first display parameters, the first application is launched on the first display screen, and the content of the first application is displayed.

2. The screen display method according to claim 1, characterized in that, The step of determining the first application to be opened on the first display screen and the first display parameters of the first application on the first display screen based on the status information and the application information of multiple launched applications includes: Based on the application information, the multiple launched applications are sorted to obtain an application list; Filter the target application from the application list, and determine the first application based on the target application and the status information; Based on the first application, a first display parameter is determined on the first display screen.

3. The screen display method according to claim 2, characterized in that, The step of sorting multiple launched applications based on the application information to obtain an application list includes: The activity level of each launched application is determined based on the application information. Based on the activity level, the launched applications are sorted to obtain the application list.

4. The screen display method according to claim 2, characterized in that, Determining the first application based on the target application and the status information includes: Based on the status information, determine the direction of movement of the first display screen; The first application is determined based on the direction of movement and the target application.

5. The screen display method according to claim 1, characterized in that, The step of launching the first application on the first display screen and displaying the content of the first application according to the first display parameters includes: Based on the first display parameters, determine the coordinates of the first application in the first display screen; Launch the first application on the first display screen and display the content of the first application at the coordinates.

6. The screen display method according to claim 5, characterized in that, Determining the coordinates of the first application in the first display screen based on the first display parameters includes: Obtain the first physical position of the first display screen and the second physical position of the second display screen; A virtual coordinate system is constructed based on the first physical location and the second physical location; Based on the first display parameters and the virtual coordinate system, determine the coordinates of the first application in the first display screen.

7. The screen display method according to claim 1, characterized in that, The step of launching the first application on the first display screen according to the first display parameters includes: Based on the first display parameters and the status information, an instruction to launch the first application is generated; According to the instruction, the opening interface of the first application is invoked; The first application is launched on the first display screen according to the launch interface.

8. A screen display device, characterized in that, include: The acquisition module is used to acquire the status information of the first display screen in response to a display event triggered by the movement of the first display screen; An identification module is used to identify multiple launched applications on a second display screen, wherein the first display screen is a display screen connected to the second display screen. The determining module is used to determine, based on the status information and the application information of multiple launched applications, the first application to be opened on the first display screen and the first display parameters of the first application on the first display screen. The startup module is used to launch the first application on the first display screen according to the first display parameters and display the content of the first application.

9. A computer device, characterized in that, The device includes a memory and a processor, wherein the memory stores computer-readable instructions, and the processor executes the computer-readable instructions to implement the steps of the screen display method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-readable instructions, which, when executed by a processor, implement the steps of the screen display method as described in any one of claims 1 to 7.

Images