A display device and a multi-screen display method

Abstract

This application provides a display device and a multi-screen display method in some embodiments. The method responds to a user-input touch command for multi-screen display, acquires a touch trajectory extending from a first display to a second display, and extracts a first judgment point located within the edge area of ​​the first display and a second judgment point located within the edge area of ​​the second display from the touch trajectory. It then calculates the movement speed of the trajectory points and the interval distance between the first and second judgment points based on the movement speed, thereby shifting the display of the second user interface according to the interval distance. This method can detect the interval distance between displays by using the trajectory points in the touch trajectory, and adjust the display mode of the second user interface according to the interval distance to solve the problem of user interface splicing display errors.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a multi-screen display method. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, communication terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technology, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs. Display devices may be equipped with image interfaces, which can be used to connect to monitors to form multi-screen display modes.

[0003] In multi-screen display mode, the display device can send the displayed user interface to multiple monitors for display. The content of the user interface displayed on multiple monitors can be the same or different. That is, in the same-screen display mode, the user interface content displayed on multiple monitors is the same, while in the different-screen display mode, the content displayed on multiple monitors is different. In the different-screen display mode, the display device can control the screen content on multiple monitors separately, so that the multiple monitors can be combined to display the overall user interface.

[0004] However, during the process of splicing displays, the gaps between multiple monitors and the influence of monitor bezels can cause severe fragmentation in the spliced ​​image, reducing display quality. Furthermore, when the user adjusts the position of the monitors, changing their relative positions, it can lead to splicing errors in the user interface, negatively impacting the viewing experience. Summary of the Invention

[0005] This application provides a display device and a multi-screen display method, which adjusts the display mode of the user interface by detecting the spacing between multiple screens, thereby solving the problem of user interface splicing display errors.

[0006] In a first aspect, this application provides a display device, including: a first display, a device interface, and a controller. The first display is configured to display a first user interface; the first display is connected to a touch interaction module, the touch interaction module being used to acquire touch commands input by a user; the device interface is configured to connect to a second display, the second display being configured to display a second user interface; the second display is connected to the touch interaction module; the controller is configured to execute the following program steps:

[0007] In response to a user-input touch command for multi-screen display, a touch trajectory is acquired, the touch trajectory extending from the first display to the second display; the touch trajectory includes a start point, a trajectory point, and an end point;

[0008] Extract a first judgment point and a second judgment point from the touch trajectory, wherein the first judgment point is a trajectory point located within the edge area of ​​the first display; and the second judgment point is a trajectory point located within the edge area of ​​the second display.

[0009] Calculate the moving speed of the trajectory points in the touch trajectory;

[0010] Calculate the interval distance between the first and second judgment points based on the moving speed and the input time of the first and second judgment points.

[0011] The second display is controlled to pan and show the second user interface according to the stated interval distance.

[0012] Secondly, this application also provides a multi-screen display method, applied to the display device provided in the first aspect, the multi-screen display method comprising:

[0013] In response to a user-input touch command for multi-screen display, a touch trajectory is acquired, the touch trajectory extending from the first display to the second display; the touch trajectory includes a start point, a trajectory point, and an end point;

[0014] Extract a first judgment point and a second judgment point from the touch trajectory, wherein the first judgment point is a trajectory point located within the edge area of ​​the first display; and the second judgment point is a trajectory point located within the edge area of ​​the second display.

[0015] Calculate the moving speed of the trajectory points in the touch trajectory;

[0016] Calculate the interval distance between the first and second judgment points based on the moving speed and the input time of the first and second judgment points.

[0017] The second user interface is displayed by panning according to the stated interval distance.

[0018] As can be seen from the above technical solutions, some embodiments of this application provide a display device and a multi-screen display method. The method can respond to a user-input touch command for multi-screen display, acquire a touch trajectory extending from a first display to a second display, and extract a first judgment point located within the edge area of ​​the first display and a second judgment point located within the edge area of ​​the second display from the touch trajectory. Then, the moving speed of the trajectory points in the touch trajectory is calculated, and the interval distance between the first and second judgment points is calculated based on the moving speed, thereby shifting the display of the second user interface according to the interval distance. This method can detect the interval distance between displays through the trajectory points in the touch trajectory, thereby adjusting the display mode of the second user interface according to the interval distance to solve the problem of user interface splicing display errors. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a schematic diagram illustrating the usage scenarios of the display device in some embodiments of this application;

[0021] Figure 2 Hardware configuration block diagrams of display devices provided in some embodiments of this application;

[0022] Figure 3 Hardware configuration block diagrams of control devices provided in some embodiments of this application;

[0023] Figure 4 This is a schematic diagram of the software configuration in a display device provided in some embodiments of this application;

[0024] Figure 5 This is a schematic diagram illustrating the connection relationship of external terminal devices provided in some embodiments of this application;

[0025] Figure 6 This application provides structural diagrams of a dual-screen display system for some embodiments.

[0026] Figure 7 This application provides a diagram illustrating the touch data transmission relationship of a dual-screen display system in some embodiments.

[0027] Figure 8 These are schematic diagrams illustrating the dual-screen display effect provided in some embodiments of this application;

[0028] Figure 9Schematic diagram of sidebar tools provided for some embodiments of this application;

[0029] Figure 10 These are schematic diagrams illustrating the splicing display effect provided in some embodiments of this application;

[0030] Figure 11 This is a schematic diagram illustrating the splicing display error effect provided in some embodiments of this application;

[0031] Figure 12 This is a schematic flowchart of a multi-screen display method provided in some embodiments of this application;

[0032] Figure 13 Schematic diagrams of the first and second determination points provided for some embodiments of this application;

[0033] Figure 14 Schematic diagram of edge regions provided for some embodiments of this application;

[0034] Figure 15 These are schematic diagrams illustrating the multi-screen display effect provided in some embodiments of this application;

[0035] Figure 16 This is a schematic diagram of the interval distance provided for some embodiments of this application. Detailed Implementation

[0036] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0037] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0038] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0039] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0040] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0041] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0042] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, the user can operate the display device 200 through the mobile terminal 300 and the control device 100.

[0043] In some embodiments, the mobile terminal 300 may install software applications with the display device 200 to establish a connection and communication via a network communication protocol, thereby achieving one-to-one control operation and data communication. Alternatively, audio and video content displayed on the mobile terminal 300 can be transmitted to the display device 200 to achieve synchronous display.

[0044] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0045] In addition to providing broadcast television reception functions, the display device 200 can also be equipped with intelligent network television functions that provide computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0046] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0047] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0048] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0049] In some embodiments, the display 260 includes a display screen component for presenting an image, a driving component for driving image display, a component for receiving image signals output from a controller, and a user control UI interface, etc.

[0050] In some embodiments, the display 260 is connected to a touch interaction module, enabling the display device 200 to support touch interaction operations. The touch interaction module can be a built-in module or an external module. For example, to implement touch interaction operations, for a display device 200 with a built-in touch interaction module, the display 260 can be a touch screen or a touch display integrated screen. The touch screen or touch display integrated screen can receive touch signals input from fingers, touchpads, styluses, etc., and execute touch interaction responses according to a pre-set interaction strategy.

[0051] For the display device 200 with the external touch interaction module, terminals, devices, and components with touch functionality can be connected through the device interface of the display device 200. For example, the USB or USB-C interface of the display device 200 can be connected to a touchpad. The touchpad can receive touch data input by the user in real time and transmit the touch data to the display device 200 through the USB channel. The display device 200 can then perform interactive responses based on the received touch data and in conjunction with touch applications, enabling the display device 200 to support touch interactive operations.

[0052] In some embodiments, the communicator 220 is a component for communicating with external devices or the server 400 according to various communication protocol types.

[0053] In some embodiments, device interface 240 is an interface component for connecting terminal devices, external components, signal sources, etc. For example, device interface 240 includes one or more combinations of a High-Definition Multimedia Interface (HDMI) interface, a Composite Video Broadcast Signal (CVBS) interface, a component interface, and a Universal Serial Bus (USB) interface.

[0054] The display device 200 can connect to other devices via a device interface. For example, to enrich the display types of the display device 200, it can be equipped with an HDMI interface and a USB interface. The HDMI interface can connect to devices with video and audio input / output functions, and implement the corresponding audio and video output / input functions through the HDMI driver. The USB interface can connect to devices with signal and data transmission functions and interactive functions, and, based on the USB driver, receive signals, transmit data, and perform specific interactive actions.

[0055] In some embodiments, the display device 200 can support simultaneous access to multiple device interfaces and perform corresponding functions according to the specific device type accessed. For example, the display device 200 can connect to another monitor or terminal device 500 via an HDMI interface to form display functions such as dual-screen, split-screen, screen sharing, conferencing, whiteboard, and NFC. The display device 200 can also connect to the terminal device 500 via a USB interface and activate the Open Pluggable Specification (OPS) channel to connect the external terminal device 500. When connecting the terminal device 500 via the OPS channel, since the display device 200 has an independent operating system (System A) and the terminal device 500 can also have an independent operating system (System B), a dual-system mode can be formed.

[0056] When both the display device 200 and the connected terminal device 500 support touch interaction, a data transmission and conversion module can be set in the display device 200 to transmit and convert touch data generated during the touch interaction process, thereby achieving channel reverse control, that is, controlling the display device 200 through the touch-interactive terminal device 500. For example, Figure 5 As shown, a switch module can be set up in the touch interaction system. The TP module with touch functionality can be connected to the main control system (system A) of the display device 200 via a USB interface, and can also be connected to the terminal device 500 (system B), an external host, and a type-C device. In this way, the OPS channel formed by the HDMI interface can transmit display content data, and the switch module and USB interface can transmit touch data.

[0057] In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0058] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0059] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0060] In some embodiments, user interface 280 is an interface that can be used to receive control input.

[0061] Figure 3 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of the central control device. (Example) Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0062] The control device 100 is configured to control the display device 200, and to receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0063] In some embodiments, the control device 100 may be an intelligent device. For example, the control device 100 may be equipped with various applications for controlling the display device 200 according to user needs.

[0064] In some embodiments, such as Figure 1 As shown, the mobile terminal 300 or other smart electronic devices can perform similar functions to the control device 100 after installing the application of the control display device 200.

[0065] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0066] Under the control of the controller 110, the communication interface 130 enables communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of other near-field communication modules such as WiFi chip 131, Bluetooth module 132, and NFC module 133.

[0067] User input / output interface 140, wherein the input interface includes at least one of other input interfaces such as microphone 141, touchpad 142, sensor 143, button 144, etc.

[0068] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, which can encode user input commands via WiFi, Bluetooth, or NFC protocols and send them to the display device 200.

[0069] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can also store various control signal instructions input by the user.

[0070] The power supply 180 is used to provide operating power support for the various components of the control device 100 under the control of the controller.

[0071] Figure 4 Provided for some embodiments of this application Figure 1 The diagram shows the software configuration of the display device. In some embodiments, the system of the display device 200 can be divided into three layers, from top to bottom: the application layer, the middleware layer, and the hardware layer.

[0072] The application layer mainly includes commonly used applications on TVs, as well as the application framework. The commonly used applications are mainly browser-based applications, such as HTML5 apps, and native apps.

[0073] An application framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, and the user interface for these functions (toolbar, status bar, menu, dialog box).

[0074] Native apps can support online or offline access, push notifications, or access to local resources.

[0075] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware can use the basic services (functions) provided by system software to connect different parts of application systems or different applications on the network, achieving resource sharing and function sharing.

[0076] The hardware layer mainly includes the Hardware Abstraction Layer (HAL) interface, hardware, and drivers. The HAL interface serves as a unified interface for all TV chips, with the specific logic implemented by each individual chip. Drivers primarily include: audio drivers, display drivers, Bluetooth drivers, camera drivers, Wi-Fi drivers, USB drivers, HDMI drivers, sensor drivers (such as fingerprint sensors, temperature sensors, and pressure sensors), and power drivers.

[0077] In some embodiments, the display device 200 can connect an external monitor via an HDMI interface to form a dual-screen system with its own display 260, thereby achieving a dual-screen display mode. For example... Figure 6 As shown, a dual-screen system may include an image generation (ImageProducer) module, an image rendering (surface flinger) module, a compositing (Composer) module, a video processing unit (VPU hardware) module, as well as a main screen (panel screen) and a secondary screen (hdmiscreen).

[0078] During the display process, the media player, camera viewer, and OpenGL ES graphics interface of the image generation module generate image content and pass it to the image rendering module. The image rendering module includes a primary display unit and an external display unit. The primary display unit controls the content displayed on the main screen; that is, the primary display unit renders the image content through the user interface layer (UI layer) or the video layer based on the image content.

[0079] To achieve better display results, the image content of the UI layer can be rendered by the GPU component, thereby forming display frames in the compositing module. The compositing module stores these frames using both frame buffers and video buffers, and the video processing module forms the image content on the corresponding layers. Specifically, image frames generated during video playback are processed through the video plane, while frames from other image elements (such as touch traces and graphics) are processed through the primary OSD plane. Finally, the display device 200 uses the blending unit of the video processing module to create the final image, which is then displayed on the main screen.

[0080] The extended display unit controls the content displayed on the secondary screen. After the image generation module passes the image content to the image rendering module, the extended display unit also renders the image content through the UI layer or video layer. Following the main screen's display process, image frames are formed through the image rendering module, compositing module, and video processing module, and then displayed on the secondary screen.

[0081] In some embodiments, to achieve better image display, an external OSD plane can be additionally set in the video processing module of the display device 200, on top of the main OSD layer and the video layer. This external OSD plane can be configured with different layer characteristics according to specific display requirements. For example, the bitmap refresh mode of the external OSD plane can be modified to allow it to refresh in real time by region, thereby improving the display speed of graphics. In this case, the external OSD plane can be used as an acceleration layer in scenarios with high dynamic range display effects.

[0082] Taking a whiteboard drawing application running on a display device 200 as an example, to improve the responsiveness of the line drawing process, the touch trajectory can be drawn in real time on an extended display layer (acceleration layer) after the user's touch operation is detected. The display level of the acceleration layer can be higher than other layers, and when the user completes the touch input, the lines drawn by the acceleration layer are updated to other layers, thereby reducing input latency and improving the real-time display effect of the whiteboard application drawing process.

[0083] In some embodiments, the extended display layer can also work in conjunction with other graphics to improve display quality. For example, the acceleration layer can respond to user touch events simultaneously with the main OSD layer and draw graphics separately. However, since the acceleration layer is displayed above the main OSD layer, the graphics drawn by the acceleration layer can obscure the graphics drawn by the OSD layer, maintaining real-time response speed. After the user finishes inputting the touch interaction, the content displayed by the acceleration layer can be directly released, and the OSD layer directly forms the drawn graphics, thus eliminating the need for the acceleration layer to refresh the drawn graphics to the OSD layer, reducing graphics blending time. This improves both the real-time display effect of the graphics drawing process and the final presentation quality of the graphics.

[0084] It should be noted that the extended display layer, as an auxiliary display layer, can be controlled to show and hide itself according to the actual interaction process. For example, when the extended display layer acts as an acceleration layer to assist the user in real-time display of touch trajectories, the display device 200 can control it to show when the user inputs a touch interaction operation and hide it when the user does not input a touch interaction operation. That is, the display device 200 can listen for touch interaction events input by the user. When a down event is detected in the user's touch interaction operation, the acceleration layer is enabled and displayed; when an up event is detected in the user's touch interaction operation, the acceleration layer is deactivated and hidden. In some embodiments, the display device 200 can also control the display and hiding of the extended display layer according to the application's running state. For example, when the display device 200 detects that it has started running a touch interaction application such as a whiteboard, the acceleration layer is enabled and displayed; when the display device 200 detects that it has exited the touch interaction application such as the whiteboard, the acceleration layer is deactivated and hidden.

[0085] Based on the aforementioned dual-screen display system, users can control the display device 200 to execute different display strategies as needed. For example, the main screen can be connected to the secondary screen via HDMI OUT to achieve dual-screen display, with the secondary screen integrating touch components to enable touch control of its content. Furthermore, the main and secondary screens are connected via USB, and the USB connection channel can be used to transmit touch data, i.e., the secondary screen's touch interface connects to the main screen's USB port. After connection, the display device 200 can control the display on both the main and secondary screens. The main and secondary screens can support simultaneous display, meaning the content displayed on the display device 200's monitor 260 (main screen) is the same as that displayed on an external monitor. They can also support different displays, meaning the content displayed on the main and secondary screens is different. Differential display, also known as extended display, mainly includes scenarios such as: displaying the physical signal source image on the secondary screen; displaying the player image on the secondary screen; displaying two screen sharing images wirelessly; and displaying shared content on the secondary screen in conferencing applications.

[0086] When the secondary screen connected to the display device 200 also supports touch interaction, the user can control the display device 200 or the external terminal device 500 by inputting touch operations on the secondary screen. Specifically, in some embodiments, after the user inputs a touch interaction action on the secondary screen, the secondary screen transmits the touch data from the touch event to the display device 200 via a USB channel. When the display device 200 is also connected to the external terminal device 500, the touch data can be forwarded to the USB channel connected to the terminal device 500 via a built-in conversion module, thereby enabling the terminal device 500 to respond to the touch events input by the user on the secondary screen.

[0087] For example, such as Figure 7As shown, a user can connect a touch-enabled monitor to the HDMI1 interface of the display device 200 based on System A, using it as a secondary screen for the display device 200. Simultaneously, an OPS computer based on System B can be connected to the HDMI2 interface of the display device 200, serving as an external terminal device 500 for the display device 200. Furthermore, the display device 200 also connects to the secondary screen device via USB1 and to the OPS computer via USB2, forming an interactive system capable of supporting reverse control functionality. The monitor 260 of the display device 200 serves as the primary screen. During display, the primary and secondary screens can display the content output by the OPS computer simultaneously or separately.

[0088] When a user inputs touch data on the main screen, the display device 200 transmits the resulting touch data to the OPS computer via the USB2 interface channel, whereby the OPS computer responds to the touch data. Conversely, when a user touches or clicks interactive controls on the secondary screen, the resulting touch data is transmitted to the display device 200 via the USB1 interface channel, then through a switch module within the display device 200 to the USB2 interface channel, and finally to the OPS computer, where it responds to the touch data.

[0089] It should be noted that the touch-to-reverse-control function can generate different interaction logics depending on the application scenario. Specifically, reverse control can include the following scenarios:

[0090] This scenario involves a primary and secondary screen, where display device 200 is connected to an external monitor as the secondary screen, and the built-in monitor 260 of display device 200 serves as the primary screen. In this scenario, display device 200 needs to distinguish between the physical touchscreen and the external USB touchscreen, configuring the physical touchscreen as internal and the external USB touchscreen as external to achieve dual-screen touch control. The application dynamically adjusts the display based on whether the extended mode is enabled.

[0091] In this scenario, the display device 200 is simultaneously connected to an external monitor and an OPS device. The external monitor acts as the secondary screen, while the built-in monitor 260 of the display device 200 serves as the primary screen, and the OPS device acts as the signal source. In this scenario, it's necessary to differentiate the display screens showing the OPS signal. When the OPS signal is displayed on the secondary screen, the USB needs to be switched to the OPS channel to enable the secondary screen to control the OPS channel. Simultaneously, the primary screen's external touch functionality needs to be disabled. When the OPS signal is displayed on the primary screen, the primary screen's touch functionality needs to be enabled and switched to the OPS device. Because the USB channel has been switched to the OPS device, the secondary screen's touch functionality will also be recognized and responded to by the OPS.

[0092] For this scenario, the touch component needs to support disabling the current channel's output via an external channel. When switching from USB to the OPS channel, it needs to determine if USB Touch is connected. If USB Touch is connected, the output must be disabled before switching to the OPS channel. The hardware design of the aforementioned touch-controlled reverse system allows all USB 3.0 ports to be controlled by a single switch.

[0093] The following describes the display process based on the above dual-screen system through specific examples. It should be understood that the following display process is only an example and does not limit the specific display method of the dual-screen system. Other display methods and interface content that can be conceived by those skilled in the art based on the following examples are all within the protection scope of this application.

[0094] like Figure 8 As shown, following the dual-screen system connection method described above, after connecting to the external screen via an HDMI cable, dual-screen mode can be activated. In dual-screen mode, the display device 200 can set the display mode of the secondary screen. The default display mode is extended screen mode, meaning the secondary screen extends the display of the main screen's content, effectively increasing the main screen's display area. Therefore, the wallpaper displayed on the secondary screen can automatically change according to the wallpaper displayed on the main screen's homepage.

[0095] After activating dual-screen mode, the main screen and secondary screen can display user interfaces according to the set display mode. To facilitate page control, in some embodiments, the interfaces displayed on the main screen and secondary screen may also include sidebars. These sidebars can be used to control the content displayed on the other screen within one screen environment. For example, ... Figure 9 As shown, the sidebar consists of arrow icons displayed on both sides of the interface. Users can click these icons to bring up an extended menu. The extended menu can include shortcut options such as "Back," "Home," "Settings," and "Switch," allowing users to control the dual-screen display process by clicking any option icon.

[0096] It should be noted that in the above example, the display device 200 is used as the signal input source. In actual applications, the signal input source can be the display device 200 or the terminal device 500 connected to the display device 200. When the signal input source is the external terminal device 500, the processes of adjusting, switching, and displaying the screen in the above example can be performed by the terminal device 500, by the display device 200, or by both the display device 200 and the terminal device 500.

[0097] Based on the aforementioned multi-screen display method, when the display device 200 is connected to a monitor via an external device interface 240 such as HDMI, it can control the multiple monitors to display different parts of the overall image according to the user-set extended display mode and the relative positions of the multiple monitors, thereby stitching the content displayed on the multiple monitors together to form a complete image. For example, as Figure 10 As shown, the built-in display of the display device 200 is called the first display, and the external display of the display device 200 is called the second display. The first display 261 and the second display 262 can be set side by side, with the first display 261 on the left and the second display 262 on the right. In this way, the first display 261 can display the left part of the overall image, and the second display 262 can display the right part of the overall image.

[0098] However, when display device 200 is used in extended display mode for splicing, the spliced ​​display image suffers from severe fragmentation due to the gaps between multiple displays and the influence of the display bezels, thus reducing display quality. For example, as Figure 10 As shown, the distance between the first display 261 and the second display 262 is x0, the width of the right border of the first display 261 is x1, and the width of the left border of the second display 262 is x2. In the final spliced ​​image effect, the distance between the left and right images is x0+x1+x2, causing the image to be fragmented.

[0099] Furthermore, when users adjust the positions of the monitors, changing the relative positions of multiple monitors, it can cause splicing errors in the user interface, affecting the user's viewing experience. For example, if a user swaps the positions of the first monitor 261 and the second monitor 262—that is, moving the first monitor 261 from left to right and the second monitor 262 from right to left—the first monitor 261 will still display the left side of the image, and the second monitor 262 will still display the right side. This results in the left and right sides of the image being reversed after splicing, causing a splicing error. Figure 11 As shown.

[0100] To alleviate the aforementioned problems of image fragmentation and splicing errors, some embodiments of this application provide a multi-screen display method, which can be applied to a display device 200. To implement the multi-screen display method, the display device 200 should at least include: a first display 261, a user interface 280, an external device interface 240, and a controller 250. The first display 261 is configured to display a first user interface; the user interface is configured to acquire touch commands input by the user; the external device interface 240 is configured to connect to a second display 262, and the second display 262 is configured to display a second user interface. Figure 12As shown, the controller 250 is configured to execute the program steps corresponding to the multi-screen display method, including the following:

[0101] S100: Responds to user-inputted touch commands for multi-screen display and acquires touch trajectory.

[0102] The user interface of the display device 200 can be connected to a built-in or external touch interaction module. This module can detect user-input touch actions and generate touch data. Different touch commands have different functions. To detect the distance between the first display 261 and the second display 262, the user needs to input a touch interaction action that facilitates distance detection. For example, in this application, the touch command requires the user to start touching the first display 261 and slide towards the second display 262, with the sliding trajectory extending from the first display 261 to the corresponding screen area of ​​the second display 262.

[0103] A touch command refers to a user's touch event, which includes down, move, and up events based on the user's actual touch action. Correspondingly, the touch trajectory includes a start point (down event), a trajectory point (move event), and an end point (up event).

[0104] It should be noted that, in this embodiment, since the sliding trajectory corresponding to the touch command extends from the first display 261 to the detection range of the touch interaction module corresponding to the second display 262, and the first display 261 and the second display 262 may have two independent touch interaction modules, strictly speaking, the touch trajectory includes two trajectory segments: the first segment detected by the touch interaction module corresponding to the first display 261 and the second segment detected by the touch interaction module corresponding to the second display 262. Based on this, in this embodiment, the starting point and the ending point can be used to indicate the starting and ending points of the entire touch trajectory (including the first and second segments), or they can be used to indicate the starting and ending points of either the first or second segment.

[0105] For ease of description, in this embodiment, the starting point and ending point are used as the starting and ending points of the entire touch trajectory. That is, the starting point is the starting point of the first segment of the trajectory, and the ending point is the ending point of the second segment of the trajectory. Both the ending point of the first segment and the starting point of the second segment serve as the touch points of the entire touch trajectory. It should be understood that the multi-screen display method described in this embodiment can also be applied to situations where the starting and ending points are the starting and ending points of either the first or second segment of the trajectory. Those skilled in the art only need to make simple substitutions in the algorithm.

[0106] The display device 200 can detect the user's touch interaction operation in real time. When it detects a sliding touch operation that starts from the first display 261 and ends at the second display 262, it indicates that the user has entered a touch interaction command for multi-screen display and records the touch data in the touch trajectory.

[0107] Since the first display 261 and the second display 262 are two independent displays, differences in specifications between the first display 261 and the second display 262 may cause subsequent calculation errors during the display and touch interaction detection process. Therefore, in some embodiments, to obtain more accurate calculation results, the display device 200 may perform a unified detection of the display resolution of the first display 261 and the second display 262 after or before obtaining a touch command. That is, the controller 250 of the display device 200 is also configured to:

[0108] Obtain the display resolutions of the first display 261 and the second display 262; if the display resolution of the first display 261 is greater than the display resolution of the second display 262, adjust the display resolution of the second display 262 to be equal to the display resolution of the first display 261, and set the touch resolution to the display resolution of the first display 261; if the display resolution of the first display 261 is less than the display resolution of the second display 262, adjust the display resolution of the first display 261 to be equal to the display resolution of the second display 262, and set the touch resolution to the display resolution of the second display 262.

[0109] In the above embodiments, the display device 200 can adjust the display resolution of the first display 261 and the second display 262 to a higher resolution when a difference in display resolution is detected. For example, if both the first display 261 and the second display 262 have a resolution of 3840×2160 pixels, the touch resolution will be processed according to 3840×2160. If the first display 261 has a resolution of 3840×2160 and the second display 262 has a resolution lower than 3840×2160, the resolution of the second display 262 will be adjusted to 3840×2160 for subsequent calculations.

[0110] S200: Extract the first judgment point and the second judgment point from the touch trajectory.

[0111] After extracting the touch trajectory, the display device 200 can extract a first judgment point and a second judgment point from the touch trajectory, wherein the first judgment point is a trajectory point located in the edge area of ​​the first display; and the second judgment point is a trajectory point located in the edge area of ​​the second display.

[0112] In this embodiment, the first determination point and the second determination point can be any marker point located within the edge regions of the first display 261 and the second display 262, respectively, used to determine the distance between the first display 261 and the second display 262. Therefore, the selection of the first determination point and the second determination point should be beneficial for determining the distance between the first display 261 and the second display 262.

[0113] For example, such as Figure 13 As shown, the first judgment point is the end point of the touch trajectory (first segment trajectory) on the first display 261. That is, after the touch interaction module of the first display 261 detects an up event of the touch trajectory within the range of the first display 261, it can record the touch point coordinates [up; x1, y1] corresponding to the up event to determine the first judgment point. The second judgment point is the starting point of the touch trajectory (second segment trajectory) on the second display 262. That is, after the touch interaction module of the second display 262 detects a down event of the touch trajectory within the range of the second display 261, it can record the touch point coordinates [down; x2, y2] corresponding to the down event to determine the second judgment point.

[0114] Since the touch trajectory of the touch commands used for multi-screen display extends from the first display 261 to the second display 262, the touch trajectory input by the user will pass through the edge areas of the first display 261 and the second display 262. Therefore, the display device 200 can divide the edge areas according to the size specifications of the first display 261 and the second display 262. Figure 14 As shown, the edge region can be a rectangular ring-shaped area extending from the screen border towards the center of the screen. When a touch point is located within this region, it indicates a higher probability that the user will input a touch command for multi-screen display. Therefore, the first and second judgment points can be determined by detecting touch points located within the edge region.

[0115] In some embodiments, the controller 250 of the display device 200 is further configured to: acquire a first edge coordinate range of the first display 261 and a second edge coordinate range of the second display 262; and extract a first target trajectory point and a second target trajectory point from the touch trajectory based on the position coordinates of the trajectory points. The first target trajectory point is a trajectory point whose position coordinates are within the first edge coordinate range; the second target trajectory point is a trajectory point whose position coordinates are within the second edge coordinate range.

[0116] Obtain the first side region to which the first target trajectory point belongs, and the second side region to which the second target trajectory point belongs; if the first side region and the second side region are two adjacent edge regions of the first display 261 and the second display 262, then mark the first target trajectory point as the first judgment point and the second target trajectory point as the second judgment point.

[0117] For example, the display device 200 can set the detection rules for the first judgment point and the second judgment point to be the trajectory point that first enters the edge region, i.e. Figure 14 As shown, when the display device 200 detects the trajectory point [move; x10, y10] on the first display 261, it uses this trajectory point as the first judgment point. Similarly, when it detects the trajectory point [move; x20, y20] on the second display 262, it uses this trajectory point as the second judgment point.

[0118] Since the first display 261 and the second display 262 are two independent displays, they support users to perform other touch interaction operations besides multi-screen display. Therefore, the display device 200 can determine whether the touch command is used to perform multi-screen display based on the touch trajectory after extracting the touch trajectory.

[0119] In some embodiments, the display device 200 can determine whether a touch event is a relay event, and the controller 250 is further configured to acquire the input positions of the start point and the end point. If the input positions of the start point and the end point are located on different displays, it indicates that the user has input a touch command for multi-screen display, and therefore the step of extracting the first judgment point and the second judgment point from the touch trajectory can be performed. If the input positions of the start point and the end point are located on the same display, it indicates that the user has not input a touch command for multi-screen display, and therefore the first display 261 and / or the second display 262 are controlled to display input prompt information.

[0120] For example, after extracting the touch trajectory, the display device 200 can read the starting point [down; x1, y1] and the ending point [up; x2, y2] in the touch trajectory, and determine the input position of the starting point and the ending point based on the display area to which the corresponding coordinates of the starting point and the ending point belong. If [down; x1, y1] is located within the touch area of ​​the first display 261 and [up; x2, y2] is located within the touch area of ​​the second display 262, it indicates that the user has input a touch command for multi-screen display. If [down; x1, y1] is located within the touch area of ​​the first display 261 and [up; x2, y2] is also located within the touch area of ​​the first display 261, it indicates that the user has not input a touch command for multi-screen display.

[0121] In some embodiments, the display device 200 can also determine whether a touch event is a relay event based on the touch time. Specifically, the controller 250 is further configured to: acquire the input times of the first judgment point and the second judgment point, and calculate the input time difference based on the input times. If the input time difference is less than or equal to a preset input time threshold, the first display and the second display are marked as adjacent devices; if the input time difference is greater than the preset input time threshold, the first display and the second display are marked as non-adjacent devices.

[0122] For example, based on a time threshold as a preliminary condition for connecting the first display 261 and the second display 262, the touch interaction module can record touch device, position, and time information, i.e., the first judgment point [up; x1, y1; T1], the second judgment point [down; x2, y2; T2]. When the touch device changes, i.e., (x1, y1) is detected on the first display 261, and (x2, y2) is detected on the second display 262, the display device 200 can calculate the time difference ΔT = T2 - T1 between the second judgment point and the last event (first judgment point) of the previous touch device. Based on the calculated time difference ΔT, it determines whether the first display 261 and the second display 262 are adjacent devices. If the time difference ΔT is less than or equal to the set threshold T0, it is preliminarily determined that the first display 261 and the second display 262 are adjacent devices. If the time difference ΔT is greater than the set threshold T0, it is preliminarily determined that the first display 261 and the second display 262 are not adjacent devices, and the user-input touch command may not be used to execute multi-screen display.

[0123] After initially determining that the first display 261 and the second display 262 are adjacent devices, the display device 200 can also determine the screen position based on the screen edge. When the touch device changes, if the touch area of ​​the first judgment point on the first display 261 and the touch area of ​​the second judgment point on the second display 262 are detected, the display device 200 first processes whether the touch areas of the first judgment point and the second judgment point are both in the edge area. If both points are in the edge area, the display device 200 further determines the positional relationship of the screen areas, that is, whether the two points satisfy the front-back screen relationship of left-right; bottom-up; right-left; top-bottom.

[0124] If the front and rear screen relationship is satisfied, the position of the second display 262 is determined according to the screen relationship. For example, if the first judgment point is at the right edge of the first display 261 and the second judgment point is at the left edge of the second display 262, that is, if the first judgment point and the second judgment point satisfy the right-left relationship, then the second display 262 is determined to be to the right of the first display 261.

[0125] To facilitate determining screen relationships, the display device 200 can use directional coordinates. For example, points on the left or right edges are considered in the X-direction, while points on the top or bottom edges are considered in the Y-direction. If [up; x1, y1] is on the right edge of the first display 261, and [down; x2, y2] is not on the left edge of the second display 262, then the corresponding directional coordinate distance between the two points is determined. When the coordinate distance is less than a certain threshold, the screen position is determined according to the coordinate relationship. For example, if the X-direction coordinate distance is less than a certain threshold, and the previous point is on the right edge of the main screen, then the second display 262 is determined to be to the right of the first display 261. If the coordinate distance is greater than a certain threshold, then this determination is excluded, and the user is prompted to pay attention to the screen position relationship.

[0126] S300: Calculate the moving speed of the trajectory points in the touch trajectory.

[0127] After determining that the first display 261 and the second display 262 are adjacent devices and that the touch event is a relay event, the display device 200 can determine the moving speed of the trajectory point based on the touch trajectory. The moving speed of the trajectory point can be determined based on the time and position information recorded by multiple trajectory points.

[0128] Since the event movement speeds of the two touch devices are essentially the same in determining a continuous event, in some embodiments, the display device 200 can calculate the trajectory point movement speed based on the coordinates of the trajectory points throughout the entire touch trajectory. That is, the controller 250 is also configured to:

[0129] The system acquires the position coordinates and input time of the starting point and the first judgment point; and acquires the position coordinates and input time of the second judgment point and the ending point. Based on the position coordinates and input time, it calculates a first speed and a second speed, where the first speed is the touch speed of the touch trajectory segment from the starting point to the first judgment point; and the second speed is the touch speed of the touch trajectory segment from the second judgment point to the ending point. The average of the first speed and the second speed is calculated to generate the movement speed of the trajectory points in the touch trajectory.

[0130] For example, after acquiring the starting point [down; xs, ys; Ts] and ending point [up; xe, ye, Te] of the touch trajectory, and extracting the first judgment point [up; x1, y1; T1] and the second judgment point [down; x2, y2, T2], the display device 200 can first calculate the first velocity based on the starting point and the first judgment point, that is:

[0131]

[0132] Where V1 represents the first velocity, (x1, y1) are the coordinates of the first judgment point, (xs, ys) are the coordinates of the starting point, T1 is the input event of the first judgment point, and Ts is the input time of the starting point.

[0133] Similarly, based on the position coordinates of the second judgment point and the termination point, and the input time, the second velocity can also be calculated, i.e.:

[0134]

[0135] Where V2 represents the second velocity, (x2, y2) are the coordinates of the second judgment point, (xe, ye) are the coordinates of the termination point, T2 is the input event of the first judgment point, and Te is the input time of the termination point.

[0136] After calculating the first speed V1 and the second speed V2, the display device 200 can calculate the average of the first speed V1 and the second speed V2 as the moving speed V of the trajectory point, that is: V = (V1 + V2) / 2.

[0137] S400: Calculate the interval distance between the first judgment point and the second judgment point based on the moving speed and the input time of the first judgment point and the second judgment point.

[0138] After calculating the moving speed of the trajectory points in the touch trajectory, the display device 200 can calculate the interval distance between the first judgment point and the second judgment point based on the moving speed and the input time of the first judgment point and the second judgment point. In order to obtain the interval distance between the first judgment point and the second judgment point, the display device 200 needs to extract the input time of the first judgment point and the second judgment point respectively after calculating the moving speed of the trajectory points, and calculate the interval distance between the first judgment point and the second judgment point based on the product of the input time and the moving speed.

[0139] In some embodiments, the controller 250 is further configured to: acquire the input times of the first judgment point and the second judgment point; calculate the difference between the input time T1 of the first judgment point and the input time T2 of the second judgment point to obtain the input interval time difference ΔT; and then calculate the product of the input interval time difference ΔT and the moving speed V to obtain the interval distance between the first judgment point and the second judgment point.

[0140] In the example above, the first and second judgment points are used as markers for the change of the touch trajectory on the device. That is, the touch trajectory leaves the first display 261 at the first judgment point and enters the second display 262 at the second judgment point. For the touch operation performed by the user, the first and second judgment points are close to the edge area of ​​the screen. Therefore, the distance between the first and second judgment points can be directly used to represent the distance between the first display 261 and the second display 262, and the screen can be adjusted based on the distance between the first and second judgment points.

[0141] S500: Control the second display to pan and display the second user interface according to the interval distance.

[0142] After calculating the distance between the first judgment point and the second judgment point, the display device 200 can control and adjust the content displayed on the second display 262, and shift the display of the second user interface so that the content displayed on the second display 262 can be better spliced ​​with the content displayed on the first display 261, thereby improving the splicing effect of the user interface.

[0143] For example, if the interval distance between the first judgment point and the second judgment point is calculated to be X, the display device 200 can modify the image generation result of the extended display unit in the image rendering module, and move the screen content displayed on the second display 262 to the left by a distance of X, so that the content displayed on the first display 261 and the second display 262 can adapt to the interval distance and improve the screen splicing effect.

[0144] It is evident that when the first display 261 and the second display 262 are spaced a certain distance apart, if the content displayed on the two screens is simply divided based on the first display 261 and the second display 262, a segmentation effect will occur. Based on the distance between the first display 261 and the second display 262 obtained above, the second display 262 can be moved a corresponding distance towards the first display 261, thereby alleviating the segmentation effect. For example... Figure 15 As shown, when the first display 261 and the second display 262 are displayed in a left-right direction, the second display 262 can move to the left by an interval distance to achieve reasonable display of text.

[0145] Because the translation of the second user interface during the process of displaying the second user interface can cause the loss of display content near the adjacent edge, and the larger the interval between the first display 261 and the second display 262, the more display content is lost, in order to reduce the impact of lost content on the user's viewing process, in some embodiments, after calculating the interval distance, the display device 200 can also judge the interval distance. That is, the controller 250 is also configured to: obtain a preset interval distance threshold and compare the interval distance with the interval distance threshold; if the interval distance is less than or equal to the interval distance threshold, control the second display to translate the second user interface according to the interval distance; if the interval distance is greater than the interval distance threshold, control the second display to display the second user interface in its original position.

[0146] By comparing the interval distance and the interval distance threshold, the display device 200 can perform the translation display of the second user interface within a reasonable range. When the interval distance between the first display 261 and the second display 262 is large, it will still display in the original position to alleviate the loss of too much display content.

[0147] However, the display device 200 can determine its position based on other points within the edge region. That is, the first determination point is not the end point [up; x1, y1] in the first trajectory segment, and / or the second determination point is not the starting point [down; x2, y2] in the second trajectory segment, but rather another marker point located within the edge region. In this case, there is still a certain distance between the first determination point and the border position of the first display 261, and there is also a movement distance between the second determination point and the border position of the second display 262. Therefore, in some embodiments, the controller 250 executes the operation of controlling the second display to translate and display the second user interface according to the stated interval distance, and is further configured to:

[0148] Obtain the first edge distance between the first judgment point and the first edge of the first display bezel, and obtain the second edge distance between the second judgment point and the second edge of the second display bezel; calculate the difference between the interval distance and the first edge distance and the second edge distance to obtain the screen spacing; and translate the second user interface in a direction closer to the first display according to the screen spacing.

[0149] For example, the display device 200 can calculate the number of pixels moved in the x-direction based on the time it takes for the touch trajectory to change the device, and then calculate the number of pixels between the two screens x3 based on the distance x1 from the first judgment point to the right edge of the first display 261 and the distance x2 from the second judgment point to the left edge of the second display 262. Figure 16As shown, when the first display 261 and the second display 262 are in a left-right screen relationship, the touch movement speed V1 of the first display 261 is considered to be X1 / t1. Where X1 is the distance interval between the first judgment point and the previous touch sampling point, and t1 is the time interval between the first judgment point and the previous touch sampling point.

[0150] Similarly, the moving speed of the touch trajectory on the second display 262 is V2 = X2 / t2, where X2 is the distance between the second judgment point and the next touch sampling point, and t2 is the time interval between the second judgment point and the next touch sampling point. Therefore, the moving speed of the touch trajectory point between the first display 261 and the second display 262 is (V1 + V2) / 2. Combining this with the time interval t3 between the two points, the interval between the two displays can be obtained as X3 = (V1 + V2)t3 / 2. Then, the image displayed on the second display 262 is shifted according to this interval to reduce the impact of the touch positions of the first and second judgment points on the image stitching effect.

[0151] Based on the display device 200 provided in the above embodiments, a multi-screen display method is also provided in some embodiments of this application, including the following steps:

[0152] S100: In response to a user-inputted touch command for multi-screen display, obtain a touch trajectory, the touch trajectory extending from the first display to the second display; the touch trajectory includes a start point, a trajectory point, and an end point;

[0153] S200: Extract a first judgment point and a second judgment point from the touch trajectory, wherein the first judgment point is a trajectory point located within the edge area of ​​the first display; and the second judgment point is a trajectory point located within the edge area of ​​the second display.

[0154] S300: Calculate the moving speed of the trajectory points in the touch trajectory;

[0155] S400: Calculate the interval distance between the first judgment point and the second judgment point based on the moving speed and the input time of the first judgment point and the second judgment point;

[0156] S500: The second user interface is displayed by panning according to the stated interval distance.

[0157] As can be seen from the above technical solutions, the display device and multi-screen display method provided in some embodiments of this application can respond to a user-input touch command for multi-screen display, obtain a touch trajectory extending from the first display to the second display, and extract a first judgment point located in the edge area of ​​the first display and a second judgment point located in the edge area of ​​the second display from the touch trajectory. Then, the moving speed of the trajectory points in the touch trajectory is calculated, and the interval distance between the first and second judgment points is calculated based on the moving speed, thereby shifting the display of the second user interface according to the interval distance. This method can detect the interval distance between displays by using the trajectory points in the touch trajectory, thereby adjusting the display mode of the second user interface according to the interval distance to solve the problem of user interface splicing display errors.

[0158] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0159] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0160] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0161] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The first display is configured to display the first user interface; The first display is connected to a touch interaction module, which is used to acquire touch commands input by the user. A device interface is connected to a second display configured to display a second user interface; the second display is connected to the touch interaction module. The controller is configured as follows: In response to a user-input touch command for multi-screen display, a touch trajectory is acquired, the touch trajectory extending from the first display to the second display; the touch trajectory includes a start point, a trajectory point, and an end point; Extract a first judgment point and a second judgment point from the touch trajectory, wherein the first judgment point is a trajectory point located within the edge area of ​​the first display; The second determination point is a trajectory point located within the edge area of ​​the second display; Calculate the moving speed of the trajectory points in the touch trajectory; Calculate the interval distance between the first and second judgment points based on the moving speed and the input time of the first and second judgment points. The second display is controlled to pan and show the second user interface according to the stated interval distance.

2. The display device according to claim 1, characterized in that, The controller is also configured to: Obtain the input positions of the starting point and the ending point; If the input positions of the starting point and the ending point are located on different displays, then the step of extracting the first judgment point and the second judgment point from the touch trajectory is performed; If the input positions of the starting point and the ending point are located on the same display, then control the first display and / or the second display to display input prompt information.

3. The display device according to claim 1, characterized in that, The controller extracts a first judgment point and a second judgment point from the touch trajectory and is further configured to: Obtain the first edge coordinate range of the first display and the second edge coordinate range of the second display; Based on the position coordinates of the trajectory points, a first target trajectory point and a second target trajectory point are extracted from the touch trajectory; the first target trajectory point is a trajectory point whose position coordinates are within the range of the first edge coordinates; The second target trajectory point is the trajectory point whose position coordinates are within the range of the second edge coordinates; Obtain the first side region to which the first target trajectory point belongs, and the second side region to which the second target trajectory point belongs; If the first side area and the second side area are two adjacent edge areas of the first display and the second display, then the first target trajectory point is marked as the first judgment point, and the second target trajectory point is marked as the second judgment point.

4. The display device according to claim 1, characterized in that, Before the controller performs the step of calculating the moving speed of the trajectory points in the touch trajectory, it is also configured to: Obtain the input times of the first judgment point and the second judgment point; Calculate the input time difference based on the input time; If the input time difference is less than or equal to a preset input time threshold, then the first display and the second display are marked as adjacent devices, and the step of calculating the moving speed of the trajectory points in the touch trajectory is performed; If the input time difference is greater than a preset input time threshold, the first display and the second display are marked as non-adjacent devices, and the step of calculating the moving speed of the trajectory points in the touch trajectory is not performed.

5. The display device according to claim 1, characterized in that, The controller calculates the moving speed of the trajectory points in the touch trajectory and is further configured to: Obtain the position coordinates and input time of the starting point and the first judgment point; and obtain the position coordinates and input time of the second judgment point and the ending point; The first speed and the second speed are calculated based on the position coordinates and the input time; the first speed is the touch speed of the touch trajectory from the starting point to the first judgment point; the second speed is the touch speed of the touch trajectory from the second judgment point to the ending point. Calculate the average of the first speed and the second speed to generate the movement speed of the trajectory point in the touch trajectory.

6. The display device according to claim 1, characterized in that, The controller performs the calculation of the interval distance between the first judgment point and the second judgment point based on the moving speed and the input time of the first judgment point and the second judgment point, and is further configured to: Obtain the input times of the first judgment point and the second judgment point; Calculate the input time difference between the first judgment point and the second judgment point to obtain the input interval time difference; Calculate the product of the input interval time difference and the moving speed to obtain the interval distance between the first judgment point and the second judgment point.

7. The display device according to claim 1, characterized in that, The controller, in accordance with the stated interval distance, controls the second display to pan and display the second user interface, and is further configured to: Obtain the first distance between the first judgment point and the first edge of the first display bezel, and obtain the second distance between the second judgment point and the second edge of the second display bezel; Calculate the difference between the interval distance and the first edge distance and the second edge distance to obtain the screen spacing; The second user interface is shifted toward the first display according to the screen spacing.

8. The display device according to claim 1, characterized in that, The controller, in accordance with the stated interval distance, controls the second display to pan and display the second user interface, and is further configured to: Obtain the preset interval distance threshold; If the interval distance is less than or equal to the interval distance threshold, control the second display to pan and display the second user interface according to the interval distance; If the interval distance is greater than the interval distance threshold, control the second display to show the second user interface in its original position.

9. The display device according to claim 1, characterized in that, The controller is also configured to: Obtain the display resolutions of the first display and the second display; If the display resolution of the first display is greater than the display resolution of the second display, adjust the display resolution of the second display to be equal to the display resolution of the first display, and set the touch resolution to the display resolution of the first display; If the display resolution of the first display is less than that of the second display, adjust the display resolution of the first display to be equal to that of the second display, and set the touch resolution to the display resolution of the second display.

10. A multi-screen display method, characterized in that, Applied to the display device according to any one of claims 1-9, the method comprises: In response to a user-input touch command for multi-screen display, a touch trajectory is acquired, the touch trajectory extending from the first display to the second display; the touch trajectory includes a start point, a trajectory point, and an end point; Extract a first judgment point and a second judgment point from the touch trajectory, wherein the first judgment point is a trajectory point located within the edge area of ​​the first display; and the second judgment point is a trajectory point located within the edge area of ​​the second display. Calculate the moving speed of the trajectory points in the touch trajectory; Calculate the interval distance between the first and second judgment points based on the moving speed and the input time of the first and second judgment points. The second user interface is displayed by panning according to the stated interval distance.

Images