Single-double screen convenient switching control method and terminal

Abstract

This invention discloses a control method and terminal for convenient switching between single and dual screens. The method includes the following steps: when entering dual-screen mode, sending the operation interface in the first video stream to the control device, and outputting the playback video in the second video stream to the main screen for display; receiving operation information from the control device on the operation interface, and outputting the playback video in response to the operation information as the updated second video stream to the main screen for display. This invention eliminates the need for two dedicated hardware screens, ensuring that user interface operation and screen display do not conflict, thus providing a low-cost and convenient solution to the conflict between screen display and interface operation.

Description

Technical Field

[0001] This invention relates to the field of screen display control technology, and in particular to a control method and terminal for convenient switching between single and dual screens. Background Technology

[0002] When using a single-screen product that can only connect to one display, both the operator and the viewer see the same screen. This prevents the operator from preparing for the next playback step without interrupting the viewer's viewing experience. Furthermore, the operator's preparation for playback is also visible to the viewer, such as searching for content or previewing and confirming playback. Therefore, single-screen products present numerous inconveniences when used in public. On the other hand, dual-screen products require two dedicated hardware screens—one for display and one for control—which must be used together, increasing costs and reducing usability.

[0003] Currently, there are some screen mirroring applications, such as projecting the content displayed on a mobile phone onto a TV. In this method, the TV simply acts as a display screen, similar to a projection screen, showing the content of the mobile phone interface. When performing other operations on the mobile phone or needing to switch displays, the current screen mirroring must be ended, and the content to be switched to must be mirrored again before it can be displayed on the TV again. It is not possible to control the mobile phone while the screen mirroring is being established. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide a control method and terminal for convenient switching between single and dual screens, so as to solve the conflict between screen display and interface operation in a low cost and convenient way.

[0005] To solve the above-mentioned technical problems, the technical solution adopted by the present invention is as follows:

[0006] A control method for convenient switching between single and dual screens includes the following steps:

[0007] When entering dual-screen mode, the operation interface in the first video stream is sent to the control device, and the playback video in the second video stream is output to the main screen for display.

[0008] The system receives operation information from the control device on the operation interface and outputs the playback video in response to the operation information as an updated second video stream to the main screen for display.

[0009] To solve the above-mentioned technical problems, another technical solution adopted by the present invention is as follows:

[0010] A control terminal for convenient switching between single and dual screens includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the various steps of the aforementioned control method for convenient switching between single and dual screens.

[0011] The beneficial effects of this invention are as follows: A control method and terminal for convenient switching between single and dual screens. For single-screen products, there is only one output interface to the main screen. This invention can output two different video streams. When entering dual-screen mode, the operation interface in the first video stream is sent to the control device, and the playback video in the second video stream is output to the main screen for display. Then, the operation information of the user on the control device is received, the playback video corresponding to the operation information is obtained, and the playback video corresponding to the operation information is output as the updated second video stream to the main screen for updated display. Therefore, there is no need to equip two dedicated hardware displays, so that the user's interface operation and screen display will not conflict. Thus, the conflict between screen display and interface operation can be solved in a low-cost and convenient way. Attached Figure Description

[0012] Figure 1 This is a flowchart illustrating a control method for convenient switching between single and dual screens according to an embodiment of the present invention.

[0013] Figure 2 This is a schematic diagram of the structure of a control terminal that allows for convenient switching between single and dual screens according to an embodiment of the present invention.

[0014] Label Explanation:

[0015] 1. A control terminal that allows for convenient switching between single and dual screens; 2. A processor; 3. A memory. Detailed Implementation

[0016] To explain in detail the technical content, objectives, and effects of the present invention, the following description is provided in conjunction with the embodiments and accompanying drawings.

[0017] Please refer to Figure 1 A control method for convenient switching between single and dual screens, including the following steps:

[0018] When entering dual-screen mode, the operation interface in the first video stream is sent to the control device, and the playback video in the second video stream is output to the main screen for display.

[0019] The system receives operation information from the control device on the operation interface and outputs the playback video in response to the operation information as an updated second video stream to the main screen for display.

[0020] As can be seen from the above description, the beneficial effects of the present invention are as follows: For single-screen products, there is only one output interface to the main screen. The present invention can output two different video streams. When entering dual-screen mode, the operation interface in the first video stream is sent to the control device, and the playback video in the second video stream is output to the main screen for display. Then, the operation information of the user on the control device is received, the playback video corresponding to the operation information is obtained, and the playback video corresponding to the operation information is output to the main screen as the updated second video stream for updated display. Therefore, there is no need to equip two dedicated hardware displays, so that the user's interface operation and screen display will not conflict. Thus, the conflict between screen display and interface operation can be solved in a low-cost and convenient way.

[0021] Furthermore, it also includes the following steps: In single-screen mode, the first video stream is output to the main screen for display by default;

[0022] When switching from single-screen mode to dual-screen mode, the step of outputting the playback video in the second video stream to the main screen for display specifically involves switching the output video stream of the main screen from the first video stream to the second video stream, so as to output the playback video in the second video stream to the main screen for display.

[0023] As can be seen from the above description, under the existing display framework, the underlying logic defaults to using the first video stream as the display content of the main screen and only the first video stream can be manipulated. When switching from single-screen mode to dual-screen mode, the display content of the main screen is switched from the default first video stream to the second video stream. The operation interface in the first video stream is sent to the operation device for interface operation. Thus, while ensuring that the output display of the main screen does not conflict with the interface operation, there is no need to modify the underlying logic.

[0024] Furthermore, it also includes the following steps:

[0025] When switching back from dual-screen mode to single-screen mode, the video stream displayed on the main screen is switched from the second video stream to the first video stream.

[0026] As can be seen from the above description, in single-screen mode, the main screen's display video stream remains the default first video stream, so as to achieve the effect of switching back from dual-screen display mode to single-screen mode.

[0027] Furthermore, the step of sending the operation interface in the first video stream to the control device specifically involves:

[0028] The operation interface in the first video stream is recorded, encapsulated into a video stream, and then pushed to the control device.

[0029] As can be seen from the above description, screen recording enables the control device to obtain the operation interface in the default video stream for independent operation.

[0030] Furthermore, receiving the operation information from the control device on the operation interface specifically includes:

[0031] Receive relative coordinate information of the operation performed by the control device on the operation interface;

[0032] The relative coordinate information is converted into real coordinate information according to the ratio between the control device and the main screen, and the real coordinate information is used as operation information.

[0033] As can be seen from the above description, by performing coordinate transformation on the operation of the control device, the operation events performed on the main screen are simulated, so as to achieve the purpose of controlling a single-screen product by the control device.

[0034] Furthermore, the ratio between the control device and the main screen specifically refers to the ratio between the control device and the main screen in terms of resolution.

[0035] As can be seen from the above description, the purpose of simulating the main screen operation is achieved by using the proportional relationship of resolution.

[0036] Furthermore, the specific meaning of entering dual-screen mode is as follows: when a confirmation message for entering dual-screen mode is received from the control device, the single-screen mode is switched to dual-screen mode;

[0037] It also includes the step of: when receiving confirmation information from the control device to exit dual-screen mode via a display button or a combination of buttons, switching dual-screen mode back to single-screen mode.

[0038] As can be seen from the above description, the control device can switch the current mode in multiple ways to facilitate the user's switching between dual-screen mode and single-screen mode.

[0039] Furthermore, the switching between the single-screen mode and the dual-screen mode is communicated to the control device via HTTP protocol and broadcast messages.

[0040] As can be seen from the above description, communication with the control device is achieved through the HTTP protocol and broadcast messages.

[0041] Furthermore, the control device is a mobile device.

[0042] As can be seen from the above description, with the widespread use of mobile devices, controlling the home screen through mobile devices has high versatility and convenience.

[0043] Please refer to Figure 2A control terminal for convenient switching between single and dual screens includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the various steps in the aforementioned control method for convenient switching between single and dual screens.

[0044] The present invention provides a control method and terminal for convenient switching between single and dual screens, which is applicable to scenarios requiring simultaneous display and control of screens, such as the main display screen of home audio-visual playback devices, external screens in performance venues, televisions, projectors, etc. The following describes specific implementation methods:

[0045] Please refer to Figure 1 Embodiment 1 of the present invention is as follows:

[0046] A control method for convenient switching between single and dual screens includes the following steps:

[0047] S1. In single-screen mode, the first video stream is output to the main screen for display by default;

[0048] In this embodiment, the single-screen product has only one output interface to the main screen. The system on the single-screen product is Android, which by default supports the display of two different video streams (including a first video stream and a second video stream), corresponding to virtual display screens Display 0 and Display 1, respectively. By default, upon startup, the content of virtual display screen Display 0 is output to the main screen for display, and only Display 0 can be operated. Display 0 corresponds to displaying the first video stream, and Display 1 corresponds to displaying the second video stream. Therefore, in single-screen mode, the single-screen product by default outputs the video from the first video stream to the main screen for display.

[0049] S2. When entering dual-screen mode, the operation interface in the first video stream is sent to the control device, and the playback video in the second video stream is output to the main screen for display.

[0050] Specifically, step S2, which involves outputting the playback video from the second video stream to the main screen for display, involves switching the display video stream on the main screen from the first video stream to the second video stream, so as to output the playback video from the second video stream to the main screen for display.

[0051] In this embodiment, the control device is a mobile device, that is, a mobile phone or tablet is required. The device is connected to an RJ45 wired network or a Wi-Fi wireless network to scan the QR code provided at a specific entry point of the single-screen product to download and install the accompanying APP.

[0052] In this embodiment, the switching between single-screen mode and dual-screen mode is communicated to the control device via HTTP protocol and broadcast messages. Therefore, when the user opens the APP and clicks the corresponding touchscreen entry on the mobile device, the single-screen product is notified via HTTP protocol to confirm whether to enter dual-screen display mode. When the control device receives confirmation information from the user confirming entry into dual-screen mode, the single-screen mode is switched to dual-screen mode.

[0053] Specifically, sending the operation interface from the first video stream to the control device involves:

[0054] Record the operation interface in the first video stream, encapsulate it into a video stream, and then push it to the control device.

[0055] When entering dual-screen mode, the screen information of the virtual display screen Display0 is recorded and the video stream is encapsulated. The stream is then pushed to the mobile device via RTSP service. The mobile device is responsible for receiving the video stream and creating a player to play it, thereby enabling real-time display of the operation page of the virtual display screen Display0. At the same time, the single-screen product switches the main screen display of the system to the virtual display screen Display1.

[0056] S3. Receive the operation information from the control device on the operation interface, and output the video in response to the operation information as the updated second video stream to the main screen for display.

[0057] Specifically, receiving operation information from the control device on the user interface includes:

[0058] S31. Receive the relative coordinate information of the control device when it operates on the operation interface;

[0059] S32. Convert the relative coordinate information into real coordinate information according to the ratio between the control device and the main screen, and use the real coordinate information as operation information.

[0060] Specifically, the ratio between the control device and the main screen refers to the ratio between the control device and the main screen in terms of resolution.

[0061] Therefore, in the dual-screen display mode, assuming that a gesture operation performed on the mobile device, such as a touch click event, is performed, the mobile device collects the relative coordinate information, encapsulates it through WebSocket (a full-duplex communication protocol based on TCP) and pushes it to the single-screen product. After receiving the relative coordinate information, the single-screen product converts it according to the resolution ratio to obtain the real coordinate information and then performs a simulated touch click event to achieve the purpose of controlling the single-screen product by the mobile device. Other gesture operations are similar.

[0062] In this system, after being controlled by a mobile device, the single-screen product displays the corresponding content page based on the mobile device's operation. For example, when playing a video on the mobile device's interface, the mobile device collects relative coordinate information, encapsulates it via WebSocket, and pushes it to the single-screen product. After receiving the relative coordinate information, the single-screen product converts it according to the resolution ratio to obtain the actual coordinate information, simulates a touch click event, obtains the video to be played corresponding to the touch click event, and displays the video as an updated second video stream on Display1. Display1 then outputs the updated second video stream to the main screen connected to the single-screen device for display, while the mobile device screen continues to display the operation interface, achieving the purpose of dual-screen display.

[0063] S4. When switching back from dual-screen mode to single-screen mode, switch the main screen's display video stream from the second video stream to the first video stream.

[0064] In this embodiment, when the single-screen product receives confirmation information from the control device to exit dual-screen mode via a display button or a combination of buttons, it switches back from dual-screen mode to single-screen mode.

[0065] The display button is the exit control button. Combination buttons can be a combination of volume down and volume up, power button and volume down, or power button and volume up, etc. At this time, the mobile device notifies the single-screen product via HTTP protocol and broadcast message to switch the system's main screen output to Display0, thus achieving the effect of switching back from dual-screen display mode to single-screen mode.

[0066] Please refer to Figure 2 Embodiment two of the present invention is as follows:

[0067] A control terminal 1 that allows for convenient switching between single and dual screens includes a memory 3, a processor 2, and a computer program stored in the memory 3 and capable of running on the processor 2. When the processor 2 executes the computer program, it implements the steps described in Embodiment 1 above.

[0068] In summary, the present invention provides a control method and terminal for convenient switching between single and dual screens. For single-screen products, there is only one output interface to the main screen. Furthermore, the underlying logic defaults to displaying the first video stream as the main screen and only the first video stream can be controlled. The present invention can output two video streams. When entering dual-screen mode, the first video stream, which is the default output video, is switched to the second video stream. Then, the operation interface in the first video stream is sent to the control device, and the playback video in the second video stream is output to the main screen for display. Then, the operation information of the user on the control device is received, and the operation of the control device is transformed into coordinates to simulate the operation event performed on the main screen. The playback video corresponding to the operation event is obtained, and the playback video corresponding to the operation information is output as the updated second video stream to the main screen for updated display. Therefore, it is possible to eliminate the need for two dedicated hardware screens and without modifying the underlying logic, so that the user interface operation and screen display will not conflict. Thus, it can solve the problem of conflict between screen display and interface operation in a low-cost and convenient way.

[0069] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent modifications made based on the content of the present invention's specification and drawings, or direct or indirect applications in related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A control method for single-double screen convenient switching, characterized in that, The method comprises the steps of: when entering the dual-screen mode, sending the operation interface in the first video stream to the control device, and outputting the playing video in the second video stream to the main screen for display; receiving operation information of the control device on the operation interface, and outputting the playing video in response to the operation information as the updated second video stream to the main screen for display; when in the single-screen mode, defaulting to output the first video stream to the main screen for display; when switching from the single-screen mode to the dual-screen mode, the outputting the playing video in the second video stream to the main screen for display specifically comprises: switching the output video stream of the main screen from the first video stream to the second video stream to output the playing video in the second video stream to the main screen for display; the sending the operation interface in the first video stream to the control device specifically comprises: recording the operation interface in the first video stream and encapsulating it into a video stream, and then pushing the video stream to the control device.

2. The control method of claim 1, wherein, The method further comprises the steps of: when switching from the dual-screen mode to the single-screen mode, switching the display video stream of the main screen from the second video stream to the first video stream.

3. The control method of claim 1, wherein, The receiving operation information of the control device on the operation interface specifically comprises: receiving relative coordinate information of the control device on the operation interface; converting the relative coordinate information into real coordinate information according to the proportional relationship between the control device and the main screen, and taking the real coordinate information as the operation information.

4. The control method of claim 3, wherein, The proportional relationship between the control device and the main screen specifically refers to the proportional relationship between the control device and the main screen in resolution.

5. The control method of claim 1, wherein, The entering the dual-screen mode specifically comprises: when receiving confirmation information of entering the dual-screen mode sent by the control device, switching from the single-screen mode to the dual-screen mode. The method further comprises the steps of: when receiving confirmation information of exiting the dual-screen mode triggered by the control device through the display button or through the combination of keys, switching from the dual-screen mode to the single-screen mode.

6. The control method of claim 5, wherein, The switching between the single-screen mode and the dual-screen mode is notified to the control device through the HTTP protocol and the broadcast message.

7. The control method of claim any one of claims 1 to 6, wherein, The control device is a mobile device.

8. A control terminal with single / dual screen convenient switching, comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, characterized in that, The processor executes the computer program to implement each step in the control method for switching between the single-screen mode and the dual-screen mode according to any one of claims 1 to 7.

Images