Multi-terminal linkage large screen control system and method
By designing a multi-end linkage large-screen control system, unified control between mobile devices and large screens is solved, and the problem of difficulty in realizing fast and intuitive control between mobile devices and large screens in the existing technology is solved, and the mobile operation of large screens is achieved and the user experience is improved.
Patent Information
- Application Number
- CN202411411397.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-10
- Publication Date
- 2025-02-25
AI Technical Summary
The existing technology is difficult to achieve unified, fast and intuitive control of mobile devices and large screens, and cannot meet the centralized control and management needs of coal mine enterprises for exhibition hall equipment and content.
Design a multi-end linkage large-screen control system, including mobile terminal, server and web terminal, generate large-screen operation instructions through mobile terminal, send them to server, server analysis and push them to web terminal, and web terminal parses and performs large-screen operations. Linkage control software is set up in the mobile terminal, which supports key clicks and voice triggering operations. The voice-text conversion module converts voice commands into text commands.
The mobile operation of large screens is realized. Users can control it through smartphones or tablets and synchronize it with PC computers. They have centralized control, synchronized display, remote operation and other functions, reducing hardware equipment and costs and improving user experience.
Smart Images

Figure CN119520498A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a multi-terminal linkage large-screen control system and method, belonging to the technical field of large-screen control. Background Art
[0002] In the field of coal mines, information centers or exhibition halls need to display information about the entire mine on a large screen. Currently, computers are usually used in the prior art to control page switching and jump operations on the large screen.
[0003] However, with the development of information technology and mobile devices, traditional exhibition halls can no longer meet the diverse needs of enterprises. Therefore, how to apply mobile devices (such as mobile phones and tablets) to large-screen control to achieve unified, fast and intuitive centralized control and management of equipment and content in the exhibition hall, and bring better exhibition experience to visitors, has become a concern of coal mining enterprise users. Summary of the invention
[0004] The technical problem to be solved by the present invention is to overcome the shortcomings of the prior art and provide a multi-terminal linkage large-screen control system and method to achieve remote synchronous control from the mobile terminal to the Web terminal and the large-screen terminal, thereby simplifying and intelligentizing the large-screen control.
[0005] In order to solve the above technical problems, the technical solution of the present invention is:
[0006] On one hand, the present invention provides a multi-terminal linkage large-screen control system, which includes a mobile terminal, a server and a Web terminal;
[0007] The mobile terminal is used to generate a user's large-screen operation instruction, and then send the large-screen operation instruction to the server through the interface;
[0008] The server is used to receive the large screen operation instructions sent by the mobile terminal, perform relevant instruction analysis, and push the results that need to be operated to the Web terminal;
[0009] The Web end is used to monitor the designated command response interface of the server, parse the commands sent by the server, and perform corresponding operations on the large screen.
[0010] Furthermore, linkage control software is provided in the mobile terminal, and the linkage control software is used to provide the user with button click trigger operation and voice trigger operation.
[0011] Furthermore, a voice-to-text conversion module is integrated into the linkage control software, and the voice-to-text conversion module is used to convert the user's voice command into a text command.
[0012] Furthermore, the mobile terminal includes a mobile phone and a tablet.
[0013] Furthermore, the Web terminal includes a computer.
[0014] Another aspect of the present invention provides a control method for a multi-terminal linkage large-screen control system, which comprises the following steps:
[0015] Step S1: Log in to the linkage control software on the mobile terminal;
[0016] Step S2: After the user sends a voice or key command through the mobile terminal, the linkage control software of the mobile terminal generates the user's large-screen operation instruction, and then sends the large-screen operation instruction to the server backend through the interface;
[0017] Step S3: The background configures the mapping relationship between the large-screen operation instructions and the large-screen menu;
[0018] Step S4: After the mapping relationship is established, the corresponding page can be opened on the large screen according to the large screen operation instruction.
[0019] Furthermore, the interface is provided by a server, and the interface is used for the mobile terminal, the web terminal and the server to interact.
[0020] Furthermore, the server backend is a data processing service deployed in the server and is used to develop a server interface.
[0021] Furthermore, in step S3, the mapping relationship between the large-screen operation instructions and the large-screen menu is configured by the background, which specifically includes the following steps:
[0022] Configure the mapping relationship between the large-screen operation instructions and the large-screen menu. First, open the page to the large-screen menu, establish a websocket connection between the front-end and the server back-end, and the front-end and the server back-end exchange information through the websocket connection;
[0023] When the page opens the large-screen menu, the page actively establishes a websocket connection with the server backend, allowing the server backend to actively communicate with the page and pass the new page address that needs to be jumped to the large screen.
[0024] By adopting the above technical solution, the present invention can realize the mobile operation of large screens. It can be easily installed on a smart phone or tablet and can be synchronously controlled with a PC. It has multiple functions such as centralized control, synchronous display, and remote operation, which solves the troubles of users in controlling multiple large screens in the exhibition hall. The system is simplified, the hardware equipment is reduced, and the cost is greatly reduced. Users can control with a handheld mobile device, which can free users from the passive and static state of acceptance, and can help people better integrate into the exhibition environment and obtain a two-way interactive communication experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] Figure 1 This is a principle block diagram of the multi-terminal linkage large-screen control system of the present invention;
[0026] Figure 2 The present invention is a flowchart of a control method for a multi-terminal linkage large-screen control system. DETAILED DESCRIPTION
[0027] In order to make the contents of the present invention more clearly understood, the present invention is further described in detail below based on specific embodiments in conjunction with the accompanying drawings.
[0028] Embodiment 1
[0029] like Figure 1 As shown, this embodiment provides a multi-terminal linkage large-screen control system, which includes a mobile terminal, a server and a Web terminal.
[0030] The mobile terminal is used to generate the user's large screen operation instructions (such as large screen page switching and jump instructions), and then send the large screen operation instructions to the server through the interface. The mobile terminal of this embodiment can be a mobile phone and a tablet.
[0031] The server is used to receive large-screen operation instructions sent by the mobile terminal, perform relevant instruction analysis, and push the results that need to be operated to the Web terminal.
[0032] The Web terminal is used to monitor the designated command response interface of the server, parse the command sent by the server, and perform corresponding operations on the large screen. The Web terminal of this embodiment is a computer.
[0033] like Figure 1 As shown, the mobile terminal of this embodiment is provided with linkage control software, which is used to provide users with button click triggering operations and voice triggering operations. Users can send instructions by pressing buttons on mobile phones and tablets, or by voice.
[0034] like Figure 1 As shown, a speech-to-text conversion module is integrated in the linkage control software of this embodiment. The speech-to-text conversion module adopts iFlytek SDK and is used to convert the user's voice commands into text commands.
[0035] Embodiment 2
[0036] like Figure 2 As shown, this embodiment provides a control method of a multi-terminal linkage large-screen control system of Embodiment 1, which includes the following steps:
[0037] Step S1: Log in as a user on the linkage control software on the mobile terminal.
[0038] Step S2: After the user sends a voice or key command through the mobile terminal, the linkage control software of the mobile terminal generates the user's large-screen operation instructions, and then sends the large-screen operation instructions to the server backend through the interface. The interface is provided by the server, which defines a set of specifications and methods for the mobile terminal, web terminal and server to interact; the server backend is a service for processing data deployed in the server, which is used to develop these server interfaces, and each project has a corresponding backend.
[0039] Step S3: The background configures the mapping relationship between the large-screen operation instructions and the large-screen menu; the mapping relationship refers to the relationship between a specific value and a specific path. For example, if "home page" is defined, it is mapped to the path " / home". When the server receives an operation command specifying the home page from the mobile terminal, it sends the mapped path " / home" to the large screen, and the large screen jumps to the home page in response.
[0040] To configure the mapping relationship between the large-screen operation instructions and the large-screen menu, you need to first open the page (the page is the interface that the user can see through the computer and the large-screen) to the large-screen menu. This is mainly to establish a websocket connection between the front desk (the front desk is the Web page on the computer) and the server backend. The front desk and the server backend exchange information through the websocket connection.
[0041] When the page opens the large-screen menu, the page actively establishes a websocket connection with the server backend. This connection enables the server backend to actively communicate with the page and pass the new page address that needs to be jumped to the large screen.
[0042] The main purpose of using websocket here is for the server backend to actively push messages to the page, because the http protocol interface used by the page can only be initiated by the page to transmit messages to the server backend, and the server backend can only passively receive and send messages. If the page needs to receive background data in real time, http high-frequency polling can also be used, but this consumes a lot of resources, so the present invention uses websocket.
[0043] Websocket is a network technology for full-duplex communication between browsers and servers. It is an application layer protocol. It is based on the TCP transmission protocol and reuses the HTTP handshake channel. It has the following advantages:
[0044] 1. Support two-way communication, more real-time.
[0045] 2. Better binary support.
[0046] 3. Less control overhead. After the connection is established, when the Web client and the server exchange data, the header of the data packet controlled by the protocol is smaller. Without the header, the header from the server to the Web client is only 2 to 10 bytes (depending on the length of the data packet). For the header from the client to the server, an additional 4-byte mask is required. The HTTP protocol needs to carry a complete header for each communication.
[0047] Step S4: After the mapping relationship is established, the corresponding page can be opened on the large screen according to the large screen operation instruction.
[0048] If there is no page in the system that needs to be opened in the large-screen operation command, the interface will return a message such as "No page to open!" to the linkage control software;
[0049] If user A has opened the big screen on the computer (that is, the front-end and back-end connection is established), the back-end will pass the big screen address to it for corresponding menu jump. The big screen page opened by user B on the computer will not be affected.
[0050] The specific embodiments described above further illustrate the technical problems, technical solutions and beneficial effects solved by the present invention. It should be understood that the above are only specific embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A multi-terminal linkage large-screen control system, characterized in that: It includes mobile, server and web terminals; The mobile terminal is used to generate a user's large-screen operation instruction, and then send the large-screen operation instruction to the server through the interface; The server is used to receive the large screen operation instructions sent by the mobile terminal, perform relevant instruction analysis, and push the results that need to be operated to the Web terminal; The Web end is used to monitor the designated command response interface of the server, parse the commands sent by the server, and perform corresponding operations on the large screen.
2. The multi-terminal linkage large-screen control system according to claim 1 is characterized in that: The mobile terminal is provided with linkage control software, and the linkage control software is used to provide the user with button click trigger operation and voice trigger operation.
3. The multi-terminal linkage large-screen control system according to claim 3 is characterized in that: The linkage control software is integrated with a voice-to-text conversion module, and the voice-to-text conversion module is used to convert the user's voice command into a text command.
4. The multi-terminal linkage large-screen control system according to claim 1 is characterized in that: The mobile terminal includes a mobile phone and a tablet.
5. The multi-terminal linkage large-screen control system according to claim 1 is characterized in that: The Web terminal includes a computer.
6. A control method for a multi-terminal linkage large-screen control system according to any one of claims 1 to 5, characterized in that: It includes the following steps: Step S1: Log in to the linkage control software on the mobile terminal; Step S2: After the user sends a voice or key command through the mobile terminal, the linkage control software of the mobile terminal generates the user's large-screen operation instruction, and then sends the large-screen operation instruction to the server backend through the interface; Step S3: The background configures the mapping relationship between the large-screen operation instructions and the large-screen menu; Step S4: After the mapping relationship is established, the corresponding page can be opened on the large screen according to the large screen operation instructions.
7. The control method according to claim 6, characterized in that: The interface is provided by the server, and is used for the mobile terminal, the web terminal and the server to interact.
8. The control method according to claim 6, characterized in that: The server backend is a data processing service deployed in the server and is used to develop the server interface.
9. The control method according to claim 6, characterized in that: In step S3, the mapping relationship between the large-screen operation instructions and the large-screen menu is configured by the background, which specifically includes the following steps: Configure the mapping relationship between the large-screen operation instructions and the large-screen menu. First, open the page to the large-screen menu, establish a websocket connection between the front-end and the server back-end, and the front-end and the server back-end exchange information through the websocket connection; When the page opens the large-screen menu, the page actively establishes a websocket connection with the server backend, allowing the server backend to actively communicate with the page and pass the new page address that needs to be jumped to the large screen.
Citation Information
Cited By
Data linkage display method and system based on natural language interaction
CN120950751A