Multi-screen interaction system based on virtual remote controller

Abstract

The invention is suitable for the technical field of multi-screen interaction, and particularly relates to a multi-screen interaction system based on a virtual remote controller, and the system comprises a virtual remote controller module which is used for receiving and analyzing user input, converting the user input into a control instruction, and sending the control instruction to a multi-screen interaction module. The multi-screen interaction module is used for processing an instruction of the virtual remote controller and transmitting control information to the television equipment through network communication; and the equipment connection module is used for realizing the connection between the intelligent equipment and the television equipment, and is used for performing unified management on the media contents, including content retrieval, playing control and interactive management. By introducing the virtual remote controller, the user experience is greatly improved, the operation is more intuitive and flexible, the user can perform natural gesture operation through the touch screen, and the system response is quick. Meanwhile, the multi-screen interaction function enables the content to be switched among different devices more smoothly, and the overall experience of the user is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of multi-screen interaction, and in particular relates to a multi-screen interaction system based on a virtual remote controller. Background Art

[0002] With the rapid development of technology and the diversification of consumer demand, the television media industry is facing unprecedented changes. Home viewers increasingly expect seamless interaction with television through smart devices (such as smartphones and tablets) to obtain a richer viewing experience and convenient operation. However, traditional television media transmission and interaction methods are limited by device compatibility and technical architecture, and are difficult to meet current and future needs.

[0003] Virtual remote control, with its cross-platform, high compatibility and easy operation, has gradually become a key technology to enhance the multi-screen interactive experience. Through the virtual remote control, users can break through the limitations of physical space and achieve seamless switching and content synchronization between multiple devices, which will greatly enhance the audience's participation and stickiness, especially in the field of TV media.

[0004] With the rapid advancement of technology and the popularity of smart devices, people's lifestyles and work styles have changed dramatically. In daily life, more and more families have multiple display devices, such as smart TVs, tablets, and smartphones. At the same time, users' demand for multi-screen interaction is also increasing. They hope to be able to easily share and synchronize content between different devices to improve the user experience. For example, users hope to be able to select a movie on their mobile phone and play it directly on the TV; or browse pictures on the tablet and display them on the TV in real time to share with their family.

[0005] The existing multi-screen interactive solutions on the market mainly rely on physical remote controls or specific multi-screen interactive software. However, these solutions often have the following problems in practical applications:

[0006] 1. Device compatibility issues: There are compatibility issues between devices of different brands and models, which makes it impossible to smoothly implement the multi-screen interactive function.

[0007] 2. Operational complexity: Users need to perform complex settings on multiple devices or download dedicated software. The operation process is cumbersome and the user experience is poor.

[0008] 3. Poor control flexibility: The control range of the physical remote control is limited, and the operation is restricted by the number and function of buttons, which cannot meet diverse interaction needs. Summary of the invention

[0009] The purpose of the present invention is to provide a multi-screen interactive system based on a virtual remote control, aiming to solve the problem that the control range of a physical remote control is limited and the operation is restricted by the number and function of buttons, and cannot meet diverse interaction needs.

[0010] The present invention is implemented as follows: a multi-screen interactive system based on a virtual remote controller, the system comprising:

[0011] The virtual remote control module is used to receive and analyze user input, convert the user input into control commands and send them to the multi-screen interaction module.

[0012] A multi-screen interactive module, used to process the instructions of the virtual remote control and transmit the control information to the TV device through network communication;

[0013] The device connection module is used to realize the connection between the smart device and the TV device.

[0014] The content management module is used to uniformly manage media content, including content retrieval, playback control and interactive management.

[0015] Preferably, the virtual remote control module is used to collect user inputs through the touch screen and sensors on the smart device and convert these operations into control instructions, and the user inputs at least include gesture operations, sliding and clicking.

[0016] Preferably, the multi-screen interaction module has multiple network communication protocols built in, and the multi-screen interaction module receives instructions from the virtual remote control module and is connected to the display device via WIFI.

[0017] Preferably, the device connection module is used to connect the smart device and the display device. During the connection process, the device connection module automatically identifies the device and monitors the connection status between the devices in real time.

[0018] Preferably, the content management module is used to distribute the content selected by the user to different display devices, and the content management module supports content in multiple formats, including video, audio, picture and document.

[0019] Preferably, the multi-screen interaction module supports multiple screen interaction modes, and the screen interaction modes include:

[0020] Mirror mode: display the same content on multiple display devices;

[0021] Extended mode: different display devices display different content;

[0022] Independent mode: Each user operates one display device.

[0023] Preferably, the content management module analyzes the user's usage habits and generates personalized recommended content. When making content recommendations, it analyzes based on the user's historical operating behavior, makes recommendations based on real-time usage scenarios, and adjusts content push based on user feedback.

[0024] Preferably, the system includes a device status monitoring module that monitors the operating status of the device in real time by periodically sending heartbeat packets or status query instructions. When it is detected that the device is disconnected, the network is unstable, or the content is out of sync, the corresponding response strategy is executed. When an abnormality occurs or user operation is required, the user is notified through the virtual remote control module or the device prompt sound, and a solution is provided.

[0025] The multi-screen interactive system based on the virtual remote controller provided by the present invention greatly improves the user experience by introducing the virtual remote controller, and the operation is more intuitive and flexible. The user can perform natural gesture operation through the touch screen, and the system responds quickly. At the same time, the multi-screen interactive function makes the switching of content between different devices smoother, which improves the overall user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 A schematic diagram of the principle of a multi-screen interactive system based on a virtual remote controller provided by an embodiment of the present invention;

[0027] Figure 2 The overall architecture diagram of the multi-screen interactive system based on the virtual remote controller provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0029] like Figure 1 and Figure 2 As shown, a multi-screen interactive system based on a virtual remote controller comprises:

[0030] The virtual remote control module is used to receive and analyze user input, convert the user input into control commands and send them to the multi-screen interaction module.

[0031] A multi-screen interactive module, used to process the instructions of the virtual remote control and transmit the control information to the TV device through network communication;

[0032] The device connection module is used to realize the connection between the smart device and the TV device.

[0033] The content management module is used to uniformly manage media content, including content retrieval, playback control and interactive management.

[0034] In this embodiment, the multi-screen interactive system based on the virtual remote controller is composed of the following core modules, each of which cooperates with each other to achieve the overall function:

[0035] 1. Virtual remote control module: responsible for receiving and parsing user input, converting it into control commands and sending them to the multi-screen interaction module.

[0036] 2. Multi-screen interaction module: processes the instructions of the virtual remote control and transmits the control information to the TV device through network communication to achieve content synchronization and control.

[0037] 3. Device connection module: ensures stable connection between smart devices and TV devices and supports multiple wireless communication protocols.

[0038] 4. Content management module: unified management of media content, including content retrieval, playback control and interactive management functions.

[0039] The virtual remote control module is the core part of the user-system interaction. It can collect user inputs such as gestures, sliding, and clicking through the touch screen and sensors on smart devices, and convert these operations into control commands. For example, users can switch TV content by sliding the screen on their mobile phones, and can control play and pause by clicking buttons.

[0040] User interface: Users can control multi-screen devices through gestures such as clicking and sliding.

[0041] Feedback mechanism: After each operation, the virtual remote control will promptly feedback the operation results, such as successful playback, pause or switching of content, etc., to improve the user experience.

[0042] The multi-screen interactive module is the core of the entire system, responsible for receiving instructions from the virtual remote control and communicating with each display device through the network communication protocol Wi-Fi. Its core functions include:

[0043] Command processing: Receive and parse control commands from the virtual remote control and distribute them to the corresponding display device for execution.

[0044] Content synchronization: Ensure that content is displayed synchronously across multiple display devices to avoid asynchrony caused by factors such as network delays.

[0045] Mode switching: supports multiple screen interaction modes, such as touch mode and button mode, to meet the different needs of users.

[0046] The device connection module is responsible for the connection between smart devices (such as mobile phones and tablets) and display devices (such as TVs). The system supports Wi-Fi connection. During the connection process, the system will automatically identify the device, provide automatic connection or manual connection options, and monitor the connection status in real time. Features:

[0047] Auto-Connect: Enables fast and seamless device connections through automatic scanning and device recognition.

[0048] Connection method: Users can connect to the device through the network.

[0049] Connection stability guarantee: The system ensures connection stability between devices and low latency in data transmission by optimizing connection protocols and data transmission methods.

[0050] The content management module is responsible for distributing the content selected by the user to different display devices and ensuring real-time synchronization of the content. This module supports content in multiple formats, including video, audio, pictures, and documents, and has content caching and distribution strategies to ensure smooth playback even in poor network environments.

[0051] Function:

[0052] Content distribution: Send content to corresponding display devices based on user selection.

[0053] Content synchronization: Synchronous display of content on multiple display devices to avoid delays and freezes.

[0054] Format compatibility: Supports multiple content formats and has conversion and optimization capabilities to adapt to the requirements of different display devices.

[0055] Virtual remote control module, referred to as virtual remote control.

[0056] When the present invention is used, the system needs to be initialized:

[0057] 1. Device preparation: Make sure that both the smart device and the display device are turned on and in the same network environment.

[0058] 2. Application installation: Install the virtual remote control application on the smart device and perform initial configuration.

[0059] 3. Device binding: Scan the display device’s connection information through the application or manually enter it to complete the device binding.

[0060] Connect and Sync:

[0061] 1. Connection establishment: The virtual remote control application establishes a connection with the display device through the remote control server and confirms the connection status.

[0062] 2. Content selection: The user selects the content to be played or displayed through the virtual remote control interface.

[0063] 3. Synchronous control: Send control commands through the virtual remote control to realize operations such as playing, pausing, switching, etc. of content, ensuring synchronization between multiple display devices.

[0064] Users can use the virtual remote control module to achieve a variety of interactive controls, such as:

[0065] 1. Playback control: basic controls such as play, pause, fast forward, and fast rewind.

[0066] 2. Mode switching: switch between various interactive modes such as touch mode and button mode.

[0067] 3. Volume adjustment: adjust the volume through the virtual remote control.

[0068] The system supports multiple screen interaction modes, and users can choose different modes according to actual needs:

[0069] 1. Mirror mode: All connected display devices display the same content, which is suitable for demonstrations or scenarios where multiple devices watch the same content.

[0070] 2. Extended mode: Different display devices display different content. Users can operate on one device, and other devices display corresponding extended information, such as the content display of the primary and secondary screens.

[0071] 3. Independent mode: Each display device operates independently, suitable for scenarios where multiple users use the same system at the same time.

[0072] By analyzing the user's usage habits and preferences, the system provides personalized content recommendations. For example, the system can automatically recommend suitable movies, music or pictures based on factors such as the user's past viewing content, current time, device type, etc. The main functions of this module include:

[0073] 1. User preference analysis: The system extracts user preference patterns by performing data analysis on the user’s past operating behaviors.

[0074] 2. Real-time recommendation: Recommend appropriate content in real time based on the user’s current usage scenario (such as home entertainment, conference presentation, etc.).

[0075] 3. Intelligent adjustment: The system can dynamically adjust the recommended content based on the user's immediate feedback (such as likes, skips, etc.) to ensure the accuracy of the recommendation and user satisfaction.

[0076] The system includes an equipment status monitoring module:

[0077] In order to ensure the stable operation of the system, the device status monitoring module monitors the connection status, operation status and content synchronization of smart devices and display devices in real time. When an abnormality occurs, the system will promptly feedback to the user and provide corresponding solutions, such as reconnecting, switching content sources or adjusting network settings.

[0078] 1. Status monitoring: The system monitors the operating status of the device in real time by regularly sending heartbeat packets or status query instructions.

[0079] 2. Exception handling: When abnormal situations such as device disconnection, network instability or content asynchrony are detected, the system will automatically handle them, such as reconnection, content reloading, etc.

[0080] 3. User notification: When an abnormality occurs or user operation is required, the system will notify the user through the virtual remote control interface or device prompt sound, and provide a simple solution.

[0081] After the system of the present invention is developed, it needs to be fully tested in a variety of real environments to ensure its functionality, stability and user experience.

[0082] 1. Test equipment configuration: Prepare display devices and smart devices of various models and brands to ensure the diversity and representativeness of the test environment.

[0083] 2. Test tool selection: Use professional test software and tools to simulate real user operations and network environments to comprehensively test the performance and stability of the system.

[0084] Functional testing:

[0085] Functional testing is a key step to ensure that each module and function of the system operates normally according to design requirements. Testing includes but is not limited to:

[0086] 1. Unit testing: Test each independent functional module in the system to ensure that it runs independently and correctly.

[0087] 2. Integration test: Based on unit testing, integrate the modules for testing to ensure that the data transmission and logic control between modules are normal.

[0088] 3. User experience testing: Test the system’s usability, response speed and rationality of operating procedures through actual user operations.

[0089] Performance optimization:

[0090] The performance bottlenecks found during the test need to be optimized, mainly involving the following aspects:

[0091] 1. Network transmission optimization: By optimizing data transmission protocols and compressing data volume, network delays can be reduced and data transmission speeds can be increased.

[0092] 2. System resource management: Optimize the system's use of hardware resources, such as memory, processor, etc., to ensure smooth system operation.

[0093] 3. User interface optimization: Based on user feedback and test results, the user interface of the virtual remote control is optimized to enhance the user's operating experience.

[0094] Safety Testing:

[0095] In order to ensure the data security and privacy protection of users, the system needs to undergo comprehensive security testing, including:

[0096] 1. Data leakage risk assessment: Simulate possible data leakage scenarios and evaluate the system's ability to protect user data.

[0097] 2. Network attack simulation: Test the system's protection capabilities by simulating common network attack methods, such as DDoS attacks and man-in-the-middle attacks.

[0098] 3. Security vulnerability repair: Repair the security vulnerabilities found in the test and conduct secondary testing to ensure the security and reliability of the system.

[0099] The multi-screen interactive system based on virtual remote controller provided by the present invention is a multi-screen interactive method based on virtual remote controller tailored for the television media industry. The method is implemented by the following technical means:

[0100] Wireless virtual remote control:

[0101] Use your smartphone or tablet as a virtual remote control to connect and control the TV in real time via a wireless network (such as Wi-Fi).

[0102] Cross-platform compatibility:

[0103] Ensure that the virtual remote control is compatible with mainstream smart devices and TV brands on the market, breaking down the technical barriers between devices.

[0104] Smart Content Sync:

[0105] Synchronize media content between different devices in real time based on user operations, including video, audio, and subtitles.

[0106] Enhanced interactive features:

[0107] Through advanced interaction methods such as gesture recognition and voice control, it provides users with a richer and more convenient interactive experience.

[0108] Optimization of user experience:

[0109] The introduction of the virtual remote control has greatly improved the user experience, making the operation more intuitive and flexible. Users can perform natural gesture operations through the touch screen, and the system responds quickly. At the same time, the multi-screen interactive function makes the switching of content between different devices smoother, improving the overall user experience.

[0110] High compatibility and scalability:

[0111] This system has extremely high compatibility and scalability, and can support most brands and models of smart devices and display devices on the market, so users do not need to worry about compatibility issues between devices. In addition, the system also supports future functional expansion, such as adding more interactive modes and content sources to meet the ever-changing needs of users.

[0112] Real-time and stability:

[0113] Through optimized network transmission protocols and data synchronization mechanisms, the system can achieve real-time data transmission and content synchronization, ensuring the smoothness and stability of multi-screen interaction. Even in poor network conditions, the system can still provide a stable user experience through optimized transmission strategies and content caching mechanisms.

[0114] Security and Privacy Protection:

[0115] The system adopts a multi-level security protection mechanism, from data transmission encryption to user data storage protection, to fully protect user data security and privacy. Through strict access control and permission management, it ensures that user data is not accessed by unauthorized devices or applications.

[0116] Application scenarios:

[0117] Home entertainment: In home entertainment scenarios, users can use a virtual remote control to project the content on their smartphones and tablets directly onto the TV, achieving multi-screen interaction. Whether watching movies, listening to music, or playing home games, users can switch freely between different devices through simple operations to enhance the home entertainment experience.

[0118] Conference presentation: In conference scenarios, the system can help users switch and display content between multiple display devices, greatly improving presentation efficiency. Speakers can control the content display of projectors and monitors through virtual remote controls, without complicated operations or switching cables, and easily achieve multi-screen collaborative presentations.

[0119] Education and training: In education and training scenarios, the system supports teachers to control the content display of multiple screens in the classroom through virtual remote controls, such as synchronously displaying textbook content on students' tablets, or displaying teaching videos on a large screen, to achieve multi-screen interactive teaching and improve classroom interactivity and teaching effectiveness.

[0120] Commercial display: In commercial display scenarios, the system can help merchants control multiple display screens through virtual remote controls to achieve synchronous and interactive product displays. Users can display the main information of the product on the main screen, and display detailed parameters, usage scenarios, etc. of the product on the auxiliary screen, improving the display effect and customer experience.

[0121] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A multi-screen interactive system based on a virtual remote controller, characterized in that: The system comprises: The virtual remote control module is used to receive and analyze user input, convert the user input into control commands and send them to the multi-screen interaction module. A multi-screen interactive module, used to process the instructions of the virtual remote control and transmit the control information to the TV device through network communication; The device connection module is used to realize the connection between the smart device and the TV device. The content management module is used to uniformly manage media content, including content retrieval, playback control and interactive management.

2. The multi-screen interactive system based on virtual remote controller according to claim 1, characterized in that: The virtual remote control module is used to collect user inputs through the touch screen and sensors on the smart device and convert these operations into control instructions. The user inputs at least include gesture operations, sliding and clicking.

3. The multi-screen interactive system based on virtual remote controller according to claim 1, characterized in that: The multi-screen interactive module has multiple network communication protocols built in. The multi-screen interactive module receives instructions from the virtual remote control module and connects to the display device via WIFI.

4. The multi-screen interactive system based on virtual remote controller according to claim 1, characterized in that: The device connection module is used to connect the smart device and the display device. During the connection process, the device connection module automatically identifies the device and monitors the connection status between the devices in real time.

5. The multi-screen interactive system based on virtual remote controller according to claim 1, characterized in that: The content management module is used to distribute the content selected by the user to different display devices. The content management module supports content in multiple formats, including video, audio, picture and document.

6. The multi-screen interactive system based on virtual remote controller according to claim 1, characterized in that: The multi-screen interaction module supports multiple screen interaction modes, including: Mirror mode: display the same content on multiple display devices; Extended mode: different display devices display different content; Independent mode: Each user operates one display device.

7. The multi-screen interactive system based on virtual remote controller according to claim 1, characterized in that: The content management module analyzes the user's usage habits and generates personalized recommended content. When making content recommendations, it analyzes the user's historical operation behavior, makes recommendations based on real-time usage scenarios, and adjusts content push based on user feedback.

8. The multi-screen interactive system based on virtual remote controller according to claim 1, characterized in that: The system includes a device status monitoring module that monitors the operating status of the device in real time by regularly sending heartbeat packets or status query instructions. When it detects that the device is disconnected, the network is unstable, or the content is out of sync, the corresponding response strategy is executed. When an abnormality occurs or user operation is required, the user is notified through the virtual remote control module or the device prompt sound, and a solution is provided.

Images