Control and screen interaction system and method based on docking station

Abstract

The invention discloses a control and screen interaction system and method based on a docking station, and relates to the technical field of computer peripheral equipment, the control and screen interaction system based on the docking station comprises an upper computer, client management software running on the upper computer, the docking station and equipment side core firmware running on the docking station; the docking station-based control and screen interaction method is operated on the system. The intelligent docking station has the beneficial effects that the docking station and the upper computer intelligently cooperate to improve the working efficiency, the docking station supports visual interaction, scenes recognized by the docking station are more comprehensive, personalized configuration of users is supported, and the user experience is prominent.

Description

Technical Field

[0001] This invention relates to the field of computer peripheral equipment technology, specifically to a control and screen interaction system and method based on a docking station. Background Technology

[0002] A docking station, also known as a port replicator, is an external device designed for laptops, primarily used to expand interface functionality.

[0003] Traditional all-in-one docking stations (such as Belkin, UGREEN, and Baseus products): only support USB-A / USB-C / HDMI / DP / RJ45 interfaces, lacking AI intelligent control and integrated displays; operation relies on computer shortcuts or system settings, lacking a visual interactive interface, and requiring manual checking of peripheral status; they lack application scenario recognition capabilities, requiring manual switching of functions for different usage scenarios, resulting in poor adaptability. Ordinary peripherals with integrated screens (such as simple display extenders and independent smart screens): can only display basic information such as time and weather, lacking interface expansion capabilities, and must be carried separately from the docking station; they lack AI scene following and habit learning capabilities, have fixed functions, and cannot be customized. They lack data linkage with computers and peripherals, and cannot display core information such as interface status and device parameters.

[0004] Edge AI docking stations (a small number of extension products with basic voice control): only support simple voice commands (such as "open interface"), have no integrated display screen, and the interactive feedback is not intuitive; they lack scene intelligent recognition capabilities and cannot dynamically match functions according to the current application; they lack custom configuration functions and cannot adapt to users' personalized usage habits.

[0005] Currently, there is a demand for docking stations that integrate "interface expansion + AI learning and intelligent control + display interaction," applicable to multiple platforms such as personal computers (laptops / desktops) and mobile devices (tablets / phones). This can cover scenarios such as office meetings, remote collaboration, education and training, design and creation, and daily office work, meeting users' comprehensive needs for interface expansion, high-speed data transmission, AI scenario adaptation, visual interaction, and personalized customization. However, there are no solutions on the market specifically for this demand.

[0006] Therefore, the market needs a new integrated design solution that combines "docking station + AI intelligent control + integrated display". Summary of the Invention

[0007] The purpose of this invention is to provide a control and screen interaction method based on a docking station, which integrates an AI module into a traditional docking station to solve the problems mentioned in the background art.

[0008] On one hand, the present invention provides a control and screen interaction system based on a docking station, including a host computer and client management software running on the host computer, a docking station and device-side core firmware running on the docking station; The host computer is a computer device that runs programs for users' daily work and client management software; Client management software is a program used to implement mode switching, personalized configuration, data synchronization, and status monitoring functions. The docking station includes the main docking station body, an AI intelligent control module, and a display and interaction module, on which client management software runs; The main body of the docking station is equipped with an uplink interface, a downlink interface, and a display and interaction module. Internally, it contains a power module, a memory, and an AI intelligent control module. The uplink interface of the docking station connects to the host computer via a data cable to exchange data. The AI ​​intelligent control module includes an AI scene recognition chip and a user habit learning module; The display and interaction module includes a display screen and physical interaction components; The core firmware on the device side is a program used to implement application scenario recognition, interactive control, and user habit learning functions.

[0009] Preferably, the mode switching function supports one-click switching between button mode, information display mode, screen display mode, and AI scene following mode; The personalized configuration feature allows users to modify the virtual button positions, add frequently used software, folders or websites, and set weather and geolocation through mouse drag-and-drop operations to adapt to user habits. The data synchronization function automatically synchronizes daily usage habits and current mode settings to the docking station; The status monitoring function displays the docking station interface connection status, storage capacity, and device parameters through a graphical interface on the host computer screen.

[0010] Preferably, the AI ​​scene recognition chip is a chip used for identifying application scenarios in a host computer. The user habit learning module is a module that records user operation behaviors.

[0011] Preferably, the application scenario recognition function supports real-time capture of active application signals from the host computer, and quickly identifies application scenarios and matches corresponding functional modules through the AI ​​scenario recognition chip. Application scenarios include office, meeting, design, and offline drawing screen.

[0012] Preferably, the interactive control function recognizes signals from knob rotation, button pressing, and touchscreen virtual buttons to trigger corresponding operations, synchronously controls the display screen status, and feeds back the user's operation to the host computer; The user habit learning function records user behavior through a user habit learning module and generates a personalized recommendation list.

[0013] Preferably, the upstream interface is a USB-C interface; the downstream interfaces include an HDMI interface, a DP interface, a USB-A interface, a PD interface, and an RJ45 network port.

[0014] On the other hand, the present invention provides a docking station-based control and screen interaction method, which runs on the aforementioned docking station-based control and screen interaction system, and includes the following steps: S1: The docking station's uplink interface connects to the host computer, and its downlink interface connects to the display device and external power supply. The docking station is in its initial mode. S2: The host computer runs the client management software program and daily work software. The client management software program sets the current mode and performs personalized configuration, and sends the current mode settings and personalized configuration to the expansion dock simultaneously. S3: The device-side core firmware receives the current mode information from the host computer, and switches to the corresponding application scenario mode based on the identified application scenario; it also identifies the user's daily usage habits and generates and displays a personalized recommendation list on the screen. S4: Users operate via touch screen or by a combination of knobs and buttons, and the device's core firmware sends the combined operation information to the host computer. S5: The client management software program receives virtual button information and combination operation information from the expansion dock and performs corresponding control on the host computer. S6: The host computer stops running daily work software, and the docking station automatically restores to the initial mode.

[0015] Preferably, when the external power supply powers the PD interface, the external power supply prioritizes powering the interface expansion, AI module, and display screen to ensure full-function operation. At the same time, it provides reverse power to the host computer via the data cable. When the external power supply does not provide power to the PD interface, the docking station only maintains the offline screen display mode and the docking station interface expansion function.

[0016] Preferably, the physical interaction components include buttons and knobs; the operating modes include independent function mode and combined function mode; Independent Functional Mode: Switch by turning the knob, trigger by pressing the button, and automatically spring back to its original position after being released. Combined function mode: Adjust the knob, and use the on-screen prompts and touch functions to switch functions.

[0017] Preferably, the daily usage habits module generates a personalized recommendation list based on user usage frequency, scenario preferences, and personalized configurations, supports local data storage, and feeds back user operations to the host computer; The AI ​​intelligent control module also includes a perception sensor. The core firmware on the device side automatically adjusts the brightness of the display screen based on the ambient brightness detected by the perception sensor.

[0018] Compared with the prior art, the beneficial effects of the present invention are: 1. Intelligent collaboration improves efficiency: AI automatically identifies and matches scenes with functions, eliminating the need for manual switching settings, simplifying operation steps by 80%, and improving multitasking efficiency by 70%.

[0019] 2. More comprehensive scenario adaptation: Covers multiple scenarios such as online office, meetings, design, and offline drawing screen, supports switching between 4 core modes, and adapts to different usage needs; 3. Prominent Personalized Experience: Supports customizable functions and habit learning; AI accurately recommends frequently used applications and folders to adapt to different user habits. Attached Figure Description

[0020] Figure 1 This is a schematic diagram of a control and screen interaction system based on an expansion dock as described in this invention; Figure 2 This is a flowchart of a control and screen interaction method based on a docking station as described in this invention; Figure 3 A logic diagram of the button mode described in the invention; Figure 4 This is a logical diagram of the meeting scenario described in this invention; Figure 5 This is a logical diagram illustrating the AI ​​autonomous learning described in this invention; Figure 6 This is a three-dimensional rendering of the docking station described in this invention. Detailed Implementation

[0021] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0022] On the one hand, such as Figure 1 As shown, the present invention provides a control and screen interaction system based on a docking station, including a host computer and client management software running on the host computer, a docking station and device-side core firmware running on the docking station; A host computer is a computer device that runs programs for users' daily work and client management software, including desktop computers, laptops, etc. The client management software is a program used to implement mode switching, personalized configuration, data synchronization, and status monitoring functions; the mode switching function supports one-click switching between button mode, information display mode, offline screen display mode, and AI scene following mode; The personalized configuration function allows users to modify the virtual button positions, add frequently used software, folders or websites, and set weather and geographical locations through mouse drag-and-drop operations to adapt to user habits; the data synchronization function automatically synchronizes daily usage habits and current mode settings to the docking station; the status monitoring function displays the docking station interface connection status, storage capacity, and device parameters in a graphical interface on the host computer screen.

[0023] The client management software can control the expansion dock to upgrade the core firmware on the device side.

[0024] like Figure 6 As shown, the docking station includes a main docking station body, an AI intelligent control module, and a display and interaction module, on which client management software runs; The docking station is equipped with uplink and downlink interfaces. The entire docking station adopts an integrated shell design with no disassembly modules. The docking station contains a power module and a memory. The uplink interface of the docking station is connected to the host computer via a data cable to exchange data. For example, the upstream interface includes one USB-C port, which supports high-speed data transmission and control signal synchronization, and is compatible with USB 3.0 / USB 3.1 / USB 3.2 / USB 4.0; the downstream interface includes one HDMI port supporting 4K@60Hz, one DP port supporting 4K@60Hz, two USB-A ports supporting 5Gbps, one PD port supporting 100W power supply, and one RJ45 network port supporting 1000Mbps.

[0025] like Figure 5 As shown, the AI ​​intelligent control module is located inside the main body of the docking station and can realize AI autonomous learning function. It includes an AI scene recognition chip, a user habit learning module, and a perception sensor. The AI ​​scene recognition chip is a chip that recognizes the application scene of the host computer. The user habit learning module is a module that records user operation behavior and generates a personalized recommendation list based on user usage frequency, scene preferences, and personalized configuration. A perception sensor is built into the front of the docking station. It is a brightness sensor that senses changes in ambient brightness through a lens. The core firmware on the device side automatically adjusts the screen brightness of the display according to the detection value of the perception sensor.

[0026] The display and interaction module is located on the surface of the docking station body and includes a display screen and physical interaction components. For example, the physical interaction components include a set of buttons and knobs, including one micro switch button (press to trigger, automatically rebounds) and one infinitely adjustable knob, which can be expanded into multiple sets of buttons and knobs. The working modes include independent function mode and combined function mode. Independent Functional Mode: For example, turning the knob selects a virtual button on the screen. When the button is pressed, it triggers the screen to turn on and off. When the button is released, it automatically springs back to its original position. With the display screen lit, turning the knob can adjust the screen brightness. Turning the knob selects the virtual button for silent mode. Pressing the button triggers the on / off state of silent mode, and the button automatically springs back to its original position when released. With silent mode off, you can adjust the volume by turning the knob. Combined function mode: Adjust the knob, and use the on-screen prompts and touch functions to switch functions.

[0027] The core firmware on the device side is a program used to implement application scenario recognition, interactive control, and user habit learning functions.

[0028] The application scenario recognition function supports real-time capture of active application signals from the host computer. It quickly identifies application scenarios and matches corresponding functional modules through the AI ​​scenario recognition chip. Application scenarios include office, meeting, design, offline drawing screen, etc. The office scenario is further divided into Word, Excel and PPT scenarios.

[0029] The interactive control function recognizes signals from knob rotation, button pressing, and touchscreen virtual buttons to trigger corresponding operations, synchronously controls the display screen status, and feeds back user operations to the host computer.

[0030] The device-side core firmware stores the personalized recommendation list locally and sends user operations back to the host computer. The device's core firmware automatically adjusts the display brightness by sensing the ambient brightness collected by sensors.

[0031] On the other hand, such as Figure 2 As shown, this invention provides a control and screen interaction method based on a docking station, comprising the following steps: S1: The docking station's uplink interface connects to the host computer, and its downlink interface connects to the display device and external power supply. The docking station is in its initial mode. The PD interface in the downstream interface is used to connect the power supply. The HDMI interface, DP interface or USB-A interface in the downstream interface can be used to connect the display device. The USB-A interface can also connect external input devices (such as a mouse) or external storage devices (such as a USB flash drive). The docking station has the following working modes: button mode, information display mode, offline screen display mode, AI scene following mode, etc. For example, the initial mode is information display mode.

[0032] Button mode: The core shortcut operation mode uses a combination of "knob + button + virtual button" to achieve one-click access and precise adjustment of high-frequency operations in office scenarios, without relying on host computer menus or shortcut keys, simplifying the operation process.

[0033] like Figure 3 As shown, the docking station's display screen shows a set of virtual buttons, each corresponding to a specific function. For example, button 1 shows the desktop, button 2 locks the screen, etc. The docking station has four sets of stepless knobs and physical buttons on its side. In the default configuration, button 1 is a mute switch, and knob 1 is used to adjust the volume; button 2 is a screen light switch, and knob 2 is used to adjust the screen brightness; button 3 is a magnifying glass, pressing button 3 magnifies the selected object on the host computer, and knob 3 restores the docking station to its initial mode; button 4 is a scene switch, pressing button 4 switches the docking station to the current mode, and knob 4 switches the current scene.

[0034] Information Display Mode: A practical mode focusing on visualizing the status of docking station peripherals and hardware information. The docking station's onboard display shows the real-time usage of its interfaces and the core parameters of connected devices, helping users intuitively understand device status and efficiently manage interface resources. Offline Screen Mode: A relaxing mode that balances emotional value and desktop atmosphere creation. It injects warmth into the office scene by rotating personalized content, relieving work fatigue and upgrading the desktop from a "tool carrier" to an "emotional companion carrier".

[0035] AI Scene Following Mode: This intelligent adaptation mode relies on AI's autonomous recognition capabilities. By sensing the current active applications and work scenarios on the host computer, it dynamically matches exclusive shortcut functions and auxiliary tools to achieve an intelligent office experience of "scenario as a service".

[0036] When the PD interface is connected to an external power source, the external power supply prioritizes powering the interface expansion, AI intelligent control module, and display screen to ensure full-function operation. At the same time, it provides reverse power to the host computer via the data cable. When the PD interface is not connected to an external power source, the docking station only supports offline screen display mode and docking station interface expansion function, and does not provide power to the AI ​​intelligent control module. S2: The host computer runs the client management software program and daily work software. The client management software program sets the current mode and performs personalized configuration, and sends the current mode settings and personalized configuration to the expansion dock simultaneously. The client management software program supports one-click setting of the current mode of the docking station. The mode can be switched between the following modes: button mode, information display mode, offline screen display mode, and AI scene follow mode. User application scenarios include office work (Word, Excel, PPT), meetings, design, offline screen drawing, etc. The personalized configuration feature allows users to modify the virtual button positions, add frequently used software, folders or websites, and set weather and geolocation through mouse drag-and-drop operations to adapt to user habits. The data synchronization function automatically synchronizes daily usage habits (usage frequency, scenario preferences, personalized configurations) and current mode settings to the docking station; The status monitoring function displays the docking station interface connection status, storage capacity, and device parameters through a graphical interface on the host computer screen.

[0037] S3: The device-side core firmware receives the current mode information from the host computer, and switches to the corresponding application scenario mode based on the identified application scenario; it also identifies the user's daily usage habits and generates and displays a personalized recommendation list on the screen. The docking station automatically starts the device-side core firmware when powered on. For example... Figure 5 As shown, the AI ​​intelligent control module can realize AI self-learning function, the AI ​​scene recognition chip is a chip for recognizing the application scene of the host computer; the user habit learning module is a module that records user operation behavior and generates a personalized recommendation list based on user usage frequency, scene preference and personalized configuration. When the device-side core firmware switches to the corresponding application scenario mode, the current mode and application scenario information of the host computer will be displayed on the screen, along with the corresponding virtual buttons. For example, such as Figure 4As shown, in a meeting scenario, virtual button 1 on the monitor is for microphone on / off, virtual button 2 for speaker mute, virtual button 3 for camera on / off, virtual button 4 for screen sharing on / off, virtual button 5 for screen sharing off / off, virtual button 6 for meeting recording on / off, virtual button 7 for meeting summary, virtual button 8 for ending the meeting, and virtual button 9 for exiting the meeting scenario. The docking station has four sets of infinitely variable knobs and physical buttons on its side. In a meeting scenario, knob 1 is for volume control, and button 1 is for mute; knob 2 scrolls the participant list, automatically opening the list when rotated, and button 2 opens / closes the participant list; knob 3 adjusts screen brightness, and button 3 is inactive; knob 4 switches between scenarios, and button 4 switches between modes.

[0038] For example, in Word office mode, the virtual keys are used for text continuation and translation; in Excel office mode, the virtual keys are used for automatic summation, decimal point removal, etc. For example, the device-side core firmware automatically filters and displays the top five most frequently used items on the screen based on daily usage habits (usage frequency, scenario preferences, and personalized configurations). When the user touches and selects a virtual button, the device-side core firmware saves the virtual button information locally and sends it to the host computer. S4: Users operate via touch screen or by a combination of knobs and buttons, and the device's core firmware sends the combined operation information to the host computer. The device-side core firmware can recognize user operations, including knob rotation, button pressing, touch screen click signals, etc., trigger corresponding operations, synchronously control the display status, and feed back the user operations to the host computer. For example, such as Figure 3 As shown, virtual button 1 on the touch screen sends the command to switch the host computer screen to the desktop to the host computer via the device-side core firmware; virtual button 2 on the touch screen sends the command to lock the host computer screen to the host computer via the device-side core firmware.

[0039] S5: The client management software program receives virtual button information and combination operation information from the expansion dock and performs corresponding control on the host computer. For example, such as Figure 3 As shown, after receiving the instruction to touch virtual button 1, the client management software controls the host computer's operating system to switch to the desktop; after receiving the instruction to touch virtual button 2, the client management software controls the host computer's screen to enter the lock screen state.

[0040] S6: The host computer stops running daily work software, and the docking station automatically restores to the initial mode.

[0041] In the initial mode, the display shows information such as the current system time, local weather, and docking station interface connection status.

[0042] An exemplary embodiment 1 of the present invention: 1. The docking station connects to the laptop via a USB-C upstream cable. Upon power-up, the docking station automatically runs the device-side core firmware. The downstream HDMI interface connects to the monitor, and the PD interface connects to an external power source. The mouse and USB flash drive are connected to the docking station's USB-A interface. The docking station's display mode is "Information Display Mode". 2. Launch the Tencent Meeting software and client management software on your laptop and observe the status of the docking station display: It should recognize the meeting scene within 3 seconds and automatically switch to "AI Scene Follow - Meeting Mode". The display should show virtual buttons such as "Microphone On", "AI Transcription", "Screen Sharing", and "Meeting Minutes". 3. Adjust the laptop volume using the docking station knob, with the display showing the volume value in real time; press the button to set the laptop to mute mode with one click, and the display will show a mute indicator simultaneously. 4. After the Tencent Meeting ends, close the Tencent Meeting software. The display screen will automatically switch back to "Information Display Mode" to show the USB flash drive capacity (11.4 / 16.0G), mouse DPI (800), and docking station port usage. An exemplary embodiment 2 of the present invention: The docking station connects to a laptop via a USB-C upstream cable. After two weeks of daily computer use, based on daily work content and usage habits, frequently accessing websites, software, and files, the docking station is switched to "AI Learning Mode." The AI ​​intelligent control module, after two weeks of self-learning, displays shortcuts for the most frequently accessed files, websites, and commonly used software on the monitor and touchscreen. The device's core firmware sends the touch information and the corresponding file information to the host computer. Upon receiving this information, the client management software controls the host computer to perform the corresponding operations, providing a program that allows one-click control of the host computer via the docking station's touchscreen.

Claims

1. A control and screen interaction system based on a docking station, characterized in that: This includes the host computer and the client management software running on the host computer, the docking station and the device-side core firmware running on the docking station; The host computer is a computer device that runs programs for users' daily work and client management software; Client management software is a program used to implement mode switching, personalized configuration, data synchronization, and status monitoring functions. The docking station includes the main docking station body, an AI intelligent control module, and a display and interaction module, on which client management software runs; The main body of the docking station is equipped with an uplink interface, a downlink interface, and a display and interaction module. Internally, it contains a power module, a memory, and an AI intelligent control module. The uplink interface of the docking station connects to the host computer via a data cable to exchange data. The AI ​​intelligent control module includes an AI scene recognition chip and a user habit learning module; The display and interaction module includes a display screen and physical interaction components; The core firmware on the device side is a program used to implement application scenario recognition, interactive control, and user habit learning functions.

2. The control and screen interaction system based on a docking station according to claim 1, characterized in that: The mode switching function supports one-click switching between button mode, information display mode, offline screen mode, and AI scene follow mode; The personalized configuration feature allows users to modify the virtual button positions, add frequently used software, folders or websites, and set weather and geolocation through mouse drag-and-drop operations to adapt to user habits. The data synchronization function automatically synchronizes daily usage habits and current mode settings to the docking station; The status monitoring function displays the docking station interface connection status, storage capacity, and device parameters through a graphical interface on the host computer screen.

3. The control and screen interaction system based on a docking station according to claim 2, characterized in that: AI scene recognition chips are chips used for identifying application scenarios in host computers. The user habit learning module is a module that records user operation behaviors.

4. The control and screen interaction system based on a docking station according to claim 3, characterized in that: The scene recognition function supports real-time capture of active application signals from the host computer. It quickly identifies application scenarios and matches corresponding functional modules through the AI ​​scene recognition chip. Application scenarios include office, meeting, design, and offline drawing screen.

5. The control and screen interaction system based on a docking station according to claim 4, characterized in that: The interactive control function recognizes signals from knob rotation, button pressing, and touch screen virtual buttons to trigger corresponding operations, synchronously controls the display screen status, and feeds back user operations to the host computer. The user habit learning function records user behavior through a user habit learning module and generates a personalized recommendation list.

6. The control and screen interaction system based on a docking station according to claim 5, characterized in that: The upstream interface is a USB-C interface; the downstream interfaces include an HDMI interface, a DP interface, a USB-A interface, a PD interface, and an RJ45 network port.

7. A docking station-based control and screen interaction method, running on the docking station-based control and screen interaction system described in claims 1-6, characterized in that: Includes the following steps, S1: The docking station's uplink interface connects to the host computer, and its downlink interface connects to the display device and external power supply. The docking station is in its initial mode. S2: The host computer runs the client management software program and daily work software. The client management software program sets the current mode and performs personalized configuration, and sends the current mode settings and personalized configuration to the expansion dock simultaneously. S3: The device-side core firmware receives the current mode information from the host computer, and switches to the corresponding application scenario mode based on the identified application scenario; it also identifies the user's daily usage habits and generates and displays a personalized recommendation list on the screen. S4: Users operate via touch screen or by a combination of knobs and buttons, and the device's core firmware sends the combined operation information to the host computer. S5: The client management software program receives virtual button information and combination operation information from the expansion dock and performs corresponding control on the host computer. S6: The host computer stops running daily work software, and the docking station automatically restores to the initial mode.

8. The control and screen interaction method based on a docking station according to claim 7, characterized in that: When an external power supply powers the PD interface, it prioritizes powering the interface expansion, AI module, and display screen to ensure full functionality. At the same time, it provides reverse power to the host computer via the data cable. When the external power supply does not provide power to the PD interface, the docking station only maintains the screen display mode and the docking station interface expansion function.

9. The control and screen interaction method based on a docking station according to claim 8, characterized in that: Physical interaction components include buttons and knobs; operating modes include independent function mode and combined function mode; Independent Functional Mode: Switch by turning the knob, trigger by pressing the button, and automatically spring back to its original position after being released. Combined function mode: Adjust the knob, and use the on-screen prompts and touch functions to switch functions.

10. The control and screen interaction method based on a docking station according to claim 9, characterized in that: The daily usage habits module generates a personalized recommendation list based on user usage frequency, scenario preferences, and personalized configurations. It supports local data storage and feeds user operations back to the host computer. The AI ​​intelligent control module also includes a perception sensor. The core firmware on the device side automatically adjusts the brightness of the display screen based on the ambient brightness detected by the perception sensor.

Images