System and method for remotely and locally automatically entering BIOS interface

Abstract

The invention provides a system and a method for remotely and locally automatically entering a BIOS (Basic Input / Output System) interface, and belongs to the technical field of computer control. According to the invention, the central control module coordinates the power supply control module, the mechanical operation module, the input simulation module, the video acquisition module, the data processing module, the network communication module and the user interaction module, so that full-process automation of remote and local automatic entry into a BIOS interface and subsequent setting operation is realized. The system has the functions of high-precision mechanical operation, input simulation with high compatibility, image data processing, network adaptive communication and user interaction, solves the problems of low manual operation efficiency, poor accuracy, incapability of remote control and the like in the prior art, remarkably improves the efficiency, accuracy and compatibility of entering a BIOS interface for operation, and improves the user experience. The method is suitable for various scenes such as after-sales maintenance, PC research and development and production, factory testing and the like.

Description

Technical Field

[0001] This invention belongs to the field of computer control technology, and more specifically relates to a system and method for automatically entering the BIOS interface remotely and locally. Background Technology

[0002] Currently, booting up a computer and entering the BIOS interface mainly relies on manual operation. Users need to press the power button, and during the computer's startup process, quickly press hotkeys such as Del, F2, F10, or F12 to enter the BIOS interface, then use the keyboard to navigate and select settings options. Throughout this process, the user must constantly monitor the boot status and time the hotkey presses precisely.

[0003] However, existing technologies have many shortcomings. First, modern computers boot up much faster, making it difficult for manual operators to accurately time hotkey presses, leading to frequent hotkey malfunctions. Second, when dealing with local or remote user boot anomalies and BIOS tuning issues, after-sales service personnel struggle to accurately replicate the problem scenario, increasing the difficulty of fault diagnosis and repair. Furthermore, for PC R&D and manufacturing companies, as well as related operations in factories, manual operation is inefficient and cannot meet the automation needs of large-scale production. Simultaneously, manual operation cannot achieve automated checking and error correction, resulting in poor reliability.

[0004] Furthermore, existing technologies cannot effectively determine whether entry into the BIOS interface was successful or whether the operation was effective, lacking accurate feedback and confirmation mechanisms. While the operating system can attempt to enter the BIOS interface via command line (such as shutdown -r -fw), this method is limited by operating system and BIOS security interception, resulting in poor stability and the inability to remotely manipulate BIOS interface options. Third-party devices on the market (such as Sunflower Box) have serious compatibility issues with other PCs, making it difficult to successfully enter the BIOS interface and perform subsequent operations.

[0005] In summary, the existing technologies have significant shortcomings in terms of accessing the BIOS interface and related operations, and there is an urgent need for a system and method that can automatically access the BIOS interface remotely and locally. Summary of the Invention

[0006] To address the above problems, the present invention aims to provide a system and method for automatically entering the BIOS interface remotely and locally. By integrating high-precision mechanical operation, accurate input simulation, efficient data processing, and adaptive network communication technologies, the entire process of automatically entering and setting the BIOS interface remotely and locally is automated.

[0007] To achieve the above objectives, the present invention employs the following technical solution: In a first aspect, embodiments of this application provide a system for automatically entering the BIOS interface remotely and locally, comprising: a central control module, a power control module, a mechanical operation module, an input simulation module, a video acquisition module, a data processing module, a user interaction module, and a network communication module. The central control module is connected to the power control module, the mechanical operation module, the input simulation module, the video acquisition module, the network communication module, and the data processing module, respectively. The data processing module is connected to the video acquisition module, and the user interaction module is connected to the central control module and the network communication module, respectively. The central control module is used for human-computer interaction and system control, and coordinates the operation of various modules to achieve automatic entry into the BIOS interface and subsequent settings; The power control module is used to receive control commands from the central control module to enable the power-on and power-off operations of the device under test. The mechanical operation module is used to simulate a person pressing the power button on the device under test through mechanical components, triggering the device startup process. The input simulation module is used to send keyboard and mouse simulation signals to the device under test. After the device under test is started, it automatically sends preset hotkey codes to trigger the operation of entering the BIOS interface and modifying options in the BIOS interface. The video capture module is used to capture the screen image of the device under test and obtain screen information in real time during the device startup and BIOS interface operation process; The data processing module is used to process and recognize text information from the captured screen using OpenCV and Tesseract-OCR technologies, identify BIOS interface features and option content, and confirm the BIOS interface status. The network communication module is used to establish local and remote network connections, support remote users to send commands and receive operation progress and result feedback, and realize the function of remotely controlling access to the BIOS interface; The user interaction module provides an interface for local and remote users to initiate operations that require access to the BIOS interface and to present the operation process and results.

[0008] In an optional implementation, the mechanical operation module includes a slide rail robotic arm clamp and a push rod servo motor and its drive plate. The slide rail robotic arm clamp is adjusted in position in three mutually perpendicular directions to adapt to different sized chassis and is fixedly installed on the mechanical part of the device under test. The position adjustment accuracy of the slide rail robotic arm clamp is ±0.1mm. The push rod servo and its drive board are fixedly mounted on the slide rail robotic arm fixture. The drive board is connected to the central control module and the push rod servo respectively. The drive board is used to receive control signals from the central control module and drive the push rod servo to perform the power button pressing action according to the control signals. The thrust adjustment range of the push rod servo is 1N to 50N, and the thrust adjustment accuracy is ±0.1N.

[0009] In an optional implementation, the input simulation module uses a wireless keyboard and mouse simulator to send simulated keyboard and mouse signals to the device under test. The wireless keyboard and mouse simulator uses the Qinheng CH9329 chip and the USB to serial port chip CH342. It communicates with the central control module through the serial port to simulate at least 10 different keyboard layouts and 5 different mouse operation modes. It adjusts the frequency and timing of signal transmission with an accuracy of ±0.1ms within a time range of 1ms to 100ms to adapt to the response characteristics of different devices under test.

[0010] In an optional implementation, the video acquisition module uses a video acquisition card to capture the screen image of the device under test, and obtains the screen information during the device startup and BIOS interface operation process in real time. The video capture card features automatic exposure compensation, automatic white balance adjustment, and automatic focus functions to maintain the clarity and stability of the captured image in environments with light intensity variations ranging from 1 lux to 100,000 lux. The video capture card integrates a hardware-level image enhancement processing unit to perform real-time noise reduction, sharpening, and color correction on the image while the video signal is being captured, ensuring accurate capture of the BIOS interface screen in different environments.

[0011] In an optional implementation, the network communication module supports wired and wireless dual-mode communication, supports the 802.11ax protocol to provide a transmission rate of at least 1Gbps, and has beamforming technology and multi-user MIMO functionality to ensure remote communication in electromagnetic environments. The network communication module is used to ensure that the transmission delay of control commands does not exceed 500ms and the transmission delay of screen data does not exceed 1s when the network bandwidth varies from 1Mbps to 1Gbps, the latency varies from 10ms to 1000ms, and the packet loss rate varies from 0% to 30%.

[0012] Secondly, embodiments of this application also provide a method for automatically entering the BIOS interface remotely and locally, including: The central control module sends control commands to the power control module, which then supplies power to the device under test via a 220VAC switching relay. The central control module sends a PWM control signal to the mechanical operation module, which controls the slide rail robotic arm gripper to move the push rod servo to the power button position and simulates a finger pressing the power button. The operation is confirmed to be successful by the pressure sensor inside the push rod servo. The central control module sends pulse signals to the device under test through the input analog module, detects the status code of the CH9329 chip, and sends the F1 hotkey code after confirming that the USB device is powered on. The video acquisition module captures the image of the device under test in real time, and the data processing module uses OpenCV and Tesseract-OCR for processing and recognition, confirming entry into the BIOS interface and obtaining key information. Based on the key information obtained by the data processing module, the central control module modifies the BIOS options by inputting the simulation module. After making the changes, send the save and exit command to complete the BIOS settings; The system monitors the status of the device under test in real time, provides feedback on the operation progress and results to the user through the network communication module, and records the operation log. If any abnormal situation occurs, the operation is immediately suspended, the abnormal information is recorded, an alarm is sent to the user, and the system attempts to re-execute or enters safe mode to wait for intervention.

[0013] In an optional implementation, the central control module sends a pulse signal to the device under test via the input analog module, detects the CH9329 chip status code, and after confirming that the USB device is powered on, sends the F1 hotkey code, including: After sending the F1 hotkey code for the first time, it will be sent again at preset time intervals, for a total of 3 to 5 times, with each sending interval being 0.5 to 1 second, to ensure that the BIOS interface is triggered. The interval between each transmission is dynamically adjusted according to the response characteristics of the device under test. The success of the transmission is determined by monitoring the changes in the status of the USB device. If there is no response after two consecutive transmissions, the exception handling process is triggered.

[0014] In one optional implementation, the video acquisition module captures the image of the device under test in real time, and the data processing module uses OpenCV and Tesseract-OCR for processing and recognition, confirming entry into the BIOS interface and obtaining key information, including: The video acquisition module continuously captures images of the device under test at a variable frame rate of 20 frames per second to 30 frames per second; After the data processing module performs noise reduction and sharpening on each frame, it uses Tesseract-OCR to recognize the text content and uses deep learning algorithms to detect feature points and extract key information from the image. The key information includes, but is not limited to, text content, option position, and status.

[0015] In an optional implementation, the central control module modifies BIOS options via the input simulation module based on key information obtained by the data processing module, including: Based on the key information obtained by the data processing module, the central control module sends a combination of keyboard arrow keys and Enter key via the input simulation module to modify BIOS options. For operations requiring coordinate clicking, the operation is performed by simulating mouse movement and click signals. The positioning accuracy of the mouse movement is ±0.1 pixels, and the click force is adjustable from 0.1N to 1N with an adjustment accuracy of ±0.01N. During the BIOS option modification process, the response of the device under test is monitored in real time. If the modification is found to be ineffective, the operation is automatically repeated or the parameters are adjusted and retried. For BIOS interfaces of different brands and models, the built-in operation template is automatically selected through feature matching.

[0016] In an optional implementation, the real-time monitoring of the device under test status, the feedback of operation progress and results to the user via the network communication module, and the recording of operation logs include: The network communication module monitors network bandwidth, latency, and packet loss rate in real time and automatically assesses the current network condition. For local wired connections, Gigabit Ethernet is used first; when a wired connection failure is detected, it automatically switches to wireless network and automatically selects the 2.4GHz or 5GHz band according to the signal strength. For remote operation, the video capture frame rate and image quality are automatically adjusted according to network latency to optimize bandwidth usage while ensuring real-time operation. A forward error correction algorithm and a data packet retransmission mechanism are employed to ensure the reliable transmission of critical control commands; By implementing QoS policies at the network and application layers, higher transmission priorities are assigned to control commands and real-time video transmissions to ensure smooth operation. Specifically, the transmission priority of control commands is at least 3 levels higher than that of ordinary data, and the transmission priority of real-time video data is at least 2 levels higher than that of ordinary data.

[0017] As can be seen from the above technical solutions, the present invention has the following advantages: The system provided in this application, which enables remote and local automatic BIOS interface access, coordinates the power control module, mechanical operation module, input simulation module, video acquisition module, data processing module, network communication module, and user interaction module through a central control module. This achieves full automation of the remote and local automatic BIOS interface access and subsequent settings operations. The system features high-precision mechanical operation, highly compatible input simulation, image data processing, adaptive network communication, and user interaction functions. It solves the problems of low efficiency, poor accuracy, and inability to remotely control manual operations in existing technologies, significantly improving the efficiency, accuracy, and compatibility of BIOS interface access operations. It is suitable for various scenarios such as after-sales maintenance, PC R&D and production, and factory testing.

[0018] This application can automatically complete a series of operations from powering on the device, pressing the power button, triggering entry into the BIOS interface, to modifying options within the BIOS, without manual intervention. This greatly improves the level of automation and effectively solves the problems of cumbersome and inefficient manual operation in the prior art.

[0019] This application achieves precise control over the power button's press position, accurate triggering of hotkeys, and precise identification and positioning of BIOS interface information through a high-precision mechanical operation module, a precise input simulation module, and a data processing module based on OpenCV and Tesseract-OCR technologies, ensuring operational accuracy. Simultaneously, the system possesses automatic monitoring and error correction functions, enabling timely adjustment and re-execution of operations in abnormal situations, effectively improving operational reliability.

[0020] The mechanical operation module of this application can be adapted to chassis of different sizes, the input simulation module can simulate various keyboard layouts and mouse operation modes, the video acquisition module can stably acquire images under various lighting conditions, and the network communication module supports wired and wireless dual-mode communication and has strong anti-interference capabilities, making this system compatible with computer devices of various brands and models, suitable for various application scenarios such as local and remote, and has wide applicability.

[0021] The network communication module of this application supports the high-speed 802.11ax protocol and has beamforming technology and multi-user MIMO function, which can ensure stable communication in complex electromagnetic environments. By dynamically adjusting the data transmission strategy, the transmission latency of control commands and screen data is effectively guaranteed, realizing real-time monitoring and smooth control of the BIOS interface operation by remote users, which greatly improves the efficiency and convenience of remote operation.

[0022] The user interaction module of this application provides an intuitive and user-friendly interface for both local and remote users. Users can easily initiate operation requests and view the operation process and results in real time. Simultaneously, the system automatically records operation logs for easy querying and analysis, further enhancing users' control over the entire operation process and improving the user experience. Attached Figure Description

[0023] To more clearly illustrate the technical solution of the present invention, the accompanying drawings used in the description will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 A schematic diagram of the structure of the remote and local automatic BIOS interface system provided in this application.

[0025] Figure 2 This is a flowchart illustrating the remote and local automatic BIOS interface access methods provided in this application. Detailed Implementation

[0026] The various embodiments of this disclosure will be described more fully in the detailed functional architecture of the remote and local automatic BIOS interface system described below. This disclosure may have various embodiments, and adjustments and changes may be made therein. However, it should be understood that there is no intention to limit the various embodiments of this disclosure to the specific embodiments disclosed herein, but rather this disclosure should be understood to cover all adjustments, equivalents, and / or alternatives falling within the spirit and scope of the various embodiments of this disclosure.

[0027] In the following, the terms “comprising” or “may include”, which may be used in various embodiments of this disclosure, indicate the presence of the disclosed functions, operations, or elements, and do not limit the addition of one or more functions, operations, or elements. Furthermore, as used in various embodiments of this disclosure, the terms “comprising,” “having,” and their cognates are intended only to indicate a particular feature, number, step, operation, element, component, or combination of the foregoing, and should not be construed as primarily excluding the presence of one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing, or the possibility of adding one or more combinations of the foregoing.

[0028] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0029] Please see Figure 1 The diagram shows a schematic of a system for automatically entering the BIOS interface remotely and locally in a specific embodiment. The system includes: a central control module, a power control module, a mechanical operation module, an input simulation module, a video acquisition module, a data processing module, a user interaction module, and a network communication module. The central control module is connected to the power control module, the mechanical operation module, the input simulation module, the video acquisition module, the network communication module, and the data processing module. The data processing module is connected to the video acquisition module. The user interaction module is connected to the central control module and the network communication module.

[0030] The central control module is used for human-computer interaction and system control, and coordinates the operation of various modules to achieve automatic entry into the BIOS interface and subsequent settings.

[0031] In this specific implementation, the central control module, acting as the "brain" of the system, undertakes the crucial tasks of human-computer interaction and system control. It not only provides users with a complete user interface, enabling operators to easily initiate operation requests and obtain real-time feedback, but also achieves precise control over the entire operation process through close collaboration with various functional modules. The central control module is responsible for coordinating the operations of each module, including sending commands to the power control module to power on and off the equipment, sending PWM signals to the mechanical operation module to control mechanical components to simulate manually pressing the power button, sending keyboard and mouse simulation signals to the device under test via the input simulation module to trigger entry into the BIOS interface for operation and option modification, and acquiring the screen image of the device under test from the video acquisition module and handing it over to the data processing module for processing and analysis. Furthermore, the central control module also interacts with remote users through the network communication module to ensure the real-time nature and feasibility of remote operation.

[0032] The power control module is used to receive control commands from the central control module to enable the power-on and power-off operations of the device under test.

[0033] In this specific implementation, the power control module is a crucial component for achieving automated operation. It primarily receives control commands from the central control module to power on and off the device under test (DUT). Through precise power management, it provides stable and reliable power support for the entire testing process. Its core function lies in controlling the on / off state of the 220VAC switching relay according to instructions from the central control module, thereby enabling remote power management of the DUT. This not only improves the level of automation but also reduces manual intervention, lowers the risk of operational errors, and ensures the smooth and efficient execution of the testing process.

[0034] The mechanical operation module is used to simulate a person pressing the power button on the device under test through mechanical components, triggering the device startup process.

[0035] In a specific implementation, the mechanical operation module simulates manual pressing to achieve a key step in the equipment startup process. This module consists of a slide rail robotic arm fixture and a push rod servo motor and its drive board. The slide rail robotic arm fixture can adjust its position in three mutually perpendicular directions to adapt to different sized chassis and is fixedly installed on the device under test, with a position adjustment accuracy of ±0.1mm. The push rod servo motor and its drive board are fixedly mounted on the slide rail robotic arm fixture. After receiving control signals from the central control module, the drive board precisely drives the push rod servo motor to execute the pressing action of the power button. The push rod servo motor's thrust adjustment range is 1N to 50N, with an adjustment accuracy of ±0.1N, ensuring the stability and adaptability of the pressing force, thus providing a reliable physical trigger for equipment startup and laying the foundation for subsequent operations to enter the BIOS interface. The successful application of this module not only improves the accuracy and adaptability of operation but also greatly expands the system's compatibility with different types of equipment.

[0036] The input simulation module is used to send keyboard and mouse simulation signals to the device under test. After the device under test is started, it automatically sends preset hotkey codes to trigger the operation of entering the BIOS interface and modifying options within the BIOS interface.

[0037] In this specific implementation, the input simulation module employs advanced wireless keyboard and mouse simulation technology, capable of sending simulated keyboard and mouse signals to the device under test. Its core component is a wireless keyboard and mouse simulator. This simulator relies on the Qinheng CH9329 chip and the USB-to-serial chip CH342, establishing a stable communication connection with the central control module via a serial port. With this technical solution, the input simulation module can simulate at least 10 different keyboard layouts and 5 different mouse operation modes, ensuring broad compatibility with different types of devices. After the device starts up, the module can automatically send preset hotkey codes (such as F1) to trigger the entry into the BIOS interface. Furthermore, the module has the ability to adjust the signal transmission frequency and timing with an accuracy of ±0.1ms within a time range of 1ms to 100ms, accurately adapting to the response characteristics of the device under test, thereby ensuring the accuracy and reliability of signal transmission and providing stable support for entering the BIOS interface and subsequent operations. The application of this module not only achieves a high degree of simulation of keyboard and mouse operations but also significantly improves the system's automation level and operational efficiency.

[0038] The video capture module is used to capture the screen image of the device under test and obtain screen information in real time during the device startup and BIOS interface operation process.

[0039] In this specific implementation, the video acquisition module plays a crucial role in acquiring real-time screen information from the device under test, and a professional video capture card is used to achieve this function. This video capture card features excellent automatic exposure compensation, automatic white balance adjustment, and automatic focus, enabling it to maintain image clarity and stability across a wide range of light intensities from 1 lux to 100,000 lux. This characteristic ensures that the system can acquire high-quality image data under different lighting conditions, providing a reliable foundation for subsequent processing and analysis. Furthermore, the video capture card integrates a hardware-level image enhancement processing unit, which can perform real-time noise reduction, sharpening, and color correction on the image while acquiring the video signal, further improving image quality and ensuring accurate acquisition of the BIOS interface screen in various environments. This provides strong support for the accurate identification and analysis by the data processing module. Through this module, the system achieves real-time, clear, and stable acquisition of the screen image from the device under test, providing key support for the visualization and intelligentization of the entire operation process.

[0040] The data processing module is used to process and recognize text information from the captured screen using OpenCV and Tesseract-OCR technologies, identify BIOS interface features and option content, and confirm the BIOS interface status.

[0041] In this specific implementation, the data processing module serves as the system's "intelligent hub," primarily operating on the main control board of the central control module. It utilizes OpenCV and Tesseract-OCR technologies to process and recognize text information acquired by the video capture module. Its core function is to accurately identify the features and options of the BIOS interface, confirm the BIOS interface status, and provide precise location data for subsequent BIOS option modifications. The data processing module first preprocesses the captured image information, including image noise reduction and sharpening, to improve image quality. Then, it uses Tesseract-OCR technology to perform text recognition and text localization on the processed image, extracting key text information. Finally, it combines deep learning algorithms to perform feature point detection and key information extraction on the image, including text content, option location, and status. This series of processing steps ensures that the system can accurately and efficiently extract valuable data from complex image information, providing precise guidance and decision support for subsequent automated operations. The successful application of the data processing module not only enhances the system's intelligence level but also strengthens its adaptability and fault tolerance to different BIOS interface layouts, ensuring the accuracy and reliability of operations.

[0042] The network communication module is used to establish local and remote network connections, support remote users to send commands and receive operation progress and result feedback, and enable remote control access to the BIOS interface.

[0043] In this specific implementation, the network communication module is a key component for remote control and data interaction, supporting both wired and wireless dual-mode communication and possessing strong network adaptability and stability. The module supports the advanced 802.11ax protocol, providing a high-speed transmission rate of at least 1Gbps, and is equipped with beamforming technology and multi-user MIMO functionality, ensuring high-quality remote communication even in complex electromagnetic environments. Under conditions of significant network parameter variations (bandwidth 1Mbps to 1Gbps, latency 10ms to 1000ms, packet loss rate 0% to 30%), the network communication module can dynamically adjust data transmission strategies to ensure that the transmission latency of control commands does not exceed 500ms and the transmission latency of screen data does not exceed 1s. This feature guarantees that remote users can operate and monitor the BIOS interface in real-time and smoothly. Furthermore, the module employs forward error correction algorithms and packet retransmission mechanisms to further improve the reliability and stability of data transmission. QoS policies implemented at the network and application layers allocate higher transmission priority to control commands and real-time screen transmission, ensuring smooth and real-time operation. This module enables local and remote users to efficiently, stably, and reliably control the device under test, breaking spatial limitations and greatly improving the system's application scope and ease of operation.

[0044] The user interaction module provides an interface for local and remote users to initiate operations that require access to the BIOS interface and to present the operation process and results.

[0045] In this specific implementation, the user interaction module acts as a bridge between the system and the user, providing an intuitive and convenient operating interface for both local and remote users. This allows users to easily initiate requests to enter the BIOS interface and view the operation process and results in real time. Local users can operate the system via the 3.5-inch touchscreen LCD display on the central control module, while remote users access the system through a network connection, sending commands and receiving feedback. The system automatically records operation logs, detailing timestamps, operation steps, device responses, and anomalies for easy user query and analysis. This module not only improves user control over the operation process but also enhances system usability and user experience, ensuring transparency and traceability of operations.

[0046] In this embodiment, through the collaborative work of the central control module, power control module, mechanical operation module, input simulation module, video acquisition module, data processing module, network communication module, and user interaction module, the entire process of remotely and locally entering the BIOS interface and subsequent settings operations is fully automated. The system possesses high-precision mechanical operation, accurate input simulation, efficient data processing, and adaptive network communication technologies, significantly improving operational efficiency, accuracy, and reliability. It is widely compatible with different devices and scenarios, providing users with an efficient, stable, and convenient solution.

[0047] like Figure 2 As shown, the following are embodiments of the method for automatically entering the BIOS interface remotely and locally provided by this disclosure. This method belongs to the same inventive concept as the system for automatically entering the BIOS interface remotely and locally in the above embodiments. For details not described in detail in the embodiments of the method for automatically entering the BIOS interface remotely and locally, please refer to the embodiments of the system for automatically entering the BIOS interface remotely and locally described above.

[0048] A method for automatically entering the BIOS interface remotely and locally includes the following steps: S1: The central control module sends control commands to the power control module, which then supplies power to the device under test via a 220VAC switching relay.

[0049] In a specific implementation, the central control module sends commands to the power control module via the GPIO expansion board. Upon receiving the commands, the power control module controls the 220VAC switching relay to close, supplying power to the device under test. This process provides the necessary power support for subsequent operations, ensuring that the device can start normally.

[0050] S2: The central control module sends a PWM control signal to the mechanical operation module, which controls the slide rail robotic arm gripper to move the push rod servo to the power button position and simulates pressing the power button with a finger. The operation is confirmed to be successful by the pressure sensor inside the push rod servo.

[0051] In this specific implementation, the central control module sends a PWM signal to the mechanical operation module, controlling the slide rail robotic arm gripper to move the push rod servo to the power button position. The push rod servo applies approximately 2KG of thrust, simulating a finger pressing the power button. After the pressure sensor on the mechanical arm detects a successful press, it returns an confirmation signal to the central control module. This process, through high-precision mechanical operation, ensures the accuracy and reliability of the power-on operation.

[0052] S3: The central control module sends a pulse signal to the device under test through the input analog module, detects the status code of the CH9329 chip, and sends the F1 hotkey code after confirming that the USB device is powered on.

[0053] In a specific implementation, the central control module sends pulse signals to the device under test (DUT) via the input analog module, detects the CH9329 chip status code, and confirms that the USB device is powered on and recognized. Then, it continuously sends the F1 hotkey code 3-5 times, with the interval between each transmission dynamically adjusted based on the DUT's response characteristics to ensure triggering entry into the BIOS interface. If there is no response after two consecutive transmissions, an exception handling procedure is triggered.

[0054] This process improves the success rate of entering the BIOS interface through precise signal transmission and dynamic adjustment.

[0055] S4: The video acquisition module captures the screen of the device under test in real time. The data processing module uses OpenCV and Tesseract-OCR for processing and recognition, confirms entry into the BIOS interface and obtains key information.

[0056] In a specific implementation, the video acquisition module continuously captures images of the device under test at a variable frame rate of 20 to 30 frames per second. The data processing module performs noise reduction and sharpening on each frame, then uses Tesseract-OCR to recognize the text content and employs deep learning algorithms to detect feature points and extract key information from the image, including text content, option positions, and status. This process, through efficient image processing and intelligent recognition technology, ensures accurate acquisition of BIOS interface information.

[0057] S5: Based on the key information obtained by the data processing module, the central control module modifies the BIOS options by inputting the simulation module.

[0058] In a specific implementation, based on key information acquired by the data processing module, the central control module sends a combination of keyboard arrow keys and the Enter key via the input simulation module to modify BIOS options. For options requiring mouse clicks, mouse movement and click signals are simulated, with mouse movement positioning accuracy of ±0.1 pixels and click force adjustable from 0.1N to 1N, with an adjustment accuracy of ±0.01N. During the modification process, the response of the device under test is monitored in real time. If the modification is found to be ineffective, the operation is automatically repeated or the parameters are adjusted and retried. For BIOS interfaces of different brands and models, the appropriate built-in operation template is automatically selected through feature matching. This process, through precise simulation and automatic adaptation, ensures accurate modification of BIOS options.

[0059] S6: After making the changes, send the save and exit command to complete the BIOS settings.

[0060] In this specific implementation, after the modifications are completed, the central control module sends a save and exit command to complete the BIOS settings. This process ensures that the modified BIOS settings are correctly saved and take effect.

[0061] S7: Monitors the status of the device under test in real time, provides feedback on operation progress and results to the user through the network communication module, and records operation logs; if an abnormal situation occurs, it immediately suspends the operation, records the abnormal information, sends an alarm to the user, and attempts to re-execute or enters safe mode to wait for intervention.

[0062] In specific implementations, the system monitors the status of the device under test in real time, provides feedback on operation progress and results to the user via the network communication module, and records operation logs. If any abnormality occurs, the operation is immediately paused, abnormal information is recorded, an alarm is sent to the user, and the system attempts to re-execute or enters safe mode to await intervention. The network communication module monitors network bandwidth, latency, and packet loss rate in real time, automatically assessing the current network condition. For local wired connections, gigabit Ethernet is prioritized; when a wired connection failure is detected, the system automatically switches to a wireless network, automatically selecting the 2.4GHz or 5GHz frequency band based on signal strength. For remote operation, the system automatically adjusts the video capture frame rate and image quality based on network latency, optimizing bandwidth usage while ensuring real-time operation. Forward error correction algorithms and packet retransmission mechanisms are employed to ensure reliable transmission of critical control commands. By implementing QoS policies at the network and application layers, higher transmission priorities are allocated to control commands and real-time video transmission, ensuring smooth operation. Specifically, the transmission priority of control commands is at least 3 levels higher than that of ordinary data, and the transmission priority of real-time video data is at least 2 levels higher than that of ordinary data.

[0063] This process ensures the transparency and reliability of the operation through real-time monitoring and feedback.

[0064] As an example, in practical applications, this method fully utilizes hardware devices such as a central control box (including a main control board and a 3.5-inch touchscreen LCD display), GPIO expansion board, wireless keyboard and mouse simulator, wireless network card, 220V AC switching relay, video capture card, power-on / off data cable, sliding rail robotic arm gripper, push rod servo motor and its drive board, etc., and combines them with a Python interface program to achieve fully automated remote and local access to the BIOS interface and subsequent settings operations. Through high-precision mechanical operation, accurate input simulation, efficient data processing, and adaptive network communication, this method can significantly improve operational efficiency, accuracy, and reliability, and is widely compatible with different devices and scenarios, providing users with an efficient, stable, and convenient solution.

[0065] Through a communication design between the control box and the keyboard and mouse emulator, the system detects the motherboard's USB port electrical signal or uses OCR to detect the boot screen beyond the logo, thereby effectively triggering key presses and entering the BIOS interface. Simultaneously, combined with OCR technology's 4-point coordinate positioning method, it accurately determines whether to enter the BIOS and modify options. This innovative triggering and confirmation scheme further improves the accuracy and reliability of entering the BIOS interface and modifying options, ensuring a high success rate and efficiency.

[0066] The method for remotely and locally automatically entering the BIOS interface provided in this embodiment automates the entire process from device power-on, booting, entering the BIOS interface, to modifying BIOS options by simulating manual operation and combining it with automation technology. This method not only significantly improves operational efficiency and accuracy but also enhances operational stability and reliability through precise signal transmission, dynamic adjustment, and intelligent recognition technology. Furthermore, its support for remote operation and real-time feedback further improves user experience and ease of use, making it suitable for various devices and scenarios and possessing broad application prospects.

[0067] The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A system for automatically entering the BIOS interface remotely and locally, characterized in that, include: The system includes a central control module, a power control module, a mechanical operation module, an input simulation module, a video acquisition module, a data processing module, a user interaction module, and a network communication module. The central control module is connected to the power control module, mechanical operation module, input simulation module, video acquisition module, network communication module, and data processing module, respectively. The data processing module is connected to the video acquisition module, and the user interaction module is connected to the central control module and the network communication module, respectively. The central control module is used for human-computer interaction and system control, and coordinates the operation of various modules to achieve automatic entry into the BIOS interface and subsequent settings; The power control module is used to receive control commands from the central control module to enable the power-on and power-off operations of the device under test. The mechanical operation module is used to simulate a person pressing the power button on the device under test through mechanical components, triggering the device startup process. The input simulation module is used to send keyboard and mouse simulation signals to the device under test. After the device under test is started, it automatically sends preset hotkey codes to trigger the operation of entering the BIOS interface and modifying options in the BIOS interface. The video capture module is used to capture the screen image of the device under test and obtain screen information in real time during the device startup and BIOS interface operation process; The data processing module is used to process and recognize text information from the captured screen using OpenCV and Tesseract-OCR technologies, identify BIOS interface features and option content, and confirm the BIOS interface status. The network communication module is used to establish local and remote network connections, support remote users to send commands and receive operation progress and result feedback, and realize the function of remotely controlling access to the BIOS interface; The user interaction module provides an interface for local and remote users to initiate operations that require access to the BIOS interface and to present the operation process and results.

2. The system for automatically entering the BIOS interface remotely and locally according to claim 1, characterized in that, The mechanical operation module includes a slide rail robotic arm clamp and a push rod servo motor and its drive plate. The slide rail robotic arm clamp is adjusted in position in three mutually perpendicular directions to adapt to different sizes of chassis and is fixedly installed on the mechanical part of the device under test. The position adjustment accuracy of the slide rail robotic arm clamp is ±0.1mm. The push rod servo and its drive board are fixedly mounted on the slide rail robotic arm fixture. The drive board is connected to the central control module and the push rod servo respectively. The drive board is used to receive control signals from the central control module and drive the push rod servo to perform the power button pressing action according to the control signals. The thrust adjustment range of the push rod servo is 1N to 50N, and the thrust adjustment accuracy is ±0.1N.

3. The system for automatically entering the BIOS interface remotely and locally according to claim 1, characterized in that, The input simulation module uses a wireless keyboard and mouse simulator to send simulated keyboard and mouse signals to the device under test. The wireless keyboard and mouse simulator uses the Qinheng CH9329 chip and the USB to serial port chip CH342. It communicates with the central control module through the serial port to simulate at least 10 different keyboard layouts and 5 different mouse operation modes. It adjusts the frequency and timing of signal transmission with an accuracy of ±0.1ms within a time range of 1ms to 100ms to adapt to the response characteristics of different devices under test.

4. The system for automatically entering the BIOS interface remotely and locally according to claim 1, characterized in that, The video acquisition module uses a video acquisition card to capture the screen image of the device under test, and obtains the screen information during the device startup and BIOS interface operation process in real time; The video capture card features automatic exposure compensation, automatic white balance adjustment, and automatic focus functions to maintain the clarity and stability of the captured image in environments with light intensity variations ranging from 1 lux to 100,000 lux. The video capture card integrates a hardware-level image enhancement processing unit to perform real-time noise reduction, sharpening, and color correction on the image while the video signal is being captured, ensuring accurate capture of the BIOS interface screen in different environments.

5. The system for automatically entering the BIOS interface remotely and locally according to claim 1, characterized in that, The network communication module supports wired and wireless dual-mode communication. It supports the 802.11ax protocol to provide a transmission rate of at least 1Gbps and has beamforming technology and multi-user MIMO function to ensure remote communication in electromagnetic environments. The network communication module is used to ensure that the transmission delay of control commands does not exceed 500ms and the transmission delay of screen data does not exceed 1s when the network bandwidth varies from 1Mbps to 1Gbps, the latency varies from 10ms to 1000ms, and the packet loss rate varies from 0% to 30%.

6. A method for automatically entering the BIOS interface remotely and locally, characterized in that, The method employs the system described in any one of claims 1 to 5 for remote and local automatic access to the BIOS interface; The method includes: The central control module sends control commands to the power control module, which then supplies power to the device under test via a 220VAC switching relay. The central control module sends a PWM control signal to the mechanical operation module, which controls the slide rail robotic arm gripper to move the push rod servo to the power button position and simulates a finger pressing the power button. The operation is confirmed to be successful by the pressure sensor inside the push rod servo. The central control module sends pulse signals to the device under test through the input analog module, detects the status code of the CH9329 chip, and sends the F1 hotkey code after confirming that the USB device is powered on. The video acquisition module captures the image of the device under test in real time, and the data processing module uses OpenCV and Tesseract-OCR for processing and recognition, confirming entry into the BIOS interface and obtaining key information. Based on the key information obtained by the data processing module, the central control module modifies the BIOS options by inputting the simulation module. After making the changes, send the save and exit command to complete the BIOS settings; The system monitors the status of the device under test in real time, provides feedback on the operation progress and results to the user through the network communication module, and records the operation log. If any abnormal situation occurs, the operation is immediately suspended, the abnormal information is recorded, an alarm is sent to the user, and the system attempts to re-execute or enters safe mode to wait for intervention.

7. The method for automatically entering the BIOS interface remotely and locally according to claim 6, characterized in that, The central control module sends pulse signals to the device under test via the input analog module, detects the CH9329 chip status code, and after confirming that the USB device is powered on, sends the F1 hotkey code, including: After sending the F1 hotkey code for the first time, it will be sent again at preset time intervals, for a total of 3 to 5 times, with each sending interval being 0.5 to 1 second, to ensure that the BIOS interface is triggered. The interval between each transmission is dynamically adjusted according to the response characteristics of the device under test. The success of the transmission is determined by monitoring the changes in the status of the USB device. If there is no response after two consecutive transmissions, the exception handling process is triggered.

8. The method for automatically entering the BIOS interface remotely and locally according to claim 7, characterized in that, The video acquisition module captures the image of the device under test in real time, and the data processing module uses OpenCV and Tesseract-OCR for processing and recognition, confirming entry into the BIOS interface and obtaining key information, including: The video acquisition module continuously captures images of the device under test at a variable frame rate of 20 frames per second to 30 frames per second; After the data processing module performs noise reduction and sharpening on each frame, it uses Tesseract-OCR to recognize the text content and uses deep learning algorithms to detect feature points and extract key information from the image. The key information includes, but is not limited to, text content, option position, and status.

9. The method for automatically entering the BIOS interface remotely and locally according to claim 8, characterized in that, Based on the key information obtained by the data processing module, the central control module modifies BIOS options through the input simulation module, including: Based on the key information obtained by the data processing module, the central control module sends a combination of keyboard arrow keys and Enter key via the input simulation module to modify BIOS options. For operations requiring coordinate clicking, the operation is performed by simulating mouse movement and click signals. The positioning accuracy of the mouse movement is ±0.1 pixels, and the click force is adjustable from 0.1N to 1N with an adjustment accuracy of ±0.01N. During the BIOS option modification process, the response of the device under test is monitored in real time. If the modification is found to be ineffective, the operation is automatically repeated or the parameters are adjusted and retried. For BIOS interfaces of different brands and models, the built-in operation template is automatically selected through feature matching.

10. The method for automatically entering the BIOS interface remotely and locally according to claim 9, characterized in that, The system monitors the status of the device under test in real time, provides feedback on operation progress and results to the user through the network communication module, and records operation logs, including: The network communication module monitors network bandwidth, latency, and packet loss rate in real time and automatically assesses the current network condition. For local wired connections, Gigabit Ethernet is used first; when a wired connection failure is detected, it automatically switches to wireless network and automatically selects the 2.4GHz or 5GHz band according to the signal strength. For remote operation, the video capture frame rate and image quality are automatically adjusted according to network latency to optimize bandwidth usage while ensuring real-time operation. A forward error correction algorithm and a data packet retransmission mechanism are employed to ensure the reliable transmission of critical control commands; By implementing QoS policies at the network and application layers, higher transmission priorities are assigned to control commands and real-time video transmissions to ensure smooth operation. Specifically, the transmission priority of control commands is at least 3 levels higher than that of ordinary data, and the transmission priority of real-time video data is at least 2 levels higher than that of ordinary data.

Images