2207 results about "Human–machine interface" patented technology

Machine vision devices may be configured to automatically connect to a remote management server (e.g., a “cloud”-based management server), and may offload and / or communicate images and analyses to the remote management server via wired or wireless communications. The machine vision devices may further communicate with the management server, user computing devices, and / or human machine interface devices, e.g., to provide remote access to the machine vision device, provide real-time information from the machine vision device, receive configurations / updates, provide interactive graphical user interfaces, and / or the like.

The invention relates to the technical field of monitoring and early warning of power equipment, in particular to a monitoring and early warning method and system for substation power equipment. Comprising a data acquisition module, an intelligent diagnosis module, a risk assessment module, a collaborative early warning module and an interaction control module. The data acquisition module acquires equipment operation data including current, voltage, temperature and humidity and vibration signals. And the intelligent diagnosis module identifies equipment abnormity through the generative adversarial network and the graph neural network. The risk assessment module generates a risk assessment curve based on a fractional order differential model and a reinforcement learning algorithm. And the collaborative early warning module generates a graded early warning scheme by utilizing edge calculation. And the interaction control module displays a state and optimizes a control strategy through a human-computer interface. The intelligent monitoring and management level of the power equipment of the transformer substation is improved, the service life of the equipment is prolonged, and the operation and maintenance cost is reduced.

The present technology relates to artificial intelligence assisted device troubleshooting. In an implementation, an interface service of a human machine interface application trains a machine learning model on the content of an embeddings database. The interface service then receives an input comprising a context of an automation system design. The interface service generates a prompt that includes an instruction for the ML model to identify an anomaly type associated with the context of the automation system design and to generate a solution that addresses the anomaly type. The interface service transmits the prompt to the ML model and receives a response from the ML model that includes the anomaly type and the requested solution. After receiving a response, the interface service may modify the automation system design based on the content of the response and surface a graphical user interface that includes the modified design.

The invention provides a comprehensive and intelligent mariculture net cage management and control system. The system integrates a multi-parameter sensor module, an underwater robot module, an underwater camera module, a central control module, a data storage and analysis module, an early warning module, a remote communication module and an automatic execution module. By monitoring multiple environmental parameters such as water temperature, salinity, dissolved oxygen and the like in real time and utilizing the underwater robot and the underwater camera to carry out autonomous inspection and fish behavior observation, the system can accurately master the culture environment condition. The AI algorithm and the intelligent model are combined, the system dynamically adjusts the bait casting amount, the oxygenation frequency and the net cage position, and the breeding benefits are effectively improved. Meanwhile, the early warning module carries out graded early warning on risk events such as typhoon and diseases, and the breeding safety is ensured. The remote communication and visual human-computer interface further enhances the remote monitoring and management capability of the system.

The invention provides a vehicle-mounted display terminal man-machine interface interaction experience optimization method and system, and relates to the technical field of vehicle-mounted man-machine interaction, and the method comprises the steps: obtaining eyeball watching, hand operation and head rotation data of a driver, and carrying out the fusion to generate an attention distribution thermodynamic diagram; constructing a dynamic scene recognition model in combination with the vehicle running state and the environment information; and calculating a function module optimization index based on the thermodynamic diagram and scene prediction, and dynamically adjusting the position, the response area and the display level of the function module. According to the invention, the interaction efficiency of drivers can be improved, the operation distraction risk is reduced, and the driving safety is enhanced.

The invention provides a coal quantity detection method and device based on laser radar and vision fusion, and belongs to the technical field of coal quantity detection of underground coal mine conveying belts. According to the technical scheme, the coal quantity detection method based on laser radar and vision fusion comprises the following steps: S1, sensor joint calibration; s2, data acquisition; s3, identifying a coal quantity area; s4, complementing the depth image; and S5, calculating the coal quantity. The invention further provides a coal quantity detection device which comprises a speed sensor, a laser radar, an industrial camera, a computer and a human-computer interface. The method has the beneficial effects that through multi-sensor data fusion and a deep learning algorithm, underground complex environment interference is overcome, and high-precision real-time detection of the coal quantity is realized; the detection device has the explosion-proof and dust-resistant characteristics, and the detection method comprises environment self-adaptive correction and lightweight calculation, and can be widely applied to intelligent mine transportation systems.

A system for interactive searches based on user queries data and a plurality of Large Language Models (LLMs) including a processor of a Human-Machine Interface (HMI) server node configured to host a network of LLMs and at least one machine learning module (ML) and connected to at least one user-entity node over a network and a memory on which are stored machine-readable instructions that when executed by the processor, cause the processor to: receive a search request input data from the at least one user-entity node; evaluate, by a first dedicated LLM, relevance of the search request input data by discerning between primary and secondary information; responsive to evaluation by the first dedicated LLM, derive classifying features from the primary and secondary information and generate a feature vector based on the classifying features; ingest the feature vector into the ML module configured to extract additional search parameters from a predictive search model based on historical search data associated with the at least one user-entity node; dissect, by a second dedicated LLM, the search request input data and the additional search parameters to separate the data into qualitative and quantitative criteria elements based on the primary and the secondary information; transform, by a third dedicated LLM, the quantitative criteria elements into structured queries for a database; process, by a fourth dedicated LLM, the qualitative criteria elements by searching through a semi-structured data repository; and synthesize, by the fifth LLM, processed search findings into a succinct human-language summary.

The invention provides a state self-checking system for an unhooking robot, and relates to the technical field of automatic machinery, and the system comprises a real-time collection module which collects a real-time working data set of the unhooking robot; the operation evaluation module is used for comprehensively evaluating the operation of the unhooking robot based on the real-time working data set; the fault detection module is used for carrying out point cloud matching and data comparison on the unhooking robot based on the operation state evaluation information, carrying out fault detection according to a comparison result and generating a fault self-detection report; the fault tracing module is used for synchronizing the fault self-checking report to a human-computer interface for fault tracing; and the fault processing module is used for formulating fault processing suggestions and sending the suggestions to the human-computer interface to perform remote control on the unhooking robot. The technical problem that in the prior art, due to insufficient fault detection precision, tiny or complex faults cannot be found in time, and the operation stability of the robot is affected is solved, the fault detection precision and the response speed are improved, and the operation reliability and safety are enhanced.

A method and system controlled by a human machine interface (HMI) connected to an industrial process control and automation system controlling an industrial process. The HMI collects information and data from a semantic network in response to a natural language request input into the HMI by an operator. The HMI generates a visual layout for the received information and data that is displayed to the operator using the visual layout.

A “one-pedal rocking mode” for extricating an electric vehicle from a stuck condition is implemented by: receiving, via a human-machine interface (HMI) of the electric vehicle, an indication of a user selection to activate the one-pedal rocking mode; operating the electric vehicle in the one-pedal rocking mode responsive to detecting movement of an accelerator pedal of the electric vehicle; controlling at least one electric motor of the electric vehicle to: (i) apply a forward torque to corresponding drive wheels when the accelerator pedal is in a first pedal position that exceeds a forward threshold, (ii) apply a reverse torque to the corresponding drive wheels when the accelerator pedal is in a second pedal position that is less than or equal to the forward threshold; and exiting the one-pedal rocking mode by switching operations of the electric vehicle to a second operating mode responsive to detecting an exit condition.

A device for time-based tracking and cost optimization in construction projects, the device comprising the following: a robust housing suitable for use on construction sites; a processing unit located inside the housing, configured to perform real-time time-stamping, data acquisition and preprocessing tasks; a multimodal sensor unit that is operationally coupled with the processing unit, wherein the sensor unit comprises at least a motion sensor, an RFID reader, sensors for environmental conditions and a vision module with optical character recognition; a real-time clock module that is operationally connected to the processing unit to provide time synchronization for all sensor data streams; a wireless communication module that supports the Wi-Fi, LoRa and LTE protocols and is configured for transmitting time-stamped data to a central project server; a storage module that is operationally coupled with the processing unit to locally buffer time series data of construction activity during offline operation; a housing-mounted, touchscreen-based human-machine interface configured to allow site personnel to enter activity updates and confirm the status of construction tasks; a cost optimization engine running on the central server, the engine being configured to receive time-synchronized sensor data from multiple such devices and dynamically calculate time-cost trade-offs using a predictive planning technique that incorporates the principles of the critical path and the power value; furthermore, the device is configured to be integrated into a digital twin environment of the building under construction in order to provide real-time visualization of progress and to generate suggestions for resource reallocation based on a time-cost-benefit analysis.

An automatic tightening apparatus for a suction cup assembly. The apparatus comprises a suction cup assembly tightening apparatus bench and at least one tightening station, the tightening stations including a first automatic tightening station, a second automatic tightening station, a third automatic tightening station, a fourth automatic tightening station, and a fifth automatic tightening station which are sequentially mounted above the suction cup assembly tightening apparatus bench; and a tightening structure and moving module and a human-machine interface are provided above the suction cup assembly tightening apparatus bench. The beneficial effects are: by providing the tightening stations on the suction cup assembly tightening apparatus bench, sequentially arranging the tightening stations, and disposing the tightening structure and moving module horizontally, switching between the tightening stations can be achieved; the suction cup assembly tightening and assembly process is concentrated on the suction cup assembly tightening apparatus bench, the apparatus has a simple structure and a reasonable layout, and the area occupied by the tightening apparatus is reduced.

The invention discloses a 2 [mu] m nanosecond pulse fiber laser and a time domain waveform adjustment method thereof. The laser comprises a seed source module and an amplification module connected with the seed source module. The seed source module comprises a first high-reflectivity fiber bragg grating, an acoustic optical modulator, a first beam combiner, a first thulium-doped fiber, a 2 * 2 coupler and a second high-reflectivity fiber bragg grating which are connected in sequence, as well as a driving source connected with the acoustic optical modulator and a first pumping source connected with the first beam combiner; the amplification module comprises an online isolator, a second beam combiner, a second thulium-doped optical fiber and an output jumper which are connected in sequence, and a second pumping source connected with the second beam combiner; the rising edge time and the starting time of the acousto-optic modulator are subjected to parameter setting through a human-computer interface of the driving source; the wavelengths of lasers output by the first pumping source and the second pumping source are both 793 nanometers. According to the invention, the multi-peak phenomenon of the Q-switched pulse laser of the 2um waveband can be conveniently and effectively eliminated, the performance of the laser is improved, and the application requirements of low cost and mass production are met.

The invention relates to the technical field of water resource management, in particular to a cascade reservoir ecological scheduling system based on artificial intelligence, which comprises a multi-source data integrated processing module, an ecological influence prediction module, a scheduling strategy optimization module, a self-adaptive water quality management module and an intelligent user interaction module. Wherein the multi-source data integrated processing module is used for collecting various data of a meteorological station, a hydrometric station and an ecological monitoring point; the ecological influence prediction module is used for constructing an ecological influence model; the scheduling strategy optimization module is used for formulating a reservoir scheduling strategy; the self-adaptive water quality management module is used for adjusting the reservoir outlet flow and the adjusting strategy of the reservoir; and the intelligent user interaction module provides a human-computer interface. According to the invention, by integrating multi-source real-time data, applying reinforcement learning to optimize the scheduling strategy and providing an efficient user interaction interface, the real-time responsiveness and decision-making efficiency of reservoir management are significantly improved, and optimal utilization of water resources and protection of the ecological environment are ensured at the same time.

Disclosed is a robotic system and method designed for the verification and validation of smart connected Human-Machine Interface (HMI) devices. The robotic system integrates a multi-finger modular robotic module, a haptic module, a finger actuator, vision cameras, vision lights, a finger rotary module, a Cartesian robotic arm, an onboard user interface, and an L-shaped door. The method involves replicating human finger interactions, simulating touch sensations on a device under test (DUT), ensuring continuous and reliable operation, utilizing vision cameras for navigation and verification, optimizing vision with controlled lighting, positioning cameras strategically, executing various tasks with a robotic arm, and facilitating user interaction through an onboard interface.

The invention provides an arbitrary point turn-back method under a train control system route architecture based on communication, which comprises the following steps of: when an arbitrary point turn-back command for a train is received and the train is determined to be in a stable stop state, generating a reverse route containing turnout opening information. And according to the reverse direction head code, generating a starting end signal machine list of which the route needs to be manually solved and sending the starting end signal machine list to an automatic train protection system. And an unlocking request command of the first signal machine in the starting end signal machine list is sent to the area controller, and the access in the starting end signal machine list is unlocked through interactive verification with a train automatic protection system. After it is confirmed that the route corresponding to the first signal machine is successfully unlocked, a turn-back instruction is sent to the automatic train protection system, and meanwhile the automatic train protection system is controlled to execute end changing operation. After the end changing operation is completed, new movement authorization is established to control the train to run, route unlocking in the original direction and passenger prompting are triggered when preset conditions are met, meanwhile, a turn-back mark of any point is updated and displayed on a human-computer interface, and turn-back of any point is achieved.

A method for operating an ego-vehicle includes receiving sensor data of a sensor system of the ego-vehicle, detecting an absence of lane markings based on the sensor data, and transmitting instructions to a human machine interface of the ego-vehicle to prompt a driver of the ego-vehicle to drive to a perceived center line of a lane. The method also includes determining a virtual lane based on the perceived center line to which the driver has driven, and performing a lane keeping assistant function to keep the ego-vehicle on the virtual lane.

The invention discloses a multi-language dynamic switching system and method of embedded equipment, and relates to the technical field of human-machine interfaces and embedded systems.The method comprises the steps that source codes in an HMI program are traversed through a character extraction module to extract all character strings; eliminating repeated items, numbering the character strings, and outputting a database file and a replacement array; substituting the serial number into the source code file again by using the substitution array to replace the character string at the corresponding position; outputting the translated database file as a C language source code, compiling the C language source code into a dictionary generation module project, generating an executable file, and outputting the dictionary file to an HMI running directory after the device is started; after the HMI program is started, the dictionary is read into different dictionary arrays according to blocks, and character strings at corresponding positions in the dictionary arrays are extracted after a page sends a request. The method has the advantages of being lower in maintenance difficulty, more efficient in resource utilization, shorter in indexing time, better in system robustness and the like.

A resistance training machine, a method of providing custom workouts, and a method of providing feedback on user form and user balance are disclosed. The resistance training machine includes a left and right motor, a left and right pulley system, a left and right cable, a machine controller, and a human machine interface. Advantageously, the resistance training machine can provide isotonic exercises, isokinetic exercises, and feedback on form and balance for a user. The first method includes a user calibrating one or more exercises, selecting an exercise, selecting an exercise mode, and performing the exercise. For each exercise, a motor may ramp up to and ramp down from a selected velocity or force level.

Aspects of adaptive trust calibration may include receiving a trust model for an occupant of an autonomous vehicle calculated based on occupant sensor data and a first scene context sensor data, and / or receiving a second scene context sensor data associated with an environment of the autonomous vehicle, determining an over trust scenario or an under trust scenario based on the trust model and a trust model threshold, and generating and implementing a human machine interface (HMI) action or a driving automation action based on the determination of the over trust scenario or the determination of the under trust scenario, and / or the second scene context sensor data.

The invention relates to an intelligent avoiding control method for machining of a numerical control flanging machine. Comprising the following steps that before machining, a correct machining program is compiled on a human-computer interface according to an actual workpiece drawing or a real object forming process; the numerical control system analyzes a machining program to obtain data necessary for a position avoiding algorithm, machining is started, and in a bending forming rectangular coordinate system, pole coordinate values of a current forming shape are automatically calculated in real time; in the continuous machining process, the target positions and the action time sequence of a feeding shaft, a pressing shaft and an edge folding shaft of the edge folding machine in the next step are correctly adjusted, so that a workpiece and an edge folding machine die are prevented from interfering and colliding, and meanwhile set process actions are completed. According to the control method and the numerical control system, the forming shape and related coordinate data of the workpiece can be obtained in real time, the mutual positions of the workpiece, the machine tool moving part and the mold are adjusted in time through the process control instruction, and interference and collision of the workpiece, the machine tool and the mold are correctly avoided.

Systems and methods of controlling graphic displays within a multi-display human machine interface (“HMI”) environment for industrial systems. One system includes an electronic processor configured to determine a display parameter for a header portion of a graphic display of the plurality of graphic displays. The electronic processor may be configured to determine, based on the display parameter, an arrangement for the graphic display, where the arrangement maintains the header portion of the graphic display within a display frame for the graphic display. The electronic processor may be configured to generate the graphic display based on the arrangement. The electronic processor may be configured to display the HMI-client application across the plurality of display devices and display the graphic display within the display frame for the graphic display on a first display device of the plurality of display devices.

An interaction assistance system for a user computing device can operate as an intermediate layer in a human-machine interface to receive user action data that describes user actions with a user computing device, interpret the actions in context, and intelligently instruct or command the host system to perform tasks associated with the user action data. An example interaction assistance system can enable faster and more efficient human-machine interfaces by simplifying a number or complexity of inputs to perform a given task.

A flexible mechanism for an exoskeleton allows for a simple and low-cost method of allowing a high range of motion between an frame and a human interface while effectively transferring support forces from the frame to the human interface. Additionally, the flexible mechanism adds kinematic redundancy that compensates for incongruities between the exoskeleton and human during forward flexion to prevent the human interface from uncomfortably sliding on the person via purely tension-loaded force transmitting elements.

This technology provides designs and methods for the vehicle on-board unit (OBU), which facilitates vehicle operations and control for connected automated vehicle highway (CAVH) systems. OBU systems provide vehicles with individually customized information and real-time control instructions for vehicle to fulfill the driving tasks such as car following, lane changing, route guidance. OBU systems also realize transportation operations and management services for both freeways and urban arterials. The OBU composed of the following devices: 1) a vehicle motion state parameter and environment parameter collection unit; 2) a multi-mode communication unit; 3) a location unit; 4) an intelligent gateway unit, and 5) a vehicle motion control unit. The OBU systems realize one or more of the following function categories: sensing, transportation behavior prediction and management, planning and decision making, and vehicle control. OBU is supported by real-time wired and / or wireless communication, the power supply networks, the cloud, cyber safety, security services, and the human machine interface.

An integrated development environment (IDE) for designing, programming, and configuring aspects of an industrial automation system uses a generative artificial intelligence (AI) model and associated neural networks to generate portions of an industrial automation project in accordance with functional requirements provided to the industrial IDE system in intuitive formats, such as spoken or written plain language text. The system uses generative AI to translate plain language requests or functional specifications into industrial control code, human-machine interface (HMI) applications, device configuration settings, or other aspects of an industrial control project.

A method of controlling a human-machine interface having an input device for receiving a user input and a display device for displaying a graphical user interface is disclosed herein. The method includes obtaining monitoring data of at least a portion of a passenger compartment of the vehicle by the input device; processing the monitoring data to obtain hand gesture data from the monitoring data by detecting in the monitoring data a hand gesture performed by a passenger of the vehicle as the user input; determining one of at least two seats in which the passenger is seated who performs the hand gesture for which the hand gesture data are obtained; and controlling the graphical user interface depending on the detected hand gesture and the determined seat.

Enhanced human interface lighting for autonomous machines is described. In one or more implementations, a system includes perception sensor devices (e.g., camera systems, radar systems, lidar systems) to obtain environmental condition information for the environment around a vehicle. A vehicle control system controls the brightness or wavelength characteristics for one or more exterior lights of the vehicle based on the environmental condition information. In this way, the system improves driver and passenger safety, enhances the experience and safety of humans interacting with the vehicle, and improves the perception characteristics of the perception sensor devices.

An electrified vehicle includes a human-machine interface to enable a towed vehicle mode to enable electric pumps to lubricate and / or cool vehicle components and to disable driver assistance features while the electrified vehicle is being towed by another vehicle. The electrified vehicle includes a drivetrain having an electric machine configured to provide propulsive torque to vehicle wheels, a high-voltage traction battery selectively connected to the electric machine, a battery powered fluid pump configured to pump fluid to the drivetrain, and a controller programmed to, after receiving a signal enabling towed vehicle operation of the electrified vehicle, control operation of the battery powered fluid pump while the electrified vehicle is being towed. The controller may disable one or more driver assistance features and alerts such as automatic emergency braking, automatic shifting of the drivetrain, automatic parking brake operation, automatic headlights, automatic steering, cruise control, parking assistance, and external object distance detection.

The invention discloses an oligosaccharide enzyme fermentation process control system and method based on pH and dissolved oxygen electrode feedback, relates to the technical field of oligosaccharide enzyme fermentation, and aims to improve the yield and activity of oligosaccharide enzyme. The system comprises a pH electrode, a dissolved oxygen electrode, a stirrer, a ventilation system and a temperature control system, and accurate control is realized through a data acquisition and processing unit, a logic control unit and a human-computer interface. The control method comprises the steps of seed culture, shake flask fermentation, fermentation tank culture, monitoring and evaluation as well as optimization and adjustment. Through a segmented oxygen control strategy and dissolved oxygen and stirring linkage control, the dissolved oxygen level is accurately controlled, the yield and activity of the oligosaccharide enzyme are remarkably improved, the fermentation process conditions are optimized, and the monitoring and evaluation capability is enhanced. The method is suitable for industrial production of the oligosaccharide enzyme, and is beneficial for improving the product quality and the economic benefit.