Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

2991 results about "Man machine" patented technology

Multi-modal shared teleoperation system and method for three-arm space robot

Disclosed in the present invention are a multi-modal shared teleoperation system and method for a three-arm space robot. The system at least comprises a master-side teleoperation system, a communication module and a slave-side robot system, wherein the master-side teleoperation system at least comprises two force feedback hand controllers, a microphone array and upper computer software, and the slave-side robot system comprises two operating arms each equipped with a gripper at the end, an observation arm having a binocular camera mounted at the end, a vision unit, a force sensor and lower computer software. The method comprises: an operator controlling two operating arms of an extravehicular robot to execute a task, and controlling an observation arm to acquire a better local field of view. In the method, a multi-modal teleoperation method comprising pose control, voice control and force control is fused with autonomous control of a robot by means of a shared control algorithm, and thus, human-robot collaborative control over the position, orientation and contact force of a robotic arm can be realized on the basis of the requirements of the operator, and the robot autonomously executes other relatively simple tasks, thereby reducing the operation burden of operators, and improving the control efficiency.
Owner:SOUTHEAST UNIV

Intelligent warehousing optimization management platform based on digital twinning and space-time prediction

The invention discloses an intelligent warehouse optimization management platform based on digital twinning and space-time prediction, which relates to the technical field of intelligent warehouse management and comprises a digital twinning model construction module, a space-time prediction module, an inventory optimization management module and a user interaction module. The digital twinborn model construction module realizes digital mapping of a physical warehousing system by constructing a warehousing space three-dimensional model and associating warehousing sensing data, and the space-time prediction module constructs a prediction model to obtain inventory prediction information in a future time period, and performs inventory risk assessment and early warning according to the inventory prediction information; the inventory optimization management module generates an inventory strategy and an optimized storage position according to the prediction result, the storage cost and the cargo demand, and formulates a warehouse-in and warehouse-out task scheduling scheme; and the user interaction module visually presents the warehouse management data and receives a user interaction operation instruction to realize man-machine collaborative management, and the platform reduces the vacancy rate of the warehouse space and the interruption risk of the supply chain, and reduces the invalid carrying energy consumption.
Owner:JINJIANG NEW JIANXING MACHINERY EQUIP

Four-foot robot mechanical arm tail end force feedback teleoperation control system and method

The invention belongs to the technical field of robot control, particularly provides a force feedback teleoperation control system and method for the tail end of a mechanical arm of a quadruped robot, and aims at the key challenges that control errors are caused by communication time delay and soft obstacles are difficult to recognize in a dynamic environment. Modeling and judgment are conducted on the contact state of the tail end of the mechanical arm in advance, and feedforward control and buffer adjustment oriented to communication time delay are achieved. And meanwhile, a dynamic semantic map is constructed in combination with multi-source sensing information, and soft obstacle reasoning and path optimization are performed by fusing a tail end force sense change trend, so that the recognition and avoidance capabilities of the system in a complex and invisible obstacle environment are remarkably improved. The system has good perspectiveness, self-adaptability and high redundancy safety characteristics, is suitable for multi-task inspection operation of industrial sites such as a thermal power plant, and is especially suitable for a remote man-machine cooperative operation scene in a narrow space.
Owner:武汉跨克信息技术有限公司

Power battery pack thermal management control system and method

The invention discloses a thermal management control system and method for a power battery pack, and belongs to the technical field of electric automobiles, and the system comprises the following modules: a multi-parameter acquisition module which is used for acquiring parameter data of the battery pack in real time; the data preprocessing and fusion module is used for generating a high-quality and uniform-format data set; the dynamic prediction modeling module is used for realizing accurate temperature trend prediction; the intelligent decision module is used for generating an optimal heat management strategy; the thermal management execution module is used for realizing accurate temperature regulation and thermal management; the system monitoring and diagnosis module is used for ensuring safe operation of the system; a man-machine interaction module; the intelligent thermal management system is used for realizing man-machine collaborative intelligent thermal management. According to the thermal management control system and method for the power battery pack, the particle swarm optimization algorithm is utilized, the power battery thermal management system of a thermal management strategy is dynamically adjusted, more accurate temperature prediction and control are achieved, energy consumption is optimized, and the service life of the battery is prolonged.
Owner:SHANDONG UNIV

Intelligent self-adaptive industrial robot control system and method thereof

The invention discloses an intelligent self-adaptive industrial robot control system and method, and the method comprises the steps: carrying out the automatic recognition and self-inspection of a sensor, an actuator and a controller module through a standardized interface when the system is started; various sensors are used for environment monitoring, acquired data are stored in a cloud end, and a sensor fusion technology is applied for integration; the system state and the environment condition are monitored in real time, machine learning and an artificial intelligence algorithm are used for analyzing the operation state and the task effect, and a corresponding operation strategy is formulated; based on task execution and environment information, an execution path is generated by adopting a path planning algorithm, and an operation strategy and parameters are dynamically adjusted according to real-time feedback; a real-time safety monitoring mechanism is introduced, and a safety threshold value is set; sensor data are analyzed regularly, potential faults are identified, and fault prediction is carried out; according to the intelligent self-adaptive industrial robot control system and method, when the robot is designed, the safety of man-machine cooperation is considered, and safety protection measures are added.
Owner:GUANGDONG VOCATIONAL & TECHNICAL COLLEGE

Intelligent cabin interaction method and system combined with digital twinning

The invention discloses an intelligent cabin interaction method and system combined with digital twinning, and relates to the technical field of man-machine interaction, and the method comprises the steps: collecting the multi-dimensional perception data of a cabin, and constructing a layered cabin digital twinning model; performing scene analysis on the cockpit digital twin model, extracting driver state features, predicting driver potential interaction demands, generating a multi-modal interaction strategy set in combination with the driver potential interaction demands and a current driving scene, and performing simulation evaluation on the multi-modal interaction strategy set to obtain an interaction evaluation index set; performing multi-objective decision optimization under the driving safety constraint based on the interaction evaluation index set, and determining and adaptively executing an optimal interaction strategy; and acquiring actual execution data and driver feedback data of the optimal interaction strategy, and incrementally updating the hierarchical cabin digital twin model. According to the invention, the interaction adaptability and the safety reliability of the intelligent cabin system in a complex driving scene are obviously improved, and an effective technical support is provided for realizing intelligent man-machine cooperative driving.
Owner:GUANGZHOU KOMI CULTURE COMMUNICATION CO LTD

Construction man-machine safety intelligent detection and early warning method based on deep learning

The invention discloses a construction man-machine safety intelligent detection and early warning method based on deep learning. The method comprises the following steps: S1, introducing a wavelet convolution improved YOLOv11 target detection algorithm framework; s2, coordinate extraction of the instance segmentation module; s3, designing a monocular depth estimation network; s4, training the monocular deep network; and S5, converting the two-dimensional coordinates into the three-dimensional coordinates. According to the invention, the real distance between the worker and the equipment is obtained and real-time safety early warning is carried out; obtaining a man-machine actual distance, and judging the accurate position and posture of the machine by combining angle information of the construction machine with edge contour detection; target detection in a complex construction scene is realized by optimizing a network structure; the S2R-DepthNet depth estimation network is used for performing depth estimation on a single RGB image through a self-supervised learning method, the three-dimensional information acquisition process is simplified, and dependence on expensive hardware is eliminated.
Owner:CHENGDU SEFON SOFTWARE CO LTD +1

An automatic winding drum taking and loading mechanism for glass fiber drawing machine

The present invention relates to an automatic winding drum taking and loading mechanism for a glass fiber drawing machine, comprising a middle bracket, an upper bracket, a winding drum pulling and pushing unit and a winding drum supporting unit; the winding drum pulling and pushing unit is mounted on the upper bracket, and the winding drum supporting unit is mounted on the middle bracket; the winding drum pulling and pushing unit comprises an upper linear module fixedly mounted on the upper bracket, a sliding assembly of the upper linear module is fixed with a combined bracket, and a pulling and pushing structure is mounted on the lower end of the combined bracket; the winding drum supporting unit comprises a middle support plate fixedly mounted on the middle bracket, a rear fixed flap and a weighing sensor are inherently provided on the upper side of the middle support plate, a front fixed flap is fixed on the weighing sensor, a supporting mechanism for driving the three supporting drum flaps to move is also mounted on the middle support plate, and a second camera is fixed to the end of the middle support rod. The present invention has the advantages of being able to reduce labor costs, improve the degree of automation, and avoid the risk of mechanical collisions to humans during human-machine collaborative work.
Owner:CSIC (CHONGQING) SOUTHWEST EQUIP RES INST CO LTD

Wharf steel structure construction progress dynamic management and control and resource allocation system

The invention relates to the field of engineering management, and discloses a wharf steel structure construction progress dynamic management and control and resource allocation system, which comprises a real-time data perception and fusion module for collecting field data and an initial plan and generating a fusion data stream; the dynamic construction digital twinborn construction and evolution module is used for updating the digital twinborn and a dynamic empirical risk layer in real time based on the fusion data flow; the multi-agent self-adaptive decision engine is used for generating a self-adaptive construction scheme based on digital twinborn simulation deduction and feeding back a risk signal; and the man-machine cooperation and closed-loop execution module is used for visualizing the scheme for manual decision making and issuing an instruction to a site. According to the method, the physical field data sensed in real time is fused with the digital model, the dynamic construction digital twin capable of being synchronously updated with the physical construction field state is constructed, and the technical effect that digital information and the physical entity state are kept highly consistent is achieved.
Owner:CCCC THIRD HARBOR ENGINEERING CO LTD

Man-machine reinforcement learning method based on multi-dimensional human feedback fusion

A man-machine reinforcement learning method based on multi-dimensional human feedback fusion comprises the steps of performing generative adversarial imitation learning based on a strategy generator and a discriminator through expert demonstration, so that a strategy learned by the strategy generator cannot be distinguished by the discriminator, and obtaining a demonstration reward function; obtaining a preference award function conforming to the user preference by using the track preference of the user; and fusing the demonstration reward function and the preference reward function to obtain a unified reward function, and solving the conflict between the demonstration reward function and the preference reward function through a dynamic reward weight adjustment strategy. According to the method, limitation caused by single feedback and potential conflicts existing among a plurality of feedback sources can be overcome, and the robustness and continuity of the reward function are enhanced.
Owner:NORTHWESTERN POLYTECHNICAL UNIV

Industrial equipment intelligent operation and maintenance management system and method based on 5G-MOM

The invention discloses an industrial equipment intelligent operation and maintenance management system and method based on 5G-MOM, and belongs to the technical field of industrial internet and intelligent manufacturing. The system comprises a multi-source heterogeneous data acquisition layer deployed in industrial equipment, an edge computing node cluster based on 5G, a cloud intelligent analysis platform and a man-machine collaborative operation and maintenance terminal. The method comprises the following steps of collecting equipment vibration, temperature and current multi-dimensional working condition data in real time through a 5G network; performing data cleaning and feature extraction by using edge computing nodes, and constructing an equipment operation digital twin model; a cloud deep neural network is adopted to carry out fusion analysis on the multi-dimensional time series data, and self-adaptive diagnosis and residual life prediction of a fault mode are realized; a dynamic maintenance strategy is generated based on an MOM system, and field personnel are guided to execute precise maintenance through an AR terminal. According to the invention, 5G ultra-low time delay communication and an industrial mechanism model are creatively combined, and real-time visual management and predictive maintenance decision optimization of the equipment health state are realized.
Owner:NANJING MINGJUEDA INTELLIGENT TECHNOLOGY CO LTD

Mechanical arm natural language instruction control system and method based on large language model

The invention discloses a mechanical arm natural language instruction control system and method based on a large language model, and belongs to the field of intelligent manufacturing. Aiming at the limitation that traditional mechanical arm control depends on pre-programming and a static rule library, a dynamic mapping mode from a natural language instruction to an atomic action sequence is designed, an atomic skill library including detection, grabbing, moving, placement and other operations is constructed, and semantic analysis and a multi-mode cooperation technology are combined, so that the atomic action sequence is obtained. And support is provided for man-machine cooperation of a flexible assembly task. The method specifically comprises the steps that a DeepSeek-Distil-Llam-8B large model and a LoRA fine tuning technology are adopted, and a natural language instruction is converted into an executable atomic action sequence; based on a transfer learning optimized YOLOv8 target detection technology and a binocular vision positioning technology, a sensing module adaptive to an assembly scene is constructed and is fused with a mechanical arm motion planning module, and positioning grabbing of parts and tools is achieved. And an interactive interface is built by combining a voice-to-text large model and a Gradio front-end framework, so that the convenience of man-machine interaction is improved. By optimizing large model reasoning and motion planning cooperation efficiency, response delay from instructions to execution is reduced, and an efficient and extensible solution is provided for man-machine cooperation in intelligent manufacturing.
Owner:BEIJING INST OF TECH

Vehicle man-machine voice interaction method and system and vehicle

PendingCN118968992AGood semantic understandingGood ability to hold multi-turn conversationsInternal combustion piston enginesSemantic analysisUser needsMan machine
The invention discloses a man-machine voice interaction method and system for a vehicle and the vehicle, and the method comprises the steps: obtaining audio data of a user, and carrying out the text conversion of the audio data, and obtaining text information; performing intention analysis on the text information to obtain an analysis result, performing scheme determination according to the analysis result to obtain a target semantic processing scheme, and performing semantic understanding processing on the text information according to the target semantic processing scheme to obtain semantic information; and performing association processing on the semantic information to obtain target semantics, performing instruction execution according to the target semantics to obtain an execution result, obtaining reply text information according to the execution result, and broadcasting target voice information obtained after voice conversion. According to the method, a rule-based result is taken as a lower limit to ensure simple intention implementation, and a result of a large model is taken as an upper limit to ensure the accuracy of semantic understanding; and for multiple rounds of dialogue scenes, user demands can be better understood by associating historical semantics, and more accurate responses can be provided.
Owner:CHONGQING CHANGAN TECH CO LTD

Automatic yarn breaking mechanism of wire drawing machine

ActiveCN222138959URealize automatic yarn breaking functioncompact structureGlass making apparatusYarnBobbin
The utility model relates to an automatic yarn breaking mechanism of a wire drawing machine, which belongs to the technical field of wire drawing machines, and comprises a machine head, a yarn roll is arranged on the machine head, an automatic yarn breaking component movably contacted with the yarn roll is arranged on the outer side of the machine head, the automatic yarn breaking component comprises a rotating shaft, a rotating shaft rotating cylinder is arranged on one side of the rotating shaft, and the rotating shaft rotating cylinder is arranged on the other side of the rotating shaft. And a rotating shaft arm for driving the rotating shaft to operate is arranged between the rotating shaft rotating cylinder and the rotating shaft. The device has the characteristics of compact structure, good operation stability and high efficiency. The problems that potential safety hazards exist in man-machine cross operation and a mechanical arm automatically takes yarns and unloads the bobbins are solved. The automatic yarn breaking function of the wire drawing machine is achieved, and the conditions of high labor intensity and low working efficiency caused by frequent manual operation are avoided.
Owner:HANGZHOU TIANQI MASCH CO LTD

Humanoid robot real-time cooperation decision-making method based on multi-modal perception fusion

The invention discloses a humanoid robot real-time cooperation decision-making method based on multi-mode perception fusion. The method comprises the following steps: dynamically deploying a sensor array, acquiring multi-modal original sensing data of the humanoid robot through the deployed sensor array, and performing physiological signal fusion processing and multi-modal feature enhancement processing on the multi-modal original sensing data to obtain a multi-level feature set; performing cross-modal semantic mapping and intention reasoning on the multi-level feature set by using a cross-modal semantic reasoning system supported by a large model to obtain a cooperative execution instruction containing a target action and a force control parameter; and dynamically updating a behavior decision model of the humanoid robot by using a double-buffer collaborative distributed incremental learning mechanism based on the collaborative execution instruction, and obtaining a real-time collaborative decision of the humanoid robot based on the behavior decision model. The technical problem that the man-machine cooperation efficiency of the humanoid robot in a complex scene is low is solved.
Owner:BEIJING INFORMATION SCI & TECH UNIV

Man-machine cooperation method and system based on robot process automation

The invention provides a man-machine cooperation method and system based on robot process automation, and relates to the technical field of automation, and the method comprises the steps: building a data perception processing network, collecting a user operation instruction, a system operation state and task environment data, obtaining a task feature vector through semantic analysis, and matching a business model to generate a task processing strategy. A man-machine cooperative processing framework is constructed based on the strategy, a robot unit processes a structured task, a manual operation unit processes an unstructured task and is connected through an information interaction channel, and transmission of a data analysis result and decision suggestions and updating of processing regulation information when deviation exceeds a threshold value are achieved. Besides, a knowledge migration processing network is constructed, business rules and expert experience data features are extracted, a scene migration model is trained, business feature vectors are mapped to a preset scene feature space, and after validity verification, parameters of the data perception processing network and the man-machine cooperative processing framework are updated.
Owner:BEIJING SEEYON INTERNET SOFTWARE CORP

Man-machine cooperative medical teaching interaction method and system

The invention relates to the technical field of man-machine interaction, relates to a man-machine cooperation medical teaching interaction method and system, and provides a man-machine cooperation medical teaching interaction method. Through the steps of data acquisition and processing, virtual simulation and interaction, deep learning-driven situational operation simulation and emergency response evaluation, intelligent analysis and evaluation, interactive feedback and guidance, data backflow and optimization and the like, a dynamically adjusted and continuously optimized teaching closed-loop system is constructed, and a biomechanical model and a deep learning technology are utilized to establish a teaching closed-loop system. Immersive teaching and emergency response capability evaluation are realized, personalized teaching content and guidance are provided for learners in combination with real-time data analysis and a feedback mechanism, the training effect of medical operation skills is improved, the operation reality sense in a virtual environment is enhanced through application of a biomechanical model, and the training efficiency is improved. Therefore, a learner can train in an environment close to a real operation, the operation accuracy and the emergency response capability are improved, and the defects of a traditional system are overcome.
Owner:WENZHOU MEDICAL UNIV

Robot autonomous learning and adaptive trajectory planning method oriented to man-machine cooperation

The invention provides a robot autonomous learning and adaptive trajectory planning method oriented to man-machine cooperation aiming at a mechanical arm simulating a human teaching sample to obtain a motion skill and generalizing the motion skill to an adaptive obstacle avoidance behavior of a new situation, and specifically, a dynamic motion primitive algorithm is introduced to carry out learning and generalization of a motion trajectory of the mechanical arm. Based on the initial state and the search area of a generalized trajectory improved particle swarm algorithm, rapid search of a local obstacle avoidance trajectory is achieved, and mechanical arm motion trajectory planning with an autonomous obstacle avoidance function is comprehensively achieved. The method has the advantages that the method has high consistency with an original generalization track and wider adaptability, and the path searching efficiency is remarkably improved; a virtual simulation experiment and a physical experiment verify that the method has good stability and practicability.
Owner:CHAOHU UNIV

Mechanical arm force feedback control method based on deep reinforcement learning

The invention discloses a mechanical arm force feedback control method based on deep reinforcement learning, and the method comprises the following steps: 1, data collection and preprocessing: collecting environment data, collecting operation data, and preprocessing the data; 2, designing a self-adaptive deep reinforcement learning algorithm, including initial model training, self-adaptive learning module and model online updating; 3, introducing a prediction model, including human operation intention prediction and motion trail prediction; and step 4, performance test and optimization, including simulation test and safety and efficiency evaluation. The force feedback control precision of the mechanical arm during operation in a complex environment and the safety and efficiency of man-machine cooperation are improved. According to the method, a control strategy is updated and adjusted in real time by designing an adaptive deep reinforcement learning algorithm and introducing a human operation intention prediction model, so that environmental changes and unknown interference can be better coped with.
Owner:WUXI XINENG REAL ESTATE MANAGEMENT CO LTD

Numerical control machine tool wear monitoring and intelligent compensation control method based on deep learning

The invention discloses a numerical control machine tool wear monitoring and intelligent compensation control method based on deep learning, and relates to the field of numerical control machine tool wear monitoring. Multi-source data are collected through a sensor, and are preprocessed and fused through edge calculation; deep features are extracted and enhanced through an improved network, the abrasion state is evaluated through a mixed expert model, and life is predicted in combination with survival analysis; based on enhanced transfer learning, generating an intelligent compensation strategy according to a processing target, and executing the intelligent compensation strategy after verification in a virtual environment; a closed-loop system is constructed, all modules are acquired, fed back and optimized, and full-process intelligent management of functions such as knowledge graph early warning and multi-machine-tool cooperation is integrated. According to the method, the wear monitoring accuracy is improved, and early wear is accurately recognized; machining parameters are intelligently compensated and optimized, precision is improved, and the service life of a tool is prolonged; closed-loop control and multiple technologies are fused, the response time is shortened, and shutdown is reduced; the operation efficiency and reliability of the numerical control machine tool are improved, and the cost is reduced.
Owner:JIANGSU ANTO INTELLIGENT EQUIP TECH CO LTD

Man-machine interaction control method for flexible lower limb exoskeleton

ActiveCN118981855AAvoid falls and injuriesPrecise Trajectory TrackingGeometric CADDiagnosticsHuman bodyDynamic models
The invention provides a man-machine interaction control method for a flexible lower limb exoskeleton. The man-machine interaction control method comprises an impedance control algorithm, a reinforcement learning algorithm, a self-adaptive control algorithm and a nonlinear disturbance observer. A mass model, a rigidity model and a damping model are established through an impedance control algorithm, a joint reference track of a user is solved, and a mathematical relationship between a joint interaction torque and a motion track of the man-machine coupling system is disclosed; impedance model parameters are optimized through a reinforcement learning algorithm under the condition that robot and human body dynamic model parameters are limited, and the aim is to reduce the muscle activation degree and the joint rigidity to the maximum extent; a tracking error between an actual track of an exoskeleton system and an output track of an impedance model is reduced to the maximum extent through a self-adaptive control algorithm, and a nonlinear disturbance observer is introduced to compensate disturbance caused by external factors such as material friction, estimation errors and model tight coupling so as to achieve the optimal power-assisted walking effect.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Human-machine cooperation assembly method and system guided by digital twinning and augmented reality

The invention relates to the technical field of workpiece assembly, in particular to a digital twinning and augmented reality guided man-machine cooperation assembly method and system, and the method comprises the steps: collecting a multi-view image, mechanical arm sensing data and a first person image of AR glasses; fusing the data, generating scene assembly information, and constructing a digital twin model; configuring an operation standard, a standard assembly unit space state and a standard hand action template of each assembly process stage, judging a current assembly process stage, identifying an operation intention, predicting a next process in combination with the current assembly stage and the operation standard, and generating a man-machine instruction and simulation data; three-dimensional action guidance is displayed through AR glasses, a mechanical arm is driven to execute planning actions, and a digital twin interface feeds back the assembly state, precision data and prediction animation in real time. According to the method, man-machine standardized cooperation and high-precision assembly are achieved, pre-stored parameters are adaptive to multi-variety production, and the process consistency is improved through real-time feedback.
Owner:SHANGHAI UNIV

Man-machine exoskeleton cooperation method based on multi-modal signal fusion

The invention discloses a man-machine exoskeleton cooperation method based on multi-modal signal fusion, and relates to the technical field of exoskeleton program control. The method comprises the following steps that man-machine exoskeleton driving pre-pressure cold and hot mutation analysis is conducted in combination with man-machine exoskeleton man-machine cooperation components; and performing memory alloy spring pre-pressure optimization adjustment in combination with a man-machine exoskeleton driving pre-pressure cold and hot mutation analysis result. According to the invention, cold chain exoskeleton cooperative control is realized through multi-mode signal fusion, and three-level regulation and control are implemented based on a current threshold value and a myoelectricity state: graded current rising / falling and safety early warning are carried out in case of abnormal current; dynamic gain compensation or joint retardation protection is carried out when myoelectricity is abnormal; according to the man-machine exoskeleton cooperative control method and the man-machine exoskeleton cooperative control system, the effect of improving the accuracy of man-machine exoskeleton cooperative control for coping with cold-chain logistics is achieved, and the problem that the accuracy of man-machine exoskeleton cooperative control for coping with cold-chain logistics is disabled in the prior art is solved.
Owner:HEFEI HAIFENG HUIXIN INTELLIGENT TECHNOLOGY CO LTD

Psychological counseling man-machine interaction method based on large model

The invention provides a psychological counseling man-machine interaction method based on a large model, a psychological counseling large model is constructed based on a collected and preprocessed psychological counseling data set, and the psychological counseling large model comprises a multi-modal feature extraction module, an encoder stacking structure, a decoder stacking structure and a prediction output module; wherein each encoder in the encoder stacking structure adopts a self-adaptive multi-modal feature fusion module obtained through design; each decoder in the decoder stacking structure adopts a designed three-dimensional attention decoder; and performing fine tuning training on the large model by using the training set and the calculated training strategy to obtain a final psychological counseling large model for psychological counseling man-machine interaction. According to the multi-modal feature extraction method, the ability of the model to understand the complex psychological state is remarkably improved, the efficiency and accuracy of the model to process multi-modal information are greatly improved through the self-adaptive attention fusion mechanism, and the model can generate more comprehensive and professional consultation suggestions through the design of the three-dimensional attention decoder.
Owner:CHONGQING NORMAL UNIVERSITY

Building robot task planning and skill learning method and system

The invention discloses a building robot task planning and skill learning method and system, and relates to the technical field of intelligent construction and building robot control, and the method comprises the steps: receiving construction target description and construction environment information through a multi-modal task-skill collaborative generation model; and generating a structured semantic vector and reasoning a construction planning graph containing a plurality of subtasks. And collecting operation behavior parameters of the building robot in each subtask according to the construction planning graph, constructing an operation sample, and inputting the operation sample into the multi-modal task-skill collaborative generation model for skill learning and action instruction generation. And in the construction execution process, various sensing data are fused for real-time judgment, and if the task execution state is inconsistent with the planning state, the multi-mode task-skill collaborative generation model adjusts an instruction based on the latest state and outputs a reasoning chain. According to the method, the deployment efficiency and task adaptability of the robot system in actual construction are improved, and a foundation is laid for man-machine cooperation and unmanned construction in the field.
Owner:中亿丰数字科技集团股份有限公司

Resource allocation method and system in man-machine collaborative decision-making scene

The invention relates to the technical field of man-machine collaborative interaction, and discloses a resource allocation method and system in a man-machine collaborative decision-making scene, and the method comprises the steps: generating corresponding task features based on the three dimension indexes of task complexity, knowledge density and intelligent adaptation degree of a to-be-processed task; initializing initial weight coefficients of the three-dimensional indexes, and dynamically optimizing the weight coefficients corresponding to the three-dimensional indexes by using a preset strategy network according to the task characteristics and the real-time system resource state; performing weighted normalization on the three-dimensional indexes according to the weight coefficient to generate a task comprehensive score; task priorities are divided according to the task comprehensive scores, and the tasks are dynamically allocated to manual and / or intelligent systems to execute the tasks according to the priorities, so that the flexibility of artificial experience and the high efficiency of the intelligent systems can be brought into full play, man-machine labor division is flexibly adjusted according to task characteristics, and the universality of cross-task scenes is improved. And the dynamic adaptability, decision reliability and task execution efficiency of the man-machine cooperation system are improved.
Owner:CHINA SHENHUA ENERGY CO LTD

Long-distance tunnel in-hole man-machine real-time positioning method based on UWB

The invention relates to a UWB-based man-machine real-time positioning method in a long-distance tunnel hole. The method comprises the following steps: S1, collecting original ranging information of integrated signal characteristics; s2, correcting an original distance based on signal quality; s3, carrying out NLOS signal identification based on SVM (Support Vector Machine); s4, NLOS ranging error elimination based on an error distribution fitting model; s5, preliminarily resolving a tag position stake number; s6, label position correction based on Kalman filtering; and S7, determining a man-machine position based on label matching. According to the invention, the UWB positioning system is used for positioning and tracking personnel machinery in a hole, so that real-time transmission and analysis of man-machine position pile number information in the hole are realized, and management personnel can timely and accurately master man-machine operation positions; according to the man-machine real-time positioning method, the influence of the complex construction environment in the tunnel hole is reduced, and the man-machine positioning precision and stability in the tunnel hole are effectively improved.
Owner:TIANJIN UNIV

MES system-based workshop production task intelligent scheduling method

The invention discloses a workshop production task intelligent scheduling method based on an MES system, and relates to the technical field of scheduling management, and the method comprises the steps: decomposing workshop production tasks, obtaining production subtask lists, extracting task features of each subtask for clustering identification, and outputting a first production subtask list, a second production subtask list and a third production subtask list, and the MES system is connected with the personnel scheduling management system and the machine scheduling management system to obtain resource information, generate a personnel scheduling strategy, a machine scheduling strategy and a man-machine cooperative scheduling strategy, and perform workshop production task intelligent scheduling. The technical problems that in the prior art, due to the complication trend of the production technology and the finiteness and sharing of production resources, resource conflicts are caused, and the production efficiency and the product quality are affected are solved, intelligent scheduling of the production resources is carried out through task decomposition and subtask feature analysis, resource utilization is optimized, and the production efficiency and the product quality are improved. And the production efficiency and the product quality are improved.
Owner:BOYUE JINGCHENG (JIANGSU) TECHNOLOGY DEVELOPMENT CO LTD

Robot teleoperation method and system based on virtual reality and digital twinning

The invention provides a robot teleoperation method and system based on virtual reality and digital twinning, and particularly relates to the technical field of man-machine collaborative intelligent manufacturing and assemblation.The scheme comprises the steps that an industrial robot and wearable equipment are started; establishing a two-way communication connection between the virtual environment of the wearable device and the industrial robot, and rendering the virtual robot of the wearable device in the virtual environment; and inputting the target pose operation instruction into the virtual robot, responding to a received target motion track planned by the wearable device according to the target pose operation instruction, and controlling the industrial robot to execute an operation task according to the motion track. According to the scheme, information interaction between an operator and the robot can be achieved, so that immersive real-time robot teleoperation is achieved through instant and accurate operation commands and field feedback, and the teleoperation precision of complex tasks and flexible operation tasks can be remarkably improved.
Owner:THE HONG KONG POLYTECHNIC UNIV SHENZHEN RES INST +1

Flexible control method and system for automobile welding process

The invention relates to the technical field of automatic control, in particular to an automobile welding process flexible control method and system.The automobile welding process flexible control method comprises the following steps that according to geometrical information of an automobile workpiece, by analyzing the positions of multiple welding spots on the target automobile workpiece and considering path intersection and conflict of multiple mechanical arms, path planning of a welding robot is calculated; and the moving track and speed parameters of the robot are adjusted, and welding path configuration is generated. According to the method, by simulating the interactive action of the multiple mechanical arms, path intersection and conflict between the mechanical arms are prevented, the downtime in production is shortened, material waste caused by welding errors is reduced, welding precision is optimized by identifying the weld boundary and comparing the weld boundary with a standard model, and changes of various vehicle types and designs are matched; and by predicting the welding completion time and comparing the welding completion time with the preset time table, the welding workflow is adjusted, the man-machine cooperation efficiency is optimized, and the production flexibility and the economic benefits are improved.
Owner:GUANGZHOU FUJI ASSEMBLY LINE AUTO MFG CO LTD