471 results about "Visual appliances" patented technology

The invention discloses an equipment access control method and system based on a security sandbox, which adopts an advanced virtualization technology, constructs a highly isolated operation environment, combines technologies such as deep packet inspection, system call interception and process operation logic analysis, comprehensively monitors access behaviors of processes in the sandbox to virtual equipment, and improves the access performance of the virtual equipment. And the security and credibility of the equipment are evaluated, and illegal processes are prevented from running on the access terminal, so that the security access control of the equipment is realized. The monitoring comprises data packet content, protocol filtering, threat detection, system call interception, process creation, execution and termination behavior monitoring and the like. In combination with a trust evaluation algorithm, behavior data features are collected and extracted, trust scoring is performed by applying a machine learning model, and the equipment trust level and the access strategy are dynamically adjusted according to the score. According to the invention, the access control strategy is managed in a unified manner and deployed quickly based on the security sandbox management program and the authentication server. After identity authentication of the equipment, real-time monitoring of process dynamic behaviors in the running process of the equipment is added, and the safety of the equipment in the data exchange process is further improved.

The invention provides a practical training method and system based on multi-modal Internet of Things perception and virtual-real symbiosis, and relates to the technical field of virtual-real symbiosis, and the method comprises the steps: collecting the multi-modal perception data of a practical training environment through a plurality of heterogeneous Internet of Things devices arranged in the practical training environment; constructing a three-dimensional digital twinborn model of the practical training environment according to the category and position information of the object in the practical training environment, the voice control instruction and the comprehensive environment parameters; the method comprises the following steps: setting training items and evaluation indexes in a virtual-real symbiotic training space, receiving a training item selection instruction input by training personnel, and loading a corresponding training item according to the selection instruction, and sending a control instruction of the practical training project to a virtual equipment model in the three-dimensional digital twinborn model and Internet of Things equipment mapped with the virtual equipment model in the practical training environment for practical training, and evaluating the practical training process and the practical training result of the practical training project according to the evaluation index after the practical training project is finished. And a training evaluation report is generated and fed back to the training management system.

The invention relates to a remote memory read-write method and device based on an RDMA transmission protocol. The method comprises the following steps: creating a virtual character device based on memory information transmitted by a remote node, and mapping the memory information to a local virtual device; when missing page interruption is triggered, distributing a physical memory, initiating an RDMA read request, reading target memory data of a remote node to the physical memory, performing write protection on the target memory data, marking a dirty mark on the target memory data when a process of a user mode modifies the target memory data, and performing write protection on the target memory data; periodically detecting a local physical memory according to a preset time interval, when target memory data carrying a dirty mark is detected, initiating an RDMA write request, writing back the target memory data carrying the dirty mark to a far-end node, and when detecting that the physical memory is overtime, recovering the physical memory; by adopting the method, the data synchronization performance between the local node and the remote node can be accelerated, and the memory utilization efficiency can be improved.

The invention discloses a distributed training scheduling and communication optimization method and system of a multi-modal large model on a domestic computing power platform. The method comprises the following steps: virtualizing a heterogeneous computing unit of a preset platform into a virtual device pool, and fusing first-order gradient of a multi-modal sample and Hessian matrix information based on quantitative perception training to generate a sample sensitivity grading atlas; virtual device pool attributes and the sensitivity grading atlas are used as input, an optimal hybrid parallel configuration scheme is automatically generated through a configuration search algorithm, and a parallel combination mode, resource mapping and a high-sensitivity sample scheduling strategy are defined; a distributed training code of an integrated communication optimization strategy is automatically generated according to a configuration scheme, pipeline parallel communication and data parallel gradient synchronization constraint are executed in a topology adjacent equipment subset, and a hierarchical aggregation mechanism is adopted; and dynamically screening a core training set and scheduling a calculation task to complete distributed training. According to the method, efficient cooperative training of the multi-modal large model on the domestic computing power platform is realized.

The invention discloses a multi-type dish identification method and system capable of being used for virtual equipment, and belongs to the field of target identification of deep learning. The method comprises the following steps: collecting dish images, and analyzing and processing; constructing a dish image data set; constructing a target recognition model based on a YOLOv8 algorithm; using the dish image data set to obtain a trained dish identification model, and combining any dish image to obtain a final prediction result; converting the improved dish identification model into an ONNX format; a Pico MR environment perception application is developed by Unity, and a real environment is obtained; obtaining the dish identification model output in the ONNX format by using a Unity Sensitive plug-in; and packaging the application into an apk format, and installing the apk format in Pico 4Pro to identify and display real dishes. According to the invention, the virtual reality device is used for dish identification, consumers can more intelligently and visually know dish information by means of the virtual-reality combination visualization effect, and the service quality of catering enterprises is also positively influenced.

The invention relates to the technical field of sewage treatment supervision, and discloses a sewage plant supervision system based on digital twinning. The system comprises an operation mirror image generation module which collects data in real time and generates a digital twin mirror image of the sewage treatment facility; the virtual equipment state library construction module is used for extracting key equipment parameters based on the digital twin mirror image and dynamically updating a virtual equipment state library; the strategy optimization module is used for analyzing a sewage flow state and a pollutant migration path and generating a virtual operation strategy optimization parameter set; the abnormal response engine module is used for monitoring abnormal fluctuation of key nodes and generating an abnormal response intervention data set; and the efficiency improvement module is used for optimizing virtual processing path regulation and control parameters and generating a pollutant removal efficiency improvement scheme. According to the system, dynamic monitoring, intelligent optimization and quick response of the whole sewage treatment process are achieved through the digital twinning technology, supervision accuracy and timeliness are improved, and the system adapts to complex and changeable operation conditions.

The invention provides a digital-analog hybrid simulation method and simulator based on a QEMU, a SystemC and a SystemC-AMS. The digital-analog hybrid simulation method comprises the following steps: adding an external memory access interface and a time sequence synchronization interface in the QEMU; the method comprises the following steps: constructing a virtual CPU (Central Processing Unit) device in a SystemC; a register interface function and a logic signal function are realized by adopting a systemc model in the equipment, and a port analog signal function is realized by adopting a systemc-am model; the starting parameters are analyzed in the main program, and the simulation component is loaded; executing a virtual target machine instruction in the instruction core environment; switching to a systemc running environment, changing the value of an on-chip device register, and updating the logic function state and the port state of the device; and exiting from the systemc operation environment, and entering the operation environment of the instruction core again. The technical advantages of the QEMU, the SystemC and the SystemC-AMS are combined, a QEMU instruction set is reused, meanwhile, the hardware description language characteristics of the SystemC and the analog signal processing capacity of a simulation scheduler and the SystemC-AMS are utilized, digital-analog hybrid simulation is achieved, and the verification efficiency and accuracy of SoC design are improved.

The invention provides a multi-mode virtual-real fusion interaction method and system, and particularly relates to the technical field of man-machine interaction. According to the method, hand three-dimensional coordinate data are collected through a depth perception camera, voice data are collected through a microphone array, the hand data are input into a gesture recognition model to output operation intention parameters, real-time state data of virtual equipment are obtained according to the operation intention parameters, tactile feedback parameters are generated, and the real-time state data of the virtual equipment are obtained after linear mapping association. And generating a vibration waveform and outputting to the touch execution unit. And meanwhile, analyzing the voice data to obtain a voice instruction, and performing space-time alignment on the voice instruction and the operation intention parameter to generate a virtual-real synchronous control instruction. According to the method, the technical problems of how to realize touch feedback of linkage of gesture operation and the equipment state through a low-cost and low-delay natural interaction mode and how to improve the multi-mode instruction cooperation capability so as to reduce the misoperation rate are solved, and accurate touch feedback of linkage of gesture operation and the virtual equipment state is realized; and the multi-mode instruction cooperation capability is improved, and the misoperation rate is remarkably reduced.

The invention discloses a development machine GPU resource dynamic regulation and control method, a computer device and a medium, and the method comprises the steps: responding to a development machine creation request, creating a user-defined resource object containing development machine configuration information, creating a target Pod in a Kubernetes cluster, determining a to-be-scheduled target GPU node, obtaining the GPU application number of the to-be-scheduled target GPU node, and then determining a target physical GPU, creating a virtual GPU device file on the host, and establishing a soft link between the virtual GPU device file and the target physical GPU; after the creation is completed, starting a development machine container and mounting the virtual GPU equipment file into the container; when it is monitored that the container GPU resource idle information meets the preset idle condition, the soft link is released, and the real GPU state is updated to be idle. According to the method, container mirror images and original K8s deployment logic do not need to be modified, sharing and multiplexing of GPU resources among multi-container development machines are supported, and the GPU resource utilization rate is remarkably increased.

A simulation system may comprise a headset and an equipment. A wireless communication interface of the headset may receive position information from the equipment. The headset may detect a passively-instrumented object represented in a captured image. The headset may detect a wearable device coupled to the passively-instrumented object. The headset may determine position information for the passively-instrumented object. The headset may present an image of virtual equipment corresponding to the equipment in accordance with the position information from the equipment and the position information detected for the passively-instrumented object.

The present disclosure relates to implementing, updating, and managing operation of a client agent on a client device (e.g., computing device, virtual device) in a way that enables isolation of features and functionality while also allowing the client agent to self-heal and intelligently update discrete features thereon. The client agent includes a collection of plugins that are isolated and run in accordance with respective plugin policies. The client agent makes use of device-level, agent-level, and plugin-level health monitors that collectively monitor a health status of discrete components of the client agent in a way that enables the client agent to selectively discontinue scheduling certain plugins without interrupting functionality of other plugins or of the client agent as a whole. Indeed, features described herein enable the client agent to intelligently update and self-heal with respect to individual plugins based on information obtained by the respective health monitors.

The invention provides a power plant equipment fault prediction method and system fusing digital twinning, and relates to the technical field of data processing, and the method comprises the steps: collecting real-time multi-modal time sequence operation data of equipment, and carrying out the preprocessing of the data through an edge calculation node, and obtaining the preprocessed multi-modal time sequence data; according to the preprocessed multi-modal time sequence data, dynamically evolving the running state of the virtual equipment through a multi-physical field coupling model in the digital twin, and carrying out online calibration on rigidity, damping and heat conduction coefficient parameters in the twin model by taking actual measurement data of a physical entity as a benchmark; generating simulation data consistent with the physical entity in a time-frequency domain; time domain, frequency domain and time-frequency domain feature fusion is carried out on simulation data and various fault samples in a historical fault database, and a high-dimensional initial feature set is constructed; the safety and the economic efficiency are improved.

There is provided a configuration entity in a wireless communication network, the configuration entity comprising a receiver, a processor and a transmitter. The receiver is arranged to receive a service requirement for communication of virtual devices within a virtual experience service at the wireless communication network, wherein each virtual device corresponds to a physical device identified by a subscriber identity. The processor is arranged to discover a plurality of candidate digital and physical devices for a given area and based on the received service requirement. The processor is further arranged to derive one or more session requirements from the received service requirement; wherein a session is established between any combination of the plurality of candidate digital and physical devices. The processor is further still arranged to determine a parameter for each session. The transmitter is arranged to transmit the determined parameter to at least one network node.

The embodiment of the invention relates to the technical field of semiconductor processing, and discloses a semiconductor virtual machine system, method, equipment and medium. The system comprises a basic physical module, and the basic physical module comprises a loading port, a mechanical arm and a processing unit and is used for simulating transmission and processing behaviors of wafers in a machine table; the virtual equipment control platform is connected with the basic physical module and is used for controlling the basic physical module according to a received instruction of a host system; the communication module defines a communication interface of a virtual machine based on an SEM I standard, and communicates with the host system; and the behavior model is used for defining a transportation flow and a processing flow of the wafer. The technical problem that the compatibility of a virtual machine is poor can be solved at least.

The invention relates to a packaging method for modeling and production unit combination of digital twin virtual equipment, which realizes modeling of the virtual equipment through an abstract process from top to bottom, and ensures high cohesion packaging of key attributes, states and behaviors of the virtual equipment in combination with an information hiding and uniform interface mechanism. A production unit-level combination and hierarchical packaging framework is further constructed based on the equipment model, and recursive combination and interoperation of multiple layers of modules are realized through unified station-level, production line-level and workshop-level interfaces and scheduling logic; according to the method, the modeling and packaging process of the digital twin virtual equipment is defined, the high cohesion packaging and interface uniformity of the model are highlighted, and cross-level combination and scheduling logic design are supported, so that the consistency and the implementability of the model in the system integration, evolution extension and module multiplexing processes are remarkably improved, and the modeling efficiency of the digital twin virtual equipment is improved. And universal and normalized technical support is provided for hierarchical construction and efficient deployment of virtual equipment in an intelligent manufacturing system.

The invention discloses a server system based on a public cloud technology and an access method thereof, and belongs to the technical field of cloud services. The server system comprises a server and an external device inserted in the server. A virtual machine manager in the server is used for providing a virtual external device and a virtual memory for a virtual machine in the server, the virtual external device is obtained through device simulation based on the external device, and the virtual memory is obtained through device simulation based on a memory configured for the external device. The virtual device driver of the virtual external device is used for sending an access request carrying the target GPA to the external device when the virtual external device accesses the target GPA of the virtual memory. And the external device is used for obtaining a target host physical address corresponding to the target client physical address based on the access request, obtaining target data recorded by the target host physical address, and sending the target data to the virtual device driver. According to the invention, the address translation performance of the server system is effectively improved.

The invention discloses a virtual interaction system for realizing multi-dimensional perception, which relates to the technical field of virtual interaction, and comprises a man-machine interaction unit, a mapping matching unit, a data processing unit and a data processing unit, and the coordinate matching module is responsible for establishing a coordinate matching relation of the virtual object in the virtual space according to the size, shape and attitude parameters of the virtual object. The interaction device is operated to control the intelligent mark point in the virtual interaction system to interact with the target object, according to the position relation in the interaction process, the position posture of the interaction object is collected to determine whether contact occurs, event triggering and target interaction are achieved through the triggering control unit, a user senses the event, and the interaction efficiency is improved. Interaction requirements can be met, multi-target interaction control requirements are met, and the purpose of saving system resources is achieved.

The invention provides a model training recovery method and electronic equipment, and the method comprises the steps: obtaining task processes of executing a large model training task by a plurality of pieces of processing equipment and equipment information of the plurality of pieces of processing equipment in response to a failure of first processing equipment in the plurality of pieces of processing equipment; based on the task process and the device information, updating a first communication topological relation of the plurality of processing devices to obtain a second communication topological relation; the communication topological relation represents a communication connection mode between the virtual devices corresponding to the processing devices; and sending the second communication topological relation to the processing equipment which does not have the fault.

The invention discloses a power distribution automation control method and device based on virtual bus communication, and relates to the technical field of power distribution automation, and the method comprises the steps: registering a physical communication interface to a drive chain table, and achieving the standardized operation of the physical interface through a drive layer; configuring a physical communication interface as a virtual communication interface, registering the virtual communication interface to a virtual bus linked list, and realizing unified scheduling and data interaction of multiple interfaces through a virtual bus layer; physical communication equipment is configured as virtual communication equipment, the virtual communication equipment is registered to a virtual equipment linked list, and equipment function mapping and protocol adaptation are completed through a virtual equipment layer; registering a physical equipment instance to an equipment instance linked list, and realizing data transceiving and control instruction execution through an equipment instance layer; based on a virtual bus architecture, different communication protocols and transmission modes are dynamically matched so as to communicate heterogeneous equipment. According to the application, diversified field application requirements can be met, and the communication configuration efficiency between the power distribution automation terminal and the external equipment is improved.

The embodiment of the invention provides a command processing method and related equipment.The command processing method applied to a processor comprises the steps that command encryption information sent by a virtual machine manager is obtained, and the command encryption information comprises a memory address of target command data and a virtual equipment identifier of target virtual equipment; based on the virtual device identifier, determining memory key information corresponding to the target virtual machine; based on the memory key information and the memory address of the target command data, performing decryption to obtain a plaintext of the target command data; and executing a target command based on the plaintext of the target command data to obtain a command result of the target command. According to the command processing method and the related equipment, the data security of the virtual machine in the process of running the virtual equipment is improved.

The embodiment of the invention provides a dynamic mapping method and system for a cloud host with a direct connection device, and the method comprises the steps: in the initialization process of the cloud host, initializing a first virtual device through a virtual layer to obtain the memory configuration of the cloud host, and enabling a memory space address required by a driver directly connected to the cloud host in the memory configuration to be default; initializing a corresponding memory space in the direct connection equipment in a process of initializing an operating system of the direct connection equipment in the virtual layer; physical memory missing page interruption is caused by default of the configured memory space address required by the driver, the memory space address required by the driver is allocated to the cloud host, and the allocated memory space address required by the driver is associated with a virtual machine hardware address of the cloud host in a middle-layer data table; and when the cloud host is operated, applying for a corresponding memory space in the direct connection device according to the memory space address required by driving in the memory address mapping relationship, so that the direct connection device is directly connected to the cloud host. According to the invention, the time of direct connection of the direct connection device to the cloud host can be accelerated.

The invention discloses a method for communication between jailhome partitions. The method comprises the following steps: configuring a jailhome cell configuration file according to hardware platform resources and task requirements in a cell; compiling and operating jailhouse, starting an inmate cell, and completing registration of a destination port and a source port and memory mapping of an FIFO annular buffer area; sending data to the virtual PCI device through a source port, filling in a Doorbell register after data sending is completed, and sending an interrupt signal to a destination port through a Hypervisor; reading data from the virtual PCI device through the destination port; and after the application program of the destination port receives the data, executing the predefined task. According to the method, the controllability, verifiability and adaptation flexibility of communication behaviors are enhanced, and the method is suitable for safety key scenes with strict requirements for high-frequency, small-data-volume, low-delay and deterministic communication.

The invention discloses an equipment topology simulation method and device, a chip, a medium and electronic equipment. The method comprises the following steps: acquiring equipment configuration information and dictionary data, and creating an equipment topological relation tree based on the dictionary data and the equipment configuration information; traversing the device topological relation tree, and creating a virtual device according to the traversed device information; and receiving a scanning message sent by a host end, performing data reading and writing on the configuration space of the virtual equipment in the equipment topological relation tree based on the scanning message, and sending a data reading and writing result to the host end, so that the host end performs equipment topological simulation. The equipment topology relation tree is constructed through the equipment configuration information and the dictionary data, equipment topology simulation is realized through message transmission with the host end, the equipment topology simulation is not limited by equipment types, code upgrading is not needed, and the flexibility and expansibility of the equipment topology simulation are improved.

The invention relates to the field of artificial intelligence, and provides a resource management method, electronic equipment and a storage medium, and the method comprises the steps: obtaining equipment information of computing equipment deployed at a node, and reporting the equipment information to a cluster end, so as to trigger the cluster end to create equipment resources based on the equipment information; registering virtual equipment information and reporting the virtual equipment information to a cluster end; when the resource management request is monitored, querying a resource deployment unit corresponding to the resource management request, determining target device information from device binding resources of the resource deployment unit, and mounting a computing device corresponding to the target device information to the resource deployment unit; the device binding resource is created by the cluster end based on the resource management request and the virtual device information, and the target device information is device information of a target device resource selected by the cluster end from unbound device resources based on the device binding resource. According to the method, the device and the storage medium provided by the invention, fine-grained resource management is realized, and the performance and efficiency of resource management are improved.

The invention discloses an extracorporeal membrane oxygenation VR training system, which comprises a virtual scene construction module, and is characterized in that the virtual scene construction module carries out modeling on an operating room environment and ECMO equipment based on modeling software; the VR virtual interaction operation module performs virtual scene interaction between the trainee and the virtual scene and the virtual device through the interaction device; the ECMO pre-flushing operation process module generates standard steps and specification requirements based on the construction of the virtual scene and the interaction information of the VR virtual interaction operation module; the multi-person cooperation module is used for distributing persons participating in training according to different roles and playing different persons in a virtual scene for cooperative training; the training content management module is used for managing the ECMO training content of trainees; organic combination of practical training and cyclic training can be achieved, the situation that current ECMO professional medical talents are in shortage is effectively improved, and then the treatment success rate and the medical service quality of critical patients are improved.

The invention discloses a virtual USB device connection method, system and device and a storage medium, and relates to the field of computers.The method comprises the steps that in response to a connection instruction of a target USB device, a virtual machine creates a corresponding USB device virtual instance for the target USB device through a virtual USB controller and generates a connection data packet; and forwarding the connection data packet to a USB hub through a rear-end driver, so that the USB hub controls the connection of the target USB device according to the USB device virtual instance identifier. By allocating a unique identifier to each virtual USB device instance, it is ensured that USB device access between different virtual machines is isolated, and data leakage and unauthorized access are prevented. The virtual machine is allowed to access the physical USB device through the virtual USB controller, thereby enabling the virtual machine to access the USB device as accessing the local device.

The invention discloses a method and system for adapting an industrial intelligent gateway to multiple industrial protocols, and relates to the technical field of industrial Internet of Things edge computing, and the method comprises the steps: monitoring industrial network traffic self-learning, and constructing a protocol fingerprint database; dynamically constructing a virtual equipment twinborn body based on the fingerprint database to form a simulation environment; automatically verifying protocol configuration in a simulation environment; the application verification configuration is connected with the entity device to collect data; performing in-stream calculation processing on the data stream in real time to generate an advanced event and feature data; according to the method, automatic identification and compatibility of unknown protocols are realized, production accidents are avoided through virtual simulation verification, data value extraction is synchronously completed in the data acquisition process, and the security, reliability and data processing efficiency of protocol adaptation are effectively improved.

The invention belongs to the technical field of medical training, and particularly relates to a method and a system for constructing a virtual operating room resource library for reappearing an offshore operation scene, and the method comprises the following steps: 1, collecting offshore medical data and scene demands: collecting an offshore environment and medical data, and determining medical care core capability demands; in the application, coupling parameters generated by a sea condition dynamic sensing module drive a mixed reality scene rendering module to present real shake and environment change; meanwhile, parameters are synchronously input to the equipment modeling module, fault response of virtual equipment is triggered, a user operates the virtual equipment through the interaction module and executes an operation on a virtual human body model, and the resource library management module guarantees reusability and updatability of resources in the whole process. Through real-time data linkage among the modules, total-factor dynamic coupling of sea conditions, scenes, equipment and operation objects is finally realized, and the problem of simulation distortion of a traditional system is solved.

The invention relates to the technical field of medical training, and discloses a sputum suction operation training method and system based on a virtual reality technology. The method comprises the steps that historical operation records of a trainee are collected, key operation nodes are extracted, and an airway state model of a virtual patient is constructed based on the nodes; secondly, setting a virtual sputum suction equipment model, performing a multi-working-condition simulation test on the virtual sputum suction equipment model to obtain operation response characteristics, and mapping the equipment model into the virtual airway state model; then calculating a secretion distribution parameter of a virtual airway in a training period and a theoretical clearance load of virtual equipment, and combining operation response characteristics to obtain an operation intensity parameter; generating an operation triggering instruction sequence based on the operation intensity parameter, and performing staged operation control on the virtual equipment according to the sequence; and finally, carrying out quantitative evaluation on the operation effect of the virtual equipment in the virtual airway. According to the method, a targeted virtual training scene can be constructed, a real operation response is restored, and accurate tracking and effect quantitative evaluation of the operation process are realized.

The present invention belongs to the field of virtual character generation and relates to interactive testing technology, which is used to solve the problem that the existing technology cannot generate virtual characters for simulation training. Specifically, it is a virtual character interaction design generation method based on multimodal perception, including a character generation sub-method and a test optimization sub-method; the character generation sub-method includes the following steps: "Virtual image setting conception": setting basic parameters of the virtual character, the basic parameters include image style, category, positioning and basic information, the basic information includes gender, age, appearance characteristics and personality characteristics, realizing first-person perspective roaming and device interactive operation, allowing users to operate virtual devices; the present invention can simulate gas stations, oil depots and other depot scenes, and can also develop emergency accident scenes for simulation training. At the same time, it combines key technologies such as 3D modeling and emergency simulation to ensure training effects.