205results about "Virtual/augmented reality" patented technology

The invention discloses a construction method of an intelligent workshop digital twin system, and belongs to the technical field of intelligent manufacturing. The method comprises the following steps: aiming at physical workshop production elements, constructing a workshop total element multi-level twin model to obtain a digital twin workshop model; constructing a data acquisition system to acquire multi-source heterogeneous data of a physical workshop, preprocessing and standardizing the multi-source heterogeneous data, and storing the preprocessed and standardized multi-source heterogeneous data into a database; by adopting the digital twin workshop model as a client and by combination with a server, achieving interaction between the digital twin workshop client and the database so that bidirectional mapping between the digital twin workshop client and the physical workshop is realized; based on three-dimensional visualization system integration, subjecting the physical workshop model and the digital twin workshop model to deep fusion interaction to finish construction of the intelligent workshop digital twin system. Therefore, the functions of real-time state display, historical state reproduction, remote control, fault alarm, state prediction and the like are achieved, and the problems that existing digital workshop data are monotonous in presentation and poor in interaction and immersion are solved.

A virtual fabrication environment for semiconductor device fabrication that includes an analytics module for performing key parameter identification, process model calibration and variability analysis is discussed.

A system for generating formal premises designs is discussed. The system begins by inputting an informal two-dimensional rendering of the premises. The system continues by analyzing the informal two-dimensional rendering and determining features found on the premises depicted by the two-dimensional rendering. The system then generates a three-dimensional model of the premises and populates it with interactive objects. Finally, the system provides multiple views of the three-dimensional rendering containing interactive objects.

The invention discloses a bridge construction management system based on BIM, and belongs to the technical field of bridge construction management. Key points of the technical scheme are as follows: the system comprises a design stage and a construction stage, the design stage is used for designing a scheme framework of a bridge. On the basis of the scheme framework, the framework is split to a construction installation unit to form a parameter table; a bridge BIM model is constructed, three-dimensional numerical finite element analysis is performede, engineering quantity calculation is performed on the bridge BIM model, cost data is generated, a part drawing is formed according to the bridge BIM model, and three-dimensional construction simulation is achieved according to the bridge model; in the construction stage, error checking is carried out through a point cloud model in combination with a bridge BIM model, and the earth-rock engineering quantity is calculated through an unmannedaerial vehicle and the BIM technology to obtain the accurate filling and digging quantity. According to the system, the technical barriers in the aspects of model delivery, information transmission and data interaction between design and construction are broken through, and an effective BIM collaborative application and communication mechanism between design and construction is established.

The embodiment of the invention discloses a model display method and a device in a three-dimensional house model, a computer readable storage medium and electronic equipment. The method is applied tothe electronic equipment and comprises the following steps: determining a user visual angle range in a three-dimensional house model; according to the plane house type graph, obtaining first inter-function feature information of a local model corresponding to the user visual angle range in the three-dimensional house model; wherein the planar house type drawing and the three-dimensional house model correspond to the same house; and displaying the local model, and displaying the first inter-function feature information corresponding to the local model. Compared with the prior art, the method ofthe invention can better meet the requirement of the user for understanding the house.

A system allows a user to select designs for apparel and preview these designs before manufacture. The previews provide photorealistic visualizations in two or three dimensions, and can be presented on a computer display, projected on a screen, or presented in virtual reality (e.g., via headset), or augmented reality. The system can also include a projection system that projects the new designs onto garments on mannequins in a showroom. The garments and the new designs projected onto the garments have a three-dimensional appearance as if the garments having the new designs are worn by people. Software and lasers are used in finishing the garments to produce garments with the new designs and the finished garments have an appearance of the three-dimensional appearance of the garments and new designs on the mannequins with the new designs projected onto the garments by the projection system.

A method for creating a traffic scenario in a virtual driving environment is provided. The method includes steps of: a traffic scenario-generating device, (a) on condition that driving data have been acquired which are created using previous traffic data corresponding to discrete traffic data extracted by a vision-based ADAS from a past driving video and detailed traffic data corresponding to sequential traffic data from sensors of data-collecting vehicles in a real driving environment, inputting the driving data into a scene analyzer to extract driving environment information and into a vehicle information extractor to extract vehicle status information on an ego vehicle, and generating sequential traffic logs according to a driving sequence; and (b) inputting the sequential traffic logs into a scenario augmentation network to augment the sequential traffic logs using critical events, and generate the traffic scenario, verifying the traffic scenario, and mapping the traffic scenario onto a traffic simulator.

Disclosed herein is a web-based videoconference system that allows for video avatars to navigate within the virtual environment. The system has a presented mode that allows for a presentation stream to be texture mapped to a presenter screen situated within the virtual environment. The relative left-right sound is adjusted to provide sense of an avatar's position in a virtual space. The sound is further adjusted based on the area where the avatar is located and where the virtual camera is located. Video stream quality is adjusted based on relative position in a virtual space. Three-dimensional modeling is available inside the virtual video conferencing environment.

Methods, systems and devices for assembling components to form an assembled structure, using virtual or augmented assembly tooling, in real time, real-time virtual assembly tooling (or RVAT). Structures such as vehicles, aircrafts, or other products are produced from assembling a plurality of component parts together, with virtual assembly tooling of the system, method and devices that provides real-time capability for directing and guiding operations and for generating feedback. The structure is built from the CAD, transforming the CAD to imaging representations whose transformations are generated with one or more component scans, projected on a display. The method, system and devices are constructed to build a product from a CAD through transformations of CAD information in conjunction with the real-time imaging and tracking of assembly components and tooling precise positioning of components, and controlling assembly operations, such as, for example, assembly, drilling, riveting, bonding, and welding, a product is constructed.

The invention discloses an anti-rollover driving decision method for a heavy commercial vehicle based on deep reinforcement learning. The method comprises the steps: firstly, establishing a three-lanevirtual environment model including a straight lane and a bent lane for a high-grade road; secondly, acquiring road state information and vehicle motion information; finally, modeling the anti-rollover driving decision problem as a Markov decision process, and establishing an anti-rollover driving decision model of the heavy commercial vehicle by using a depth deterministic strategy gradient algorithm to obtain anti-rollover driving decision strategies under different traffic environments and driving conditions, thereby realizing an optimal decision for active prevention and control of rollover of the heavy commercial vehicle. The decision-making method provided by the invention overcomes the defects of lack of effectiveness, environmental adaptability and the like of an existing method,and provides accurate and quantitative driving suggestions such as brake pedal opening, steering wheel angle control quantity and the like for a driver, so an effective, reliable and self-adaptive rollover prevention driving decision is realized.

In one embodiment, augmented reality is simulated by augmenting a pre-generated, physical environment-aligned 3D reality mesh. A camera system captures digital images of a site. A backend processing system generates a 3D reality mesh of the site based on the digital images, assigns metadata to infrastructure elements in the 3D reality mesh, and stores the 3D reality mesh and metadata. At a subsequent time, a mobile device accesses the 3D reality mesh and assigned metadata. A positioning sensor determines a live position of the mobile device. An orientation sensor determines a live orientation of the mobile device. Based on the live position and live orientation, a view of the 3D reality mesh aligned to the physical environment is produced and displayed on a display device of the mobile device. That view is then augmented based on the assigned metadata.

A computer-implemented method of machine-learning is described that includes obtaining a dataset of virtual scenes. The dataset of virtual scenes belongs to a first domain. The method further includes obtaining a test dataset of real scenes. The test dataset belongs to a second domain. The method further includes determining a third domain. The third domain is closer to the second domain than the first domain in terms of data distributions. The method further includes learning a domain-adaptive neural network based on the third domain. The domain-adaptive neural network is a neural network configured for inference of spatially reconfigurable objects in a real scene. Such a method constitutes an improved method of machine learning with a dataset of scenes including spatially reconfigurable objects.

The invention discloses a BIM (Building Information Modeling)-based metro station municipal pipeline relocation construction method. The method mainly comprises the following steps: detecting underground municipal pipelines in a construction area by using a radar; building an underground pipeline model by using the BIM; using a laser scanner to generate point cloud data to perform reverse modeling on the terrain and surrounding environment of the construction area; building a construction site, a station main body and an enclosure structure model of each stage, and preliminarily drawing up a pipeline relocation scheme of each stage in combination with the underground comprehensive pipeline model; optimizing a migration and modification scheme through dynamic migration and modification simulation; visually displaying the installation node deepening design through BIM; and in combination with a collaborative management platform, carrying out accurate management and control on the relocation process. The invention aims to solve the problems that the pipeline cannot be accurately positioned on the drawing, the construction communication coordination difficulty is high, the construction efficiency is low and the like.

The invention relates to a blast furnace digital twinning system based on Unity 3D. The system comprises a scene roaming module, an operation scene positioning module, a video monitoring module, a safety alarm feedback module, a self-checking feedback module, a data twinning module, a data diagnosis module and a data visualization module, wherein the data twinning module is used for carrying out intelligent processing, global perception and operation monitoring on the data returned by the blast furnace monitoring equipment, integrating historical accumulated data to carry out operation and carrying out visualization processing on the data through a three-dimensional space. According to the system, by establishing a steel mill virtual environment model, a user can overview the panoramic structure of a steel mill conveniently, and steel mill virtual environment roaming is achieved, a high-precision blast furnace body three-dimensional model is established, the blast furnace body operation technological process is restored through the three-dimensional visualization technology, the operation effect of a blast furnace body can be visually observed by a user through the virtual environment, and safe and stable operation of the blast furnace is guaranteed.

The invention discloses an aircraft pipeline AR three-dimensional registration method based on deep learning and image processing. The aircraft pipeline AR three-dimensional registration method comprises the steps of performing multi-view image acquisition on a 3D model of an aircraft pipeline part; preprocessing the acquired multi-view images to form a contour image data set under multiple views; training the contour image data set through a deep learning network; preprocessing the real object scene image of the aircraft pipeline part; sending the preprocessed real object scene image into a trained deep learning network to detect an object and a frame thereof in the real object scene image; judging whether a registered object exists in the real object scene image or not; when a registered object exists in the real object scene image, determining a six-degree-of-freedom pose of the registered object under a camera coordinate system to complete registration; otherwise, outputting the information that no registered object exists in the real object scene image. The method can support augmented reality auxiliary operation guidance for aircraft pipelines, improves the registration recognition rate, and improves the visualization effect of guidance information.

The invention discloses a workflow-based three-dimensional fire emergency plan method. The method comprises the following steps: initializing a fire accident simulation scene in a plan text; making fire-fighting topic simulation materials; constructing a plan event workflow component, including packaging workflow driving-based time and constructing a fire emergency plan template; making a three-dimensional fire emergency plan, including creating a fire point, starting an alarm, evacuating a route, rescuing the route, displaying a water source and a fire hydrant around the fire point, displaying a preset fire fighting truck placement position and a water taking position, attacking the route, spraying water and extinguishing fire; and carrying out three-dimensional fire emergency plan deduction simulation, including loading a three-dimensional fire emergency plan, carrying out deduction simulation and advancing and retreating. Therefore, the workflow-based three-dimensional fire emergency plan method provided by the invention can solve the defects caused by the fact that the traditional emergency plan takes simple text management as a main mode, and improves the expression and association of emergency measures in the aspects of space, logic, information and operability.

The invention discloses a digital factory simulation system based on a virtual reality technology, and mainly relates to the field of intelligent manufacturing factory systems. Comprising: a user management module used for realizing functions of user registration, login and logout of the system; the 3D factory modeling module that is used for establishing a factory 3D model based on drawing or importing an existing drawing and generating corresponding virtual reality image data based on the 3D model; the layout planning module that is used for carrying out layout on the internal area based on the obtained factory 3D model; the simulation verification module that is configured to be used for planning based on the factory 3D model and the layout; and the real scene interaction module that is used for providing interaction in a human-computer interaction mode for the user based on the VR image. The invention has the beneficial effects that a live-action three-dimensional model of a factory can be established through user operation, visual planning and prediction are carried out on the whole life cycle of an enterprise, and man-machine interaction is realized in a VR form.

The invention discloses virtual reality display equipment and a display method, and aims to solve the problems of high power consumption and resource waste of virtual reality display equipment in theprior art. The display method of the virtual reality display device comprises the steps of starting an intelligent display mode in response to a first operation of a user; controlling a screen of thevirtual reality display device to be displayed in a first display area watched by human eyes at a first definition, and controlling a second display area outside the first display area to be displayedat a second definition, the first definition being higher than the second definition; and controlling a part of pixels of the second display area to perform black compensation display.

The invention relates to a mobile intelligent agent digital twinning system based on a multi-dimensional cyber space, and the system specifically comprises the following structures: a physical space test field which provides a motion space for the testing of a mobile intelligent agent as a simple physical testing environment; a cyber space operation and maintenance system which is a multidimensional mapping cyber space operation carrier is which constructed by carrying out data acquisition and fusion processing according to the physical space test field and utilizing a VR technology, an integrated entity modeling technology and a multidisciplinary joint simulation technology; a high-throughput data transmission channel which is used for providing a multiple-input-multiple-output data transmission channel for information flow interaction between the cyber space operation and maintenance system and the physical space test field; and a virtual-real multi-dimensional space visualization system which provides visualization deduction and man-machine interaction of the test process of the mobile intelligent agent test. Compared with the prior art, the system has the advantages that the many-to-one virtual-real interaction twin test capability is achieved, the generalization capability of the mobile intelligent agent test is improved, the test result is enhanced, and meanwhile, the test research and development cost is reduced.

A method includes simulating a process, with computer-based software, to produce virtual data about the process; identifying process parameters for a real-world version of the process; providing a real-world sensor to sense a parameter associated with the real-world version of the process; receiving sensor readings from the real-world sensor while the real-world version is being performed; and training a machine-learning software model to predict a behavior of the real-world sensor based on the virtual data about the process, the process parameters, and the sensor readings.

Systems and methods include obtaining data capture at a cell site utilizing any of an Unmanned Aerial Vehicle (UAV), a satellite, a multiple camera apparatus, a telescoping apparatus, and a camera; creating a model of the cell site based on the data capture; processing the model to perform a plurality of measurements; utilizing the plurality of measurements to identify potential Passive Intermodulation (PIM) issues at the cell site; and displaying the identified PIM issues for mitigation thereof.