211results about "Virtual/augmented reality" patented technology

Fiducial markers are printed patterns detected by algorithms in imagery from image sensors for applications such as automated processes and augmented reality graphics. The present invention sets forth extensions and improvements to detection technology to achieve improved performance, and discloses applications of fiducial markers including multi-camera systems, remote control devices, augmented reality applications for mobile devices, helmet tracking, and weather stations.

The invention discloses a construction method of an intelligent workshop digital twin system, and belongs to the technical field of intelligent manufacturing. The method comprises the following steps: aiming at physical workshop production elements, constructing a workshop total element multi-level twin model to obtain a digital twin workshop model; constructing a data acquisition system to acquire multi-source heterogeneous data of a physical workshop, preprocessing and standardizing the multi-source heterogeneous data, and storing the preprocessed and standardized multi-source heterogeneous data into a database; by adopting the digital twin workshop model as a client and by combination with a server, achieving interaction between the digital twin workshop client and the database so that bidirectional mapping between the digital twin workshop client and the physical workshop is realized; based on three-dimensional visualization system integration, subjecting the physical workshop model and the digital twin workshop model to deep fusion interaction to finish construction of the intelligent workshop digital twin system. Therefore, the functions of real-time state display, historical state reproduction, remote control, fault alarm, state prediction and the like are achieved, and the problems that existing digital workshop data are monotonous in presentation and poor in interaction and immersion are solved.

A virtual object display system that generates, as the machine configuration of a control target, a graph including nodes, selects a node on which a virtual object is to be displayed, notifies the node on which the virtual object is to be displayed to a machine configuration management device, calculates transformation information which includes a coordinate value of a control axis node on a path in the graph from a marker node to the node of a display target and which is used for calculating the position and / or the posture of the node of the display target in a coordinate system of the marker node based on the graph, notifies the transformation information to an augmented information controller and transforms the coordinate value of a control axis into the position and / or the posture of the node of the display target in the coordinate system of the marker node.

A process and method for generation of 3D interactive rendition of space by first digitizing the space as a TXLD file from point clouds, 2-D floor plans, photographs and / or videos, and / or elevation views then processing the file to create 3D interactive renditions of the space using virtual reality, augmented reality, or mixed reality technologies, constantly growing and evolving 3D library of digital representations of both fixtures and non-fixtures based on real products, automating and personalizing product selection and placement for a given user and target environment, using an ensemble recommendation system, which relies on weighted averages of probabilistic, content-based, clustering, and collaborative filtering models, among other suitable models that may be added to the ensemble in the future. If a medium does not necessitate 3D model creation of the environment the products are automatically placed in the medium view based on the encoded position in the TXLD file.

Embodiments provide methods and systems for constructing surrogate models for use in interactive experiences. One such embodiment begins by defining a model that includes a parametric state vector and a design variable vector and represents a real world system. Next, a first and second experiment are performed to determine a response over time of the parametric state vector and to produce a dataset of the parametric state vector and the design variable vector as a function of time. The dataset is then modified with one or more derivatives of the parametric state vector and a set of surrogate differential equations is constructed that approximates a higher derivative of the parametric state vector relative to that in the dataset and the set of surrogate differential equations is stored as a surrogate model. The surrogate model is in turn provided from memory in a manner accelerating simulated behavior in response to user-interaction with the model.

A virtual fabrication environment for semiconductor device fabrication that includes an analytics module for performing key parameter identification, process model calibration and variability analysis is discussed.

A system for generating formal premises designs is discussed. The system begins by inputting an informal two-dimensional rendering of the premises. The system continues by analyzing the informal two-dimensional rendering and determining features found on the premises depicted by the two-dimensional rendering. The system then generates a three-dimensional model of the premises and populates it with interactive objects. Finally, the system provides multiple views of the three-dimensional rendering containing interactive objects.

Fiducial markers are printed patterns detected by algorithms in imagery from image sensors for applications such as automated processes and augmented reality graphics. The present invention sets forth extensions and improvements to detection technology to achieve improved performance, and discloses applications of fiducial markers including multi-camera systems, remote control devices, augmented reality applications for mobile devices, helmet tracking, and weather stations.

The invention discloses a bridge construction management system based on BIM, and belongs to the technical field of bridge construction management. Key points of the technical scheme are as follows: the system comprises a design stage and a construction stage, the design stage is used for designing a scheme framework of a bridge. On the basis of the scheme framework, the framework is split to a construction installation unit to form a parameter table; a bridge BIM model is constructed, three-dimensional numerical finite element analysis is performede, engineering quantity calculation is performed on the bridge BIM model, cost data is generated, a part drawing is formed according to the bridge BIM model, and three-dimensional construction simulation is achieved according to the bridge model; in the construction stage, error checking is carried out through a point cloud model in combination with a bridge BIM model, and the earth-rock engineering quantity is calculated through an unmannedaerial vehicle and the BIM technology to obtain the accurate filling and digging quantity. According to the system, the technical barriers in the aspects of model delivery, information transmission and data interaction between design and construction are broken through, and an effective BIM collaborative application and communication mechanism between design and construction is established.

An embodiment provides a virtual reality experience by defining a model representing an object that includes experimental parameters. After defining the model, a model simulation is performed, using variations of the experimental parameters, that produces results for each of the one or more variations. The results include a value for a behavior of interest of the model for each of the variations. Next, the results are compressed to an interpolant comprising discrete polytope bins with continuous surrogates of the behavior of interest. Responsive to user provided values of the experimental parameters, a value of the behavior of interest is predicted using the interpolant. In turn, a virtual reality experience is provided by displaying to the user an effect on the model for the user-provided values of the one or more experimental parameters where the displayed effect on the model reflects the predicted value for the behavior of interest.

The embodiment of the invention discloses a model display method and a device in a three-dimensional house model, a computer readable storage medium and electronic equipment. The method is applied tothe electronic equipment and comprises the following steps: determining a user visual angle range in a three-dimensional house model; according to the plane house type graph, obtaining first inter-function feature information of a local model corresponding to the user visual angle range in the three-dimensional house model; wherein the planar house type drawing and the three-dimensional house model correspond to the same house; and displaying the local model, and displaying the first inter-function feature information corresponding to the local model. Compared with the prior art, the method ofthe invention can better meet the requirement of the user for understanding the house.

A system allows a user to select designs for apparel and preview these designs before manufacture. The previews provide photorealistic visualizations in two or three dimensions, and can be presented on a computer display, projected on a screen, or presented in virtual reality (e.g., via headset), or augmented reality. The system can also include a projection system that projects the new designs onto garments on mannequins in a showroom. The garments and the new designs projected onto the garments have a three-dimensional appearance as if the garments having the new designs are worn by people. Software and lasers are used in finishing the garments to produce garments with the new designs and the finished garments have an appearance of the three-dimensional appearance of the garments and new designs on the mannequins with the new designs projected onto the garments by the projection system.

A method for creating a traffic scenario in a virtual driving environment is provided. The method includes steps of: a traffic scenario-generating device, (a) on condition that driving data have been acquired which are created using previous traffic data corresponding to discrete traffic data extracted by a vision-based ADAS from a past driving video and detailed traffic data corresponding to sequential traffic data from sensors of data-collecting vehicles in a real driving environment, inputting the driving data into a scene analyzer to extract driving environment information and into a vehicle information extractor to extract vehicle status information on an ego vehicle, and generating sequential traffic logs according to a driving sequence; and (b) inputting the sequential traffic logs into a scenario augmentation network to augment the sequential traffic logs using critical events, and generate the traffic scenario, verifying the traffic scenario, and mapping the traffic scenario onto a traffic simulator.

Disclosed herein is a web-based videoconference system that allows for video avatars to navigate within the virtual environment. The system has a presented mode that allows for a presentation stream to be texture mapped to a presenter screen situated within the virtual environment. The relative left-right sound is adjusted to provide sense of an avatar's position in a virtual space. The sound is further adjusted based on the area where the avatar is located and where the virtual camera is located. Video stream quality is adjusted based on relative position in a virtual space. Three-dimensional modeling is available inside the virtual video conferencing environment.

Methods, systems and devices for assembling components to form an assembled structure, using virtual or augmented assembly tooling, in real time, real-time virtual assembly tooling (or RVAT). Structures such as vehicles, aircrafts, or other products are produced from assembling a plurality of component parts together, with virtual assembly tooling of the system, method and devices that provides real-time capability for directing and guiding operations and for generating feedback. The structure is built from the CAD, transforming the CAD to imaging representations whose transformations are generated with one or more component scans, projected on a display. The method, system and devices are constructed to build a product from a CAD through transformations of CAD information in conjunction with the real-time imaging and tracking of assembly components and tooling precise positioning of components, and controlling assembly operations, such as, for example, assembly, drilling, riveting, bonding, and welding, a product is constructed.

The invention discloses an anti-rollover driving decision method for a heavy commercial vehicle based on deep reinforcement learning. The method comprises the steps: firstly, establishing a three-lanevirtual environment model including a straight lane and a bent lane for a high-grade road; secondly, acquiring road state information and vehicle motion information; finally, modeling the anti-rollover driving decision problem as a Markov decision process, and establishing an anti-rollover driving decision model of the heavy commercial vehicle by using a depth deterministic strategy gradient algorithm to obtain anti-rollover driving decision strategies under different traffic environments and driving conditions, thereby realizing an optimal decision for active prevention and control of rollover of the heavy commercial vehicle. The decision-making method provided by the invention overcomes the defects of lack of effectiveness, environmental adaptability and the like of an existing method,and provides accurate and quantitative driving suggestions such as brake pedal opening, steering wheel angle control quantity and the like for a driver, so an effective, reliable and self-adaptive rollover prevention driving decision is realized.

In one embodiment, augmented reality is simulated by augmenting a pre-generated, physical environment-aligned 3D reality mesh. A camera system captures digital images of a site. A backend processing system generates a 3D reality mesh of the site based on the digital images, assigns metadata to infrastructure elements in the 3D reality mesh, and stores the 3D reality mesh and metadata. At a subsequent time, a mobile device accesses the 3D reality mesh and assigned metadata. A positioning sensor determines a live position of the mobile device. An orientation sensor determines a live orientation of the mobile device. Based on the live position and live orientation, a view of the 3D reality mesh aligned to the physical environment is produced and displayed on a display device of the mobile device. That view is then augmented based on the assigned metadata.

A computer-implemented method of machine-learning is described that includes obtaining a dataset of virtual scenes. The dataset of virtual scenes belongs to a first domain. The method further includes obtaining a test dataset of real scenes. The test dataset belongs to a second domain. The method further includes determining a third domain. The third domain is closer to the second domain than the first domain in terms of data distributions. The method further includes learning a domain-adaptive neural network based on the third domain. The domain-adaptive neural network is a neural network configured for inference of spatially reconfigurable objects in a real scene. Such a method constitutes an improved method of machine learning with a dataset of scenes including spatially reconfigurable objects.

The invention discloses a BIM (Building Information Modeling)-based metro station municipal pipeline relocation construction method. The method mainly comprises the following steps: detecting underground municipal pipelines in a construction area by using a radar; building an underground pipeline model by using the BIM; using a laser scanner to generate point cloud data to perform reverse modeling on the terrain and surrounding environment of the construction area; building a construction site, a station main body and an enclosure structure model of each stage, and preliminarily drawing up a pipeline relocation scheme of each stage in combination with the underground comprehensive pipeline model; optimizing a migration and modification scheme through dynamic migration and modification simulation; visually displaying the installation node deepening design through BIM; and in combination with a collaborative management platform, carrying out accurate management and control on the relocation process. The invention aims to solve the problems that the pipeline cannot be accurately positioned on the drawing, the construction communication coordination difficulty is high, the construction efficiency is low and the like.

The invention relates to a blast furnace digital twinning system based on Unity 3D. The system comprises a scene roaming module, an operation scene positioning module, a video monitoring module, a safety alarm feedback module, a self-checking feedback module, a data twinning module, a data diagnosis module and a data visualization module, wherein the data twinning module is used for carrying out intelligent processing, global perception and operation monitoring on the data returned by the blast furnace monitoring equipment, integrating historical accumulated data to carry out operation and carrying out visualization processing on the data through a three-dimensional space. According to the system, by establishing a steel mill virtual environment model, a user can overview the panoramic structure of a steel mill conveniently, and steel mill virtual environment roaming is achieved, a high-precision blast furnace body three-dimensional model is established, the blast furnace body operation technological process is restored through the three-dimensional visualization technology, the operation effect of a blast furnace body can be visually observed by a user through the virtual environment, and safe and stable operation of the blast furnace is guaranteed.

The invention discloses an aircraft pipeline AR three-dimensional registration method based on deep learning and image processing. The aircraft pipeline AR three-dimensional registration method comprises the steps of performing multi-view image acquisition on a 3D model of an aircraft pipeline part; preprocessing the acquired multi-view images to form a contour image data set under multiple views; training the contour image data set through a deep learning network; preprocessing the real object scene image of the aircraft pipeline part; sending the preprocessed real object scene image into a trained deep learning network to detect an object and a frame thereof in the real object scene image; judging whether a registered object exists in the real object scene image or not; when a registered object exists in the real object scene image, determining a six-degree-of-freedom pose of the registered object under a camera coordinate system to complete registration; otherwise, outputting the information that no registered object exists in the real object scene image. The method can support augmented reality auxiliary operation guidance for aircraft pipelines, improves the registration recognition rate, and improves the visualization effect of guidance information.

The invention discloses a workflow-based three-dimensional fire emergency plan method. The method comprises the following steps: initializing a fire accident simulation scene in a plan text; making fire-fighting topic simulation materials; constructing a plan event workflow component, including packaging workflow driving-based time and constructing a fire emergency plan template; making a three-dimensional fire emergency plan, including creating a fire point, starting an alarm, evacuating a route, rescuing the route, displaying a water source and a fire hydrant around the fire point, displaying a preset fire fighting truck placement position and a water taking position, attacking the route, spraying water and extinguishing fire; and carrying out three-dimensional fire emergency plan deduction simulation, including loading a three-dimensional fire emergency plan, carrying out deduction simulation and advancing and retreating. Therefore, the workflow-based three-dimensional fire emergency plan method provided by the invention can solve the defects caused by the fact that the traditional emergency plan takes simple text management as a main mode, and improves the expression and association of emergency measures in the aspects of space, logic, information and operability.

An auxiliary method for graphic home improvement design includes the following steps: (1) acquiring the rendered image as the graphic home improvement background image, and at the same time acquire camera parameters and depth information of the rendered image; (2) constructing a transform matrix between the projection plane coordinate system and the world coordinate system according to the camera parameters, and construct a three-dimensional model corresponding to the plane home improvement background image according to the transform matrix; (3) selecting the target position of the home improvement material on the graphic home improvement background map, place the home improvement material at the target position according to the three-dimensional space constraint conditions corresponding to the type of home improvement material, and at the same time transform the home improvement material from the physical size to the projected size according to the target position and depth information, so as to realize the auxiliary design of graphic home improvement. The graphic home improvement auxiliary design can improve the efficiency of home improvement design.

The invention discloses a digital factory simulation system based on a virtual reality technology, and mainly relates to the field of intelligent manufacturing factory systems. Comprising: a user management module used for realizing functions of user registration, login and logout of the system; the 3D factory modeling module that is used for establishing a factory 3D model based on drawing or importing an existing drawing and generating corresponding virtual reality image data based on the 3D model; the layout planning module that is used for carrying out layout on the internal area based on the obtained factory 3D model; the simulation verification module that is configured to be used for planning based on the factory 3D model and the layout; and the real scene interaction module that is used for providing interaction in a human-computer interaction mode for the user based on the VR image. The invention has the beneficial effects that a live-action three-dimensional model of a factory can be established through user operation, visual planning and prediction are carried out on the whole life cycle of an enterprise, and man-machine interaction is realized in a VR form.

A system for generating formal premises designs is discussed. The system begins by inputting an informal two-dimensional rendering of the premises. The system continues by analyzing the informal two-dimensional rendering and determining features found on the premises depicted by the two-dimensional rendering. The system then generates a three-dimensional model of the premises and populates it with interactive objects. Finally, the system provides multiple views of the three-dimensional rendering containing interactive objects.

An embodiment provides a virtual reality experience by defining a model representing an object that includes experimental parameters. After defining the model, a model simulation is performed, using variations of the experimental parameters, that produces results for each of the one or more variations. The results include a value for a behavior of interest of the model for each of the variations. Next, the results are compressed to an interpolant comprising discrete polytope bins with continuous surrogates of the behavior of interest. Responsive to user provided values of the experimental parameters, a value of the behavior of interest is predicted using the interpolant. In turn, a virtual reality experience is provided by displaying to the user an effect on the model for the user-provided values of the one or more experimental parameters where the displayed effect on the model reflects the predicted value for the behavior of interest.

The invention relates to a building robot remote operation method in a virtual-real coupling space, which comprises the following steps: S1, establishing a building virtual model, and extracting position shape information of a building entity from the building virtual model; s2, obtaining construction scene point clouds, carrying out downsampling and filtering processing to obtain filtered point clouds, segmenting the filtered point clouds to obtain point clouds of all rooms of the construction scene and obstacle point clouds, wherein the point clouds of all the rooms of the construction scene and the obstacle point clouds jointly form environment point clouds; s3, registering the building virtual model and the environment point cloud to obtain a virtual-real coupling model; and S4, establishing remote communication between the virtual building robot and the real building robot through a Socket communication protocol, and achieving remote operation. According to the method, the virtual building robot is operated to work, the real building robot in the construction scene works synchronously, the constructors do not need to monitor on site, and the safety of the constructors is guaranteed.

Disclosed herein are systems and methods for sharing and synchronizing virtual content. A method may include receiving, from a host application via a wearable device comprising a transmissive display, a first data package comprising first data; identifying virtual content based on the first data; presenting a view of the virtual content via the transmissive display; receiving, via the wearable device, first user input directed at the virtual content; generating second data based on the first data and the first user input; sending, to the host application via the wearable device, a second data package comprising the second data, wherein the host application is configured to execute via one or more processors of a computer system remote to the wearable device and in communication with the wearable device.

The invention discloses virtual reality display equipment and a display method, and aims to solve the problems of high power consumption and resource waste of virtual reality display equipment in theprior art. The display method of the virtual reality display device comprises the steps of starting an intelligent display mode in response to a first operation of a user; controlling a screen of thevirtual reality display device to be displayed in a first display area watched by human eyes at a first definition, and controlling a second display area outside the first display area to be displayedat a second definition, the first definition being higher than the second definition; and controlling a part of pixels of the second display area to perform black compensation display.

The invention relates to a mobile intelligent agent digital twinning system based on a multi-dimensional cyber space, and the system specifically comprises the following structures: a physical space test field which provides a motion space for the testing of a mobile intelligent agent as a simple physical testing environment; a cyber space operation and maintenance system which is a multidimensional mapping cyber space operation carrier is which constructed by carrying out data acquisition and fusion processing according to the physical space test field and utilizing a VR technology, an integrated entity modeling technology and a multidisciplinary joint simulation technology; a high-throughput data transmission channel which is used for providing a multiple-input-multiple-output data transmission channel for information flow interaction between the cyber space operation and maintenance system and the physical space test field; and a virtual-real multi-dimensional space visualization system which provides visualization deduction and man-machine interaction of the test process of the mobile intelligent agent test. Compared with the prior art, the system has the advantages that the many-to-one virtual-real interaction twin test capability is achieved, the generalization capability of the mobile intelligent agent test is improved, the test result is enhanced, and meanwhile, the test research and development cost is reduced.