5553 results about "Virtual reality" patented technology

A system and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs of a system user. The system comprises a computer-readable memory, a video camera for generating video signals indicative of the gestures of the system user and an interaction area surrounding the system user, and a video image display. The video image display is positioned in front of the system user. The system further comprises a microprocessor for processing the video signals, in accordance with a program stored in the computer-readable memory, to determine the three-dimensional positions of the body and principle body parts of the system user. The microprocessor constructs three-dimensional images of the system user and interaction area on the video image display based upon the three-dimensional positions of the body and principle body parts of the system user. The video image display shows three-dimensional graphical objects within the virtual reality environment, and movement by the system user permits apparent movement of the three-dimensional objects displayed on the video image display so that the system user appears to move throughout the virtual reality environment.

A method and apparatus for determining the position and orientation of a remote object relative to a reference coordinate frame includes a plurality of field-generating elements for generating electromagnetic fields, a drive for applying, to the generating elements, signals that generate a plurality of electromagnetic fields that are distinguishable from one another, a remote sensor having one or more field-sensing elements for sensing the fields generated and a processor for processing the outputs of the sensing element(s) into remote object position and orientation relative to the generating element reference coordinate frame. The position and orientation solution is based on the exact formulation of the magnetic field coupling as opposed to approximations used elsewhere. The system can be used for locating the end of a catheter or endoscope, digitizing objects for computer databases, virtual reality and motion tracking. The methods presented here can also be applied to other magnetic tracking technologies as a final "polishing" stage to improve the accuracy of their P&O solution.

A design professional such as an interior designer running a browser program at a client computer (i) optionally causes a digital image of a room, or a room model, or room images to be transmitted across the world wide web to a graphics server computer, and (ii) interactively selects furnishings from this server computer, so as to (iii) receive and display to his or her client a high-fidelity high-quality virtual-reality perspective-view image of furnishings displayed in, most commonly, an actual room of a client's home. Opticians may, for example, (i) upload one or more images of a client's head, and (ii) select eyeglass frames and components, to (iii) display to a prospective customer eyeglasses upon the customer's own head. The realistic images, optionally provided to bona fide design professionals for free, promote the sale to the client of goods which are normally obtained through the graphics service provider, profiting both the service provider and the design professional. Models of existing objects are built as necessary from object views. Full custom objects, including furniture and eyeglasses not yet built, are readily presented in realistic virtual image.

Also, a method of interactive advertising permits a prospective customer of a product, such as a vehicle, to view a virtual image of the selected product located within a customer-selected virtual scene, such as the prospective customer's own home driveway. Imaging for all purposes is supported by comprehensive and complete 2D to 3D image translation with precise object placement, scaling, angular rotation, coloration, shading and lighting so as to deliver flattering perspective images that, by selective lighting, arguably look better than actual photographs of real world objects within the real world.

Invention is apparatus for using selectable instruments in virtual medical simulations with input devices actuated by user and resembling medical instruments which transmit various identifying data to the virtual computer model from said instruments which have been selected; then, said apparatus assist in creating full immersion for the user in the virtual reality model by tracking and homing to instruments with haptic, or force feedback generating, receptacles with which said instruments dock by means of a numerical grid, creating a seamless interface of instrument selection and use in the virtual reality anatomy.

A design professional such as an interior designer, furniture sales associate or advertising designer running a browser program at a client computer (i) uses the world wide web to connect to a graphics server computer, and (ii) interactively selects or specifies furnishings or other objects from this server computer and previews the scene and communicates with the server, so as to (iii) receive and display to his or her client a high-fidelity high-quality virtual-reality perspective-view photorealistic image of furnishings or other objects displayed in, most commonly, a virtual representation of an actual room of a client's home or an advertisement scene. The photorealistic images, optionally provided to bona fide design professionals and their clients for free, but typically paid for by the product's manufacturer, promote the sale to the client of goods which are normally obtained through the graphics service provider's customer's distributor, profiting both the service provider and the design professional. Models, textures and maps of existing objects are built as necessary from object views or actual objects. Full custom objects, including furniture and other products not yet built, are readily presented in realistic virtual image. Also, a method of interactive advertising permits a prospective customer of a product, such as furniture, to view a virtual but photorealistic, image of a selected product located within a customer-selected scene, such as the prospective customer's own home, to allow in-context visualization.

A virtual interactive environment enables a surgeon or other medical professional to manipulate implants, prostheses, or other instruments using patient-specific data from virtual reality models. The patient data includes a combination of volumetric data, surface data, and fused images from various sources (e.g., CT, MRI, x-ray, ultrasound, laser interferometry, PET, etc.). The patient data is visualized to permit a surgeon to manipulate a virtual image of the patient's anatomy, the implant, or both, until the implant is ideally positioned within the virtual model as the surgeon would position a physical implant in actual surgery. Thus, the interactive tools can simulate changes in an anatomical structure (e.g., bones or soft tissue), and their effects on the external, visual appearance of the patient. CAM software is executed to fabricate the implant, such that it is customized for the patient without having to modify the structures during surgery or to produce a better fit.

The present invention relates to synchronized vibration devices that can provide haptic feedback to a user. A wide variety of actuator types may be employed to provide synchronized vibration, including linear actuators, rotary actuators, rotating eccentric mass actuators, and rocking mass actuators. A controller may send signals to one or more driver circuits for directing operation of the actuators. The controller may provide direction and amplitude control, vibration control, and frequency control to direct the haptic experience. Parameters such as frequency, phase, amplitude, duration, and direction can be programmed or input as different patterns suitable for use in gaming, virtual reality and real-world situations.

Intelligent motion capture element that includes sensor personalities that optimize the sensor for specific movements and/or pieces of equipment and/or clothing and may be retrofitted onto existing equipment or interchanged therebetween and automatically detected for example to switch personalities. May be used for low power applications and accurate data capture for use in healthcare compliance, sporting, gaming, military, virtual reality, industrial, retail loss tracking, security, baby and elderly monitoring and other applications for example obtained from a motion capture element and relayed to a database via a mobile phone. System obtains data from motion capture elements, analyzes data and stores data in database for use in these applications and/or data mining. Enables unique displays associated with the user, such as 3D overlays onto images of the user to visually depict the captured motion data. Enables performance related equipment fitting and purchase. Includes active and passive identifier capabilities.

Motion capture element for low power and accurate data capture for use in healthcare compliance, sporting, gaming, military, virtual reality, industrial, retail loss tracking, security, baby and elderly monitoring and other applications for example obtained from a motion capture element and relayed to a database via a mobile phone. System obtains data from motion capture elements, analyzes data and stores data in database for use in these applications and/or data mining, which may be charged for. Enables unique displays associated with the user, such as 3D overlays onto images of the user to visually depict the captured motion data. Ratings, compliance, ball flight path data can be calculated and displayed, for example on a map or timeline or both. Enables performance related equipment fitting and purchase. Includes active and passive identifier capabilities.

A virtual reality system initiates desired real world actions in response to defined events occurring within a virtual environment. A variety of systems, such as communications devices, computer networks, and software applications, may be interfaced with the virtual reality system and made responsive to virtual events. For example, the virtual reality system may trigger a communications system to establish a communications link between people in response to a virtual event. Users, represented as avatars within the virtual environment, generate events by interacting with virtual entities, such as other avatars, virtual objects, and virtual locations. Virtual entities can be associated with specific users, and users can define desired behaviors for associated entities. Behaviors control the real world actions triggered by virtual events. Users can modify these behaviors, and the virtual reality system may change behaviors based on changing conditions, such as time of day or the whereabouts of a particular user.

The specification and drawings present a new apparatus and method for using a three-dimensional (3D) diffractive element (e.g., a 3D diffractive grating) for expanding in one or two dimensions the exit pupil of an optical beam in electronic devices. Various embodiments of the present invention can be applied, but are not limited, to forming images in virtual reality displays, to illuminating of displays (e.g., backlight illumination in liquid crystal displays) or keyboards, etc.

PCT No. PCT/DK95/00089 Sec. 371 Date Dec. 27, 1996 Sec. 102(e) Date Dec. 27, 1996 PCT Filed Feb. 27, 1995 PCT Pub. No. WO95/23493 PCT Pub. Date Aug. 31, 1995A method and apparatus for simulating the transmission of sound from sound sources to the ear canals of a listener encompasses novel head-related transfer functions (HTFs), novel methods of measuring and processing HTFs, and novel methods of changing or maintaining the directions of the sound sources as perceived by the listener. The measurement methods enable the measurement and construction of HTFs for which the time domain descriptions are surprisingly short, and for which the differences between listeners are surprisingly small. The novel HTFs can be exploited in any application concerning the simulation of sound transmission, measurement, simulation, or reproduction. The invention is particularly advantageous in the field of binaural synthesis, specifically, the creation, by means of two sound sources, of the perception in the listener of listening to sound generated by a multichannel sound system. It is also particularly useful in the designing of electronic filters used, for example, in virtual reality systems, and in the designing of an "artificial head" having HTFs that approximate the HTFs of the invention as closely as possible in order to make the best possible representation of humans by the artificial head, thereby making artificial head recordings of optimal quality.

Systems, methods and structures for combining virtual reality and real-time environment by combining captured real-time video data and real-time 3D environment renderings to create a fused, that is, combined environment, including capturing video imagery in RGB or HSV/HSV color coordinate systems and processing it to determine which areas should be made transparent, or have other color modifications made, based on sensed cultural features, electromagnetic spectrum values, and/or sensor line-of-sight, wherein the sensed features can also include electromagnetic radiation characteristics such as color, infra-red, ultra-violet light values, cultural features can include patterns of these characteristics, such as object recognition using edge detection, and whereby the processed image is then overlaid on, and fused into a 3D environment to combine the two data sources into a single scene to thereby create an effect whereby a user can look through predesignated areas or “windows” in the video image to see into a 3D simulated world, and/or see other enhanced or reprocessed features of the captured image.

A user interface enables a user to calibrate the position of a three dimensional model with a real-world environment represented by that model. Using a device's sensor suite, the device's location and orientation is determined. A video image of the device's environment is displayed on the device's display. The device overlays a representation of an object from a virtual reality model on the video image. The position of the overlaid representation is determined based on the device's location and orientation. In response to user input, the device adjusts a position of the overlaid representation relative to the video image.

Techniques and systems for enhancing delivered audio signals are disclosed which may be employed in a delivery system at a server side, a client side, or both. The techniques include forming a processed audio signal by processing audio signals through multiple pathways which operate on different frequency bands using dynamic processing and other elements, and thereafter providing recording or listening environment enhancements and other sound enhancements to the processed audio signal. Also disclosed are techniques and systems for implementing the multi-pathway processing and environmental and sound enhancements.

A computer based virtual reality trading system for trading financial products such as commodities and stocks uses a server based system for generating a virtual trading floor to simulate an exchange. Traders use local PC's to direct their individual avatars interactively on the virtual trading floor, using hand and voice signals similar to a non-virtual exchange. This allows an exchange to be de-coupled from its physical geographic location as traders in diverse locations can interact on the virtual trading floor. The system enables accurate tracking for audit of the trade activity and simplified trade clearing, while retaining the dynamics of a non-virtual exchange.

A virtual reality (VR)-based test battery wherein various neurobehavioral performance skills, including motor skills, sensory-perceptual skills, attention, and decision-making can be measured in human subjects. The invention can be used as a screening method within a virtual environment to provide an overall measure of general brain function relating to behavioral ability. In addition, the invention provides comprehensive VR-based neurobehavioral examinations tailored to individual subjects which can automatically self-adjust during operation in accordance with the specific purpose of the assessment, or for forms of cognitive or physical rehabilitation. According to the invention, patients with neurological and psychiatric dysfunctions can be assessed with physiologic monitoring as well as with anatomical and functional neuroimaging to non-invasively map the functional neuroanatomic correlates of VR-based test performance. In a preferred embodiment, the VR-based neurobehavioral testing system is portable allowing computerized tests to be administered in a desk-top or lap-top configuration, or via the Internet for tele-assessment of human subjects who are physically inaccessible to the test administrator. In a particularly preferred embodiment, the method of the invention is used for vocational assessment and training, wherein individual test scores are combined into a final metric useful for assessing a candidate's qualifications for employment, or certification in a particular skill.

Methods and systems for processing computer game videos for virtual reality replay are disclosed. The method, when executed by a processor, comprises first receiving a video recorded using a virtual camera array during a game play of a source computer game. Next, upscaling the received video to a higher resolution, and interpolating neighboring video frames of the upscaled video for insertion into the upscaled video at a server. Finally, generating a spherical video from the interpolated video for replay in a virtual reality environment. The virtual camera array includes multiple virtual cameras each facing a different direction, and the video is recorded at a frame rate and a resolution lower than those of the source computer game. The spherical videos are provided on a video sharing platform. The present invention solves the chicken-and-egg problem of mass adoption of virtual reality technology by easily generating VR content from existing computer games.

A simulator facilitating virtual welding activity. The simulator may include a logic processor based subsystem operable to generate an interactive welding environment in virtual reality space that emulates welding activity by simulating a virtual weld puddle having dynamic, real time molten metal fluidity and heat dissipation characteristics, responsive to performing a simulated welding activity in real time. The simulator may include a foot pedal device in operative communication with the logic processor based subsystem and configured to affect a characteristic of the virtual weld puddle in real time, responsive to user control of the foot pedal device. The simulator may be configured to track the movements of a mock welding tool and a mock filler wire and determine interaction between the virtual weld puddle, a corresponding virtual welding tool, and a corresponding filler wire in virtual reality space that would result in the welding tool becoming contaminated.

A stereoscopic endoscope system for producing images that can be perceived in three dimensions. An endoscope apparatus includes a sheath carrying a light source and two independent fixed lens endoscopes. Collimated light from the proximal ends of each endoscope are directed along folded optical paths to independent video cameras. The images generated by the video cameras energize monitors in a virtual reality display device that can be positioned proximate an observer's eyes. Adjustable mirrors and the provision of the rotation of at least one of the video cameras on its axis facilitate the alignment of the images for maximum effect.

A mobile social networking system that provides aspects of an augmented reality experience comprising a wireless infrastructure; at least one central server having a at least one database of users; a mobile scanner that scans for other users through the use of an identification mechanism, queries the server, and downloads the user profiles and displays them on an inconspicuous viewing device. An unobtrusively manipulable input device is used to select and navigate through the profiles. The invention provides a system for obtaining additional social and other information about nearby users in an unobtrusive manner to avoid detection by others.

A multi-user virtual reality universe (VRU) process receives input from multiple remote clients to manipulate avatars through a modeled 3-D environment. A VRU host models movement of avatars in the VRU environment in response to client input, which each user providing input for control of a corresponding avatar. The modeled VRU data is provided by the host to client workstations for display of a simulated environment visible to all participants. The host maintains personalized data for selected modeled objects or areas that is personalized for specific users in response to client input. The host includes personalized data in modeling the VRU environment. The host may segregate VRU data provided to different clients participating in the same VRU environment according to limit personalized data to authorized users, while all users receive common data.

Platforms, systems, media, and methods for providing virtual reality (VR) tour builder and editor applications, multi-modal VR tour applications, and VR tour analytics applications useful in real estate sales and marketing, advertising, entertainment, education, healthcare scenarios.

Disclosed are methods and systems for a virtual reality simulation and display of limb movement that facilitate the development and fitting of prosthetic control of a paralyzed or artificial limb. The user generates command signals that are then processed by the control system. The output of the control system drives a physics-based simulation of the limb that simulates the limb to be controlled. The computed movements of the model limb are displayed to the user as a 3D animation from the perspective of the user so as to give the impression that the user is watching the actual movements of his/her own limb. The user learns to adjust his/her command signals to perform tasks successfully with the virtual limb. Alternatively or additionally, the errors produced by the virtual limb and/or the responses of the user during the training process can provide information for adapting the properties of the control system itself.

A portable virtual reality device is disclosed that will facilitate the effective and efficient screening for TBI in military personnel in forward deployed military settings or remote locations using minimally trained staff. This includes the establishment of a protocol that will provide cost effective pre-screening of military personnel prior to deployment to establish a baseline of brain function prior to possible future injury. The efficiency of the device will promote subsequent follow-up screening to assess the effectiveness of prescribed TBI treatment. Further protocols for diagnosis and rehabilitation applications using the same virtual reality portable device will allow more advanced usage for clinicians providing ongoing evaluation and treatment.

A locomotion platform device enables a user to perform a simulation of various motions including walking and running. The device comprises a locomotion platform having a concave upward facing surface. The platform and/or the user's footwear incorporate a mechanism to reduce friction between the user and the surface of the platform in order to allow the user's feet to move freely.

A virtual reality display apparatus and display method thereof are provided. The display method includes displaying a virtual reality image; acquiring object information regarding a real-world object based on a binocular view of the user; and displaying the acquired object information together with the virtual reality image.

Methods and systems for presenting an object on to a screen of a head mounted display (HMD) include receiving an image of a real-world environment in proximity of a user wearing the HMD. The image is received from one or more forward facing cameras of the HMD and processed for rendering on a screen of the HMD by a processor within the HMD. A gaze direction of the user wearing the HMD, is detected using one or more gaze detecting cameras of the HMD that are directed toward one or each eye of the user. Images captured by the forward facing cameras are analyzed to identify an object captured in the real-world environment that is in line with the gaze direction of the user, wherein the image of the object is rendered at a first virtual distance that causes the object to appear out-of-focus when presented to the user. A signal is generated to adjust a zoom factor for lens of the one or more forward facing cameras so as to cause the object to be brought into focus. The adjustment of the zoom factor causes the image of the object to be presented on the screen of the HMD at a second virtual distance that allows the object to be discernible by the user.

Systems and methods generate a video for virtual reality wherein the video is both panoramic and spatially indexed. In embodiments, a video system includes a controller, a database including spatial data, and a user interface in which a video is rendered in response to a specified action. The video includes a plurality of images retrieved from the database. Each of the images is panoramic and spatially indexed in accordance with a predetermined position along a virtual path in a virtual environment.

A user of a modeling application modifies an initial virtual object using a sketch drawn on one or more construction planes. Typically, construction planes are connected by an axis that intersects the virtual object. The user can draw a sketch on each construction plane, and the modeling application interpolates a shape along the axis between the sketches to determine what material in the virtual object is to be removed from it. In this manner, material may be removed to create a recess or hole in the virtual object or otherwise to slice away material from the object. A user can use two or more axes and construction planes to produce complex shapes from the initial virtual object. A user can also select a portion of a virtual object and mirror the selected portion. Modifications that the user makes in the selected portion are made correspondingly in the mirrored portion.