2302results about How to "Improve realism" patented technology

A method of the present invention provides a user with an interactive virtual representation of a geographic location expressed to the user through a three-dimensional or a two dimensional representations and combination thereof generated by a system controlled by an operator. The method creates an interactive virtual tour of the geographic location by correlating a two-dimensional map with a three-dimensional representation of an interactive model to allow the user to synchronously navigate through the two-dimensional map and the interactive model in different directions.

A preferred embodiment of the method for converting text to speech using a computing device having a memory is disclosed. The inventive method comprises examining a text to be spoken to an audience for a specific communications purpose, followed by marking-up the text according to a phonetic markup systems such as the Lessac System pronunciation rules notations. A set of rules to control a speech to text generator based on speech principles, such as Lessac principles. Such rules are of the tide normally implemented on prior art text-to-speech engines, and control the operation of the software and the characteristics of the speech generated by a computer using the software. A computer is used to speak the marked-up text expressively. The step of using a computer to speak the marked-up text expressively is repeated using alternative pronunciations of the selected style of expression where each of the tonal, structural, and consonant energies, have a different balance in the speech, are also spoken to a trained speech practitioners that listened to the spoken speech generated by the computer. The spoken speech generated by the computer is then evaluated for consistency with style criteria and / or expressiveness. And audience is then assembled and the spoken speech generated by the computer is played back to the audience. Audience comprehension of spoken speech generated by the computer is evaluated and correlated to a particular implemented rule or rules, and those rules which resulted relatively high audience comprehension are selected.

A large depth of focus (DOF) display provides an image in which the apparent focus plane is adjusted to track an accommodation (focus) of a viewer's eye(s) to more effectively convey depth in the image. A device is employed to repeatedly determine accommodation as a viewer's gaze within the image changes. In response, an image that includes an apparent focus plane corresponding to the level of accommodation of the viewer is provided on the large DOF display. Objects that are not at the apparent focus plane are made to appear blurred. The images can be rendered in real-time, or can be pre-rendered and stored in an array. The dimensions of the array can each correspond to a different variable. The images can alternatively be provided by a computer controlled, adjustable focus video camera in real-time.

An interface device and method for interfacing instruments to a medical procedure simulation system serve to interface peripherals in the form of mock medical instruments to the medical procedure simulation system computer to enable simulation of medical procedures. The interface device includes a housing having a mock bodily region of interest to facilitate insertion of a mock instrument, such as an endoscope tube, into the interface device. The mock bodily region of interest may be pivotable to simulate various patient orientations. The instrument is engaged by a capture mechanism in order to measure rotational and translational motion of the instrument. An actuator is disposed within the interface device to provide force feedback to the instrument. The measured motion is provided to the computer system to reflect instrument motion on the display during the simulation. Alternatively, the interface device may be configured to accommodate instrument assemblies having a plurality of nested instruments (e.g., sheath, catheter and wire), whereby the interface device individually grasps, measures manipulation of and provides force feedback to the nested instruments. In addition, the interface device may be configured to simultaneously accommodate a plurality of independently inserted instruments.

A videoendoscopic surgery training system includes a housing defining a practice volume in which a simulated anatomical structure is disposed. Openings in the housing enable surgical instruments inserted into the practice volume to access the anatomical structure. A digital video camera is disposed within the housing to image the anatomical structure on a display. The position of the digital video camera can be fixed within the housing, or the digital video camera can be positionable within the housing to capture images of different portions of the practice volume. In one embodiment the digital video camera is coupled to a boom, a proximal end of which extends outside the housing to enable positioning the digital video camera. The housing preferably includes a light source configured to illuminate the anatomical structure. One or more reflectors can be used to direct an image of the anatomical structure to the digital video camera.

A video / computer game machine maps external images onto animated game players in a game program. An image of a person's face may be mapped onto the head of an animated game player. The person may then play the game using the animated game player having a face that appears to be that of the person. Similarly, images of other persons can be mapped on other animated game players that appear in the video game program. Improved realism of video games is obtained by enabling individuals to create animated game players that have features, e.g., a facial image, of the individual or that were selected and imported by the individual.

A display device, generating light flux containing image information and making the light flux incident to one-eye of an image viewer by controlling an angle of divergence of the light flux is provided. The device includes a first lens, a second lens and an angle of divergence control device provided between the first lens and the second lens, the angle of divergence control device being configured to control the angle of divergence of the light flux.

An optical system is provided, for example for use with a display device, for varying the shape of a surface in which an image displayed by the display device is perceived. The optical system comprises first and second spaced-apart partial reflectors, at least one of which is switchable between a first non-flat shape and a second different shape, which may be flat or non-flat. The reflectors, together with polarisation optics, provide a light path such that light from the display is at least partially transmitted by the first reflector, partially reflected by the second reflector, partially reflected by the first reflector and partially transmitted by the second reflector. Light which does not follow the light path is prevented from leaving the optical system.

A large depth of focus (DOF) display provides an image in which the apparent focus plane is adjusted to track an accommodation (focus) of a viewer's eye(s) to more effectively convey depth in the image. A device is employed to repeatedly determine accommodation as a viewer's gaze within the image changes. In response, an image that includes an apparent focus plane corresponding to the level of accommodation of the viewer is provided on the large DOF display. Objects that are not at the apparent focus plane are made to appear blurred. The images can be rendered in real-time, or can be pre-rendered and stored in an array. The dimensions of the array can each correspond to a different variable. The images can alternatively be provided by a computer controlled, adjustable focus video camera in real-time.

A new approach to tracking head motion for headphone-based sound is described. Called MTB2.0 for “Motion-Tracked Binaural with 2 Channels”, the method may be used for any 2-channel binaural signals without any increase in the bandwidth requirement. MTB2.0 provides a simple and effective means to improve the quality of headphone-based sound reproduction by sensing the orientation of the listener's head and using the sensed orientation to appropriately modify the signals sent to the two ears. MTB2.0 method increases the realism and removes some of the shortcomings of binaural sound capture and recording, as well as improves the quality of binaural rendering of stereo.

The present invention produces a combustion simulation of flames, burning logs and embers in a fuel-burning fireplace or like device. One or more light source(s), such as LEDs, are used to transmit light to and through: a flame cut-out panel or flame cut-out mask to simulate the flame effect; cut-outs in logs to simulate a burning edge of a log; elements or refractories that refract the light to simulate real burning embers. Fiber optic cables, or any other material that facilitates the transmission of light, may be used to assist in transmitting the visible light. A motor driven rotating disk that includes apertures may be used to fragment the transmission of the visible light. In addition, the light source may be controlled by a sequencing device to closely approximate the pulsing intensities of light seen in actual flames, the edges of burning logs, and ember beds.

An interface device and method for interfacing instruments to a medical procedure simulation system serve to interface peripherals in the form of mock medical instruments to the medical procedure simulation system computer to enable simulation of medical procedures. The interface device includes a housing having a mock bodily region of interest to facilitate insertion of a mock instrument, such as an endoscope tube, into the interface device. The mock bodily region of interest may be pivotable to simulate various patient orientations. The instrument is engaged by a capture mechanism in order to measure rotational and translational motion of the instrument. An actuator is disposed within the interface device to provide force feedback to the instrument. The measured motion is provided to the computer system to reflect instrument motion on the display during the simulation. Alternatively, the interface device may be configured to accommodate instrument assemblies having a plurality of nested instruments (e.g., sheath, catheter and wire), whereby the interface device individually grasps, measures manipulation of and provides force feedback to the nested instruments. In addition, the interface device may be configured to simultaneously accommodate a plurality of independently inserted instruments.

The present invention embodiments promote performance of exercise by users during a video or computer game by enabling a user to perform exercises to interact with the game. An embodiment of the present invention includes an exercise gaming device with a plurality of effector or gripping members in the form of handles to be manipulated by a user. The exercise gaming device further includes additional input devices to interact with a simulation or gaming scenario. The user applies forces to the handles to interact with the gaming scenario, thereby requiring the user to perform exercises during game play. The exercise gaming device may employ various damping mechanisms to provide resistance to the handles for the user. Alternatively, the handles may be fixedly attached to the exercise gaming device to resist the applied forces and provide isometric exercises for the user.

The invention discloses a three-dimensional virtual human head image generation method, and a method and a device of human head image motion tracking, and belongs to the field of image processing. The three-dimensional virtual human head image generation method comprises collecting a human face picture, obtaining feature points on the human face picture, wherein the feature points are used for showing a left eyebrow, a right eyebrow, a left eye, a right eye, a nose, the edge contour of a human face and a forehead portion of the human face; obtaining a personalized three-dimensional human face model according to the obtained feature points and a preset standard human face model; and carrying out texture mapping to the personalized three-dimensional human face model, and generating a three-dimensional virtual human head image. Due to the facts that the feature points which are used for characterizing feature information of the human face on a single human face picture are obtained, and are applied in the three-dimensional human face model, and the personalized three-dimensional human face model which includes the forehead portion and is good in third dimension is generated, the three-dimensional virtual human head image generation method, and the method and the device of the human head image motion tracking have the advantages of being in no need of manual marking of the feature points, greatly reducing manual processing amount, being applicable to modeling occasions which require for simpleness and speediness, and being capable of enabling the third dimension of the generated three-dimensional human head image to be greatly improved and to be high in accuracy due to the fact that the feature points include feature points of the forehead portion of the human face.

The present invention relates to a system and method for implementing an assistive emotional companion for a user, wherein the system is designed for capturing emotional as well as performance feedback of a participant participating in an interactive session either with a system or with a presenter participant and utilizing such feedback to adaptively customize subsequent parts of the interactive session in an iterative manner. The interactive presentation can either be a live person talking and / or presenting in person, or a streaming video in an interactive chat session, and an interactive session can be a video gaming activity, an interactive simulation, an entertainment software, an adaptive education training system, or the like. The physiological responses measured will be a combination of facial expression analysis, and voice expression analysis. Optionally, other signals such as camera based heart rate and / or touch based skin conductance may be included in certain embodiments.

A method and apparatus for providing dynamic force sensations for use with a force feedback interface device. A force feedback interface device is connected to a host computer that implements a graphical environment. The host sends commands and command parameters to the interface device to initiate and characterize dynamic force sensations output on a user manipulatable object, such as a joystick. The interface device can include a local microprocessor for implementing force sensations by controlling actuators and reading sensors according to the host commands. A dynamic force routine can control the dynamic force sensations by implementing a simulated physical system including a simulated mass capable of motion independent of the user object. The physical system provides forces on the user object influenced by motion of both the user object and the simulated mass.

A system and method for providing hazardous incident decision support and training includes a user interface component that receives situation definition data, a hazard assessment component and a decision aid. Decision support advice and decision prompts are presented by the system in response to the situation definition interface and hazard assessment. The hazard assessment and expert advice of the system are updated with elapsed time. In another embodiment of the present invention, graphical user interfaces are provided to display a set of menu entries wherein individual menu entries represent a hazardous incident characteristic. The user may select one or more of the menu entries to create a situation definition. Such definitions may be used, for example, to identify a hazardous agent based upon user-inputted signs and symptoms data.

A simulated physiological structure includes an image layer configured to enhance a visual appearance of the simulated physiological structure. The image layer includes a substrate onto which an image has been printed. Preferably, the substrate is a relatively thin layer, compared to other layers of material in the simulated physiological structure. Where the simulated physiological structure includes surface irregularities, the substrate is preferably sufficiently thin so as to be able to readily conform to the surface irregularities. Particularly preferred substrates include fabrics, fibrous materials, meshes, and plastic sheets. The image, which can be of an actual anatomical element, or a rendering of an anatomical element, is transferred onto the substrate using conventional printing technologies, including ink jet printing. Particularly preferred images illustrate vascular structures and disease conditions. Preferably, the substrate is coupled to an elastomeric material that forms at least part of the simulated physiological structure.

A system and method are configured to provide a videogame to one or more players. The videogame may involve a series of different virtual geographic locations at which players perform activities. A group of players may be associated with each location. The players may include virtual players controlled by artificial intelligence and one or more real world players. Players may progress through the videogame by moving from location to location, performing objectives at the various locations, and interacting with the players at the locations.

A model train control system providing a more realistic modeling of the movement, sound, smoke, and lighting effects of a model train is disclosed. A number of dynamic inputs are used to control such effects. Novel features include providing a dynamic variable speed compensator, a dynamic engine load calculator, automatic dynamic momentum, an adjustable train brake, spectrum control, a velocity controller, pressure sensitive effects, a voice activated dispatcher system, a train location and information reporter network, two digit addressing, a traffic control system, accessory control, a model train Central Control Module, and removable memory modules.

A computer simulation and virtual reality system simulates the use of a blasting nozzle to remove one or more coatings and / or rust from a virtual surface. The user operates an electronic controller in the form of a blasting nozzle that outputs a signal indicating whether the blasting nozzle controller is in an “on” position or in an “off” position. The system also has a motion tracking system that tracks the position and orientation of the blasting nozzle controller with respect to the virtual surface defined on the display screen. Simulation software in a computer generates virtual blast pattern data, and the removal of the virtual coating(s) and / or rust image from the virtual surface is displayed in real time on the display screen.

A virtual coatings application system has several features to enhance the realism of simulated spray painting. The system generally includes a display screen on which is defined a virtual surface (such as a truck door) that is intended to be virtually painted or coated by the user. Alternatively, the system includes a head-mounted display unit that displays a virtual spray painting environment in which the virtual surface is defined. The user operates an instrumented spray gun controller that outputs one or more signals representing data as to the status of the controls on the spray gun controller. The system also has a motion tracking system that tracks the position and orientation of the spray gun controller with respect to the virtual surface. Simulation software generates virtual spray pattern data in response to at least the data from the spray gun controller and the position and orientation data received from the tracking system. Virtual spray pattern images are displayed in real time on the virtual surface in accordance with the accumulation of virtual spray pattern data at each location on the virtual surface.

A virtual coatings application system has several features to enhance the realism of simulated spray painting. The system generally includes a display screen on which is defined a virtual surface (such as a truck door) that is intended to be virtually painted or coated by the user. The user operates an instrumented spray gun controller that outputs one or more signals representing data as to the status of the controls on the spray gun controller. The system also has a motion tracking system that tracks the position and orientation of the spray gun controller with respect to the virtual surface defined on the display screen. Simulation software generates virtual spray pattern data in response to at least the data from the spray gun controller and the position and orientation data received from the tracking system. Virtual spray pattern images are displayed in real time on the display screen in accordance with the accumulation of virtual spray pattern data at each location on the virtual surface.

A system providing three-dimensional visual navigation for a mobile unit includes a location calculation unit for calculating an instantaneous position of the mobile unit, a viewpoint control unit for determining a viewing frustum from the instantaneous position, a scenegraph manager in communication with at least one geo-database to obtain geographic object data associated with the viewing frustum and generating a scenegraph organizing the geographic object data, and a scenegraph renderer which graphically renders the scenegraph in real time. To enhance depiction, a method for blending images of different resolutions in the scenegraph reduces abrupt changes as the mobile unit moves relative to the depicted geographic objects. Data structures for storage and run-time access of information regarding the geographic object data permit on-demand loading of the data based on the viewing frustum and allow the navigational system to dynamically load, on-demand, only those objects that are visible to the user.

A simulated physiological structure includes an image layer configured to enhance a visual appearance of the simulated physiological structure. The image layer includes a substrate onto which an image has been printed. Preferably, the substrate is a relatively thin layer, compared to other layers of material in the simulated physiological structure. Where the simulated physiological structure includes surface irregularities, the substrate is preferably sufficiently thin so as to be able to readily conform to the surface irregularities. Particularly preferred substrates include fabrics, fibrous materials, meshes, and plastic sheets. The image, which can be of an actual anatomical element, or a rendering of an anatomical element, is transferred onto the substrate using conventional printing technologies, including ink jet printing. Particularly preferred images illustrate vascular structures and disease conditions. Preferably, the substrate is coupled to an elastomeric material that forms at least part of the simulated physiological structure.

A new approach to capturing and reproducing either live or recorded three-dimensional sound is described. Called MTB for “Motion-Tracked Binaural,” the method employs several microphones, a head tracker, and special signal-processing procedures to combine the signals picked up by the microphones. MTB achieves a high degree of realism by effectively placing the listener's ears in the space where the sounds are occurring, moving the virtual ears in synchrony with the listener's head motions. MTB also provides a universal format for recording spatial sound.

A personal display system with which a user may adjust the configuration of displayed media is provided. The personal display system may include an electronic device operative to provide media to a personal display device operative to display the received media. Using one or more optical and digital components, the personal display device may adjust displayed media to overlay features of a theater, thus giving the user of the personal display device the impression of being in the theater. In some embodiments, the personal display device may receive a user selection of a seat in the theater from which to watch the media, and may adjust the media display accordingly. In some embodiments, the personal display device may detect the user's movements using one or more sensors and may adjust the displayed image based on the user's movements. For example, the device may detect a user's head movement and cause the portion of media displayed to reflect the head movement.

The invention belongs to the technical field of human-computer interaction, and is a visual, operable and non-solid touch screen system which comprises a computer, two network cameras, a head-mounteddisplay and a calibration reference object, wherein the calibration reference object calibrates a virtual touch screen. A user can observe a real world containing the virtual touch screen, and directly operates the non-solid touch screen by hand through the head-mounted display. The invention uses two cameras for real-time image collection. The computer system carries out spatial calibration and the identification of the action of fingertip positions according to the image input by the cameras and synthesizes a corresponding image. The head-mounted display outputs the image containing the virtual touch screen to the user, and the user directly observes the feedback of the virtual touch screen through the head-mounted display. The invention can be used in the field of human-computer interaction, and is particularly suitable to be used as the equipment of human-computer interaction of a portable computer or a multimedia interaction experience system.

An apparatus for creating, utilizing a pair of oppositely opposed headphone speakers, the sensation of a sound source being spatially distant from the area between the pair of headphones, the apparatus comprising: (a) a series of audio inputs representing audio signals being projected from an idealised sound source located at a spatial location relative to the idealised listener; (b) a first mixing matrix means interconnected to the audio inputs and a series of feedback inputs for outputting a predetermined combination of the audio inputs as intermediate output signals; (c) a filter system of filtering the intermediate output signals and outputting filtered intermediate output signals and the series of feedback inputs, the filter system including separate filters for filtering the direct response and short time response and an approximation to the reverberant response, in addition to the feedback response filtering for producing the feedback inputs; and (d) a second matrix mixing means combining the filtered intermediate output signals to produce left and right channel stereo outputs.