54 results about "Haptic rendering" patented technology

The invention provides methods for leveraging data in the graphics pipeline of a 3D graphics application for use in a haptic rendering of a virtual environment. The invention provides methods for repurposing graphical information for haptic rendering. Thus, at least part of the work that would have been performed by a haptic rendering process to provide touch feedback to a user is obviated by work performed by the graphical rendering process.

Methods, articles of manufacture, and devices related to generating haptic feedback for point clouds are provided. A computing device receives depth data about an environment. The computing device generates a point cloud from the depth data. The computing device determines a haptic interface point (HIP). The computing device determines a haptic interface point (HIP). The computing device determines a force vector between the HIP and point cloud. The computing device sends an indication of haptic feedback based on the force vector.

The invention provides texture mapping techniques that facilitate interactive painting of a three-dimensional virtual surface by a user in object space, without requiring global parameterization. The texture mapping techniques feature rendering texture for a given virtual object using a plurality of composite textures, each formed by blending collapsible texture layers. Texture coordinates in texture space are derived using information determined at the time of surface mesh generation. The invention features dynamic texture allocation and deallocation, allowing a user to interactively modify the shape of a painted, three-dimensional model. Finally, the invention features an architecture for combined graphical rendering and haptic rendering of a virtual object, allowing a user to experience force feedback during the painting of the object in object space.

Long Elements Method (LEM) for real time physically based dynamic simulation of deformable objects. The LEM is based on a new meshing strategy using long elements whose forms can be straight or arbitrary. The LEM implements a static solution for elastic global deformations of objects filled with fluid based on the Pascal's principle and volume conservation. The volumes are discretised in long elements, defining meshes one order of magnitude smaller than meshes based on tetrahedral or cubic elements. The LEM further combines static and dynamic approaches to simulate the same deformable medium, allowing modeling a three-dimensional internal state at any point inside the deforming medium from a reduced number of explicitly updated elements. Complex elastic and plastic deformations can be simulated in real time with less computational effort. The LEM is particularly useful in real time virtual interactions, soft tissue modeling, and graphic and haptic rendering.

Apparatus and methods for generating virtual environment displays based on a group of sensors are provided. A computing device can receive first data about an environment from a first group of one or more sensors. The computing device can model the environment as a virtual environment based on the first data. The computing device can determine whether to obtain additional data to model the environment. After determining to obtain additional data to model the environment, the computing device can: receive second data about the environment, and model the environment as the virtual environment based on at least the second data. The computing device can generate a display of the virtual environment.

The invention discloses a haptic rendering method based on a texture image. The haptic rendering method comprises the following steps that (10) texture features are extracted, wherein the texture features comprises the texture surface microscopic height and the dynamic friction coefficient for rendering texture roughness; (20) on the basis of the texture features extracted in the step (10), haptic modeling is performed, and the resultant force of texture force is measured and calculated; (30) the resultant force of texture force measured and calculated in the step (20) is output and fed back to an operator through a hand controller. According to the haptic rendering method based on the texture image, the dynamic friction coefficient of virtual texture can be obtained with no need for specific measurement equipment, and the roughness of the virtual texture can be passed to humans without a special texture expression device.

An apparatus and method of implementing haptic-based networked virtual environments supporting high-resolution tiled displays. A haptic rendering process of detecting collision between a user of a haptic-device over a virtual environment and each of at least one virtual object and providing a physical force corresponding to a detection result to the haptic-device is performed, and a graphic rendering process of converting each virtual object represented as 3-D data into an object stream represented as 2-D data such that each virtual object is displayed as a 2-D image, and assigning a priority and a frame rate to each converted object stream according to a preset assignment criterion is performed. A plurality of displays provide a display image, including object streams of the virtual objects and background pixels, so that a virtual environment allowing the user of the haptic-device to visually and tactilely immerse thereto is effectively realized by utilizing limited resources.

The invention discloses a minitype haptic rendering method based on active and passive devices. The method comprises the steps of firstly conducting calibration on a magnetorheological damper and a continuous current dynamo, and obtaining a relationship of an input current and output torque; converting an expected force/torque value to a current of the magnetorheological damper to input, the corresponding torque is output through the magnetorheological damper, and exerting the torque to the body of an operation person through a force tactile transmission device; secondly, measuring actually exerted force/torque through a sensor installed at a force/torque point of action, comparing an actually output force/torque value with the expected force/torque value, and calculating a force/torque error; finally, converting the force/torque error to an input signal of the continuous current dynamo, and driving the continuous current dynamo to generate torque corresponding to the error. According to the minitype haptic rendering method based on the active and passive devices, minitype devices can output large-range and high-precision force/torque, thus haptic rendering equipment is more light and exquisite, and the fidelity of haptic interaction is improved; the method can be widely applied to the fields of virtual reality, teleoperation robot control, medical service and the like.

The invention discloses a texture haptic reproduction method based on image gray scale recovery shape technology. The method is characterized by comprising the following steps of 1, restoring a three-dimensional contour from a single image frame, performing color correction on acquisition equipment and acquiring color images in different angles by means of the acquisition equipment, fusing the color images, restoring a photographed image by means of a color restoring method based on polynomial regression, processing the images in different angles for obtaining gray scale images, and fusing the gray scale images; establishing a light reflection model; establishing an equation according to the gray scale and the light reflection model, and calculating the height of each point on the surface, and establishing a virtual surface triangular mesh model; and 2, performing haptic rendering on the virtual surface by means of a texture haptic model. The texture haptic reproduction method reduces a color image aberration and improves real feeling in haptic reproduction.

The invention relates to a three-dimensional haptic rendering device and a method based on plane interaction, belonging to the field of human-computer interaction. The device includes a positioning unit, a processing unit, a signal generator and an interaction unit, which can obtain the gray value and calculate the change rate of the corresponding gray value according to the position information of the finger on the image in real time, and further provide the tangential force by vibration, and provide the normal force by electrostatic force or air pressure film, and present the contour information by the three-dimensional haptic reproduction method based on the plane interaction. The advantages are: the portability of the device is good, at the same time, a tangential force and a normal force can be simultaneously applied to the finger, the feedback force is expanded from one dimension to two dimensions breaks through the restriction that electrostatic force only has feedback functionin the process of motion, the device and method realize the two-way width adjustment that the tangential force can be increased or decreased, and have more real three-dimensional haptic reproduction effect, which can be widely used in the field of human-computer interaction.

The invention relates to a dynamic video tactile feature extraction and rendering method, and belongs to the field of virtual reality and human-computer interaction. The method comprises the steps ofdecompressing a received video, preprocessing the video, segmenting shots based on inter-frame color histogram features, extracting saliency maps fused with time-space domain tactile saliency featuresfrom all the segmented frames in each shot, and performing pixel-level tactile rendering according to the saliency maps of the video frames. According to the method, the video content is divided intothe salient region and the non-salient region by extracting the video frame salient features fused with the space-time characteristics. And pixel-level tactile stimulation is applied to the video frame by adopting a one-to-one mapping relationship between the visual channels and the tactile channels. And real-time tactile feedback is generated through the terminal, so that the realistic experience of watching the video by the user is enriched. The method can be widely applied to video education, multimedia entertainment and human-computer interaction.

An access control method is performed on an equipment item linked to elements for rendering at least one haptic signal on a haptic rendering surface, wherein the haptic signal is a touch-discernible texture. The method includes, after an access request has been obtained: ordering rendering of a haptic signal; obtaining information on detection of a gesture of response to the signal; of validating the gesture of response when the gesture detected corresponds to a gesture previously associated with the haptic signal rendered; and authorizing access following the validation of the gesture.

The invention relates to an ultrasonic aerial tactile rendering method based on a three-dimensional grid model, and belongs to the field of human-computer interaction and virtual reality. Positioningof a hand ultrasonic focus point and description of local features of a three-dimensional graph are completed in a grid model mode. Grid vertexes of the three-dimensional model obtain three-dimensional coordinates through specific software; and according to the finger joint coordinates and the distance information between the palm plane and the vertex of the three-dimensional graph grid, positioning of a hand ultrasonic focus point, is completed and ultrasonic focusing is performed on positions such as edges and vertexes of the three-dimensional graph by adopting different intensities and frequencies to complete rendering of local features of the three-dimensional graph. The method has the advantages that the hand part is divided into the finger part and the palm part, ultrasonic focusingis conducted on the finger part and the palm part respectively, ultrasonic focusing is conducted on edges, vertexes and other positions of the three-dimensional graph through different intensities andfrequencies, rendering of local features of the three-dimensional graph is completed, the recognition rate of a user for the three-dimensional graph is increased, and the trueness of the three-dimensional graph is further improved.

The invention relates to a master-slave guide wire control method. The method is master-slave guide wire control based on virtual reality haptic rendering. Force touch representation is carried out atthe main hand end through force touch rendering; an operator controls a slave hand end guide wire to move through force touch information, and the force touch rendering model is a guide wire-vascularwall efficient contact detection algorithm based on any Lagrange Euler (ALE), which adopts one-dimensional arc length coordinates to determine the position of a contact detection point in any Lagrange Euler (ALE) guide wire unit. According to the method, the one-dimensional arc length coordinates are used for replacing three-dimensional Cartesian coordinates in the prior art to determine the position of the contact detection point in the ALE guide wire unit, the contact detection process between the guide wire and the blood vessel wall is simplified, and the collision detection efficiency isimproved on the premise that the precision is not changed.