273results about How to "Enhanced Reality" patented technology

A manually actuated input device for commanding machine- and/or computer-assisted control operations for kinematic motions of a real or virtual multipart object, including a force/moment sensor with which linear displacements in the form of translational movements in the direction of three axes (X, Y, Z), each standing perpendicular on the other, of a three-dimensional rectangular system of coordinates and/or rotational excursions in the form of rotational motions (A, B, C) about these three axes are sensed and converted into commanded motions of the object to be controlled is characterized by the commanded individual linear displacements and/or rotational excursions of the force/moment sensor being assigned specific kinematic motion patterns of parts of the real or virtual object thereby permitting manipulation or animation thereof as a transforming interlink and by the commanded velocities of the corresponding individual linear displacements and/or rotational excursions of the force/moment sensor being additionally weightable as a kinematic interlink assignment. The invention can be put to use e.g. in kinematic animation operations of human-like robots, figures or virtual animate beings.

Multiple shops exist in a virtual space of a game. Each shop belongs to any one of multiple unions. When a player character buys or sells a game item at any of the shops, a power point value of the union to which the shop belongs is increased according to the sales amount. The higher the power rank of the union to which the shop belongs becomes, the more the types of sellable and buyable game items are increased. The higher the power rank of the union to which the shop belongs becomes, the more cheaply the player can buy the game item and the higher the amount the player can sell the game item. The higher the power rank of the union where the shop belongs becomes, the more points that are given to a point card according to the buying or selling of the game items.

The invention relates to a robust real-time three-dimensional (3D) reconstruction method based on a consumer camera, and aims to solve the problems of high calculation cost and inaccurate and incomplete reconstructed model in the existing method. The method comprises the following steps: 1, estimating the camera pose of each video frame under a scene coordinate system on the basis that a current video frame of a camera is used as input in the camera moving process; 2, selecting an optimized key frame in the video frame for depth estimation; 3, estimating the depth information of each video frame by adopting a quick robust depth estimation algorithm to obtain a depth map of each video frame; and 4, converting the depth map of each video frame into an unblind distance field, parallel executing weighted average of TSDF on voxel, incrementally fusing the depth map of each video frame, and constructing a triangular mesh surface by a Marching cubes algorithm. The method is applied to the field of image processing.

A collision accident simulator is composed of a vehicle for driving on a predetermined drive road and a collision object for moving in an intersectional direction for a driving direction of the vehicle and colliding with the vehicle. A collision accident simulation method for simulating a simulation collision accident is comprised of steps of riding an experience person for experiencing the simulation collision accident on any of the vehicle and the collision object and making the collision object collide with the vehicle, wherein the vehicle drives on the predetermined drive road.

This invention relates to computer implemented methods and systems for augmented reality on mobile devices, and in particular, methods and systems for mobilization of video, music, photos and other media as augmented reality. Upon a user's selection of a map marker or other object corresponding to a place in a 2-D or 3-D view, a video or other media item is dynamically encoded for the user's specific device and carrier and played on the user's phone or mobile device or sent to another phone or mobile device. The 2-D or 3-D view may be viewed from within a browser or a separate application.

A video communication method, device, and system are provided, which relate to the filed of video communications, so as to solve problems that currently scenes of two parties of communication need special arrangement to improve sense of reality and scene contents cannot be displayed in a 3D video mode. Therefore, scenes of two parties of communication do not need special arrangement to improve the sense of reality of users, and the scene contents can be displayed in a 3D video mode. The video communication method, device, and system are applicable to video communication such as common video chat, video telephony, and video conference.

A simulation method and a simulation system for a construction crane are disclosed. The simulation system includes an input device, a processing device, and a display device. The input device is used for inputting an instruction. Furthermore, the processing device includes a computation unit, a collision detection unit, a storage unit, and a graphic unit. The computation unit is used for computing the position and the direction of each part of the construction crane and the suspension parts. The collision detection model is used for detecting whether each part of the construction crane and the suspension parts will be in collision. Besides, the data obtained from the simulation method performed in the simulation system is saved in the storage unit. The graphic unit displays the 3D dynamics images of the construction crane and the suspension parts on the display device, corresponding to the data obtained from the computation unit.

A terminal apparatus is provided that has a first and a second display units; and a control unit which controls display contents of the first and the second display units respectively. The control unit displays, on the second display unit, status information as well as an operation key associated with the display contents displayed on the first display unit. The control unit changes the display contents displayed on the first display unit in response to an input with the operation key.

The invention discloses a reality augmenting method with real environment estimation and a reality augmenting system. The method comprises the following steps: initializing a system environment and configuring system parameters; selecting or extracting one marker front view and training a marker to obtain training data; calculating and correcting camera inner parameters of a marker image; correcting each frame of a real environment shot by a camera, and based on the training data, identifying the marker and calculating a relative position matrix of the marker in a camera coordinate system; and searching a corresponding virtual model by the identified marker, determining the position of the model by utilizing the position matrix of the extracted marker, drawing the virtual model, estimating illumination information of the environment in which the marker is positioned by comparing the brightness of the identified marker and brightness of the marker front view, performing real environment light source estimation to estimate the position of the real light source and generate shadow. The method and the system greatly reduce the limitation on the marker and can be used for marking maps and complex two-dimensional images.

An interactive sound playback device includes two speakers, two microphones, a motion sensor, and an audio processing unit. The speakers and the microphones are disposed at two sides of the interactive sound playback device respectively. The audio processing unit is electrically connected to the speakers, the microphones, and the motion sensor, and has a recording mode and a playing mode. In the recording mode, the audio processing unit receives a motion sensing signal from the motion sensor and a first audio signal from the microphones, stores the first audio signal, and stores the motion sensing signal as position information. In the playing mode, the audio processing unit outputs the first audio signal to the speakers through a first path, or adjusts a second audio signal by referring to the motion sensing signal and the position information, and outputs the adjusted second audio signal to the two speakers through a second path.

A method and apparatus for providing, in response to image signals originating in an object space, mixed image signals for providing nonuniform resolution images for stimulating simulated active percepts for passive perception by a viewer in an image space. The images have a highly detailed component which has its image content changed according to changes in the direction of a simulated observer's eye position in an object space. The images may be provided stereoscopically. The images may be provided at various apparent distances and the relationship between accommodation and convergence may be preserved. Audio waves for directionally simulating that which would be heard by the simulated observer may be provided.

The invention provides a method for strengthening reality having interactive function and a system thereof, comprising initializing system environment, configuring system parameters, selecting or extracting a mark front view, training the mark to obtain the training data, calculating and correcting the intrinsic parameters of the camera of the mark image; correcting each frame of the true environment shot by the camera; identifying the mark based on the training data, calculating the relative position matrix of the mark in the camera coordinate system, comparing the identified mark and the brightness of the mark front view to evaluate the lighting information of the mark in the environment; finding the corresponding virtual model according to the identified mark, using the extracted position matrix of the mark to determine the position of the model, drafting the virtue model, setting the interaction between the interactive region and the user. The invention greatly reduces the limit to the mark, and can be used for marking the map and completed two dimensional image, and also can randomly synthesize three-dimensional model on the two dimensional image.

The invention relates to an augmented reality system having a first augmented reality device and a second augmented reality device. The first augmented reality device includes a first communication module at least temporarily connected with a second communication module of the second augmented reality device via at least one data connection during an augmented reality session. Also included is a peer-to-peer network having a peer-to-peer application configured to access a second communication data set related to the second communication module. The peer-to-peer application includes a controlling means that controls the establishment of the data connection between the first communication module and the second communication module by providing the second communication data set to the first communication module via a peer-to-peer module assigned to the first augmented reality device such that the first communication module establishes the data connection based on the provided second communication data set.

The invention discloses a reality augmenting method and a reality augmenting system based on image characteristic point extraction and random tree classification. The method comprises the following steps: initializing a system environment and configuring system parameters; selecting or extracting one marker front view and training a marker to obtain training data; calculating and correcting camera inner parameters of a marker image; correcting each frame of a real environment shot by a camera, and based on the training data, identifying the marker and calculating a relative position matrix of the marker in a camera coordinate system; and searching a corresponding virtual model by the identified marker, determining the position of the model by utilizing the position matrix of the extracted marker, and drawing the virtual model. The method and the system greatly reduce the limitation on the marker, can be used for marking maps and complex two-dimensional images, and can synthesize a three-dimensional model on any two-dimensional image to achieve three-dimensional and vivid effects.

Systems and methods for generating a true 3-D display, where each of a viewer's eyes not only sees a different scene, but the scene changes continuously as the viewer moves his/her head or change his/her position from one angular location to another angular location with respect to the display screen. In one embodiment, a system comprises a set of 2-D image projectors and a display screen. The 2-D image projectors are configured to project individual 2-D images substantially in focus on the display screen. The display screen then diffuses (or reflects) each pixel from each of the 2-D images into a small angular slice. This enables the viewer observing the display screen to see a different one of the 2-D images with each eye. Further, the image seen by each eye varies as the viewer moves his or her head with respect to the display screen.

The invention discloses a geographic information guide method and a system based on augment reality, which mainly solves the problem that the existing map-type geographic information guide method has poor intuition and needs to identify geographic direction. The guide method of the invention is as follows: firstly, collecting a plurality of images from different angles, and determining the projection coordinate of a target space point on a specified initial image plane by geometric calculation; secondly, accurately determining the coordinate of the target space point in a real-time video by geometric calculation on the basis of the projection coordinate of the target space point on the initial image plane and the real-time angle information of a camera; and finally, overlaying virtual geographic information at the position of the target space point in the real-time video, and fusing the virtual geographic information and real scenes in the video through video treatment, thus ensuring the target to be more visual and intuitive and easier to be identified by people. The invention has the advantage that the virtual geographic information provided by the invention is intuitive and effective, and the invention is applicable to places requiring geographic information guide.

Gravity center position GRA of image display device 15 is, in a human state of standing, located in a more backward position compared with eyeball 9 and in a more downward position compared with eyeball 9. In this case, assuming that the rotation axes of the head are the X-axis, the Y-axis, and the Z-axis, the intersection point of these axes is the head's rotational movement center CNT. By this, GRA comes close to CNT, and thus, even when rotational movement of the head occurs around CNT, inertia forces other than moment of inertia are successfully made small. Therefore, the image display device can smoothly follow the movements of human head even if the device is heavy in weight.

The invention discloses a motion collecting and feedback method and system based on stereoscopic vision. The method comprises the following steps that the space position of an infrared light source in an attachment position in a front space is collected, the space position is mapped into a virtual space, and the position and direction of a virtual object are controlled; when the virtual object interacts with a virtual environment, a wireless control attachment device vibrates and simulates the feedback feeling of force. The motion collecting and feedback method and system based on stereoscopic vision have the advantages that positioning is rapid and accurate, and operation is stable; the hardware is quite low in cost, simple in structure and quite small in size; force feedback is achieved and can largely improve the sense of reality of interaction behaviors, and user experience is improved; the reality function is improved, and the man-machine interaction modes are increased.

Systems are shown herein for use in stringed musical instruments for producing digital frequency and volume data. A finger contact sensor system detects the location of one or more fingers or objects at selected locations on a finger board of the instrument. Further string movement sensor systems determine if one or more strings are being played. A control system processes information from the finger contacting and string movement sensor systems to generate a digital signal containing the frequency data corresponding to the finger contacting point on the finger board and volume data corresponding to the sensed movement of a corresponding string.

An apparatus capable of reproducing or recording sounds with high reality sensation, including, for example, an image pickup unit for picking up an image and outputting a video signal representing a video image picked up, a sound acquisition unit supplied with sounds as an input to output an audio signal representing the input sound, a recording unit for recording the video signal output from the image pickup unit and the audio signal output from the sound acquisition unit, an object detector for detecting a location of a specific subject from the video signal, a sound extractor for extracting a sound corresponding to the detected specific subject from the audio signal, and a sound signal processor for adjusting a signal of the sound extracted by the sound extractor, on the basis of the location of the specific subject detected by the object detector.

A process for controlling sound producing produces predetermined sound according to a distance between a position for obtaining an invisible item and an operation character, to be computed by process for computing item distance, and outputs from sound output means. A process for obtaining invisible item executes a processing for obtaining invisible item for a corresponding operation character in such a state that the distance becomes a predetermined value or lower. Then, the perception of a player through hearing sense concerning acquisition of an item can be introduced as an element of the game. So, the player can search the item with assistance of predetermined sound produced, thereby increasing a fun of the game.

A sound effect generation device for generating a sound effect corresponding to a physical interaction between objects in a virtual space in which a plurality of virtual objects coexists, includes interaction detection means for detecting an object on which the physical interaction occurs in the virtual space, mechanical quantity calculation means for calculating mechanical quantity acting on the object in accordance with the interaction using a mechanical model for determining, based on physics, behavior between the objects on which the physical interaction acts, and sound effect generation means for generating the sound effect caused in the object by the interaction using the calculated mechanical quantity.

Game program has a procedure for determining item price (IVD), for respectively computing price for transfer of a plurality of items to be used in a game every each item, and a procedure for executing the procedure for determining item price when possession state of the item is likely to be changed in the game, and the procedure for determining item price has a procedure for computing price for transfer of the item on the basis of individual data concerning each item and for displaying the computed price. The price for transfer of the item is determined and shown, changed by the individual data concerning each item, so that the player can buy or sell the item with reality similar to economical activities in the actual world.

The invention discloses a real-time video camera tracking method based on key frames, which comprises the following steps: (1) capturing an index image sequence, and restoring a sparse three-dimensional characteristic point structure of a scene by a method of inferring a structure from movement; (2) giving the index image sequence and the sparse three-dimensional characteristic point structure, and automatically selecting the key frames by optimizing an energy function related to the key frames; (3) in the real-time video camera tracking process, for each frame of real-time input image, firstly, quickly positioning a candidate key frame similar to the real-time input image from the key frame set by a characteristic word tree method of image recognition; and (4) matching the characteristic points abstracted on the real-time input image with the characteristic points on the candidate key frame, obtaining the corresponding three dimensional coordinates of the characteristic points on the image, and calculating the directionality parameters of the video camera. The invention has high calculating efficiency and stable solving result, and the video camera tracking result obtained by the method can be directly used for the applications of reality enhancement, virtual interaction and the like.