274results about How to "Enhanced Reality" patented technology

By enabling exchange of information relating to players, apart from game data, "communication" between the players is increased, and the sense of rivalry and level of interest generated by a game are raised. The communication game system 1 forms a network comprising a plurality of game devices 2a-2d connected mutually by communication media 3. The plurality of game devices 2a-2d respectively comprise a communications system 31 for receiving data transferred over the network and transferring the received data and data generated by the home game device onto the network, and a host system 32 for accessing the received data. By this means, data comprising a game packet, sound packet and video packet can be transmitted by conducting broadcast communications based on the communications system 31 and host system 32 between the plurality of game devices 2a-2d.

The invention discloses a method and system of implementing 3D augmented reality, and the method comprises: video frame capture module captures video frames of 2D visual code mark in real environment; performing augmented reality processing on the obtained video frames and obtaining the processed virtual graphic frames; virtual-real synthesis module synthesize the obtained virtual graphic frames and the obtained video frames and obtaining the synthesized video frames of augmented reality. And the invention can better support implementation of the augmented reality technique in handheld mobile computers with relatively limited resources and expanding the application field of the augmented reality technique.

A manually actuated input device for commanding machine- and / or computer-assisted control operations for kinematic motions of a real or virtual multipart object, including a force / moment sensor with which linear displacements in the form of translational movements in the direction of three axes (X, Y, Z), each standing perpendicular on the other, of a three-dimensional rectangular system of coordinates and / or rotational excursions in the form of rotational motions (A, B, C) about these three axes are sensed and converted into commanded motions of the object to be controlled is characterized by the commanded individual linear displacements and / or rotational excursions of the force / moment sensor being assigned specific kinematic motion patterns of parts of the real or virtual object thereby permitting manipulation or animation thereof as a transforming interlink and by the commanded velocities of the corresponding individual linear displacements and / or rotational excursions of the force / moment sensor being additionally weightable as a kinematic interlink assignment. The invention can be put to use e.g. in kinematic animation operations of human-like robots, figures or virtual animate beings.

The simulated log fireplace apparatus housing forming a fire box having back, bottom, top wall, two side walls, and an open front containing at least one artificial log and simulated flame sheet. A blower directs air on to the flame sheet to simulate real flame movement. A colored light source provides color of real flames. The light source and blower are adjustable from a control panel under a top louver panel. The artificial log may include a translucent base log and ember bed with a light source beneath the translucent log. A window log having an aperture simulate a burning core. A transparent partition has a partially opaque area just above the simulated flame sheet provides the full depth of real fireplace. The apparatus may include electric blower heater, a crackle box, decorative simulated brick panels placed on back and side walls, metal screen, glass doors, vents and louvers.

Multiple shops exist in a virtual space of a game. Each shop belongs to any one of multiple unions. When a player character buys or sells a game item at any of the shops, a power point value of the union to which the shop belongs is increased according to the sales amount. The higher the power rank of the union to which the shop belongs becomes, the more the types of sellable and buyable game items are increased. The higher the power rank of the union to which the shop belongs becomes, the more cheaply the player can buy the game item and the higher the amount the player can sell the game item. The higher the power rank of the union where the shop belongs becomes, the more points that are given to a point card according to the buying or selling of the game items.

The invention relates to a robust real-time three-dimensional (3D) reconstruction method based on a consumer camera, and aims to solve the problems of high calculation cost and inaccurate and incomplete reconstructed model in the existing method. The method comprises the following steps: 1, estimating the camera pose of each video frame under a scene coordinate system on the basis that a current video frame of a camera is used as input in the camera moving process; 2, selecting an optimized key frame in the video frame for depth estimation; 3, estimating the depth information of each video frame by adopting a quick robust depth estimation algorithm to obtain a depth map of each video frame; and 4, converting the depth map of each video frame into an unblind distance field, parallel executing weighted average of TSDF on voxel, incrementally fusing the depth map of each video frame, and constructing a triangular mesh surface by a Marching cubes algorithm. The method is applied to the field of image processing.

A collision accident simulator is composed of a vehicle for driving on a predetermined drive road and a collision object for moving in an intersectional direction for a driving direction of the vehicle and colliding with the vehicle. A collision accident simulation method for simulating a simulation collision accident is comprised of steps of riding an experience person for experiencing the simulation collision accident on any of the vehicle and the collision object and making the collision object collide with the vehicle, wherein the vehicle drives on the predetermined drive road.

This invention relates to computer implemented methods and systems for augmented reality on mobile devices, and in particular, methods and systems for mobilization of video, music, photos and other media as augmented reality. Upon a user's selection of a map marker or other object corresponding to a place in a 2-D or 3-D view, a video or other media item is dynamically encoded for the user's specific device and carrier and played on the user's phone or mobile device or sent to another phone or mobile device. The 2-D or 3-D view may be viewed from within a browser or a separate application.

A video communication method, device, and system are provided, which relate to the filed of video communications, so as to solve problems that currently scenes of two parties of communication need special arrangement to improve sense of reality and scene contents cannot be displayed in a 3D video mode. Therefore, scenes of two parties of communication do not need special arrangement to improve the sense of reality of users, and the scene contents can be displayed in a 3D video mode. The video communication method, device, and system are applicable to video communication such as common video chat, video telephony, and video conference.

A simulation method and a simulation system for a construction crane are disclosed. The simulation system includes an input device, a processing device, and a display device. The input device is used for inputting an instruction. Furthermore, the processing device includes a computation unit, a collision detection unit, a storage unit, and a graphic unit. The computation unit is used for computing the position and the direction of each part of the construction crane and the suspension parts. The collision detection model is used for detecting whether each part of the construction crane and the suspension parts will be in collision. Besides, the data obtained from the simulation method performed in the simulation system is saved in the storage unit. The graphic unit displays the 3D dynamics images of the construction crane and the suspension parts on the display device, corresponding to the data obtained from the computation unit.

A terminal apparatus is provided that has a first and a second display units; and a control unit which controls display contents of the first and the second display units respectively. The control unit displays, on the second display unit, status information as well as an operation key associated with the display contents displayed on the first display unit. The control unit changes the display contents displayed on the first display unit in response to an input with the operation key.

The invention discloses a reality augmenting method with real environment estimation and a reality augmenting system. The method comprises the following steps: initializing a system environment and configuring system parameters; selecting or extracting one marker front view and training a marker to obtain training data; calculating and correcting camera inner parameters of a marker image; correcting each frame of a real environment shot by a camera, and based on the training data, identifying the marker and calculating a relative position matrix of the marker in a camera coordinate system; and searching a corresponding virtual model by the identified marker, determining the position of the model by utilizing the position matrix of the extracted marker, drawing the virtual model, estimating illumination information of the environment in which the marker is positioned by comparing the brightness of the identified marker and brightness of the marker front view, performing real environment light source estimation to estimate the position of the real light source and generate shadow. The method and the system greatly reduce the limitation on the marker and can be used for marking maps and complex two-dimensional images.

An interactive sound playback device includes two speakers, two microphones, a motion sensor, and an audio processing unit. The speakers and the microphones are disposed at two sides of the interactive sound playback device respectively. The audio processing unit is electrically connected to the speakers, the microphones, and the motion sensor, and has a recording mode and a playing mode. In the recording mode, the audio processing unit receives a motion sensing signal from the motion sensor and a first audio signal from the microphones, stores the first audio signal, and stores the motion sensing signal as position information. In the playing mode, the audio processing unit outputs the first audio signal to the speakers through a first path, or adjusts a second audio signal by referring to the motion sensing signal and the position information, and outputs the adjusted second audio signal to the two speakers through a second path.

A method and apparatus for providing, in response to image signals originating in an object space, mixed image signals for providing nonuniform resolution images for stimulating simulated active percepts for passive perception by a viewer in an image space. The images have a highly detailed component which has its image content changed according to changes in the direction of a simulated observer's eye position in an object space. The images may be provided stereoscopically. The images may be provided at various apparent distances and the relationship between accommodation and convergence may be preserved. Audio waves for directionally simulating that which would be heard by the simulated observer may be provided.

The invention provides a method for strengthening reality having interactive function and a system thereof, comprising initializing system environment, configuring system parameters, selecting or extracting a mark front view, training the mark to obtain the training data, calculating and correcting the intrinsic parameters of the camera of the mark image; correcting each frame of the true environment shot by the camera; identifying the mark based on the training data, calculating the relative position matrix of the mark in the camera coordinate system, comparing the identified mark and the brightness of the mark front view to evaluate the lighting information of the mark in the environment; finding the corresponding virtual model according to the identified mark, using the extracted position matrix of the mark to determine the position of the model, drafting the virtue model, setting the interaction between the interactive region and the user. The invention greatly reduces the limit to the mark, and can be used for marking the map and completed two dimensional image, and also can randomly synthesize three-dimensional model on the two dimensional image.

The invention relates to an augmented reality system having a first augmented reality device and a second augmented reality device. The first augmented reality device includes a first communication module at least temporarily connected with a second communication module of the second augmented reality device via at least one data connection during an augmented reality session. Also included is a peer-to-peer network having a peer-to-peer application configured to access a second communication data set related to the second communication module. The peer-to-peer application includes a controlling means that controls the establishment of the data connection between the first communication module and the second communication module by providing the second communication data set to the first communication module via a peer-to-peer module assigned to the first augmented reality device such that the first communication module establishes the data connection based on the provided second communication data set.

The invention discloses a reality augmenting method and a reality augmenting system based on image characteristic point extraction and random tree classification. The method comprises the following steps: initializing a system environment and configuring system parameters; selecting or extracting one marker front view and training a marker to obtain training data; calculating and correcting camera inner parameters of a marker image; correcting each frame of a real environment shot by a camera, and based on the training data, identifying the marker and calculating a relative position matrix of the marker in a camera coordinate system; and searching a corresponding virtual model by the identified marker, determining the position of the model by utilizing the position matrix of the extracted marker, and drawing the virtual model. The method and the system greatly reduce the limitation on the marker, can be used for marking maps and complex two-dimensional images, and can synthesize a three-dimensional model on any two-dimensional image to achieve three-dimensional and vivid effects.

Systems and methods for generating a true 3-D display, where each of a viewer's eyes not only sees a different scene, but the scene changes continuously as the viewer moves his / her head or change his / her position from one angular location to another angular location with respect to the display screen. In one embodiment, a system comprises a set of 2-D image projectors and a display screen. The 2-D image projectors are configured to project individual 2-D images substantially in focus on the display screen. The display screen then diffuses (or reflects) each pixel from each of the 2-D images into a small angular slice. This enables the viewer observing the display screen to see a different one of the 2-D images with each eye. Further, the image seen by each eye varies as the viewer moves his or her head with respect to the display screen.

The invention discloses a geographic information guide method and a system based on augment reality, which mainly solves the problem that the existing map-type geographic information guide method has poor intuition and needs to identify geographic direction. The guide method of the invention is as follows: firstly, collecting a plurality of images from different angles, and determining the projection coordinate of a target space point on a specified initial image plane by geometric calculation; secondly, accurately determining the coordinate of the target space point in a real-time video by geometric calculation on the basis of the projection coordinate of the target space point on the initial image plane and the real-time angle information of a camera; and finally, overlaying virtual geographic information at the position of the target space point in the real-time video, and fusing the virtual geographic information and real scenes in the video through video treatment, thus ensuring the target to be more visual and intuitive and easier to be identified by people. The invention has the advantage that the virtual geographic information provided by the invention is intuitive and effective, and the invention is applicable to places requiring geographic information guide.

Gravity center position GRA of image display device 15 is, in a human state of standing, located in a more backward position compared with eyeball 9 and in a more downward position compared with eyeball 9. In this case, assuming that the rotation axes of the head are the X-axis, the Y-axis, and the Z-axis, the intersection point of these axes is the head's rotational movement center CNT. By this, GRA comes close to CNT, and thus, even when rotational movement of the head occurs around CNT, inertia forces other than moment of inertia are successfully made small. Therefore, the image display device can smoothly follow the movements of human head even if the device is heavy in weight.

The invention discloses a motion collecting and feedback method and system based on stereoscopic vision. The method comprises the following steps that the space position of an infrared light source in an attachment position in a front space is collected, the space position is mapped into a virtual space, and the position and direction of a virtual object are controlled; when the virtual object interacts with a virtual environment, a wireless control attachment device vibrates and simulates the feedback feeling of force. The motion collecting and feedback method and system based on stereoscopic vision have the advantages that positioning is rapid and accurate, and operation is stable; the hardware is quite low in cost, simple in structure and quite small in size; force feedback is achieved and can largely improve the sense of reality of interaction behaviors, and user experience is improved; the reality function is improved, and the man-machine interaction modes are increased.

The invention discloses an intelligent cellphone reality reinforcing system based on a three-dimensional electronic compass and a realizing method, which solves a problem occurring when a mobile termination reality reinforcing system is established; through an integrated micro electronic compass, the invention has the advantages of low cost, handy application, and long service time of power. The method is: a. real-time location is carried out through GPS built-in the intelligent cellphone; b. data from the electronic compass are received in real time by the intelligent cellphone through three-dimensional electronic compass software and hardware interfaces in order to determine information of a visual line direction; c. video information is collected through a CCD video camera of the intelligent cellphone; d. software is drawn by the intelligent cellphone by means of a three-dimensional virtual pattern; virtual patterns are drawn by means of information obtained by the procedure a and procedure b; e. a reality reinforcing image is obtained by the intelligent cellphone by means of a software for overlaying a virtual image and a video image in real time in a pattern builder installed in the intelligent cellphone, as well as the video image in the procedure c and the virtual image in the procedure d.

Systems are shown herein for use in stringed musical instruments for producing digital frequency and volume data. A finger contact sensor system detects the location of one or more fingers or objects at selected locations on a finger board of the instrument. Further string movement sensor systems determine if one or more strings are being played. A control system processes information from the finger contacting and string movement sensor systems to generate a digital signal containing the frequency data corresponding to the finger contacting point on the finger board and volume data corresponding to the sensed movement of a corresponding string.

An apparatus capable of reproducing or recording sounds with high reality sensation, including, for example, an image pickup unit for picking up an image and outputting a video signal representing a video image picked up, a sound acquisition unit supplied with sounds as an input to output an audio signal representing the input sound, a recording unit for recording the video signal output from the image pickup unit and the audio signal output from the sound acquisition unit, an object detector for detecting a location of a specific subject from the video signal, a sound extractor for extracting a sound corresponding to the detected specific subject from the audio signal, and a sound signal processor for adjusting a signal of the sound extracted by the sound extractor, on the basis of the location of the specific subject detected by the object detector.

A process for controlling sound producing produces predetermined sound according to a distance between a position for obtaining an invisible item and an operation character, to be computed by process for computing item distance, and outputs from sound output means. A process for obtaining invisible item executes a processing for obtaining invisible item for a corresponding operation character in such a state that the distance becomes a predetermined value or lower. Then, the perception of a player through hearing sense concerning acquisition of an item can be introduced as an element of the game. So, the player can search the item with assistance of predetermined sound produced, thereby increasing a fun of the game.

The invention discloses film and television artificial intelligence based on SLAM. Video information related to self can be interactively captured from socialized big data video information; and a film and television program by taking users as protagonists is automatically generated by a computer through an inference machine and a knowledge base.

A sound effect generation device for generating a sound effect corresponding to a physical interaction between objects in a virtual space in which a plurality of virtual objects coexists, includes interaction detection means for detecting an object on which the physical interaction occurs in the virtual space, mechanical quantity calculation means for calculating mechanical quantity acting on the object in accordance with the interaction using a mechanical model for determining, based on physics, behavior between the objects on which the physical interaction acts, and sound effect generation means for generating the sound effect caused in the object by the interaction using the calculated mechanical quantity.

Game program has a procedure for determining item price (IVD), for respectively computing price for transfer of a plurality of items to be used in a game every each item, and a procedure for executing the procedure for determining item price when possession state of the item is likely to be changed in the game, and the procedure for determining item price has a procedure for computing price for transfer of the item on the basis of individual data concerning each item and for displaying the computed price. The price for transfer of the item is determined and shown, changed by the individual data concerning each item, so that the player can buy or sell the item with reality similar to economical activities in the actual world.

The invention discloses a real-time video camera tracking method based on key frames, which comprises the following steps: (1) capturing an index image sequence, and restoring a sparse three-dimensional characteristic point structure of a scene by a method of inferring a structure from movement; (2) giving the index image sequence and the sparse three-dimensional characteristic point structure, and automatically selecting the key frames by optimizing an energy function related to the key frames; (3) in the real-time video camera tracking process, for each frame of real-time input image, firstly, quickly positioning a candidate key frame similar to the real-time input image from the key frame set by a characteristic word tree method of image recognition; and (4) matching the characteristic points abstracted on the real-time input image with the characteristic points on the candidate key frame, obtaining the corresponding three dimensional coordinates of the characteristic points on the image, and calculating the directionality parameters of the video camera. The invention has high calculating efficiency and stable solving result, and the video camera tracking result obtained by the method can be directly used for the applications of reality enhancement, virtual interaction and the like.