226results about How to "Enhanced presence" patented technology

A mobile robot guest for interacting with a human resident performs a room-traversing search procedure prior to interacting with the resident, and may verbally query whether the resident being sought is present. Upon finding the resident, the mobile robot may facilitate a teleconferencing session with a remote third party, or interact with the resident in a number of ways. For example, the robot may carry on a dialogue with the resident, reinforce compliance with medication or other schedules, etc. In addition, the robot incorporates safety features for preventing collisions with the resident; and the robot may audibly announce and / or visibly indicate its presence in order to avoid becoming a dangerous obstacle. Furthermore, the mobile robot behaves in accordance with an integral privacy policy, such that any sensor recording or transmission must be approved by the resident.

A mobile robot guest for interacting with a human resident performs a room-traversing search procedure prior to interacting with the resident, and may verbally query whether the resident being sought is present. Upon finding the resident, the mobile robot may facilitate a teleconferencing session with a remote third party, or interact with the resident in a number of ways. For example, the robot may carry on a dialogue with the resident, reinforce compliance with medication or other schedules, etc. In addition, the robot incorporates safety features for preventing collisions with the resident; and the robot may audibly announce and / or visibly indicate its presence in order to avoid becoming a dangerous obstacle. Furthermore, the mobile robot behaves in accordance with an integral privacy policy, such that any sensor recording or transmission must be approved by the resident.

A mobile robot guest for interacting with a human resident performs a room-traversing search procedure prior to interacting with the resident, and may verbally query whether the resident being sought is present. Upon finding the resident, the mobile robot may facilitate a teleconferencing session with a remote third party, or interact with the resident in a number of ways. For example, the robot may carry on a dialogue with the resident, reinforce compliance with medication or other schedules, etc. In addition, the robot incorporates safety features for preventing collisions with the resident; and the robot may audibly announce and / or visibly indicate its presence in order to avoid becoming a dangerous obstacle. Furthermore, the mobile robot behaves in accordance with an integral privacy policy, such that any sensor recording or transmission must be approved by the resident.

The invention relates to a somatosensory interactive broadcasting guide system and method based on free viewpoints. The system comprises a server side, a video transmission network and a client side, wherein, the server side comprises a multi-camera system, a video processing server and a streaming media server which are used for completing multi-channel video capture, panoramic video synthesis, H.264 encoding and RTSP (real time streaming protocol) streaming media service; the video transmission network is a local area network (LAN) or wide area network (WAN) based on a TCP / IP (transmission control protocol / Internet protocol); and the client side comprises a free viewpoint playing terminal and a somatosensory sensor, wherein, the free viewpoint playing terminal comprises functional modules which are used for completing video streaming media receiving and decoding, gesture recognition based on a somatosensory controller, free viewpoint generation and other tasks. The somatosensory interactive broadcasting guide system and method have the beneficial effects that by combining multi-channel video into panoramic video, software and hardware investment and technical cost can be saved by directly utilizing the currently mature video coding and streaming media transmission technology, and meanwhile panoramic seamless roaming at 360 degrees and free viewpoint switchover can be really realized.

The invention relates to predicting or determining risk of a tumor or cancer, or the presence or absence of a tumor or cancer, in a subject. The invention also relates to methods of correlating somatic chromosomal sequence rearrangements, such as rearrangements in synteny block sequences, with the presence or probability of a tumor or cancer. The invention further relates to monitoring progression or regression of a tumor or cancer in a subject. The invention moreover relates to organizational constructs (e.g., databases) and methods of producing organizational constructs (e.g., databases) in which a plurality of somatic chromosomal sequence rearrangements predictive of the presence of a tumor or cancer are recorded or stored, for example, to correlate the somatic chromosomal sequence rearrangements with a query sample from a sample of a subject analyzed for the presence or absence of a tumor or cancer.

A method and system (100) for enhancing the determination of the presence of a surface breaking or subsurface defect with an object (114) under test are provided (FIG. 1). The method can include transferring ultrasonic energy to an object (114) under test and sensing images (514, 514′) of the object (114) under test before and after transferring ultrasonic energy to the object (114) with an infrared thermography camera (112). An increase in temperature gradients in the areas adjacent a defect (516, 516′) is shown in the images (514, 514′) produced by the camera (112), which indicates the presence of the defect (516, 516′). The temperature gradients in the area of the defect (516, 516′) and images of the defect (516, 516′) can be displayed to enable users to determine the temperature gradient and thus the extent of the defect (516, 516′). Digital images (514, 514′) of the before and after transferring ultrasonic energy can be superimposed (514″) to identify and illustrate the defect (516″).

This invention discloses a video communication system with sound position information including multiple microphones used in collecting multiple sounds, a camera head receiving control orders to rotate or regulate focus and a processor connected with the camera head and multiple microphones, in which, the processor computes the position information of the sound source based on the phones collected by the microphones and regulates the position information of the source based on the control information of the camera head, which solves the problem of non-match of the speaker position and the collected sound orientation information.

[PROBLEMS] To detect any of various movements of a finger by using the touch panel of an existing device and to give tactile sense to facilitate operation.[MEANS FOR SOLVING PROBLEMS] A touch panel input assisting device attached to an existing device having a touch panel or held by fingers so as to use it. Any of various movements of a finger is transformed into rolling of a rolling unit on a touch panel or deformation thereof, the rolling or deformation is detected as a variation of the position or area of the contact of the rolling unit with the touch panel, and a tactile sense such as a reactive force, a resistance force, vibration, or a sensation of roughness is given to the finger. A tactile interlocking program for analyzing the movement pattern and speed pattern of the point of contact of the rolling unit with the touch panel and estimating the movement of the finger is used to perform a predetermined operation interlockingly with the movement of the finger or tactile sense given to the finger.

The invention provides a large view field angle eyepiece optical system for a head-mounted displayer, wherein the large view field angle eyepiece optical system comprises a first lens, a second lens, and a third lens which are successively and coaxially arranged along an optical axis direction from a human eye observing side to a displayer side; the first lens and the third lens are all positive lenses and the second lens is a negative lens; the surface, facing the human eye observing side, of the first lens is projected towards the human eye observing side and has a positive curvature radius; the surface, facing a diaphragm side, of the second lens is projected away from the human eye observing side and has a negative curvature radius; and at the same time, the materials, the focuses and the positions of the first lens, the second lens and the third lens should satisfy certain relationship, so that an image displayed on the displayer is imaged in human eyes after the image is amplified by an eyepiece. The eyepiece has the advantages of large hole diameter, large view field, high resolution ratio, low distortion and small size; and the eyepiece is suitable for head-mounted displayers and apparatuses similar to the head-mounted displayers.

The invention provides an augmented reality (AR) and virtual reality (VR) combined medical training system. Three-dimensional (3D) images of operation appliances used by operation target objects and training personnel are acquired through a 3D image acquisition module, operation motion of the training personnel is captured in real time through a motion capture module, correction information and guidance information are output through a central processor, an AR or VR model comprising the 3D images acquired by the 3D image acquisition module, the guidance information and the correction information is established, and the training personnel obtains the status of the operation target objects and the operation appliances used by the operation target objects, the guidance information and the correction information in real time through an AR interaction module, such that medical training is enabled to be more realistic and vivid, the medical training period is shortened, and the medical training cost is decreased.

The invention relates to a space teleoperation method. Safety of a space teleoperation instruction is ensured through a three-dimensional graph simulation verification method and an executive capacity verification method, real-time visual information is provided for an operator through a forecast simulation drive three-dimensional model, force sense information is provided for the operator through the bilateral control technology, and therefore the immediacy sensor of the operator is improved. According to the specific thought, a space teleoperation instruction sending end sends the instruction to a three-dimensional graph simulation verification end and a calculation capacity verification end through an information dispatching center after generating the instruction so that the instruction can be verified, and the three-dimensional graph simulation verification end not only serves as the verification end of a space teleoperation system, but also provides necessary visual information for the operator; in addition, in the generation link of the teleoperation instruction, generating feedback force is generated for the difference between the motion state of a space robot and the motion state of the existing forecast simulation model through a bilateral control algorithm, the feedback force is exerted on the operator, and therefore the operation can sense and judge the motion state of the space robot through the force sense.

The invention relates to a high sound-surround ambiance intelligent sensing interactive motion system and an implementation method thereof; the system consists of a motion platform subsystem, a virtual reality subsystem, and a projection display subsystem; the motion platform subsystem consists of a parallel connection motion platform with N degrees of freedom, a servo motor driver, a motion controller, and a sensor; and the virtual reality subsystem consists of a motion control terminal computer, a network server computer, and a scene-rendering end computer. The projection display subsystem consists of an edge fusion device, a projector, audio equipment, and a dome screen. The invention has the beneficial effects that an immersive virtual reality environment is provided for the motion platform; simultaneously, the virtual reality environment feeds back the control information to the motion platform for realizing the interaction of the motion and the environment, the sound-surround ambiance is enhanced, and the participants is led to have high sense of immersion, thus improving the fitness fun and achieving the effect of keeping healthy.

An electronic book system which enables selecting and distributing music matching contents etc. of an electronic book and playing the selected music upon browsing the electronic book. A typical embodiment of the present invention includes a content server and a terminal having a viewer for browsing electronic books and playing music, the viewer including an electronic book playback portion which plays and displays electronic books and a music playback portion which plays music. The content server includes an electronic book information DB which retains attribution information of electronic books, a music information DB which retains attribution information of music, an electronic book distribution portion which distributes electronic books, a music distribution portion which distributes music, and a music selection portion which selects music having attribution information matching attribution information of an electronic book currently being browsed by a user from the music information DB and specifies the selected music and makes the music distribution portion distribute the selected music.

The present invention provides a three-dimensional display, which uses the electrically moistening function, according to the position of the object to be displayed, to change the focus of the two-dimensional liquid lens array in real time dynamically; realizes the definition maximization of the displayed central object or figure, or the concerned image area; improves the on-the-spot feeling of the three-dimensional image. The display is characterized in that a two-dimensional liquid lens array 22 is arrayed on a two-dimensional flat-panel display 5 in evenly to form a three-dimensional display. The two-dimensional liquid lens array and the two-dimensional flat-panel display are placed in parallel, and the focus of the two-dimensional liquid lens array is variable. The two-dimensional flat-panel display 5 can be any kind of flat-panel display. The two-dimensional liquid lens array 22 is formed by the array of a plurality of liquid single-lens, and the array method of the lens can be a square matrix, or a matrix whose odd line and whose even line are staggered, or a honeycomb shaped matrix. The preferred application case of the present invention has simple structure and low cost.

The invention provides a large-field-angle eye lens optical system used for a head worn displayer. The large-field-angle eye lens optical system comprises a first lens, a second lens and a third lens which are coaxially arranged from a human eye observation side to a displayer side in turn along an optical axis direction, and the first lens and the third lens are positive lenses and the second lens is a negative lens. The surface, which faces the human eye observation side, of the first lens convexly faces the human eye observation side, and the radius of curvature is a positive value. The surface, which faces a diaphragm, of the second lens concavely faces the human eye observation side, and the radius of curvature is a negative value. Meanwhile, the material, the focal length and the position of the first lens, the second lens and the third lens meet a certain relation so that an image displayed on a display device is enabled to be imaged in human eyes through amplification of an eye lens. The eye lens has advantages of large aperture, large field of view, high resolution, low distortion and small size so as to be suitable for the head worn displayer and similar devices.

The invention provides a movable intelligent cornea operation training system with combination of AR and VR. According to the movable intelligent cornea operation training system, images of a real animal eyeball specimen are taken by using a 3D camera microscope, and instruction information of operation of virtual-reality or augmented-reality molding is overlapped on the images by using a computer, so that a trainee can obtain the instruction information in real time in the operation process, and the training efficiency can be improved; meanwhile, real-time operation action of the trainee can be acquired through a TOF sensor, whether the operation action is correct or not can be judged by comparing the real-time operation action with preset data through the computer, and correction information is also provided, so that wrong operation action of the trainee can be corrected in real time; in addition, due to adoption of portable VR glasses and a portable operating table, operation training is not limited by a place, so that the cornea operation training cycle can be shortened while the reality and the immediacy sense of the cornea operation training are improved, the cornea operation training cost can be lowered, and movable cornea operation training can be achieved.

Methods of document expansion for a speech retrieval document by a recognizer. A database of vectors of automatic transcriptions of documents is accessed and the vectors are truncated by removing all terms that are not recognizable by the recognizer to create truncated vectors. Terms in the vectors are then weighted to associate the truncated vectors with the untruncated vectors. Terms not recognized by the recognizer are then added back to the weighted, truncated vectors. The retrieval effectiveness may then be measured.

The invention provides a display device and a video communication terminal. The display device comprises a transparent display panel which is used for displaying images; and an image photographing component which is used for acquiring images of the photographed objects arranged at the front surface side of the transparent display panel by collecting light transmitted through the transparent display panel. According to the display device, the image photographing component acquires the images of the photographed objects arranged at the front surface side of the transparent display panel by collecting light transmitted through the transparent display panel. When users perform video communication, the image photographing component can acquire the front surface images of the faces of the users through the transparent display panel so that visual and eye contact of both parties in the video communication can be realized, and thus the effect and sense of presence of the video communication can be enhanced.

The invention provides an (augmented reality) and VR (virtual reality) combined cornea smart operation training system. The system collects animal eyeball specimens during operation process and positive three-dimensional images of operation devices used by trainees in real time, performs the real-time side face 3D (three-dimension) scanning on the animal eyeball specimens, the operation devices used by trainees, and hand action of trainees through a TOF (time of flight) sensor, compares with preset data through a central processor and outputs guiding information and correction information, and sets up an augmented reality or virtual reality model containing the positive three-dimensional image, the guiding information and the correction information collected by a 3D microscope; through the AR glasses, the trainees can obtain the operation target object, status of the operation devices in use, the guiding information and correction information in real time, and thus the reality sense and on-site sense of cornea operation training are promoted, the real-time guidance in operation training is improved, the training operation of the cornea operation is shortened, the training cost of cornea is reduced, and the training quality is promoted.

Disclosed are a network experiment system based on closed-loop control and an achieving method of the network experiment system. The system comprises an entity experiment system, a control module, a measuring module, an on-site computer, a video monitoring system, an on-site server and a remote client, the entity experiment system is connected with the on-site computer through the control module and the measuring module, the measuring module is used for measuring parameter signals of the entity experiment system, the control module receives a control signal of the on-site computer and performs loop control over the entity experiment system, the on-site computer and the video monitoring system are respectively connected with the on-site server through a wired or wireless network, the control information and display information of the entity experiment system are transmitted to the on-site server, and on-site video information of a laboratory is transmitted to the on-site server. The system has the advantage of remote control, the experiment is converted into entity operation from virtual simulation, in the actual operation, the video telepresence technology is matched, an experimenter feels personal on the scene, resource sharing is achieved, and the utilization rate of the equipment is greatly improved.

The invention relates to the technical field of fire-fighting equipment, in particular to a fire-fighting teaching training system with an evaluation function. The fire-fighting teaching training system with an evaluation function includes a fire accident scene simulation subsystem, a training guidance subsystem, a commander battle position subsystem, a firefighter battle position subsystem, a data management subsystem, a three-dimensional scene generation and display subsystem, and HLA / RTI simulation software, wherein each subsystem is interconnected and intercommunicated through an HLA / RTI simulation software support platform, so as to form a distributed interactive fire-fighting rescue simulation training software and hardware environment. The fire-fighting teaching training system withan evaluation function has the advantages of low cost, wide expansion capacity, and high virtual reality, and can perform multi-person and multi-role collaborative exercise operations.

The invention discloses an all-sight image display device. Image display equipment comprises a pupil adjusting mechanism, a concave lens, a convex lens and a transparent connecting element, wherein the pupil adjusting mechanism is arranged at one side of the image display equipment, the concave lens, the convex lens and the transparent connecting element are arranged at the other side of the image display equipment, the concave lens is arranged next to the display equipment, the transparent connecting element fixes the convex lens onto the concave lens, the image processing is divided into a segmentation step and a conversion step through image processing software, an original image is segmented into a center region and a peripheral region, an image in the center region enters pupils after being refracted through the convex lens and corresponds to the view sight comfortable vision field, and the image of the peripheral part is subjected to polar coordinate inversion through a computer and then enters the pupils through the concave lens. The all-sight image display device has the advantages that an all-sight image is generated through the combination of the concave reflecting lens and the convex lens, the visible range is enlarged, the ultra-large view sight within 230 degrees can be realized, the virtual reality telepresence is greatly improved, after the design is completed, the structure is simple, the assembling and manufacturing difficulty is reduced, the mass production is convenient, and the cost is reduced.

The invention provides a vascular intervention surgical robot operating handle with handfeel and a control method thereof. The vascular intervention surgical robot operating handle comprises an operating device, a force loading mechanism and a torque loading mechanism, and the operating device, the force loading mechanism and the torque loading mechanism are arranged on a machine frame; the operating device gives out an operating instruction for rotating and / or pushing and pulling a conduit guide wire; the force loading mechanism feeds push-pull resistance exerted by the conduit guide wire when the conduit guide wire is pushed and pulled back to the operating device; the torque loading mechanism feeds resistance torque exerted by the conduit guide wire when the conduit guide wire is rotated back to the operating device; the push-pull resistance is generated by elastic force formed between the force loading mechanism and one end of a handle of the operating device; the resistance torque is generated by friction formed between the torque loading mechanism and the operating device. According to the vascular intervention surgical robot operating handle with the handfeel and the control method thereof, the operating device is utilized to operate the rotation, push-pull and the combination thereof of the conduit guide wire; the resistance or the resistance torque of the conduit guide wire in a patient side in an intervention process can be fed back to the operating device, the handfeel and an operation presence feeling of a doctor are strengthened, and the safety and stability of a surgical operation are improved; coupling of force and torque is solved.

The invention discloses a clucking power feedback system in a touching device, which comprises a chucking part, and a power feedback realization part, wherein the chucking part comprises a shell; two chucking handles are connected with the shell through a short connecting shaft and a bearing; one ends of two chucking connecting bars are connected with the chucking handles through a short connecting shaft and a bearing; the other ends of the two chucking connecting bars are connected with a sliding block through a bearing; the sliding block is fixedly connected with a spring; and the two chucking handles rotate along the two short connecting shafts to form chucked opening-closing motions. The realization of power feedback is as follows: a controller receives a chucking power signal, and sends a control signal to a motor; the motor drives a lead screw to rotate; when power is fed back, the lead screw drives a nut to move towards the direction of compressing the spring so as to compress the spring; then the spring is deformed to generate an elastic force; then the elastic force is transferred onto the chucking handles to lead an operator to feel the chucking power. The clucking power feedback system in the touching device has the advantages of simple and compact structure, high power feedback precision, easiness for operation, and low manufacturing cost.

The invention provides a remote ultrasonic scanning control device and method, and the device comprises a simulation ultrasonic probe which is used for simulating the movement of an actual ultrasonicprobe, rotating the posture of the simulation ultrasonic probe in simulation, and transmitting the positive pressure between the simulation ultrasonic probe and a simulation skin platform to an information interaction module; a simulated skin platform which is used for simulating the movement of the actual ultrasonic probe on the skin and sending the two-dimensional coordinates of the simulated ultrasonic probe on the surface of the simulated skin platform to the information interaction module; an information interaction module which is used for receiving information sent by the simulated ultrasonic probe and the simulated skin platform and transmitting the information to the field execution mechanism; and a field execution mechanism which is used for fusing the control signal with the pressure applied to the actual ultrasonic probe in the scanning process to obtain a final control signal of the actual ultrasonic probe, and controlling the actual ultrasonic probe according to the finalcontrol signal. According to the invention, the sense of immediacy of an operator is greatly increased, so the operator can carry out remote scanning more conveniently.

Provided is an imaging device which collects sound, takes an image, and records the sound and the image on a recording medium, including a sound collecting unit collecting sound signals of a plurality of channels; a wireless communication unit receiving a sound signal transmitted from an external sound collecting device by wireless; and a sound synthesis unit synthesizing the sound signal received by the wireless communication unit to at least any one of channels of the sound signals collected by the sound collecting unit.

Disclosed is an optical system for a head-mounted display, in which image rays provided from a display device are diverged to form and provide an enlarged image. First, second, and third lenses or first, second, third, and fourth lenses are sequentially disposed from an object along an optical axis and provide the enlarged image on an image plane, and angles of principal rays are gradually increased from the optical axis toward an edge of the image plane. Thus, as the angles of principal rays increase, the angle of view is improved to provide a large image so that it is possible to appreciate a vivid image due to an increase in the sense of presence and the degree of involvement. The size of the entire optical system can be reduced, thus a head-mounted display can be made compact and lightweight.

The game sounds were classified into those emitted from left and right speaker units of a television receiver and those emitted from a head set worn by a player, and emission of the individual game sounds from the speaker units or a sound emissive portion of the head set is controlled corresponding to game screens or scenes. This allows the player to enjoy the video game while hearing footstep or whispering of the leading character closely from the head set, and hearing explosive sound or shout of the enemy characters distantly from the speaker units.