224results about How to "Enhanced presence" patented technology

A mobile robot guest for interacting with a human resident performs a room-traversing search procedure prior to interacting with the resident, and may verbally query whether the resident being sought is present. Upon finding the resident, the mobile robot may facilitate a teleconferencing session with a remote third party, or interact with the resident in a number of ways. For example, the robot may carry on a dialogue with the resident, reinforce compliance with medication or other schedules, etc. In addition, the robot incorporates safety features for preventing collisions with the resident; and the robot may audibly announce and/or visibly indicate its presence in order to avoid becoming a dangerous obstacle. Furthermore, the mobile robot behaves in accordance with an integral privacy policy, such that any sensor recording or transmission must be approved by the resident.

The invention relates to a somatosensory interactive broadcasting guide system and method based on free viewpoints. The system comprises a server side, a video transmission network and a client side, wherein, the server side comprises a multi-camera system, a video processing server and a streaming media server which are used for completing multi-channel video capture, panoramic video synthesis, H.264 encoding and RTSP (real time streaming protocol) streaming media service; the video transmission network is a local area network (LAN) or wide area network (WAN) based on a TCP/IP (transmission control protocol/Internet protocol); and the client side comprises a free viewpoint playing terminal and a somatosensory sensor, wherein, the free viewpoint playing terminal comprises functional modules which are used for completing video streaming media receiving and decoding, gesture recognition based on a somatosensory controller, free viewpoint generation and other tasks. The somatosensory interactive broadcasting guide system and method have the beneficial effects that by combining multi-channel video into panoramic video, software and hardware investment and technical cost can be saved by directly utilizing the currently mature video coding and streaming media transmission technology, and meanwhile panoramic seamless roaming at 360 degrees and free viewpoint switchover can be really realized.

A method and system (100) for enhancing the determination of the presence of a surface breaking or subsurface defect with an object (114) under test are provided (FIG. 1). The method can include transferring ultrasonic energy to an object (114) under test and sensing images (514, 514′) of the object (114) under test before and after transferring ultrasonic energy to the object (114) with an infrared thermography camera (112). An increase in temperature gradients in the areas adjacent a defect (516, 516′) is shown in the images (514, 514′) produced by the camera (112), which indicates the presence of the defect (516, 516′). The temperature gradients in the area of the defect (516, 516′) and images of the defect (516, 516′) can be displayed to enable users to determine the temperature gradient and thus the extent of the defect (516, 516′). Digital images (514, 514′) of the before and after transferring ultrasonic energy can be superimposed (514″) to identify and illustrate the defect (516″).

[PROBLEMS] To detect any of various movements of a finger by using the touch panel of an existing device and to give tactile sense to facilitate operation.

[MEANS FOR SOLVING PROBLEMS] A touch panel input assisting device attached to an existing device having a touch panel or held by fingers so as to use it. Any of various movements of a finger is transformed into rolling of a rolling unit on a touch panel or deformation thereof, the rolling or deformation is detected as a variation of the position or area of the contact of the rolling unit with the touch panel, and a tactile sense such as a reactive force, a resistance force, vibration, or a sensation of roughness is given to the finger. A tactile interlocking program for analyzing the movement pattern and speed pattern of the point of contact of the rolling unit with the touch panel and estimating the movement of the finger is used to perform a predetermined operation interlockingly with the movement of the finger or tactile sense given to the finger.

The invention provides a large view field angle eyepiece optical system for a head-mounted displayer, wherein the large view field angle eyepiece optical system comprises a first lens, a second lens, and a third lens which are successively and coaxially arranged along an optical axis direction from a human eye observing side to a displayer side; the first lens and the third lens are all positive lenses and the second lens is a negative lens; the surface, facing the human eye observing side, of the first lens is projected towards the human eye observing side and has a positive curvature radius; the surface, facing a diaphragm side, of the second lens is projected away from the human eye observing side and has a negative curvature radius; and at the same time, the materials, the focuses and the positions of the first lens, the second lens and the third lens should satisfy certain relationship, so that an image displayed on the displayer is imaged in human eyes after the image is amplified by an eyepiece. The eyepiece has the advantages of large hole diameter, large view field, high resolution ratio, low distortion and small size; and the eyepiece is suitable for head-mounted displayers and apparatuses similar to the head-mounted displayers.

The invention provides an augmented reality (AR) and virtual reality (VR) combined medical training system. Three-dimensional (3D) images of operation appliances used by operation target objects and training personnel are acquired through a 3D image acquisition module, operation motion of the training personnel is captured in real time through a motion capture module, correction information and guidance information are output through a central processor, an AR or VR model comprising the 3D images acquired by the 3D image acquisition module, the guidance information and the correction information is established, and the training personnel obtains the status of the operation target objects and the operation appliances used by the operation target objects, the guidance information and the correction information in real time through an AR interaction module, such that medical training is enabled to be more realistic and vivid, the medical training period is shortened, and the medical training cost is decreased.

The invention relates to a space teleoperation method. Safety of a space teleoperation instruction is ensured through a three-dimensional graph simulation verification method and an executive capacity verification method, real-time visual information is provided for an operator through a forecast simulation drive three-dimensional model, force sense information is provided for the operator through the bilateral control technology, and therefore the immediacy sensor of the operator is improved. According to the specific thought, a space teleoperation instruction sending end sends the instruction to a three-dimensional graph simulation verification end and a calculation capacity verification end through an information dispatching center after generating the instruction so that the instruction can be verified, and the three-dimensional graph simulation verification end not only serves as the verification end of a space teleoperation system, but also provides necessary visual information for the operator; in addition, in the generation link of the teleoperation instruction, generating feedback force is generated for the difference between the motion state of a space robot and the motion state of the existing forecast simulation model through a bilateral control algorithm, the feedback force is exerted on the operator, and therefore the operation can sense and judge the motion state of the space robot through the force sense.

The invention relates to a high sound-surround ambiance intelligent sensing interactive motion system and an implementation method thereof; the system consists of a motion platform subsystem, a virtual reality subsystem, and a projection display subsystem; the motion platform subsystem consists of a parallel connection motion platform with N degrees of freedom, a servo motor driver, a motion controller, and a sensor; and the virtual reality subsystem consists of a motion control terminal computer, a network server computer, and a scene-rendering end computer. The projection display subsystem consists of an edge fusion device, a projector, audio equipment, and a dome screen. The invention has the beneficial effects that an immersive virtual reality environment is provided for the motion platform; simultaneously, the virtual reality environment feeds back the control information to the motion platform for realizing the interaction of the motion and the environment, the sound-surround ambiance is enhanced, and the participants is led to have high sense of immersion, thus improving the fitness fun and achieving the effect of keeping healthy.

The present invention provides a three-dimensional display, which uses the electrically moistening function, according to the position of the object to be displayed, to change the focus of the two-dimensional liquid lens array in real time dynamically; realizes the definition maximization of the displayed central object or figure, or the concerned image area; improves the on-the-spot feeling of the three-dimensional image. The display is characterized in that a two-dimensional liquid lens array 22 is arrayed on a two-dimensional flat-panel display 5 in evenly to form a three-dimensional display. The two-dimensional liquid lens array and the two-dimensional flat-panel display are placed in parallel, and the focus of the two-dimensional liquid lens array is variable. The two-dimensional flat-panel display 5 can be any kind of flat-panel display. The two-dimensional liquid lens array 22 is formed by the array of a plurality of liquid single-lens, and the array method of the lens can be a square matrix, or a matrix whose odd line and whose even line are staggered, or a honeycomb shaped matrix. The preferred application case of the present invention has simple structure and low cost.

The invention provides a large-field-angle eye lens optical system used for a head worn displayer. The large-field-angle eye lens optical system comprises a first lens, a second lens and a third lens which are coaxially arranged from a human eye observation side to a displayer side in turn along an optical axis direction, and the first lens and the third lens are positive lenses and the second lens is a negative lens. The surface, which faces the human eye observation side, of the first lens convexly faces the human eye observation side, and the radius of curvature is a positive value. The surface, which faces a diaphragm, of the second lens concavely faces the human eye observation side, and the radius of curvature is a negative value. Meanwhile, the material, the focal length and the position of the first lens, the second lens and the third lens meet a certain relation so that an image displayed on a display device is enabled to be imaged in human eyes through amplification of an eye lens. The eye lens has advantages of large aperture, large field of view, high resolution, low distortion and small size so as to be suitable for the head worn displayer and similar devices.

The invention provides a movable intelligent cornea operation training system with combination of AR and VR. According to the movable intelligent cornea operation training system, images of a real animal eyeball specimen are taken by using a 3D camera microscope, and instruction information of operation of virtual-reality or augmented-reality molding is overlapped on the images by using a computer, so that a trainee can obtain the instruction information in real time in the operation process, and the training efficiency can be improved; meanwhile, real-time operation action of the trainee can be acquired through a TOF sensor, whether the operation action is correct or not can be judged by comparing the real-time operation action with preset data through the computer, and correction information is also provided, so that wrong operation action of the trainee can be corrected in real time; in addition, due to adoption of portable VR glasses and a portable operating table, operation training is not limited by a place, so that the cornea operation training cycle can be shortened while the reality and the immediacy sense of the cornea operation training are improved, the cornea operation training cost can be lowered, and movable cornea operation training can be achieved.

Methods of document expansion for a speech retrieval document by a recognizer. A database of vectors of automatic transcriptions of documents is accessed and the vectors are truncated by removing all terms that are not recognizable by the recognizer to create truncated vectors. Terms in the vectors are then weighted to associate the truncated vectors with the untruncated vectors. Terms not recognized by the recognizer are then added back to the weighted, truncated vectors. The retrieval effectiveness may then be measured.

The invention provides an (augmented reality) and VR (virtual reality) combined cornea smart operation training system. The system collects animal eyeball specimens during operation process and positive three-dimensional images of operation devices used by trainees in real time, performs the real-time side face 3D (three-dimension) scanning on the animal eyeball specimens, the operation devices used by trainees, and hand action of trainees through a TOF (time of flight) sensor, compares with preset data through a central processor and outputs guiding information and correction information, and sets up an augmented reality or virtual reality model containing the positive three-dimensional image, the guiding information and the correction information collected by a 3D microscope; through the AR glasses, the trainees can obtain the operation target object, status of the operation devices in use, the guiding information and correction information in real time, and thus the reality sense and on-site sense of cornea operation training are promoted, the real-time guidance in operation training is improved, the training operation of the cornea operation is shortened, the training cost of cornea is reduced, and the training quality is promoted.

Disclosed are a network experiment system based on closed-loop control and an achieving method of the network experiment system. The system comprises an entity experiment system, a control module, a measuring module, an on-site computer, a video monitoring system, an on-site server and a remote client, the entity experiment system is connected with the on-site computer through the control module and the measuring module, the measuring module is used for measuring parameter signals of the entity experiment system, the control module receives a control signal of the on-site computer and performs loop control over the entity experiment system, the on-site computer and the video monitoring system are respectively connected with the on-site server through a wired or wireless network, the control information and display information of the entity experiment system are transmitted to the on-site server, and on-site video information of a laboratory is transmitted to the on-site server. The system has the advantage of remote control, the experiment is converted into entity operation from virtual simulation, in the actual operation, the video telepresence technology is matched, an experimenter feels personal on the scene, resource sharing is achieved, and the utilization rate of the equipment is greatly improved.

The invention relates to the technical field of fire-fighting equipment, in particular to a fire-fighting teaching training system with an evaluation function. The fire-fighting teaching training system with an evaluation function includes a fire accident scene simulation subsystem, a training guidance subsystem, a commander battle position subsystem, a firefighter battle position subsystem, a data management subsystem, a three-dimensional scene generation and display subsystem, and HLA/RTI simulation software, wherein each subsystem is interconnected and intercommunicated through an HLA/RTI simulation software support platform, so as to form a distributed interactive fire-fighting rescue simulation training software and hardware environment. The fire-fighting teaching training system withan evaluation function has the advantages of low cost, wide expansion capacity, and high virtual reality, and can perform multi-person and multi-role collaborative exercise operations.

The invention discloses an all-sight image display device. Image display equipment comprises a pupil adjusting mechanism, a concave lens, a convex lens and a transparent connecting element, wherein the pupil adjusting mechanism is arranged at one side of the image display equipment, the concave lens, the convex lens and the transparent connecting element are arranged at the other side of the image display equipment, the concave lens is arranged next to the display equipment, the transparent connecting element fixes the convex lens onto the concave lens, the image processing is divided into a segmentation step and a conversion step through image processing software, an original image is segmented into a center region and a peripheral region, an image in the center region enters pupils after being refracted through the convex lens and corresponds to the view sight comfortable vision field, and the image of the peripheral part is subjected to polar coordinate inversion through a computer and then enters the pupils through the concave lens. The all-sight image display device has the advantages that an all-sight image is generated through the combination of the concave reflecting lens and the convex lens, the visible range is enlarged, the ultra-large view sight within 230 degrees can be realized, the virtual reality telepresence is greatly improved, after the design is completed, the structure is simple, the assembling and manufacturing difficulty is reduced, the mass production is convenient, and the cost is reduced.

The invention provides a vascular intervention surgical robot operating handle with handfeel and a control method thereof. The vascular intervention surgical robot operating handle comprises an operating device, a force loading mechanism and a torque loading mechanism, and the operating device, the force loading mechanism and the torque loading mechanism are arranged on a machine frame; the operating device gives out an operating instruction for rotating and/or pushing and pulling a conduit guide wire; the force loading mechanism feeds push-pull resistance exerted by the conduit guide wire when the conduit guide wire is pushed and pulled back to the operating device; the torque loading mechanism feeds resistance torque exerted by the conduit guide wire when the conduit guide wire is rotated back to the operating device; the push-pull resistance is generated by elastic force formed between the force loading mechanism and one end of a handle of the operating device; the resistance torque is generated by friction formed between the torque loading mechanism and the operating device. According to the vascular intervention surgical robot operating handle with the handfeel and the control method thereof, the operating device is utilized to operate the rotation, push-pull and the combination thereof of the conduit guide wire; the resistance or the resistance torque of the conduit guide wire in a patient side in an intervention process can be fed back to the operating device, the handfeel and an operation presence feeling of a doctor are strengthened, and the safety and stability of a surgical operation are improved; coupling of force and torque is solved.

The invention discloses a clucking power feedback system in a touching device, which comprises a chucking part, and a power feedback realization part, wherein the chucking part comprises a shell; two chucking handles are connected with the shell through a short connecting shaft and a bearing; one ends of two chucking connecting bars are connected with the chucking handles through a short connecting shaft and a bearing; the other ends of the two chucking connecting bars are connected with a sliding block through a bearing; the sliding block is fixedly connected with a spring; and the two chucking handles rotate along the two short connecting shafts to form chucked opening-closing motions. The realization of power feedback is as follows: a controller receives a chucking power signal, and sends a control signal to a motor; the motor drives a lead screw to rotate; when power is fed back, the lead screw drives a nut to move towards the direction of compressing the spring so as to compress the spring; then the spring is deformed to generate an elastic force; then the elastic force is transferred onto the chucking handles to lead an operator to feel the chucking power. The clucking power feedback system in the touching device has the advantages of simple and compact structure, high power feedback precision, easiness for operation, and low manufacturing cost.

High value information Alert and Reporting System (HARS) and method to integrate the public into the law enforcement process by providing information on specific wanted persons/persons-of-interest to a diverse range of information display devices specifically selected to display the information to the public. Wanted persons/persons-of-interest are profiled by behavior and acquaintances and predictive behavior algorithms are used to predict locations and venues where there is a higher likelihood the person can be found and then information on that person is provided to the public in that specific area. When the public observes the wanted person, it is reported to HARS, which in turn notifies the proper Law Enforcement Agency (LEA) for investigation and apprehension. Invention can be used for providing public service information to the public in the precise area the information is needed and can also provide commercial advertising information to selected target areas.

The invention discloses a vehicle remote driving control system and method based on a 5G network, and relates to the technical field of remote driving. The vehicle remote driving control system comprises a vehicle-mounted terminal, a cloud end and a driving end, and the vehicle-mounted terminal is fixedly arranged on a vehicle; the vehicle-mounted terminal, the cloud end and the driving end are configured to establish a remote driving control system which is based on real-time data transmission connection and comprises road feel feedback and audio and video synchronous display; and the real-time data transmission is configured to be capable of packaging the vehicle comprehensive information of the vehicle into MPEG-TS data streams according to a predetermined packaging sequence and predetermined bytes and then transmitting the MPEG-TS data streams to a driving end, and is capable of packaging vehicle control information input by a driver through the driving end into UDP data packets and then transmitting the UDP data packets to the vehicle-mounted terminal. Through the implementation of the system and the method, the real-time transmission of multiple paths of high-definition audioand video information can be realized, the sense of immediacy of the driver is greatly improved, and the system has the advantages of reliable connection, low information transmission delay and goodcompatibility.