System with 3D user interface integration

Abstract

Disclosed is a system comprising a handheld device and at least one display. The handheld device is adapted for performing at least one action in a physical 3D environment; wherein the at least one display is adapted for visually representing the physical 3D environment; and where the handheld device is adapted for remotely controlling the view with which the 3D environment is represented on the display.

Description

FIELD OF THE INVENTION[0001]This invention generally relates to a method and a system comprising a handheld device and at least one display.BACKGROUND OF THE INVENTION[0002]3D visualization is important in many fields of industry and medicine, where 3D information is becoming more and more predominant.[0003]Displaying and inspecting 3D information is inherently difficult. To fully understand a 3D object or entire environment on a screen, the user should generally be able to rotate the object or scene, such that many or preferentially all surfaces are displayed. This is true even for 3D displays, e.g. stereoscopic or holographic, where from a given viewing position and with a given viewing angle, the user will only see some surfaces of an arbitrary 3D environment. Often, the user will also want to zoom into details or zoom out for an overview.[0004]Various user interaction devices are in use for software that displays 3D data; these devices are: 3D mice, space balls, and touch screen...

AI Technical Summary

Benefits of technology

[0051]The operator or user, e.g. dentist, may use one hand or both hands to hold the intraoral scanner while scanning, and the scanner may be light enough and comfortable to be held with just one hand for a longer time while scanning.

[0052]The device can also be held with one or two hands, while using the device as remote control for e.g. changing the view in the display. It is an advantage of the touchless user interface functionality that in clinical situations, the operator can maintain both hands clean, disinfected, or even sterile.

[0053]An advantage of the system is that it allows an iterative process of working in a 3D environment without releasing the handheld device during said process. For the above intraoral scanning system example, the operator, e.g. dentist, can record some teeth surface geometry with a handheld device that is an intraoral scanner, inspect coverage of the surface recording by using that same handheld device to move, e.g. rotate, the recorded surface on the display, e.g. a computer screen, de...

Problems solved by technology

Displaying and inspecting 3D information is inherently difficult.

Physically touching a user-interaction device can be a disadvantage in medical applications due to risks of cross-contamination between patients or between patient and operator, or in industrial applications in dirty environments.

It remains a problem to improve systems that require user interfaces for view control, which for example can be used for clinical purposes.

These prior art user interface devices can be inconvenient, awkward and difficult to use, and they can be labor-intensive, and thus costly to sterilize or disinfect.

However, in some cases it may not be possible for the operator to fully avoid touching other devices, and in these cases...

Images