Curved display device and method for curved display for a vehicle
The curved display device with a retractable actuator layer addresses space constraints and driver distraction by using infrared imaging and speed-dependent actuator deployment for precise user input execution.
Patent Information
- Application Number
- DE102014214774
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2013-12-18
- Filing Date
- 2014-07-28
- Publication Date
- 2024-12-24
- Estimated Expiration
- 2034-07-28
AI Technical Summary
Existing vehicle display devices face challenges in providing sufficient space for physical actuators while maintaining a curved design, which can distract drivers at high speeds and misinterpret user inputs.
A curved display device with a retractable physical actuator layer housed in a receptacle, activated by vehicle speed and user input, using infrared imaging for touch detection and a controller to manage actuator deployment.
Ensures sufficient space for physical actuators, reduces driver distraction at high speeds, and accurately executes user inputs through physical buttons or knobs, enhancing user convenience.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
(a) Field of the invention
[0001] The present invention relates to a curved display device and a method for curved display for a vehicle. More specifically, the present invention relates to a curved display device for a vehicle with physical actuation means. (b) Description of the prior art
[0002] In the prior art, a display device developed on the basis of a Braun tube known in the prior art, as well as various display devices such as a liquid crystal display (LCD), a plasma display (PDP), an organic light emitting display (OELD), an electrowetting display (EWD), an electrophoretic display (EPD), an embedded microcavity display (EMD) and a nanocrystal display (NCD) are known.
[0003] Furthermore, attempts have been made to use a curved display device for a group or audio-video navigation (AVN) system of a vehicle to improve the operating feel (or touch feeling) for a user, such as a driver, as well as the vehicle design. Furthermore, the screen size of a display device mounted inside a vehicle has increased over the years. This has resulted in a reduction in the space required for installing physical actuators (e.g., touch buttons or a jog shuttle).
[0004] US 2010 / 0 201 893 A1 discloses methods and devices for the efficient and safe provision of controls and displays, which can be used in particular in the central region of a vehicle's instrument panel. The device uses a rear projection display and machine vision to detect the position of controls and finger touch. US 2008 / 0 150 913 A1 discloses an interactive video display system. A projector projects a visual image onto a screen. An illumination device illuminates an object near the front of the screen. A camera detects the interaction of an illuminated object with the visual image, wherein the screen is at least partially transparent to the light detectable by the camera, so that the camera can detect the illuminated object through the screen.The projector is controlled to change the visual image in response to the interaction. DESCRIPTION OF THE INVENTION
[0005] The present invention provides a curved display device for a vehicle having the advantages that a physical actuator layer is pulled out when an appearance condition is satisfied, and the physical actuator layer is housed in a casing.
[0006] A curved display device for a vehicle according to an exemplary embodiment of the present invention may include: a projector arranged within an instrument panel and configured to project an image onto a predetermined projection surface; a first mirror configured to reflect the image projected by the projector; a second mirror configured to reflect the image reflected by the first mirror; a curved screen arranged on a surface of the instrument panel and configured to display the image reflected by the second mirror; an infrared illuminator configured to output infrared rays onto the curved screen; and an infrared imaging device (e.g.A camera, video camera, or the like) configured to capture an infrared image of the curved screen; a physical actuator layer receiving device comprising a housing and a physical actuator layer received within the housing and mounted to be pulled out forward from the curved screen; and a controller configured to determine the image displayed on the curved screen, operate the projector in dependence on the determined image, and determine a touch position based on the infrared image, wherein the controller is configured to determine whether an appearance condition is met, and to pull the physical actuator layer further forward from the curved screen if the appearance condition is met.
[0007] The appearance condition may be met when a vehicle speed is greater than a first predetermined speed. Furthermore, the appearance condition may be met when an appearance request signal is received from a user input unit. The controller may be configured to determine whether a lowering condition is met, and the physical actuating layer may be retracted into the housing when the lowering condition is met. The lowering condition may be met when a vehicle speed is less than a second predetermined speed. The lowering condition may be met when a lowering signal is received from a user input unit. The first mirror may be an aspherical mirror manufactured based on a curvature value of the curved screen.The image displayed on the curved screen may include a user interface configured with a plurality of selectable objects.
[0008] The curved display device may further comprise an application driver configured to execute an application function according to instructions from the controller. If the touch position corresponds to one of the plurality of objects, the controller may be configured to generate instructions for executing an application function that depicts (e.g., corresponds to) the selected object. At least one button and at least one rotary knob may be provided on a surface of the physical actuator layer.
[0009] Furthermore, the housing may include: a movement space in which a rack is slidably disposed; a receiving space in which the physical actuator layer is disposed; a guide space in which a guide groove is formed; and a gear chamber in which a pinion gear meshing with the rack is disposed. One end of the guide groove may be rounded toward the curved screen. The physical actuator layer and the rack may be connected by a connecting member, one end (e.g., a first end) of the connecting member may be pivotally connected to the physical actuator layer by means of a first pivot pin, and the other end (e.g., a second end) of the connecting member may be pivotally connected to the rack by means of a second pivot pin, wherein the first pivot pin can move along the guide groove based on movement of the rack.The gear chamber can be formed above the movement space.
[0010] According to an exemplary embodiment of the present invention, sufficient space for physical actuators can be ensured. Furthermore, an application function can be executed by a physical actuator when a user touch is misdetected (e.g., incorrectly recognized). Furthermore, it is possible to prevent a driver's attention from being distracted when a vehicle is moving at high speeds by using physical actuators. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The above and other features of the present invention will now be described in detail with reference to certain exemplary embodiments thereof illustrated in the accompanying drawings, which are included hereinafter for illustrative purposes only and thus do not limit the present invention. Fig. 1 is an exemplary schematic diagram of a curved display device for a vehicle according to an exemplary embodiment of the present invention. Fig. 2 is an exemplary drawing showing a case where a physical actuator layer is housed within a physical actuator layer housing device according to an exemplary embodiment of the present invention. Fig. 3A to 3D are exemplary drawings showing an operating state of a physical actuator layer recording device according to an exemplary embodiment of the present invention. Fig. 4 is an exemplary drawing showing a case where a physical actuator layer is pulled out from a physical actuator layer receiving device according to an exemplary embodiment of the present invention. Reference symbols: 5 Data detector 7 User input unit 10 curved screen 20 projectors 30 first mirror 35 second mirror 40 infrared illuminator 45 Infrared imaging device 50 physical actuating layer recording device 60 Control 70 application drivers 80 Instrument panel 100 curved display device 510 housing 512a Movement room 512b Recording Room 512c Command Room 512d gear chamber 514 guide groove 520 physical actuation layer 530 rack 535 pinion 540 connecting element 542a first hinge pin 542b second hinge pin 550 drive motor DETAILED DESCRIPTION
[0012] It is noted that the terms “vehicle” or “vehicle-” and similar terms are used herein to refer to motor vehicles in general, such as passenger automobiles including sport utility vehicles (SUVs), buses, trucks, various commercial vehicles, watercraft including a variety of boats and ships, aircraft and the like, and include hybrid vehicles, electric vehicles, internal combustion vehicles, plug-in electric hybrid vehicles, hydrogen-powered vehicles and other alternative fuel vehicles (e.g., fuel from resources other than petroleum).
[0013] Although an exemplary embodiment is described using a plurality of units to perform the exemplary processes, the exemplary processes may also be performed by one or a plurality of modules. Furthermore, it should be noted that the term controller / controller refers to a hardware device including a memory and a processor. The memory is configured to store the modules, and the processor is specifically configured to execute these modules to perform one or more processes described below.
[0014] Furthermore, the control logic of the present invention may be embodied as non-transitory computer-readable media on a computer-readable medium having executable program instructions executed by a processor, controller / control unit, or the like. Examples of the computer-readable medium include ROM, RAM, CD-ROMs, magnetic tapes, floppy disks, flash drives, smart cards, and optical data storage devices. The computer-readable recording medium may also be distributed in network-coupled computer systems such that the computer-readable media is stored and executed in a distributed manner, e.g., through a telematics server or a controller area network (CAN).
[0015] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms “a,” “an,” “one,” “the,” “the,” and “the” are intended to include the plural forms as well, unless the context clearly dictates otherwise. Further, as used herein, the terms “comprises” and / or “comprising” indicate the presence of the specified features, numbers, steps, acts, elements, and / or components, but do not exclude the presence or addition of one or more other features, numbers, steps, acts, elements, components, and / or groups thereof. As used herein, the term “and / or” includes any and all combinations of one or more of the linked listed elements.
[0016] Unless specifically stated or suggested by the context, the term "about" as used herein is understood to mean within normal tolerances of the state of the art, for example, within two standard deviations of the mean. "About" can be understood to mean within 10%, 9%, 8%, 7%, 6%, 5%, 4%, 3%, 2%, 1%, 0.5%, 0.1%, 0.05%, or 0.01% of the stated value. Unless otherwise clearly indicated by the context, all values used herein are preceded by the term "about."
[0017] The present invention will be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown. As will be appreciated by those skilled in the art, the described exemplary embodiments can be modified in various ways without departing from the spirit or scope of the present invention. Further, in order to clearly describe the present invention, parts that are irrelevant to the description are omitted, and like elements are designated by the same reference numerals throughout the description. Furthermore, the present invention is not limited to the components shown in the drawings, since each component shown in the drawings is shown arbitrarily for convenience of description.
[0018] Fig. 1 is an exemplary schematic diagram of a curved display device for a vehicle according to an exemplary embodiment of the present invention. Fig. 2 is an exemplary drawing showing a case where a physical actuator layer is housed in a physical actuator layer chamber according to an exemplary embodiment of the present invention. As shown in Fig. 1 and Fig. 2, a curved display device 100 for a vehicle according to an exemplary embodiment of the present invention may include a curved screen 10, a projector 20, a first mirror 30, a second mirror 35, an infrared illuminator 40, an infrared imaging device 45, a physical actuator layer receiver 50, and a controller 60. The controller 60 may be configured to operate the curved screen 10, the projector 20, the first mirror 30, the second mirror 35, the infrared illuminator 40, the infrared imaging device 45, and the physical actuator layer receiver 50.
[0019] The curved screen 10 may be arranged on a surface of an instrument panel 80 and formed of a transparent acrylic material to display an image. The projector 20 may be provided within the instrument panel 80 and configured to project the image onto a predetermined projection surface. The image may be displayed on the curved screen 10 to allow a viewer, such as a driver, to visually recognize the image. The controller 60 may be configured to specify an image to be displayed on the curved screen 10 and operate the projector 20 according to the specified image. The controller 60 may also be configured to specify the image based on travel information detected by an information detector 5 (e.g., a data detector).
[0020] The image may include cluster information, navigation information, audio information, air conditioning information, and the like. The cluster information may include vehicle speed information, engine speed information, cooling temperature information, fuel level information, accumulated mileage information, traveled mileage information, operating status information of lights (e.g., turn signal lights or high beam lights), operating status information of devices (e.g., doors, seat belts, or batteries), or the like.
[0021] The navigation information, audio information, and air conditioning information may include an operation interface configured with a plurality of selectable objects corresponding to various operating means and screens for operating a navigation device, an audio device, and an air conditioning system. More specifically, an object refers to information that is intentionally selected and executed by a user. For example, the object may be an image, an icon, a folder icon, text, a fill, a list, or the like. The navigation information may include a navigation menu configured with a plurality of selectable objects, a current position of the vehicle, route guidance on a map, or the like.The audio information may include an audio menu configured with a plurality of selectable items, volume, a sound source currently playing, a radio channel frequency, or the like. The air conditioning information may include an air conditioning menu, a current temperature, an airflow rate, or the like.
[0022] The first mirror 30 and the second mirror 35 may be arranged between the curved screen 10 and the projector 20. The image projected by the projector 20 may be reflected via the first mirror 30 to the second mirror 35. The image reflected by the second mirror 35 may be projected onto the curved screen 10 and then displayed to the user. The first mirror 30 may be an aspherical mirror manufactured based on the curvature value of the curved screen 10. Furthermore, by using the first mirror 30, the path depth of light required to display the image on the curved screen 10 can be adjusted to adapt the size of the curved display device 100.
[0023] Furthermore, the infrared illuminator 40 and the infrared imaging device 45 can be used to detect a user's touch input. The infrared illuminator 40 can be configured to output infrared rays to the curved screen 10. The infrared imaging device 45 (e.g., a camera, a video camera, or the like) can be configured to capture an infrared image corresponding to substantially the entire surface of the curved screen 10. The infrared imaging device 45 can be configured to process an image frame, such as a still image or a moving image, obtained by an image sensor in a capture mode. The further processed image frame can be passed to the controller 60. The controller 60 can be implemented by one or more microprocessors and executed by a predetermined program.The predetermined program may include a series of instructions for executing each step included in a method for controlling the curved display device 100 according to an exemplary embodiment of the present invention.
[0024] The curved display device 100 according to an exemplary embodiment of the present invention may further include an application driver 70 configured to execute an application function according to execution instructions from the controller 60. When a user's hand H touches any point on the curved screen 10 (e.g., in response to detecting a touch), the infrared imaging device 45 may be configured to capture the infrared image reflected from the curved screen 10. The controller 60 may be configured to determine a touch point based on the reflected infrared image. The user may select a desired object from the plurality of objects.In this case, the controller 60 can be configured to generate control commands for executing an application function that is linked to the selected object (e.g., corresponds to it) and to output the control commands to the application driver 70. This means that the controller 60 can be configured to determine a corresponding function based on the selected object. In particular, the application function can be one of a plurality of application functions of a plurality of electronic devices (e.g., the navigation device, the audio device, or the air conditioning system) arranged in the vehicle.
[0025] If, with reference to Fig. 2 a user's hand (H) touches a desired object 15 (e.g., in response to pressure detection on the screen), the controller 60 may be configured to generate control commands for executing a "seek-to" function associated with the selected object 15 and output the control commands to the application driver 70. As a result, the navigation device may be configured to execute the "seek-to" function. The physical actuator layer receiving device 50 may be mounted within the instrument panel 80. The physical actuator layer receiving device 50 may include a housing 510 and a physical actuator layer 520 received in the housing 510 and adapted to be pulled forward from the curved screen 10.In other words, the physical buttons and knobs of the physical actuator layer 520 may be projected forward from the curved screen 10 to allow a user to physically adjust the buttons and knobs to perform various functions.
[0026] Fig. 3A to 3D are exemplary drawings showing an operating state of a physical actuator layer recording device according to an exemplary embodiment of the present invention. Fig. 4 is an exemplary drawing showing a case where a physical actuator layer is pulled out (e.g., ejected from, protruded from, etc.) from a physical actuator layer receiving device according to an exemplary embodiment of the present invention. The physical actuator layer receiving device 50 shown in Fig.3A to 3D is merely an example for describing the exemplary embodiment of the present invention, and the present invention is not limited thereto. Even in another configuration of the physical actuating agent layer receptacle 50, the technical teachings of the present invention can be applied to any configuration in which the physical actuating agent layer 520 is substantially pull-out.
[0027] Furthermore, a movement space 512a, a receiving space 512b, a guide space 512c, and a gear chamber 512d may be formed in the housing 510. A rack 530 may be movably disposed in the movement space 512a. A pinion 535 may mesh with the rack 530. The pinion 535 may be attached to a rotation shaft of a drive motor 550, and the rack 530 may be displaced forward or backward according to rotation of the pinion 535. The pinion 535 may be disposed within the gear chamber 512d, and the gear chamber 512d may be formed above the movement space 512a.
[0028] Furthermore, the physical actuating means layer 520 may be arranged in the receiving space 512b. At least one button 520a and at least one rotary knob 520b may be provided on a surface of the physical actuating means layer 520. In particular, one end (e.g., a first end) of the receiving space 512b may be open, and the other end (e.g., a second end) of the receiving space 512b may be closed. An opened portion of the receiving space 512b may be rounded away from the curved screen 10. Furthermore, a guide groove 514 may be formed in the guide space 512c, and one end (e.g., a first end) of the guide space 512c may be rounded toward the curved screen 10. The physical actuating means layer 520 and the rack 530 may be connected by a connecting member 540. One end (e.g.,One end (e.g., a first end) of the connecting member 540 may be pivotally connected to the physical actuator layer 520 by a first pivot pin 542a, and the other end (e.g., a second end) of the connecting member 540 may be pivotally connected (e.g., via a hinge) to the rack 530 by a second pivot pin 542b.
[0029] The rack 530 may be configured to move forward when the pinion 535 is rotated counterclockwise by the drive motor 540 according to a drive signal from the controller 60. The first pivot pin 542a may be configured to move along the guide groove 514 when the rack 530 moves forward. As a result, the physical actuator layer 520 may be pulled forward from the curved display 10 (e.g., pushed out, moved forward, etc.), and the user may operate the button 520a disposed on the physical actuator layer 520. Furthermore, the rack 530 may be configured to move backward when the pinion 535 is rotated clockwise by the drive motor 540 according to a drive signal from the controller 60.The first pivot pin 542a may be configured to move along the guide groove 514 as the rack 530 moves rearward. As a result, the physical actuator layer 520 may be retracted into the housing 510 (e.g., retracted into the housing).
[0030] The controller 60 may be configured to determine whether an appearance condition is met, and the physical actuator layer 520 may be pulled forward from the curved screen 10 when the appearance condition is met. The appearance condition may be met when a vehicle speed is greater than a first predetermined speed. The controller 60 may be configured to compare a vehicle speed with the first predetermined speed based on travel information detected by the information detector 50. The first predetermined speed may be arbitrarily set by a person skilled in the art and may be 60 km / h. In other words, it is possible to prevent a driver from losing attention when the vehicle is traveling at substantially high speeds (e.g., speeds above a predetermined speed limit).
[0031] Furthermore, the appearance condition may be met when an appearance request signal is received from a user input unit 7. The user input unit 7 may be configured to generate input data for pulling out the physical actuator layer 520 according to a user input. The user input unit 7 may be configured with a button or an object displayed on the curved screen 10. The controller 60 may be configured to determine whether a lowering condition is met, and the physical actuator layer 520 may be pulled into the housing 510 (e.g., retracted) when the lowering condition is met.
[0032] The lowering condition may be satisfied when the vehicle speed is lower than a second predetermined speed. The controller 60 may be configured to compare the vehicle speed with the second predetermined speed based on travel information detected by the information detector 5. The second predetermined speed may be arbitrarily determined by a person skilled in the art, taking the first vehicle speed into account. A predetermined hysteresis may be set to prevent chatter in a boundary region between the first predetermined speed and the second predetermined speed. In other words, the second predetermined speed may be lower than the first predetermined speed. Furthermore, the lowering condition may be satisfied when a lowering request signal is received from the user input unit 7.
[0033] As described above, in the exemplary embodiment of the present invention, sufficient space for physical operating elements can be ensured. Furthermore, an application function can be executed by a physical operating element even if a user touch is misdetected. That is, a corresponding function can still be executed even if a press on a display screen is misdetected by enabling user input via physical buttons or knobs. Accordingly, the vehicle can provide both a display screen and physical buttons and knobs, thereby increasing user convenience. Furthermore, it is possible to avoid disturbing driver attention when a vehicle is moving at substantially high speeds by using physical operating means.
Claims
[1] Curved display device (100) for a vehicle comprising: a projector (20) arranged within an instrument panel (80) and configured to project an image onto a predetermined projection surface; a first mirror (30) configured to reflect the image projected by the projector (20); a second mirror (35) arranged to reflect the image reflected by the first mirror (30); a curved screen (10) arranged on a surface of the instrument panel (80) and arranged to display the image reflected by the second mirror (35); an infrared illuminator (40) configured to emit infrared rays onto the curved screen (10); an infrared imaging device (45) configured to capture an infrared image of the curved screen (10); a physical actuator layer receiving device (50) comprising a housing (510) and a physical actuator layer (520) mounted within the housing (510) to be pulled forward from the curved screen (10); and a controller (60) which is configured: to determine the image displayed on the curved screen (10); to operate the projector (20) according to the specified image; to determine a touch position based on the infrared image; to determine whether an appearance condition is met; and pull the physical actuating means layer (520) forward from the curved screen (10) when the appearance condition is met. [2] The curved display device (100) according to claim 1, wherein the appearance condition is satisfied when a vehicle speed is greater than a first predetermined speed. [3] The curved display device (100) according to claim 1, wherein the appearance condition is satisfied when an appearance request signal is received from a user input unit (7). [4] Curved display device (100) according to one of the preceding claims, wherein the controller (60) is arranged to determine whether a lowering condition is met and to retract the physical actuating means layer (520) into the housing (510) if the lowering condition is met. [5] The curved display device (100) according to claim 4, wherein the lowering condition is satisfied when a vehicle speed is less than a second predetermined speed. [6] A curved display device (100) according to claim 4, wherein the lowering condition is satisfied when a lowering request signal is received from a user input unit (7). [7] A curved display device (100) according to any one of the preceding claims, wherein the first mirror (30) is an aspherical mirror manufactured based on a curvature value of the curved screen (10). [8] Curved display device (100) according to one of the preceding claims, wherein the image displayed on the curved screen (10) has a user interface configured with a plurality of selectable objects. [9] Curved display device (100) according to claim 8, wherein the controller (60) is further configured to: Generate control commands for executing an application function associated with a selected object in response to a determination that the touch position corresponds to one of the plurality of objects. [10] A curved display device (100) according to any one of the preceding claims, wherein at least one button (520a) and one rotary knob (520b) are arranged on a surface of the physical actuation means layer (520). [11] Curved display device (100) according to one of the preceding claims, wherein the housing (510) comprises: a movement space (512a) in which a rack (530) is slidably arranged; a receiving space (512b) in which the physical actuating means layer (520) is arranged; a guide space (512c) in which a guide groove (514) is formed; and a gear chamber (512d) in which a pinion (535) engaging with the rack (530) is arranged, wherein one end of the guide space (512c) is rounded towards the curved screen (10). [12] Curved display device (100) according to claim 11, wherein the physical actuating means layer (520) and the rack (530) are connected by a connecting element (540), a first end of the connecting element (540) is pivotally connected to the physical actuating means layer (520) by a first pivot pin (542a) and a second end of the connecting element (540) is pivotally connected to the rack (530) by a second pivot pin (542b), and the first hinge pin (542a) moves along the guide groove (514) according to a movement of the rack (530). [13] A curved display device (100) according to claim 11 or 12, wherein the gear chamber (512d) is formed above the movement space (512a). [14] Method for curved representation for a vehicle with: Projecting an image onto a predetermined projection surface using a projector (20) arranged within an instrument panel (80) by a controller (60); Displaying the image projected by the projector (20) on a curved screen (10) arranged on a surface of the instrument panel (80) by the controller (60); Emitting infrared emitters onto the curved screen (10) by the controller (60); capturing an infrared image of the curved screen (10) using an infrared imaging device (45) by the controller (60); Determining a touch position based on the infrared image by the controller (60); Determining whether an appearance condition is met by the controller (60); and Pulling out a physical actuator layer (520) forward from the curved screen (10) by the controller (60) when the appearance condition is met. [15] The method of claim 14, wherein the occurrence condition is satisfied when a vehicle speed is greater than a first predetermined speed. [16] A method according to claim 14 or 15, further comprising: Determining whether a lowering condition is met by the controller (60); and Retracting the physical actuating layer (520) into a housing (510) by the controller (60) when the lowering condition is met. [17] A method according to claim 16, wherein the lowering condition is met when a vehicle speed is less than a second predetermined speed. [18] A non-transitory computer-readable medium having program instructions to be executed by a controller (60), the computer-readable medium comprising: Program instructions that project an image onto a predetermined projection surface using a projector (20) disposed within an instrument panel (80); Program instructions that display the image projected by the projector (20) on a curved screen (10) arranged on a surface of the instrument panel (80); Program instructions which emit infrared rays onto the curved screen (10); Program instructions that capture an infrared image of the curved screen (10) using an infrared imaging device (45); Program commands that determine a touch position based on the infrared image; Program instructions that determine whether an appearance condition is met; and Program instructions that extend a physical actuator layer (520) forward from the curved screen (10) when the appearance condition is met. [19] The non-transitory computer-readable medium of claim 18, wherein the appearance condition is satisfied when a vehicle speed is greater than a first predetermined speed. [20] A non-transitory computer-readable medium according to claim 18 or 19, further comprising: Program instructions that determine whether a lowering condition is met; and Program instructions that retract the physical actuator layer (520) into a housing (510) when the lowering condition is met.
Citation Information
Patent Citations
Computer vision based touch screen
US20080150913A1
Reconfigurable tactile controls and displays
US20100201893A1
