Non-contact interface device and control method thereof

Abstract

The present invention relates to a contactless interface device and a control method thereof, which can display, as a hologram, an operating system menu for a driver and an occupant to operate various devices of a vehicle, enabling a user to operate the displayed operating system menu in a contactless manner by using a user's finger, etc. And tactile feedback of non-contact operation is provided for the user, so that the user can identify whether the menu is operated or not.

Description

Technical Field

[0001] The present invention relates to a non-contact interface device and a control method thereof, and more particularly, to a non-contact interface device and a control method thereof that can operate various devices of a vehicle through non-contact operations. Background Art

[0002] According to the trend of technological advancement of autonomous driving vehicles, the driver's driving intervention is minimized. If autonomous driving vehicles of level 4 or above (which do not require driver's driving intervention) become popular, time for rest, business or other leisure activities can be freely guaranteed during the movement of the vehicle.

[0003] As the technology of such autonomous vehicles advances, solutions are needed to enable all occupants to take advantage of the human-machine interface (hereinafter referred to as "HMI") of future mobility tools by moving away from driver-centric HMI designs.

[0004] For example, if a mobile vehicle such as a purpose built vehicle (PBV) is launched, an HMI needs to be installed in the mobile vehicle so that everyone in the mobile vehicle can perform operations related to business, shopping, infotainment, etc. without being restricted by their seat positions.

[0005] On the other hand, due to the increasing global concern about hygiene caused by COVID-19, the change from traditional physical button-based contact HMI to contactless HMI has been promoted in various industries.

[0006] Therefore, the HMI installed in autonomous vehicles or future mobility tools needs to meet the requirements of a multifunctional interface that is flexible and deformable, allowing all drivers and passengers to operate regardless of their seat position, and includes contactless operation and tactile feedback functions.

[0007] The information included in the Background of the Invention is only for enhancement of understanding of the general background of the invention and should not be taken as an acknowledgment or any form of suggestion that this information forms the prior art already known to a person skilled in the art. Summary of the invention

[0008] Various aspects of the present invention are intended to provide a non-contact interface device for a vehicle and a control method thereof, which can display an operating system menu for a driver and a passenger to operate various devices of the vehicle as a hologram, enable a user to operate the displayed operating system menu in a non-contact manner by using the user's fingers, etc., and provide the user with tactile feedback of the non-contact operation so that the user can identify whether the menu has been operated.

[0009] The objects of the present invention are not limited to the above objects, and other unmentioned objects of the present invention will be clearly understood from the following description by an ordinary technician in the field to which the present invention belongs (hereinafter referred to as "ordinary technicians").

[0010] In various aspects of the present invention, an exemplary embodiment of the present invention provides a contactless interface device, which includes: an annular main body, a display, a hologram plate, a camera, a plurality of ultrasonic elements and a controller, wherein the annular main body is rotatably mounted on an internal component of a vehicle; the display is mounted on the lower part of the main body and is configured to display an operating system image; the hologram plate is mounted on the inside of the main body and is configured to generate a holographic image by transmitting the operating system image displayed on the display; the camera is mounted at a predetermined position of the main body and is configured to detect the operation of a user's finger or palm; the plurality of ultrasonic elements are mounted on the inner circumference of the main body and are configured to provide tactile feedback to the user; the controller is operably connected to the display, the camera and the plurality of ultrasonic elements, and is configured to control the display to display the operating system image, and to control the operation of the ultrasonic elements based on the recognition signal of the camera.

[0011] The display is installed at a lower portion of the main body at an inclined angle, and the hologram plate is installed inside the main body in a horizontally arranged state.

[0012] The display angle and position of the holographic image are determined according to the angle between the display and the holographic plate.

[0013] An ultrasonic element alignment plate for mounting a plurality of ultrasonic elements at predetermined intervals is attached to the inner periphery of the main body portion.

[0014] Preferably, at least two rows of alignment holes for mounting the ultrasonic elements are formed in a zigzag arrangement along the circumferential direction on the ultrasonic element alignment plate.

[0015] The controller is configured to: based on the detection signal of the camera, when it is determined that the user's finger or palm is placed in a position where the user's finger or palm can operate the holographic image, control the ultrasonic element to continue to operate for a predetermined period of time to provide continuous tactile feedback to the user.

[0016] The controller is configured to determine input coordinates of the operating system in response to a user performing an input operation of the operating system displayed as a holographic image based on a detection signal of the camera to determine what menu of the operating system the user has selected.

[0017] The controller is configured to, after determining the input coordinates of the operating system, momentarily operate the ultrasonic element to provide a tactile feedback to the user notifying that a menu of the operating system has been selected.

[0018] The main body is rotatably mounted to a mobile console in an interior assembly of a vehicle.

[0019] For this purpose, a ball bearing is installed between the bottom of the main body and the upper surface of the moving console.

[0020] In various aspects of the present invention, another exemplary embodiment of the present invention provides a method for controlling a non-contact interface device, the method comprising: displaying a holographic image by transmitting an operating system display image of a display installed on a main body through a holographic plate; detecting the operation of a user's finger or palm by a camera installed on the main body; determining by a controller whether the user's finger or palm is placed at a position where the user's finger or palm can operate the holographic image based on the detection signal of the camera; when it is determined that the user's finger or palm is placed at a position where the user's finger or palm can operate the holographic image, the controller causes a plurality of ultrasonic elements installed on the main body to operate once to preliminarily provide tactile feedback to the user; based on the detection signal of the camera, the controller determines the input coordinates of a menu of the operating system selected by the user in the menu of the operating system displayed as a holographic image; the controller causes the plurality of ultrasonic elements to operate a second time to provide the user with tactile feedback informing the user that the menu of the operating system has been selected.

[0021] In the step of once operating the ultrasonic element, the controller is configured to control the ultrasonic element to continue operating for a predetermined period of time.

[0022] In the step of the ultrasonic element secondary operation, the controller is configured to control the ultrasonic element to operate instantaneously.

[0023] By means of solving the above-mentioned problems, the present invention provides the following effects.

[0024] First, by displaying an operating system menu for operating various devices of a vehicle as a hologram and enabling the displayed operating system menu to be operated in a contactless manner by using a user's finger or the like, convenience of a user interface can be improved.

[0025] Second, by enabling all drivers and passengers in the vehicle to operate various required devices of the vehicle in a contactless manner, a hygienic effect can be provided, for example, to prevent COVID-19.

[0026] Third, during the user's contactless operation, tactile feedback is provided by the ultrasonic element, and the user can easily recognize whether the operating system menu displayed as a holographic image has been selected.

[0027] Fourth, compared with a conventional single ultrasonic element, by mounting a plurality of ultrasonic elements in at least two rows of alignment holes of an ultrasonic element alignment plate, the sound pressure level of tactile feedback may be increased.

[0028] Fifth, since a plurality of ultrasonic elements are installed in at least two rows of alignment holes of an ultrasonic element alignment plate having a ring shape, although the number of installed ultrasonic elements is greatly reduced compared to a conventional planar array, the sound pressure level of tactile feedback can be maintained almost equal to the sound pressure level of a conventional planar array in which a plurality of ultrasonic elements are installed, thereby saving manufacturing costs.

[0029] Sixth, since the main body of the contactless interface device according to an exemplary embodiment of the present invention is rotatably mounted on the mobile console, any occupant in the vehicle can operate the interface device in a contactless manner by moving the mobile console and rotating the main body, thereby greatly improving the convenience of the user interface.

[0030] Other aspects and exemplary embodiments of the invention are discussed below.

[0031] It is understood that the term "vehicle" or "vehicle-related" or other similar terms used herein generally include motor vehicles, such as passenger vehicles including sport utility vehicles (SUVs), buses, trucks, various commercial vehicles, watercraft including various boats and ships, aircraft, etc., and include hybrid vehicles, electric vehicles, plug-in hybrid electric vehicles, hydrogen-powered vehicles, and other alternative fuel vehicles (e.g., fuels derived from non-petroleum energy sources). As referred to herein, a hybrid vehicle is a vehicle having two or more power sources, such as both gasoline-powered and electric-powered vehicles.

[0032] The methods and apparatus of the present invention have other features and advantages, which will be apparent from, or will be described in more detail in, the accompanying drawings and the following detailed description incorporated herein, which together serve to explain the specific principles of the present invention.

[0033] The above and other features of the invention are discussed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 is a perspective view exemplarily showing a contactless interface device according to an exemplary embodiment of the present invention;

[0035] Figure 2 is a perspective view exemplarily showing a cross section of a contactless interface device according to an exemplary embodiment of the present invention;

[0036] Figure 3 is a cross-sectional view exemplarily illustrating a contactless interface device according to an exemplary embodiment of the present invention;

[0037] Figure 4is a control block diagram of a contactless interface device according to an exemplary embodiment of the present invention;

[0038] Figure 5 is a perspective view exemplarily showing a state in which a non-contact interface device according to an exemplary embodiment of the present invention is installed on a mobile console;

[0039] Figure 6 is a side view exemplarily showing a state in which a non-contact interface device according to an exemplary embodiment of the present invention is mounted on a mobile console;

[0040] Figure 7 is a comparison diagram of an ultrasonic element alignment plate of a non-contact interface device according to an exemplary embodiment of the present invention and a conventional planar ultrasonic element alignment plate; and

[0041] Figure 8 is a flowchart illustrating a method for controlling a contactless interface device according to an exemplary embodiment of the present invention.

[0042] It should be understood that the attached drawings are not drawn to scale, but are only appropriately simplified drawings of various exemplary features presented to illustrate the basic principles of the present invention. The specific design features of the present invention included in this article (including, for example, specific size, direction, position and shape) will be determined in part by the specific environment to be applied and used.

[0043] In the drawings, like reference numerals refer to the same or equivalent parts of the present invention throughout the several figures of the drawing. DETAILED DESCRIPTION

[0044] Reference will now be made in detail to various embodiments of the present invention, examples of which are illustrated in the accompanying drawings and described below. Although the present invention will be described in conjunction with exemplary embodiments of the present invention, it should be understood that this specification is not intended to limit the present invention to the described exemplary embodiments of the present invention. On the other hand, the present invention is intended to cover not only the exemplary embodiments of the present invention, but also various alternative embodiments, modified embodiments, equivalent embodiments or other embodiments that may be included in the spirit and scope of the present invention as defined by the appended claims.

[0045] The aspects and features of the present invention and the methods for realizing these aspects and features will become apparent through the various exemplary embodiments described in detail with reference to the attached drawings. However, the present invention is not limited to the exemplary embodiments included below and can be implemented in various forms. The exemplary embodiments are provided to help those of ordinary skill in the art to fully understand the present invention, and the present invention is defined only within the scope of the attached claims. Throughout the specification, the same reference numerals represent the same constituent elements.

[0046] Furthermore, in the specification, terms such as “first and / or second” are used to distinguish constituent elements having the same name from each other, but the constituent elements should not be limited by the terms.

[0047] The detailed description can illustrate the present invention. In addition, the above content is used to explain the exemplary embodiments of the present invention, and the present invention can be used in various other combinations, modifications and environments. That is, within the scope of the concept of the present invention included in the specification, within the scope equivalent to the above-mentioned included content and / or within the scope of technology or knowledge in the industry, the present invention can be modified or changed. The described embodiment is to explain the best state of realizing the technical idea of ​​the present invention, and various modifications required for the specific application field and usage of the present invention can be carried out. Therefore, the aforementioned detailed explanation of the present invention is not intended to limit the present invention to the present invention disclosed by the exemplary embodiments of the present invention. In addition, it should be interpreted that the attached claims include other embodiments.

[0048] Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0049] Included Figure 1 , Figure 2 and Figure 3 A contactless interface device according to an exemplary embodiment of the present invention is shown. Figure 4 is a control block diagram of a contactless interface device according to an exemplary embodiment of the present invention.

[0050] like Figure 1 , Figure 2 and Figure 3 As shown, the contactless interface device according to the exemplary embodiment of the present invention includes a ring-shaped body portion 10 as a frame.

[0051] The main body 10 may be rotatably mounted to an interior component of a vehicle.

[0052] For example, the main body portion 10 may be rotatably mounted to a mobile console in an interior assembly of a vehicle.

[0053] The display 20 is installed at the lower part of the main body 10 , and the hologram plate 30 including a dielectric film for generating a hologram is installed at an upper position of the display 20 inside the main body 10 .

[0054] The display 20 displays an operating system display image for operating various devices of the vehicle through a command signal of a controller 100 operably connected to the display 20, and the hologram plate 30 generates a holographic image around a focal point 90 set on the hologram plate 30 by transmitting the operating system display image of the display 20 according to known hologram generation principles.

[0055] To this end, the display 20 is installed at a lower portion of the main body 10 to be tilted at a predetermined angle, and the hologram plate 30 is installed in a horizontally arranged state in the middle of the vertical direction inside the main body 10 .

[0056] Therefore, the focus 90 corresponding to the display angle and display position of the holographic image (which depend on the angle between the display 20 and the hologram plate 30) can be determined.

[0057] For example, if the display 20 is installed at an angle of 30° to 60° at the lower part of the main body 10, and the hologram plate 30 is installed in a horizontal arrangement state in the middle of the vertical direction inside the main body 10, as shown in FIG. Figure 3 As shown, the display angle of the holographic image generated by the hologram plate 30 may be determined to be an angle of 30° to 60° centered at the focal point 90 .

[0058] Accordingly, the operating system image of the display 20 can pass through the hologram plate 30 and can be displayed as a contactless operable virtual holographic image 110 on the user's finger or palm with the focus 90 as the center in the upper space of the hologram plate 30.

[0059] The camera 40 for detecting finger or palm operation of the user is installed at a predetermined inner position of the main body 10 , that is, at a boundary position between the inner surface of the main body 10 and the upper surface of the hologram plate 30 .

[0060] Therefore, the camera 40 detects whether the user's finger or palm is placed at a position where the user's finger or palm can operate the holographic image in a non-contact manner, and detects the movement of the user's finger or palm to perform an input operation of a menu of the operating system (which is displayed as a holographic image) to send the detected movement to the controller 100.

[0061] A plurality of ultrasonic elements 50 are mounted on the inner periphery of the main body 10, and when a user's fingers or palms are placed in a position where the user's fingers or palms can operate the holographic image, the ultrasonic elements 50 can operate to provide tactile feedback to the user, or when the user performs a selection operation on an operating system menu of the holographic image, the ultrasonic elements 50 can operate to provide tactile feedback to the user.

[0062] To this end, an ultrasonic element alignment plate 60 for mounting the plurality of ultrasonic elements 50 is attached to the inner circumference of the body portion 10 .

[0063] The ultrasonic element alignment plate 60 is provided as an annular plate structure having a predetermined thickness and a diameter increasing from the lower end to the upper end, and is provided as a structure in which two rows of alignment holes 62 for mounting a plurality of ultrasonic elements 50 are formed in a zigzag shape in the circumferential direction.

[0064] Refer to the attached Figure 7 , the ultrasonic element alignment plate 60 has a structure in which 156 two-row alignment holes 62 for mounting ultrasonic elements are formed in the circumferential direction, and a total of 156 ultrasonic elements 50 can be mounted, while the planar ultrasonic element alignment plate 70 applied to the conventional non-contact interface system has a structure in which 256 alignment holes 72 for mounting ultrasonic elements are formed in the horizontal and vertical directions, and a total of 256 ultrasonic elements 50 are mounted. Therefore, if the ultrasonic element alignment plate 60 according to the exemplary embodiment of the present invention is used, the number of ultrasonic elements to be mounted can be reduced, so that the number of components and manufacturing costs can be reduced.

[0065] In addition, since the 156 ultrasonic elements 50 installed and inserted into the two rows of alignment holes 62 of the ultrasonic element alignment plate 60 are arranged in a zigzag shape around the focus (where the holographic image is generated) in the circumferential direction, it can be determined that the sound pressure level (approximately 164dbSPL) of the tactile feedback generated by the 156 ultrasonic elements 50 is almost the same as the sound pressure level (approximately 164dbSPL) generated by the 256 ultrasonic elements 50 installed and inserted into the conventional planar ultrasonic element alignment plate 70.

[0066] Since all 156 ultrasonic elements 50 installed and inserted into the two rows of alignment holes 62 of the ultrasonic element alignment plate 60 maintain the same distance from the focal point (where the holographic image is generated), the sound pressure level of the tactile feedback generated by each ultrasonic element 50 can be concentrated on the focal point and its surroundings, so that it can be determined that the sound pressure level (approximately 164dbSPL) generated by the 156 ultrasonic elements 50 installed and inserted into the two rows of alignment holes 62 of the ultrasonic element alignment plate 60 is almost close to the sound pressure level (approximately 164dbSPL) generated by the 256 ultrasonic elements 50 installed and inserted into the conventional planar ultrasonic element alignment plate 70.

[0067] Although the number of ultrasonic elements 50 installed on the ultrasonic element alignment plate according to the exemplary embodiment of the present invention is further reduced compared to the number of ultrasonic elements installed on the conventional planar ultrasonic element alignment plate 70, it can be determined that the sound pressure level of tactile feedback generated by the ultrasonic elements 50 installed on the ultrasonic element alignment plate 60 according to the exemplary embodiment of the present invention (approximately 164dbSPL) is equal to the sound pressure level of tactile feedback generated by the ultrasonic elements installed on the conventional planar ultrasonic element alignment plate 70 (approximately 164dbSPL).

[0068] Meanwhile, the controller 100 is configured to control the display 10 to display an operation system image for operating various devices of the vehicle, and to control the operation of the ultrasonic element 50 based on a detection (recognition) signal of the camera 40 .

[0069] In addition, the controller 100 operably connected to the ultrasonic element 50 is configured to: if it is determined based on the detection signal of the camera 40 that the user's finger or palm is placed in a position where the user's finger or palm can operate the holographic image, control the ultrasonic element 50 to continue to operate for a predetermined period of time to provide continuous tactile feedback to the user.

[0070] In addition, the controller 100 is configured to determine the input coordinates of the operating system based on the detection signal of the camera (for example, the coordinate value when the user operates the input of the menu of the operating system displayed as a holographic image with the user's finger) to determine what menu of the operating system the user has selected in response to the user performing the input operation of the operating system displayed as a holographic image.

[0071] Furthermore, after determining the input coordinates of the operating system, the controller 100 is configured to momentarily operate the ultrasonic element 50 to provide the user with tactile feedback notifying that a menu of the operating system has been selected.

[0072] Meanwhile, the contactless interface device according to the exemplary embodiment of the present invention may be rotatably mounted on the mobile console 80 in the interior assembly of the vehicle so that all drivers and passengers in the vehicle can operate the contactless interface.

[0073] For this reason, Figure 5 and Figure 6 As shown, in a state where the main body 10 is rotatably mounted on the moving console 80 , the ball bearing 82 may be installed between the bottom of the main body 10 and the upper surface of the moving console 80 .

[0074] Hereinafter, the operation flow of the non-contact interface device of the present invention including the above-mentioned structure will be described.

[0075] Included Figure 8 is a flowchart illustrating a method for controlling a contactless interface device according to an exemplary embodiment of the present invention.

[0076] First, in order for an occupant in a vehicle to use a contactless interface device, the mobile console 80 may be moved to a position where the occupant is located under the control of the controller 100 (step S101 ).

[0077] Accordingly, an operation system image for operating various devices of the vehicle is displayed on the display 20 by a command signal of the controller 100 (step S102).

[0078] Next, the operating system image displayed by the display 20 may pass through the hologram plate 30, and may be generated as a virtual hologram image 110 centered around the focus 90 in an upper space of the hologram plate 30 (step S103).

[0079] For example, since the display 20 is installed at an angle of 30° to 60° at one side of the lower end of the main body 10, and the hologram plate 30 is installed in the middle of the vertical direction in a horizontally arranged state inside the main body 10, as shown in FIG. Figure 3 The holographic image (operating system image) generated by the hologram plate 30 shown may be generated with an inclination of 30° to 60° centered at a focal point.

[0080] In addition, since the holographic image (operating system image) is generated with an inclination of 30° to 60° centered on the focal point, the user can stably operate the holographic image (operating system image) in a non-contact manner by using the user's fingers or palms.

[0081] In other words, if the holographic image (operating system image) is generated in a vertical direction with the focus as the center, the user needs to perform non-contact operation with the user's fingers or palms bent to the maximum, causing discomfort to the user. However, since the holographic image (operating system image) is generated with an inclination of 30° to 60° with the focus as the center, the user can stably and conveniently operate the holographic image (operating system image) in a non-contact manner by using the user's fingers or palms.

[0082] In this case, in order to easily operate the hologram image in a non-contact manner, the passenger may rotate the main body 10 about the ball bearing 82 .

[0083] That is, in order for the user to stably operate the hologram image in a non-contact manner by using the user's fingers or palm, the occupant may rotate the main body 10 about the ball bearing 82 in a desired direction.

[0084] Next, the hand tracking operation refers to detecting the user's finger or palm operation through the camera 40 installed in the main body 10 (step S104).

[0085] Accordingly, based on the detection signal of the camera 40, the controller 100 determines whether the user's finger or palm is placed at a position where the user's finger or palm can operate the holographic image (step S105).

[0086] If it is recognized that the user's finger or palm is placed at a position where the user's finger or palm can operate the holographic image as a result of the judgment in step S105, the controller 100 is configured to control multiple ultrasonic elements 50 installed in the main body to operate at one time to generate a tactile feedback (step S106).

[0087] In this case, in order to provide continuous tactile feedback to the user, the ultrasonic element 50 may be continuously operated for a predetermined period of time to generate one tactile feedback.

[0088] In other words, since the 156 ultrasonic elements 50 installed and inserted into the two rows of alignment holes 62 of the ultrasonic element alignment plate 60 continuously generate the sound pressure level of tactile feedback (about 164dbSPL) for a predetermined period of time, the user can feel a tactile feedback (such as tactile vibration) through the user's fingers or palm, and therefore, the user can know that the user's fingers or palm are accurately placed at the position where the user's fingers or palm can operate the holographic image in a non-contact manner.

[0089] Next, the controller 100 determines whether the user operates an operation menu of the holography image by using the user's finger or palm (step S107).

[0090] That is, based on the detection signal of the camera 40, the controller 100 determines whether the user operates a menu of the operating system displayed as a holographic image in a non-contact manner by using the user's finger or palm.

[0091] If it is determined that there is a non-contact operation using the user's finger or palm as a result of the determination in step S107, the controller 100 is configured to determine input coordinates of a menu of the operating system selected by the user using the user's finger or palm (step S108).

[0092] That is, based on the detection signal of the camera 40, the controller 100 is configured to determine the input coordinates of a menu of the operating system selected by the user by using the user's finger or palm in the menu of the operating system displayed as a holographic image. Since the method of converting the detection signal of the camera 40 into the input coordinates of the menu is well known, the detailed description is omitted.

[0093] For example, in a state where the coordinate values ​​of a menu of an operating system displayed as a holographic image are predetermined, since the controller 100 obtains the coordinate values ​​of the menu of the operating system selected by the user in a non-contact manner based on the detection information of the camera 40, the controller 100 can identify what menu of the operating system the user has selected.

[0094] Next, the controller 100 may be configured to control the plurality of ultrasonic elements 50 to operate a second time, so that the ultrasonic elements 50 generate a second tactile feedback notifying the user that the selection of the menu of the operating system has been completed.

[0095] In other words, after determining the input coordinates of the menu of the operating system selected by the user by using the user's finger or palm, the controller 100 can be configured to control the 156 ultrasonic elements 50 installed and inserted into the two rows of alignment holes 62 of the ultrasonic element alignment plate 60 to instantaneously operate so that the ultrasonic elements 50 instantaneously generate a sound pressure level (about 164dbSPL) of tactile feedback for a certain period of time. Therefore, the user can feel the secondary tactile feedback (such as tactile vibration) through the user's finger or palm, so that the user can recognize that the selection of the desired menu of the operating system has been completed.

[0096] Meanwhile, the controller 100 may operate the vehicle device or equipment selected by the user by controlling the vehicle device or equipment corresponding to the menu of the operating system selected by the user (step S110 ).

[0097] In an exemplary embodiment of the present invention, the controller 100 may operate a vehicle device or equipment selected by a user by controlling a vehicle device or equipment corresponding to a menu of an operating system selected by a user (step S110) and controlling a plurality of ultrasonic elements 50 to operate secondary (step S109).

[0098] As described above, by displaying an operating system menu for operating various devices of a vehicle as a hologram and enabling the displayed operating system menu to be operated in a contactless manner by using a user's finger or the like, convenience of a user interface can be improved.

[0099] In addition, since the main body of the contactless interface device according to an exemplary embodiment of the present invention is rotatably mounted on the mobile console, any occupant in the vehicle can operate the interface device in a contactless manner by moving the mobile console and rotating the main body, thereby greatly improving the convenience of the user interface.

[0100] In addition, terms related to control devices such as "controller", "control device", "control unit", "control means", "control module" or "server" refer to hardware devices including a memory and a processor configured to execute one or more steps interpreted as an algorithm structure. The memory stores the algorithm steps, and the processor executes the algorithm steps to perform one or more processes of the method according to various exemplary embodiments of the present invention. The control device according to the exemplary embodiment of the present invention can be implemented by a non-volatile memory and a processor, the non-volatile memory is configured to store an algorithm for controlling the operation of various components of the vehicle or data about software instructions for executing the algorithm, and the processor is configured to perform the above operations using data stored in the memory. The memory and the processor may be separate chips. Alternatively, the memory and the processor may be integrated in a single chip. The processor may be implemented as one or more processors. The processor may include various logic circuits and operating circuits, may be configured to process data according to a program provided from the memory, and may be configured to generate a control signal according to the processing result.

[0101] The control device may be at least one microprocessor operated by a predetermined program, which may include a series of instructions for executing the methods included in the aforementioned various exemplary embodiments of the present invention.

[0102] The foregoing invention may also be implemented as a computer-readable code on a computer-readable recording medium. A computer-readable recording medium is any data storage device capable of storing data that can be subsequently read by a computer system and storing and executing program instructions that can subsequently be read by a computer system. Examples of computer-readable recording media include hard disk drives (HDDs), solid-state disks (SSDs), silicon disk drives (SDDs), read-only memories (ROMs), random access memories (RAMs), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc., and are implemented as carrier waves (e.g., transmitted over the Internet). Examples of program instructions include machine language codes (e.g., machine language codes generated by a compiler) and high-level language codes that can be executed by a computer using an interpreter, etc.

[0103] In various exemplary embodiments of the present invention, each of the above-described operations may be performed by a control device, and the control device may be configured by a plurality of control devices or an integrated single control device.

[0104] In various exemplary embodiments of the present invention, the memory and the processor may be provided as one chip, or provided as separate chips.

[0105] In various exemplary embodiments of the present invention, the scope of the present invention includes software or machine-executable instructions (e.g., operating systems, applications, firmware, programs, etc.) for enabling operations of methods according to various embodiments to be performed on a device or computer, and non-transitory computer-readable media including such software or commands stored thereon and capable of being executed on a device or computer.

[0106] In various exemplary embodiments of the present invention, the control device may be implemented in the form of hardware or software, or may be implemented as a combination of hardware and software.

[0107] Furthermore, terms such as “unit”, “module” and the like included in the specification refer to a unit for processing at least one function or operation, which may be implemented by hardware, software or a combination thereof.

[0108] For ease of explanation and accurate definition of the appended claims, the terms "upper", "lower", "inner", "outer", "above", "below", "upward", "downward", "front", "rear", "back", "inside", "outside", "inward", "outward", "interior", "exterior", "inner", "exterior", "forward" and "rearward" are used to describe features of the exemplary embodiments with reference to the positions of such features as shown in the accompanying drawings. It will be further understood that the term "connected" or its derivatives refer to both direct and indirect connections.

[0109] The term "and / or" may include a combination of multiple related listed items or any one of multiple related listed items. For example, "A and / or B" includes all three situations such as "A", "B" and "A and B".

[0110] In this specification, a singular expression includes a plural expression unless the context clearly indicates otherwise.

[0111] In an exemplary embodiment of the present invention, “at least one of A and B” may refer to “at least one of A or B” or “at least one of a combination of at least one of A and B”. Furthermore, “one or more of A and B” may refer to “one or more of A or B” or “one or more of a combination of one or more of A and B”.

[0112] In the exemplary embodiments of the present invention, it should be understood that terms such as "including" or "having" are intended to indicate the presence of features, values, steps, operations, elements, parts, or combinations thereof described in the specification, and do not exclude the possibility of adding or existing one or more other features, values, steps, operations, elements, parts, or combinations thereof. The foregoing description of the specific exemplary embodiments of the present invention is presented for the purpose of illustration and description. These descriptions are not intended to be exhaustive or limit the present invention to the precise form disclosed, and it is obvious that many modifications and changes can be made according to the above teachings. Exemplary embodiments are selected and described in order to explain the specific principles of the present invention and its practical application, so that those skilled in the art can implement and utilize various exemplary embodiments of the present invention and various alternative embodiments and modified embodiments thereof. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A contactless interface device, comprising: Main body; a display mounted at a lower portion of the main body and configured to display an operating system image; a hologram plate installed inside the main body and configured to generate a holographic image by transmitting an operating system image displayed on the display; a camera mounted at a predetermined position of the main body and configured to detect an operation of a body part of a user; a plurality of ultrasonic elements mounted on an inner periphery of the main body portion and configured to provide tactile feedback to a user; as well as A controller is operably connected to the display, the camera and the plurality of ultrasonic elements, and the controller is configured to control the display to display an operating system image, and control the operation of the plurality of ultrasonic elements based on the detection signal of the camera.

2. The contactless interface device according to claim 1, wherein: The main body is rotatably mounted to an interior component of a vehicle.

3. The contactless interface device according to claim 1, wherein: The display is installed at a lower portion of the main body at an inclined angle, and the hologram plate is installed inside the main body in a horizontally arranged state.

4. The contactless interface device according to claim 1, wherein: The display angle and position of the holographic image are determined according to the angle between the display and the holographic plate.

5. The contactless interface device according to claim 1, wherein: An ultrasonic element alignment plate for mounting a plurality of ultrasonic elements at predetermined intervals is attached to the inner periphery of the main body portion.

6. The contactless interface device according to claim 5, wherein: At least two rows of alignment holes for mounting a plurality of ultrasonic elements are formed in a zigzag arrangement along a circumferential direction on the ultrasonic element alignment plate.

7. The contactless interface device according to claim 6, wherein: The ultrasonic element alignment plate is formed into an annular plate structure having a predetermined thickness and a diameter that increases from a lower end portion toward an upper end portion.

8. The contactless interface device according to claim 1, wherein: The controller is further configured to: based on the detection signal of the camera, when it is determined that the user's body part is placed in a position where the user's body part can operate the holographic image, control the multiple ultrasonic elements to continue to operate for a predetermined period of time to continuously provide tactile feedback to the user.

9. The contactless interface device according to claim 1, wherein: The controller is further configured to determine menu input coordinates of the operating system in response to a user performing an input operation of the operating system displayed as a holographic image based on a detection signal of the camera to determine what menu of the operating system the user has selected.

10. The contactless interface device according to claim 9, wherein: The controller is further configured to, after determining the input coordinates of the operating system, momentarily operate the plurality of ultrasonic elements to provide a user with tactile feedback notifying that a menu of the operating system has been selected.

11. The contactless interface device according to claim 9, wherein: The controller is further configured to control a corresponding device according to a menu of a selected operating system.

12. The contactless interface device according to claim 1, wherein: The main body is rotatably mounted on a mobile console in an interior assembly of a vehicle.

13. The contactless interface device according to claim 12, wherein: A ball bearing is installed between the bottom of the main body and the upper surface of the moving console.

14. A method for controlling a contactless interface device, the method comprising: The hologram plate of the contactless interface device transmits the operating system display image of the display installed on the main body to display the hologram image; The camera installed on the main body detects the operation of the user's body part; Based on the detection signal of the camera, determining, by a controller operably connected to the camera, whether a body part of the user is placed in a position where the body part of the user can operate the holographic image; When it is determined that the user's body part is placed in a position where the user's body part can operate the holographic image, the controller causes the plurality of ultrasonic elements mounted on the main body to operate at once to provide tactile feedback to the user; Based on the detection signal of the camera, the controller determines the input coordinates of the menu of the operating system selected by the user among the menus of the operating system displayed as the holographic image; The plurality of ultrasonic elements are secondarily operated by the controller to provide a user with tactile feedback informing the user that a menu of the operating system has been selected.

15. The method according to claim 14, wherein: The plurality of ultrasonic elements are mounted on an ultrasonic element alignment plate, and the ultrasonic element alignment plate is formed as an annular plate structure in the contactless interface device.

16. The method according to claim 14, wherein: In one operation of the plurality of ultrasonic elements, the controller is further configured to control the plurality of ultrasonic elements to continue operating for a predetermined period of time.

17. The method according to claim 14, wherein: In the secondary operation of the plurality of ultrasonic elements, the controller is further configured to control the plurality of ultrasonic elements to operate instantaneously.

18. The method according to claim 14, wherein: The controller is configured to control corresponding devices according to a menu of a selected operating system. 19 . A non-volatile computer-readable storage medium having recorded thereon a program for executing the method for controlling a contactless interface device according to claim 14 .

Images