VEHICLE AND METHOD FOR CONTROLLING THE SAME

Abstract

Input device comprising: a gesture interface (300) configured to receive a gesture input from the user; a display unit (200) configured to display a plurality of symbols; and a control unit (400) configured to detect the user's gesture and to control the display unit (200) to change the number of icons to be displayed when the detected gesture is a pinch gesture, wherein the gesture interface (300) comprises a touch interface (310) configured to detect a user touch input, wherein the control unit (400) is configured to detect a change in the positions of a plurality of fingers using touch coordinates detected by the touch interface (310) and to recognize the user's gesture based on the change in the positions of the plurality of fingers; and wherein the touch interface (310) further comprises a center point (C), and the control unit (400) is configured to recognize the user's gesture based on a change in an average distance between the plurality of fingers and the center point (C).

Description

AREA

[0001] Embodiments of the present disclosure relate to a vehicle that displays an icon corresponding to a user's gesture and a method of controlling the same. BACKGROUND

[0002] The information in this section merely provides background information related to the present disclosure and may not constitute prior art.

[0003] A vehicle not only has a basic driving function, but also various additional functions for user convenience, such as an audio function, a video function, a navigation function, an air conditioning control function, a sheet controlling function and a light control function.

[0004] Such additional functions are established through an interface screen provided in the vehicle and a user controls the additional functions using various icons displayed by the interface screen.

[0005] As the number of icons displayed on the interface screen increases, there is an advantage in allowing users to access the icons directly. However, there is also a problem in that the operation to access the icons becomes difficult.

[0006] Likewise, an image of the screen or screen displayed on the interface should be optimized according to the user or driving situation.

[0007] From US 2012 / 0 192 110 A1, an input device is known for this purpose, comprising: a gesture interface configured to receive an input of a gesture from the user; a display unit configured to display a plurality of symbols; and a control unit configured to detect the user's gesture and to control the display unit to change the number of symbols to be displayed if the detected gesture is a pinch gesture. OVERVIEW

[0008] It is therefore an object of the present disclosure to provide a vehicle capable of changing a user interface layout using simple gestures and a method of controlling the same.

[0009] The object is achieved by an input device having the features of claim 1 and a method for controlling an input device having the features of claim 16. Advantageous further developments can be found in the subclaims.

[0010] Additional aspects of the disclosure will be set forth in part in the description below and in part will be obvious from the description or learned by practice of the disclosure. According to one aspect of the present disclosure, a vehicle includes a gesture interface configured to receive a user's input gesture; a display unit configured to display a plurality of icons; and a control unit configured to detect the user's input gesture and control the display unit to change the number of icons to display when the detected gesture is a pinch gesture.The gesture interface comprises a touch interface configured to detect a user touch input, the controller is configured to detect a change in the positions of a plurality of fingers using touch coordinates detected by the touch interface, and recognize the user's gesture based on the change in the positions of the plurality of fingers; and the touch interface further comprises a center point, and the controller is configured to recognize the user's gesture based on a change in an average distance between the plurality of fingers and the center point.

[0011] The display unit may decrease the number of icons to be displayed in response to a pinch-close gesture in which a hand is cupped.

[0012] The control unit can detect a change in a distance between two fingers and recognize it as the pinch-close gesture when the distance between the two fingers is reduced.

[0013] The control unit can detect a change in the size of a gesture space formed by a plurality of fingers and recognize it as the pinch-close gesture when the size of the gesture space decreases. The control unit can form the gesture space by connecting endpoints of the plurality of fingers.

[0014] The display unit may increase the number of icons to be displayed in response to a pinch-open gesture in which a hand is opened.

[0015] The control unit can detect a change in a distance between two fingers and recognize it as the pinch-open gesture when the distance between the two fingers is increased.

[0016] The control unit may detect a change in a size of a gesture space formed by a plurality of fingers and recognize it as the pinch-open gesture when the size of the gesture space is increased.

[0017] The control unit may recognize as a pinch-close gesture when the distance between the plurality of fingers and the center point is decreased, and also recognize as a pinch-open gesture when the distance between the plurality of fingers and the center point is increased.

[0018] The gesture interface may further include a spatial interface configured to obtain an image of the user and thus receive an input of a spatial gesture of the user, and the control unit may detect a plurality of fingers based on the image, analyze a change in the positions of the plurality of fingers, and recognize the user's gesture based on the change in the positions of the plurality of fingers.

[0019] The display unit can change a layout of the plurality of icons to be displayed in response to a multi-rotation gesture in which a hand is rotated. The icon layout can include at least colors, shapes, positions, sizes, and / or arrangements of the plurality of icons.

[0020] The touch interface can change a color of the emitted light in response to a multi-rotation gesture in which a hand is rotated.

[0021] The control unit can determine the number of icons to be changed according to the size of the pinch gesture. And the control unit can determine the icons to be displayed on the display unit according to a priority order stored in a pre-stored priority list.

[0022] According to another aspect of the present disclosure, a method for controlling a vehicle includes a first display operation for displaying a plurality of icons, a gesture recognition operation for recognizing an input gesture of the user, and a second display operation for changing the number of icons to be displayed in response to a pinch gesture when the recognized gesture is the pinch gesture. Recognizing the user's gesture includes detecting a change in the positions of a plurality of fingers using touch coordinates detected by a touch interface of the input device, and recognizing the user's gesture based on the change in the positions of the plurality of fingers.Recognizing the user's gesture further includes calculating an average distance between the plurality of fingers and a center point provided on the touch interface and recognizing the user's gesture based on a change in the average distance between the plurality of fingers and the center point.

[0023] The second display operation may include decreasing the number of icons to be displayed in response to a pinch-close gesture in which a hand is cupped.

[0024] The gesture recognition operation may include detecting a change in a distance between two fingers and recognizing as the pinch-close gesture when the distance between the two fingers is decreased.

[0025] The gesture recognition operation may include detecting a size of a gesture space formed by endpoints of a plurality of fingers, and recognizing as the pinch-close gesture when a size of the gesture space is decreased.

[0026] The second display operation may include increasing the number of icons to be displayed in response to a pinch-open gesture in which a hand is opened.

[0027] The gesture recognition operation may include detecting a change in a distance between two fingers and recognizing as the pinch-open gesture when the distance between the two fingers is increased.

[0028] The gesture recognition operation may include detecting a size of a gesture space formed by endpoints of a plurality of fingers and recognizing as the pinch-open gesture when the size of the gesture space is increased.

[0029] The method may further include a third display operation for changing a layout of the plurality of icons to be displayed in response to a multi-rotate gesture in which a hand is rotated.

[0030] The method may further include changing a color of the light of a gesture interface in response to a multi-rotate gesture in which a hand is rotated. DRAWINGS

[0031] These and / or other aspects of the disclosure will be more readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, in which: Fig. 1 is a view schematically illustrating an exterior of a vehicle; Fig. 2 is a view schematically illustrating an inside of the vehicle; the Fig. 3A and Fig. 3B are views illustrating an example of an input device included in the vehicle; Fig. 4 is a control block diagram illustrating an operation of the vehicle; Fig. 5 is a view illustrating an example of a screen image of a display unit included in the vehicle; Fig. Figure 6 is a view illustrating an example of a priority list; the Fig. 7A to 7D are views illustrating a pinch-close gesture; the Fig. 8A to 8D are views illustrating a pinch-open gesture; the Fig. 9A to 9D are views illustrating a multi-rotation gesture; Fig. 10 is a flowchart illustrating a method for detecting the pinch-close gesture; Fig. 11 is a view illustrating a change in touch coordinates according to an input of the pinch-close gesture; Fig. 12 is a flowchart illustrating a method for detecting the pinch-close gesture; Fig. 13 is a view illustrating a change in touch coordinates according to an input of the pinch-close gesture; Fig. 14 is a flowchart illustrating a method for detecting the pinch-close gesture; the Fig. 15A to 15D are views illustrating a change in touch coordinates according to an input of the pinch-close gesture; the Fig. 16A and Fig. 16B are views illustrating a change of a screen image of the display unit according to detection of the pinch-close gesture; Fig. 17 is a view illustrating a display control method according to the input of the pinch-close gesture; Fig. 18 is a flowchart illustrating a method for detecting the pinch-open gesture; Fig. 19 is a view illustrating a change in touch coordinates according to an input of the pinch-open gesture; Fig. 20 is a flowchart illustrating a method for detecting the pinch-open gesture; Fig. 21 is a view illustrating a change in touch coordinates according to an input of the pinch-open gesture; Fig. 22 is a flowchart illustrating a method for detecting the pinch-open gesture; the Fig. 23A to 23D are views illustrating a change in touch coordinates according to an input of the pinch-open gesture; the Fig. 24A and Fig. 24B are views illustrating a change in the screen image of the display unit according to detection of the pinch-open gesture; Fig. 25 is a view illustrating a display control method according to the input of the pinch-open gesture; Fig. 26 is a view illustrating a change in the screen image of the display unit 200 according to detection of a rotation gesture; Fig. 27 is a flowchart illustrating a method for detecting the pinch-close gesture; and Fig. 28 is a view illustrating a method of controlling a vehicle 1. DETAILED DESCRIPTION

[0032] Example embodiments will be described in detail below with reference to the accompanying drawings. In the description provided herein, numerous specific details are set forth to aid understanding. However, well-known methods, structures, and circuits have not been shown in detail so as not to obscure an understanding of this description.

[0033] Expressions containing ordinal numbers, such as "first," "second," etc., can be used to describe different components, but the components are not limited to these expressions. The expressions are used solely for the purpose of distinguishing one component from another.

[0034] Fig. 1 is a view schematically illustrating an exterior of a vehicle, and Fig. 2 is a view schematically illustrating an inside of the vehicle.

[0035] As in Fig. 1, the vehicle 1 includes a vehicle body forming an exterior of the vehicle 1 and wheels 12 and 13 that move the vehicle 1.

[0036] The vehicle body may include a hood 11a that protects various devices, such as an engine, required to operate the vehicle 1, a roof panel 11b that forms an interior space, a trunk lid 11c in which a storage space is provided, and a front fender 11d and a side panel 11e provided on a side surface of the vehicle 1. A plurality of doors 14 connected to the vehicle body 11 by means of a hinge may also be provided on the side surface of the vehicle body 11.

[0037] A windshield 19a for providing a front view of the vehicle 1 may be provided between the hood 11a and the roof panel 11b, and a rear window 19b for providing a rear view of the vehicle 1 may be provided between the roof panel 11b and the trunk lid 11c. Likewise, a side window 19c for providing a side view of the vehicle 1 may be provided at an upper side of each door 14.

[0038] A headlight 15 that emits light in a direction of movement of the vehicle 1 may also be provided at a front side of the vehicle 1.

[0039] Likewise, a direction indicator 16 for indicating the direction of movement of the vehicle 1 may be provided at the front and rear of the vehicle 1.

[0040] A taillight 17 may also be provided at the rear of the vehicle 1. The taillight 17 is provided at the rear of the vehicle 1 for indicating a shift state of a transmission and an actuation state of a brake of the vehicle 1, or the like.

[0041] As in Fig. 2, a driver's seat DS and a passenger's seat PS may be provided on an inside of the vehicle 1, and a steering wheel 30 for regulating the moving direction of the vehicle 1 and an instrument panel 40 in which various instruments for controlling an operation of the vehicle 1 are provided and which displays driving information of the vehicle 1 are also provided.

[0042] A voice receiver 90 and a room interface 320 may be provided on a headliner 50 of the driver's seat DS. The voice receiver 90 may include a microphone that converts a user's voice command into an electrical signal and may further include a noise removal filter that removes noise from a voice input.

[0043] A display unit 200 may be provided in the center of the dashboard 40. The display unit 200 may provide information related to the vehicle 1, an interface for inputting a control command to the vehicle 1, or the like.

[0044] Specifically, the display unit 200 may provide an interface screen including control icons for controlling each function of the vehicle 1. At this time, a layout of the interface screen provided on the display unit 200 may be changed according to a user's gesture, which will be described later.

[0045] The display unit 200 may be configured with, but is not limited to, a liquid crystal display (LCD) panel, a light emitting diode (LED) panel, or an organic light emitting diode (OLED) panel.

[0046] Meanwhile, Fig. 2, an example is described in which the display unit 200 is provided on the instrument panel 40. However, this is only one example of an arrangement of the display unit 200, and a position of the display unit 200 is not limited thereto.

[0047] A center console 80 is provided at a lower end of the instrument panel 40. The center console 80 is provided between the driver's seat DS and the front passenger seat PS and separates the driver's seat DS and the front passenger seat PS.

[0048] An armrest may be provided at a rear side of the center console such that the user of the vehicle 1 places his arm on the same.

[0049] An input device 100 for operating various functions of the vehicle 1 may also be provided on the center console 80. Using the input device 100, the user can change settings of the vehicle 1 or control various comfort devices, such as an air conditioner and an audio-video navigation (AVN) device, provided in the vehicle 1, and a screen image displayed on the display unit 200 can be changed by the user's operation of the input device 100.

[0050] The Fig. 3A to 3B are views illustrating an example of the input device included in the vehicle.

[0051] Regarding the Fig. 3A to 3B, the input device 100 includes an installation surface 140, a protruding portion 120 installed on the installation surface 140 so as to protrude from the installation surface 140, and a recessed portion 130 formed on an inner side of the protruding portion 120 so as to be recessed. At this time, the protruding portion 120 and the recessed portion 130 may be integrally formed or combined into one structure, but are not limited thereto.

[0052] The installation surface 140 forming an entire outer surface of the input device 100 may be provided separately from the protruding portion 120 and the recessed portion 130, but is not limited thereto.

[0053] The installation surface 140 may be provided in a substantially flat shape, but the shape of the installation surface 140 is not limited thereto. For example, the installation surface 140 may be provided in a convex or concave shape.

[0054] Although it is in the Fig. 3A and Fig. 3B, but the input device 100 may further include other input devices. For example, a push button or membrane switch that inputs the control command may be provided on the installation surface 140, and a toggle switch may be provided on the protruding portion 120 or the recessed portion 130.

[0055] The protruding portion 120 may be provided to protrude from the installation surface 140. In particular, the protruding portion 120 may include an outer side surface 121 connected to the installation surface 140 and a ridge 122 connected to the outer side surface 121.

[0056] At this time, the outer side surface 121 is provided between the installation surface 140 and the ridge 122 to have a predetermined curvature, and thus can smoothly connect the installation surface 140 to the ridge 122. However, the shape of the outer side surface 121 is not limited to this. For example, the outer side surface 121 can be formed into a cylindrical shape.

[0057] The ridge 122 may be provided in a shape corresponding to the recessed portion 130, for example, a ring shape. However, the shape of the ridge 122 may be changed according to a shape of a touch interface 310 provided on the input device 100.

[0058] The recessed portion 130 is formed to be recessed from the ridge 122 toward the inside of the protruding portion 120. The recessed portion 130 may include a horizontally circular opening in cross-section. For example, the recessed portion 130 may be formed to be a recessed circular opening inward from the ridge 122.

[0059] The recessed portion 130 includes an inner side surface 131 connected to the protrusion 122 and a bottom 132 in which the touch interface 310 is provided. For example, the drawings illustrate the inner side surface 131 having an inner side shape of a cylinder and the bottom 132 having a circular planar shape.

[0060] The recessed portion 130 may also include a connecting portion 133 connecting the inner side surface 131 to the bottom 132. The connecting portion 133 may be formed, for example, into an inclined surface shape or a curved surface shape with a negative curvature. Here, the negative curvature is a curvature formed to be concave when viewed from the outside of the recessed portion 130.

[0061] At this time, gradations may be formed at predetermined intervals on the connecting portion 133 to allow the user to perform touch input more intuitively. The gradations may be formed using an embossing or engraving process.

[0062] Further, when the user inputs a touch gesture through the connecting portion 133, the user can intuitively perform a rolling touch input due to the tactile sensation of the gradations.

[0063] As in Fig. As illustrated in Figure 3B, the bottom 132 may have a downwardly concave shape, but the shape of the touch interface 310 is not limited to this. For example, the touch interface 310 may have a flat shape or an upwardly convex shape.

[0064] The touch interface 310 is provided on the bottom side 132 to assist the user in intuitively entering a control command. The touch interface 310 will be described in detail later.

[0065] The installation surface 140 may further include a wrist support 141 that supports a user's wrist. The wrist support 141 may be located higher than the touch interface 310. Therefore, when the user inputs a gesture on the touch interface 310 using their fingers while resting their wrist on the wrist support 141, the wrist can be prevented from bending upward. Therefore, the user's musculoskeletal disorders can be prevented, and a more comfortable operation experience can be provided.

[0066] The Fig. 3A and Fig. 3B illustrates an example in which the input device 100 includes the touch interface 310 with a concave shape. However, the input device 100 is not limited thereto. A variety of devices including the touch interface 310 that can be touched by the user can be used as the input device 100 according to an embodiment of the present disclosure.

[0067] Fig. 4 is a control block diagram illustrating an operation of the vehicle, Fig. 5 is a view illustrating an example of a screen image of the display unit included in the vehicle, and Fig. Figure 6 is a view illustrating an example of a priority list.

[0068] The Fig. 7A to 7D are views illustrating a pinch-close gesture that Fig. 8A to 8D are views illustrating a pinch-opening gesture and the Fig. 9A to 9D are views illustrating a multi-rotation gesture.

[0069] In relation to Fig. 5, the vehicle 1 may include the display unit 200, a gesture interface 300 that receives a gesture input by the user, a storage part 450 that stores data necessary for operating the vehicle 1, and the control unit 400 that forms a screen image in response to the user's gesture.

[0070] The display unit 200 may display a screen displaying information related to the vehicle 1 and a screen displaying a function of the vehicle 1.

[0071] As in Fig. As illustrated in Figure 5, the display unit 200 can display a plurality of icons 201 to 206. The user can select the plurality of icons 201 to 206 displayed on the display unit 200 to control the vehicle 1.

[0072] In particular, the user can perform a navigation function by selecting a navigation icon 201, or perform a video function by selecting a video icon 202, or perform an audio function by selecting an audio icon 203, or change the settings of the vehicle 1 by selecting a settings icon 204, or perform a telephone connection function by selecting a telephone icon 205, or perform an air conditioning function by selecting an air conditioning icon 206.

[0073] The number of icons displayed on the display unit 200 can be changed by the user's gesture or voice command. This will be described in detail later.

[0074] The storage part 450 can store various data required to operate the vehicle 1. For example, the storage part 450 can store an operating system or an application required to operate the vehicle 1 and, if necessary, temporary data generated by an operation of the control unit 400.

[0075] The memory portion 450 may also include, but is not limited to, a high-speed random access memory, a magnetic disk, an SRAM, a DRAM, a read-only memory (ROM), or the like.

[0076] The storage part 450 may also be detachable from the vehicle 1. For example, the storage part 450 may include, but is not limited to, a Compact Flash card (CF card), a Secure Digital card (SD card), a Smart Media card (SM card), a Multimedia Card (MMC), or a Memory Stick.

[0077] An example in which the memory part 450 and the control unit 400 are provided separately will be described below. However, the memory part 450 and the control unit 400 may be formed into one chip.

[0078] Meanwhile, the memory part 450 may further contain a priority list 451. As in Fig. 6, the priority list 451 stores priority information of a menu displayed on the display unit 200.

[0079] The icons to be displayed on the display unit 200 can be determined based on the menu priority information stored in the priority list 451. The icons to be additionally displayed or removed can be determined according to a pinch gesture, which will be described later.

[0080] The priority information can be set in advance or determined according to a user's usage pattern.

[0081] In an example where priority information is determined according to a usage pattern, the priority information may be determined according to a user's frequency of using the menu. That is, as a menu is used more frequently, the menu may have a higher priority. And as a menu is used less frequently, the menu may have a lower priority.

[0082] In another example where the priority information is determined according to the usage pattern, the priority information may be determined according to a history of recent menu usage. That is, it is determined that a recently used menu has a higher priority, and the menu used in the past has a lower priority.

[0083] Since the icons to be displayed on the display unit 200 are determined according to the priority information determined by the usage pattern described above, menu accessibility of the user can be improved.

[0084] Gesture interface 300 detects a user's gesture input and generates an electrical signal corresponding to the detected gesture. The generated electrical signal is transmitted to control unit 400.

[0085] In other words, the gesture interface 300 can detect the gesture input by the user, allowing the user to input the control command of the vehicle 1 using the gesture. Specifically, a user interface can detect the user's gesture input using the user's fingers, such as snapping, swiping, rolling, circling, rotating, and tapping.

[0086] The gesture interface 300 can also detect the gesture input using a plurality of fingers, such as the pinch gesture and a multi-rotate gesture.

[0087] The pinch gesture can be divided into a pinch close gesture, in which a user's hand is cupped, and a pinch open gesture, in which the user's hand is opened.

[0088] The pinch-close gesture is a gesture in which the plurality of fingers are pulled together, and can be a pinch-in gesture in which only two fingers are closed, as in Fig. 7A illustrates a gesture in which three fingers are closed, as in Fig. 7B illustrates a gesture in which four fingers are closed, as in Fig. 7C, and a gesture in which five fingers are closed, as in Fig. 7D illustrates.

[0089] The pinch-open gesture is a gesture in which the plurality of fingers are opened, and can be a pinch-out gesture in which only two fingers are opened, as in Fig. 8A illustrates a gesture in which three fingers are opened, as in Fig. 8B illustrates a gesture in which four fingers are opened, as in Fig. 8C, and a gesture in which five fingers are opened, as in Fig. 8D illustrates, contain

[0090] The multi-rotation gesture is a gesture in which the plurality of fingers rotate, and can be a gesture in which only two fingers rotate, as in Fig. 9A illustrates a gesture in which three fingers rotate, as in Fig. 9B illustrates a gesture in which four fingers rotate, as in Fig. 9C, and a gesture in which five fingers rotate, as in Fig. 9D illustrates.

[0091] Again in relation to Fig. 4, the gesture interface 300 for detecting the gesture may include the touch interface 310 that detects a touch gesture of the user and a spatial interface 320 that detects a spatial gesture of the user.

[0092] The touch interface 310 detects the user's touch gesture and outputs an electrical signal corresponding to the detected touch gesture. As shown in the Fig. 3A and Fig. As illustrated in Figure 3B, the touch interface 310 may be provided on the bottom 132 of the input device 100. The touch interface 310 may be provided to have a predetermined curvature along the bottom of the input device 100. That is, the touch interface 310 may be provided to have the concave shape according to the shape of the bottom 132.

[0093] At this time, the most concave point of the touch interface 310 is referred to as the center point C. The center point C can be used as a gesture recognition reference. This will be described in detail later.

[0094] However, a position of the touch interface 310 is not limited to the floor 132. For example, the touch interface 310 may also be provided on the connecting portion 133 to detect the gesture input to the connecting portion 133.

[0095] The touch interface 310 may also be provided integrally with the display unit 200. In particular, the touch interface 310 may be implemented as an accessory device located on a screen of the display unit 200, or as an on-cell device or an in-cell device located in the display unit 200.

[0096] The touch interface 310 may also include a touch panel for detecting a user's touch. The touch panel may include, but is not limited to, resistive, optical, capacitive, ultrasonic, and pressure touch that can detect user proximity or touch.

[0097] The touch panel generates an electrical signal corresponding to the touch and then transmits the electrical signal to a gesture recognition device 410. In particular, when a touch event occurs, the touch panel may detect touch coordinates corresponding to an area where the touch event occurs and then transmit the detected touch coordinates to the gesture recognition device 410.

[0098] Meanwhile, the spatial interface 320 detects a user's input through a gesture in a room and outputs an electrical signal corresponding to the detected spatial gesture. Specifically, the spatial interface 320 may acquire an image of the user and then transmit the acquired image to the gesture recognition device 410.

[0099] As in Fig. As illustrated in Figure 2, the room interface 320 may be disposed on a headliner 50, but a position of the room interface 320 is not limited thereto. For example, the room interface 320 may be disposed on the instrument panel or the center console 80.

[0100] The spatial interface 320 may include at least one camera that captures the user's gesture input in the room. Here, the camera may include a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor and receive light projected through one or more lenses to obtain an image.

[0101] The spatial interface 320 can also be implemented with a stereo camera to obtain a three-dimensional image.

[0102] To clearly detect the user's hand, the spatial interface 320 may also receive an infrared image. For this purpose, the spatial interface 320 may include an infrared light source that emits infrared light toward the user and an infrared camera that receives an image of an infrared area.

[0103] The control unit 400 can recognize the user's gesture and generally control the vehicle 1 according to the recognized gesture. The control unit 400 can correspond to one processor or a plurality of processors.

[0104] At this time, the processor may be implemented with an array of a plurality of logic gates or with a combination of memories in which programs executed in a microprocessor are stored. The control unit 400 may be implemented, for example, with a microcontroller unit (MCU) or a general-purpose processor, such as a central processing unit (CPU) and a graphics processing unit (GPU).

[0105] The control unit 400 can also control each function of the vehicle 1 according to the user's gesture input through the gesture interface 300 or the user's voice command input through the voice receiver 90. That is, the user can control the vehicle 1 by inputting the voice command and the gesture.

[0106] The control unit 400 may also include a voice recognition device 420 that recognizes the user's voice command and performs a function corresponding to the recognized voice command, and the gesture recognition device 410 that recognizes the user's gesture and performs a function corresponding to the recognized gesture.

[0107] The speech recognition device 420 recognizes the voice command input by the speech receiver 90 and performs the function corresponding to the recognized voice command. To recognize the voice command, a well-known speech recognition algorithm or speech recognition engine can be used, and other speech recognition algorithms or speech recognition engines developed later according to the development of technology can also be applied.

[0108] The gesture recognition device 410 recognizes the user's gesture and controls the functions of the vehicle 1 according to the recognized gesture. The gesture recognition device 410 can also control the display of the screen image of the display unit 200 according to the recognized user's gesture.

[0109] In particular, the gesture recognition device 410 may analyze a change in the positions of the user's fingers based on the user's gesture detected by the gesture interface 300 and recognize the user's gesture based on the analyzed change in the positions of the user's fingers.

[0110] Here, a method for analyzing the change in the positions of the fingers may be changed according to a type of the gesture interface 300.

[0111] Specifically, when the gesture interface 300 is the touch interface 310, the touch coordinates detected by the touch interface 310 correspond to coordinates of points touched by the user's fingers, and thus the gesture recognition device 410 can determine a start and an end of the user's touch based on whether the touch coordinates are detected, and can analyze the change in the positions of the fingers by tracking a trajectory of the touch coordinates.

[0112] Meanwhile, when the gesture interface 300 is the spatial interface 320, the gesture recognition device 410 may detect a palm and endpoints of the fingers from an image captured by the spatial interface 320, and analyze the change in the positions of the fingers by tracking a change in the positions of the palm and the endpoints of the fingers.

[0113] The gesture recognition device 410 can recognize the gesture input by the user based on the analyzed change in the positions of the fingers and perform the function corresponding to the recognized gesture.

[0114] In particular, the gesture recognition device 410 can recognize the pinch-close gesture included in the Fig. 7A to 7D. A method for recognizing the pinch-close gesture will be described in detail below.

[0115] Fig. 10 is a flowchart illustrating the method for detecting the pinch-close gesture, and Fig. 11 is a view illustrating the change of touch coordinates according to the input of the pinch-close gesture.

[0116] In one embodiment, the gesture recognizer 410 may recognize the input of the pinch close gesture using a change in a distance between the fingers.

[0117] Regarding the Fig. 10 and Fig. 11, the vehicle detects a change in the positions of two fingers (S611). When the user inputs the pinch-close gesture into the touch interface 310 using the two fingers, as shown in Fig. 7A, the touch coordinates are changed as in Fig. 11. Since the change in the touch coordinates corresponds to the change in the positions of the two fingers, the gesture recognition device 410 can detect the change in the positions of the two fingers according to the change in the touch coordinates.

[0118] The vehicle 1 calculates the change in the distance between the two fingers based on the detected change in the positions (S612). The gesture recognition device 410 can intermittently calculate the change in the distance between the two fingers.

[0119] Since the positions of the two fingers correspond to the touch coordinates as described above, the gesture recognition device 410 can calculate a distance D1 between the touch coordinates f11 and f21 at the beginning of the touch as a distance between the two fingers at the beginning of the touch, calculate a distance D2 between the touch coordinates f12 and f22 after a predetermined time interval as a distance between the two fingers after the predetermined time interval, and calculate a distance D3 between the touch coordinates f13 and f23 at the end of the touch as a distance between the two fingers at the end of the touch.

[0120] As opposed to Fig. 11, the gesture recognition device 410 can sequentially calculate the change in the distance between the two fingers.

[0121] The vehicle 1 determines whether the distance between the two fingers is decreasing (S613). The gesture recognition device 410 can determine whether the distance between the two fingers is decreasing based on the change in the distance between the two fingers. Specifically, if the distance between the two fingers is decreasing over time in the order of D1, D2, and D3, the gesture recognition device 410 determines that the distance between the two fingers is decreasing.

[0122] Meanwhile, in the case where the calculation of the change in the distance between the two fingers is continuously performed, the gesture recognition device 410 determines that when the continuously calculated distance between the two fingers is changed to decrease, the distance between the two fingers is reduced.

[0123] When the distance between the two fingers is reduced (YES in operation S613), the vehicle 1 can recognize the input gesture as the pinch-close gesture (S614).

[0124] Fig. 12 is a flowchart illustrating a method for detecting the pinch-close gesture, and Fig. 13 is a view illustrating the change of touch coordinates according to the input of the pinch-close gesture.

[0125] In another embodiment, the gesture recognition device 410 may recognize the input of the pinch-close gesture using a change in the size of a gesture space formed by the plurality of fingers. Here, the gesture space is a virtual space formed by connecting endpoints of three or more fingers.

[0126] Regarding the Fig. 12 and Fig. 13, the vehicle 1 detects a change in the positions of the fingers (S621). When the user inputs the pinch-close gesture on the touch interface 310 using four fingers, as shown in Fig. 7C, the touch coordinates are changed as in Fig. 13. Since the change in the touch coordinates corresponds to the change in the positions of the fingers, the gesture recognition device 410 can detect the change in the positions of the fingers according to the change in the touch coordinates.

[0127] The vehicle 1 calculates the change in the size of the gesture space formed by the plurality of fingers based on the detected change in positions (S622). The gesture recognition device 410 can intermittently calculate the change in the size of the gesture space formed by the plurality of fingers.

[0128] Since the positions of the fingers correspond to the touch coordinates as described above, the gesture recognition device 410 can calculate a gesture space S1 at the beginning of the touch by connecting a plurality of touch coordinates f11, f21, f31, and f41 at the beginning of the touch, calculate a gesture space S2 after a predetermined time interval by connecting a plurality of touch coordinates f12, f22, f32, and f42 after the predetermined time interval, and calculate a gesture space S3 at the end of the touch by connecting a plurality of touch coordinates f13, f23, f33, and f43 at the end of the touch, as shown in Fig. 13 illustrates.

[0129] As opposed to Fig. 13, the gesture recognition device 410 can continuously calculate the gesture space.

[0130] The vehicle 1 determines whether the size of the gesture space is being reduced (S623). The gesture recognition device 410 can determine whether the size of the gesture space is being reduced by comparing the size of the size space calculated sequentially over time. Specifically, if the size of the gesture space is being reduced over time in the order of S1, S2, and S3, the gesture recognition device 410 determines that the size of the gesture space is being reduced.

[0131] Meanwhile, in the case where the calculation of the size of the gesture space is continuously performed, when the continuously calculated size of the gesture space is changed to be smaller than a predetermined reference, the gesture recognition device 410 determines that the size of the gesture space is reduced.

[0132] When the size of the gesture space is reduced (YES in operation S623), the vehicle 1 can recognize the input gesture as the pinch-close gesture (S624).

[0133] Meanwhile, Fig. 13 describes the method for recognizing the pinch-close gesture using four fingers. However, even in the case where three or more than four fingers perform a touch, it would be obvious to someone with technical skills that the same method can determine whether the size of the gesture space is reduced, and thus the pinch-close gesture can be recognized.

[0134] Fig. 14 is a flowchart illustrating a method for detecting the pinch-close gesture, and the Fig. 15A to 15D are views illustrating the change of touch coordinates according to the input of the pinch-close gesture.

[0135] In yet another embodiment, the gesture recognition device 410 may recognize the input of the pinch-close gesture using a change in a distance between the predetermined center point C and the fingers.

[0136] Regarding the Fig. 14 and 15A to 15D, the vehicle 1 detects a change in the positions of the fingers (S631). When the user inputs the pinch-close gesture on the touch interface 310 using three fingers, as shown in Fig. 7B, the touch coordinates are changed as in Fig. 15A. Since the change in the touch coordinates corresponds to the change in the positions of the three fingers, the gesture recognition device 410 can detect the change in the positions of the three fingers according to the change in the touch coordinates.

[0137] The vehicle 1 calculates the change in the distance between the plurality of fingers and the center point C based on the detected change in the positions between the plurality of fingers and the center point C (S632). The gesture recognition device 410 can intermittently calculate the change in the distance between the plurality of fingers and the center point C.

[0138] Since the positions of the fingers correspond to the touch coordinates as described above, the gesture recognition device 410 can calculate an average value D1 of the distances D11, D12 and D13 between the plurality of touch coordinates f11, f21, and f31 and the center point C at the beginning of the touch, as shown in Fig. 15B illustrates calculating an average value D2 of the distances D21, D22 and D23 between the plurality of contact coordinates f12, f22 and f32 and the center point C after a predetermined time interval, as shown in Fig. 15C, and calculate an average value D3 of the distances D31, D32 and D33 between the plurality of contact coordinates f13, f23 and f33 and the center point C at the end of the contact, as shown in Fig. 15D illustrates.

[0139] In contrast to the Fig. 15A to 15D, the gesture recognition device 410 can sequentially calculate the change in the distance between the plurality of fingers and the center point C.

[0140] The vehicle 1 determines whether the distance between the plurality of fingers and the center point C is decreasing (S633). If the distance between the plurality of fingers and the center point C is decreasing in the order of D1, D2, and D3 over time, the gesture recognition device 410 determines that the distance between the plurality of fingers and the center point C is decreasing.

[0141] Meanwhile, in the case where the calculation of the change in the distance between the plurality of fingers and the center point C is continuously performed, when the continuously calculated distance between the plurality of fingers and the center point C is changed to be shorter than a predetermined reference, the gesture recognition device 410 determines that the distance between the plurality of fingers and the center point C is reduced.

[0142] When the distance between the plurality of fingers and the center point C is reduced (YES in operation S633), the vehicle 1 can recognize the input gesture as the pinch-close gesture (S634).

[0143] The Fig. 16A and Fig. 16B are views illustrating a change of a screen image of the display unit 200 according to detection of the pinch-close gesture, and Fig. 17 is a view illustrating a display control method according to the input of the pinch-close gesture.

[0144] When the gesture input by the user is recognized as the pinch-close gesture, the gesture recognition device 410 may control the display unit 200 in response to the pinch-close gesture so that the number of icons displayed on the display unit 200 is reduced.

[0145] That is, in a state where six symbols are displayed, as in Fig. 5, when the pinch-close gesture is entered, the number of icons displayed on the display unit 200 is reduced, as shown in the Fig. 16A and Fig. 16B illustrates.

[0146] At this time, the number of displayed icons can be determined according to the size of the pinch-close gesture. For example, if the size of the pinch-close gesture is smaller than a threshold, five icons 201 to 205 can be displayed, as shown in Fig. 16A, and when the size of the pinch-close gesture is greater than the threshold, four icons 201 to 204 are displayed as shown in Fig. 16B illustrates.

[0147] The icons that are not displayed on the display unit 200 can also be determined according to the priority information of the predetermined priority list 451.

[0148] The following describes the display control method according to the pinch-close gesture with respect to Fig. 17 are described in detail.

[0149] In relation to Fig. 17, the vehicle 1 determines the number of icons to be removed based on the size of the pinch-close gesture (S651). The gesture recognition device 410 may calculate the size of the pinch-close gesture and determine the number of icons to be removed according to the size of the calculated pinch-close gesture. A method for calculating the size of the pinch-close gesture may be changed according to the method for recognizing the pinch-close gesture.

[0150] As in Fig. 11 illustrates, for example, when the pinch-close gesture is recognized based on the distance between two fingers, as a rate of decreasing the distance between the two fingers becomes higher, the determination of the pinch-close gesture becomes greater.

[0151] The higher the rate of reducing the size of the gesture space becomes when the pinch-close gesture is recognized based on a reduction in the size of the gesture space, as in Fig. 13 illustrates, the greater the determination of the pinch-close gesture becomes.

[0152] The higher a rate of reduction of the plurality of fingers to the center point C becomes when the pinch-close gesture is recognized based on the distance between the plurality of fingers and the center point C, as shown in the Fig. 15A to 15D, the greater the determination of the pinch-close gesture becomes.

[0153] Vehicle 1 determines the icon to be removed based on the priority list (S652). The icon to be removed is determined according to the predetermined priority. That is, the icon corresponding to the menu with the lowest priority is removed first.

[0154] For example, if priority list 451 is set as in Fig. 6, the icons to be removed are determined in an order of an air conditioner icon 206 and a telephone icon 205 according to the priority of the menu.

[0155] Vehicle 1 displays the screen image while the specific icon is removed (S653). For example, when an icon is removed, the air conditioning icon 206 is removed, as shown in Fig. 16A, and a navigation icon 201, a video icon 202, an audio icon 203, a settings icon 204, and the phone icon 205 are displayed.

[0156] If two symbols are removed, the air conditioning symbol 206 and the telephone symbol 205 are also removed, as in Fig. 16B, and the navigation icon 201, the video icon 202, the audio icon 203, and the settings icon 204 are displayed.

[0157] Meanwhile, a size or arrangement of the icon can be controlled in response to the removal of the icon.

[0158] The gesture recognition device 410 can, however, Fig. 8A to 8D. A method for recognizing the pinch-to-open gesture will be described in detail below.

[0159] Fig. 18 is a flowchart illustrating the method for detecting the pinch-open gesture, and Fig. 19 is a view illustrating a change in touch coordinates according to the input of the pinch-open gesture.

[0160] In one embodiment, the gesture recognition device 410 may recognize the input of the pinch-open gesture using a change in a distance between the fingers.

[0161] Regarding the Fig. 18 and Fig. 19, the vehicle 1 detects a change in the positions of two fingers (S711). When the user inputs the pinch-open gesture on the touch interface 310 using the two fingers, as shown in Fig. 8A, the touch coordinates are changed as in Fig. 19. Since the change in the touch coordinates corresponds to the change in the positions of the two fingers, the gesture recognition device 410 can detect the change in the positions of the two fingers according to the change in the touch coordinates.

[0162] The vehicle 1 calculates the change in the distance between the two fingers based on the detected change in the positions of the two fingers (S712). The gesture recognition device 410 can intermittently calculate the change in the distance between the two fingers.

[0163] Since the positions of the two fingers correspond to the touch coordinates as described above, the gesture recognition device 410 can calculate a distance D1 between the touch coordinates f11 and f21 at the beginning of the touch as a distance between the two fingers at the beginning of the touch, calculate a distance D2 between the touch coordinates f12 and f22 after a predetermined time interval as a distance between the two fingers after the predetermined time interval, and calculate a distance D3 between the touch coordinates f13 and f23 at the end of the touch as a distance between the two fingers at the end of the touch.

[0164] As opposed to Fig. 19, the gesture recognition device 410 can sequentially calculate the change in the distance between the two fingers.

[0165] The vehicle 1 determines whether the distance between the two fingers is increasing (S713). The gesture recognition device 410 can determine whether the distance between the two fingers is increasing based on the change in the distance between the two fingers. Specifically, if the distance between the two fingers increases over time in the order of D1, D2, and D3, the gesture recognition device 410 determines that the distance between the two fingers is increasing.

[0166] Meanwhile, in the case where the calculation of the change in the distance between the two fingers is continuously performed, the gesture recognition device 410 determines that when the continuously calculated distance between the two fingers is changed to increase, the distance between the two fingers is increased.

[0167] When the distance between the two fingers is increased (YES in operation S713), the vehicle 1 can recognize the input gesture as the pinch-open gesture (S714).

[0168] Fig. 20 is a flowchart illustrating a method for detecting the pinch-open gesture, and Fig. 21 is a view illustrating a change in touch coordinates according to the input of the pinch-open gesture.

[0169] In another embodiment, the gesture recognition device 410 may recognize the input of the pinch-open gesture using a change in a size of a gesture space formed by a plurality of fingers.

[0170] Regarding the Fig. 20 and Fig. 21, the vehicle 1 detects a change in the positions of the fingers (S721). When the user inputs the pinch-open gesture on the touch interface 310 using four fingers, as shown in Fig. 8C, the touch coordinates are changed as in Fig. 21. Since the change in the touch coordinates corresponds to the change in the positions of the fingers, the gesture recognition device 410 can detect the change in the positions of the fingers according to the change in the touch coordinates.

[0171] The vehicle 1 calculates the change in the size of the gesture space formed by the plurality of fingers based on the detected change in the positions of the plurality of fingers (S722). The gesture recognition device 410 can intermittently calculate the change in the size of the gesture space formed by the plurality of fingers.

[0172] Since the positions of the fingers correspond to the touch coordinates as described above, the gesture recognition device 410 can calculate a gesture space S1 at the beginning of the touch by connecting a plurality of touch coordinates f11, f21, f31, and f41 at the beginning of the touch, calculate a gesture space S2 after a predetermined time interval by connecting a plurality of touch coordinates f12, f22, f32, and f42 after the predetermined time interval, and calculate a gesture space S3 at the end of the touch by connecting a plurality of touch coordinates f13, f23, f33, and f43 at the end of the touch, as shown in Fig. 21 illustrates.

[0173] As opposed to Fig. 21, the gesture recognition device 410 can calculate the gesture space sequentially.

[0174] The vehicle 1 determines whether the size of the gesture space is being increased (S723). The gesture recognition device 410 can determine whether the size of the gesture space is being increased by comparing the size of the gesture space calculated sequentially over time. Specifically, if the size of the gesture space is being increased over time in the order of S1, S2, and S3, the gesture recognition device 410 determines that the size of the gesture space is being increased.

[0175] Meanwhile, in the case where the calculation of the size of the gesture space is continuously performed, when the continuously calculated size of the gesture space is changed to be larger than a predetermined reference, the gesture recognition device 410 determines that the size of the gesture space is increased.

[0176] When the size of the gesture space is increased (YES in operation S723), the vehicle 1 can recognize the input gesture as the pinch-open gesture (S724).

[0177] Fig. 21, however, described the method for recognizing the pinch-open gesture using four fingers. However, even in the case where three or more than four fingers perform a touch, it would be obvious to someone with technical skills that the same method can determine whether the size of the gesture space is increased, and thus the pinch-open gesture can be recognized.

[0178] Fig. 22 is a flowchart illustrating a method for detecting the pinch-open gesture, and the Fig. 23A to 23D are views illustrating a change in touch coordinates according to the input of the pinch-open gesture.

[0179] The gesture recognition device 410 may recognize the input of the pinch-open gesture using a change in a distance between a center point C and the fingers.

[0180] Regarding the Fig. 22 and 23A to 23D, the vehicle 1 detects a change in the positions of the fingers (S731). When the user inputs the pinch-open gesture on the touch interface 310 using three fingers, as shown in Fig. 8B, the touch coordinates are changed as in Fig. 23A. Since the change in the touch coordinates corresponds to the change in the positions of the three fingers, the gesture recognition device 410 can detect the change in the positions of the three fingers according to the change in the touch coordinates.

[0181] The vehicle 1 calculates the change in the average distance between a plurality of fingers and the center point C based on the detected change in the positions of the plurality of fingers and the center point C (S732). The gesture recognition device 410 can intermittently calculate the change in the distance between the plurality of fingers and the center point.

[0182] Since the positions of the fingers correspond to the touch coordinates as described above, the gesture recognition device 410 can calculate an average value D1 of the distances D11, D12 and D13 between the plurality of touch coordinates f11, f21, and f31 and the center point C at the beginning of the touch, as shown in Fig. 23B illustrates calculating an average value D2 of the distances D21, D22 and D23 between the plurality of contact coordinates f12, f22 and f32 and the center point C after a predetermined time interval, as shown in Fig. 23C, and calculate an average value D3 of the distances D31, D32 and D33 between the plurality of contact coordinates f13, f23 and f33 and the center point C at the end of the contact, as shown in Fig. 23D illustrates.

[0183] As opposed to Fig. 23, the gesture recognition device 410 may sequentially calculate the change in the distance between the plurality of fingers and the center point C.

[0184] The vehicle 1 determines whether the distance between the plurality of fingers and the center point C is increasing (S733). If the distance between the plurality of fingers and the center point C is increasing in the order of D1, D2, and D3 over time, the gesture recognition device 410 determines that the distance between the plurality of fingers and the center point C is increasing.

[0185] Meanwhile, in the case where the calculation of the change in the distance between the plurality of fingers and the center point C is continuously performed, when the continuously calculated distance between the plurality of fingers and the center point C is changed to increase beyond a predetermined reference, the gesture recognition device 410 determines that the distance between the plurality of fingers and the center point C is increased.

[0186] When the distance between the plurality of fingers and the center point C is increased (YES in operation S733), the vehicle 1 can recognize the input gesture as the pinch-open gesture (S734).

[0187] The Fig. 24A and Fig. 24B are views illustrating a change in the screen image of the display unit according to the detection of the pinch-open gesture, and Fig. 25 is a view illustrating the display control method according to the input of the pinch-open gesture.

[0188] When the gesture input by the user is recognized as the pinch-open gesture, the gesture recognition device 410 may control the display unit 200 in response to the pinch-open gesture such that the number of icons displayed on the display unit 200 is increased.

[0189] That is, in a state where six symbols are displayed, as in Fig. 5, the number of symbols displayed on the display unit 200 is increased as shown in the Fig. 24A and Fig. 24B illustrates when the pinch-open gesture is input.

[0190] At this time, the number of displayed icons can be determined according to the size of the pinch-open gesture. For example, if the size of the pinch-open gesture is smaller than a threshold, seven icons 201 to 207 can be displayed, as shown in Fig. 24A, and when the size of the pinch-open gesture is greater than the threshold, eight icons 201 to 208 are displayed as shown in Fig. 24B illustrates.

[0191] Also, the icons additionally displayed on the display unit 200 may be determined according to the priority information of the predetermined priority list 451.

[0192] The following describes the display control method according to the pinch-open gesture with respect to Fig. 25 are described in detail.

[0193] In relation to Fig. 25, the vehicle 1 determines the number of icons to be added based on the size of the pinch-open gesture (S751). The gesture recognition device 410 may calculate the size of the pinch-open gesture and determine the number of icons to be added according to the size of the calculated pinch-open gesture. A method for calculating the size of the pinch-open gesture may be changed according to the method for recognizing the pinch-open gesture.

[0194] The higher a rate of increasing the distance between the two fingers becomes when the pinch-open gesture is recognized, for example, based on the distance between the two fingers, as in Fig. 19, the larger the determination of the pinch-open gesture becomes. The higher the rate of enlargement of the size of the gesture space becomes when the pinch-open gesture is recognized based on an enlargement of the size of the gesture space, as in Fig. 21 illustrates, the greater the determination of the pinch-opening gesture becomes.

[0195] The higher a rate of increasing the distance between the plurality of fingers and the center point C becomes when the pinch-open gesture is recognized based on the distance between the plurality of fingers and the center point C, as shown in the Fig. 23A to 23D, the larger the determination of the pinch-opening gesture becomes.

[0196] Vehicle 1 determines the icon to be added based on the predetermined priority (S752). The icon to be added can be determined according to the predetermined priority list 451. That is, the icon corresponding to the high-priority menu is added first.

[0197] For example, if priority list 451 is set as in Fig. 6, the icons are added in an order of a voice recording icon 207 and an Internet icon 208 according to the priority of the menu.

[0198] Vehicle 1 displays the screen image while the specific icon is being added (S753). For example, when an icon is being added, the screen image in which the voice recording icon 207 is added is displayed, as shown in Fig. 24A, and when two icons are added, the screen in which the voice recording icon 207 and the Internet icon 208 are added is displayed as shown in Fig. 24B illustrates.

[0199] Meanwhile, a size or arrangement of the icon can be controlled in response to adding the icon.

[0200] Fig. 26 is a view illustrating a change in the screen image of the display unit 200 according to a detection of a multi-rotation gesture, and Fig. 27 is a flowchart illustrating a method for recognizing the pinch-close gesture.

[0201] The gesture recognition device 410 can recognize the multi-rotation gesture that is Fig. 9, and control the display unit 200 such that an icon layout of the display unit 200 is changed according to the multi-rotation gesture.

[0202] In relation to Fig. 27, the vehicle 1 detects a rotation direction of the fingers (S811). The gesture recognition device 410 analyzes a change in the positions of the fingers and detects the rotation direction of each finger.

[0203] The vehicle 1 determines whether there is a regularity in the detected rotation direction (S812). That is, the gesture recognition device 410 determines whether the plurality of fingers are rotated in the same direction.

[0204] When it is determined that the regularity of the detected rotation direction exists (S812), the vehicle 1 recognizes the multi-turn gesture (S813).

[0205] The vehicle 1 changes the icon layout in response to the multi-rotation gesture and displays it (S814). The icon layout includes a color, shape, position, size, and arrangement of the icon displayed on the display unit 200. The icon layout displayed on the display unit can be changed by controlling the gesture recognition device 410.

[0206] For example, the shapes, positions, sizes and arrangements of the symbols 201a to 206a displayed on the display unit 200 can be changed as shown in Fig. 26 illustrates.

[0207] The vehicle 1 may change a color of the light in the input device 100 (S815). For example, the light emitted by the input device 100 may become brighter or the color of the light emitted by the input device 100 may be changed.

[0208] Fig. 28 is a view illustrating a method of controlling the vehicle 1.

[0209] In relation to Fig. 28, the vehicle 1 displays a plurality of icons (S911). The display unit 200 displays the screen containing the plurality of icons. The user can control the functions of the vehicle 1 or change the settings using the plurality of icons displayed on the display unit 200.

[0210] At this time, the number of icons displayed on the screen can be determined according to a recognition result of the user's speech. For example, if the user says "six," six icons can be displayed on the display unit 200, as shown in Fig. 5 illustrates.

[0211] The vehicle 1 detects a gesture of the user (S912). The vehicle 1 can detect a change in the positions of the user's fingers and recognize the gesture input by the user based on the detected change in the positions of the user's fingers.

[0212] The vehicle 1 determines whether the detected user gesture is a pinch gesture (S913). Specifically, the vehicle 1 may determine whether the user gesture is a pinch-close gesture, in which the user's hand is cupped, or a pinch-open gesture, in which the user's hand is opened.

[0213] If it is determined that the recognized gesture is the pinch gesture, the vehicle 1 changes the number of icons in response to the pinch gesture and then displays the icons (S914). Specifically, the display unit 200 displays the screen image in which the number of icons is reduced, as shown in FIGS. Fig. 16A and Fig. 16B illustrates, in response to the pinch-close gesture.

[0214] And the display unit 200 displays the screen image in which the number of symbols is increased as shown in the Fig. 24A and Fig. 24C illustrates, in response to the pinch-opening gesture.

[0215] At this time, the number of icons to be removed or added can be determined according to the size of the pinch gesture input by the user. The icons to be removed or added can be determined by the priority list 451.

[0216] The vehicle 1 determines whether the recognized user gesture is the multi-turn gesture (S915).

[0217] If it is determined that the recognized user gesture is the multi-rotation gesture, the vehicle 1 changes the icon layout and displays the same (S916). The display unit 200 can change and display the color, shape, position, size, and arrangement of the icon in response to the user's multi-rotation gesture.

[0218] As described above, the number and layout of the icons displayed on the display unit 200 can be changed based on the user's gesture, and thus it is possible to provide an interface corresponding to a user's taste.

[0219] The user can personalize the user interface using the gesture. In particular, the user can dynamically adjust the number of displayed icons using the pinch gesture, and the user interface can be optimized according to a driving situation.

[0220] The user can also dynamically adjust the layout of the icons using the multi-rotate gesture and the user interface can be optimized according to driving situations.

Claims

[1] Input device comprising: a gesture interface (300) configured to receive a gesture input from the user; a display unit (200) configured to display a plurality of symbols; and a control unit (400) configured to detect the user's gesture and to control the display unit (200) to change the number of icons to be displayed when the detected gesture is a pinch gesture, wherein the gesture interface (300) comprises a touch interface (310) configured to detect a user touch input, wherein the control unit (400) is configured to detect a change in the positions of a plurality of fingers using touch coordinates detected by the touch interface (310) and to recognize the user's gesture based on the change in the positions of the plurality of fingers; and wherein the touch interface (310) further comprises a center point (C), and the control unit (400) is configured to recognize the user's gesture based on a change in an average distance between the plurality of fingers and the center point (C). [2] The input device according to claim 1, wherein the display unit (200) is configured to reduce the number of icons to be displayed in response to a pinch-close gesture in which a hand is cupped. [3] The input device according to claim 2, wherein the control unit (400) is configured to detect a change in a distance between two fingers and recognize as the pinch-close gesture when the distance between the two fingers is reduced. [4] The input device according to claim 2, wherein the control unit (400) is configured to detect a change in a size of a gesture space formed by a plurality of fingers and recognize as the pinch-close gesture when the size of the gesture space is reduced. [5] The input device according to claim 4, wherein the control unit (400) is configured to form the gesture space by connecting endpoints of the plurality of fingers. [6] The input device according to claim 1, wherein the display unit (200) is configured to increase the number of icons to be displayed in response to a pinch-open gesture in which a hand is opened. [7] The input device according to claim 6, wherein the control unit (400) is configured to detect a change in a distance between two fingers and recognize as the pinch-open gesture when the distance between the two fingers is increased. [8] The input device according to claim 6, wherein the control unit (400) is configured to detect a change in a size of a gesture space formed by a plurality of fingers and recognize as the pinch-open gesture when the size of the gesture space is increased. [9] The input device according to claim 1, wherein the control unit (400) is configured to recognize as a pinch-close gesture when the distance between the plurality of fingers and the center point (C) is decreased, and also to recognize as a pinch-open gesture when the average distance between the plurality of fingers and the center point (C) is increased. [10] The input device of claim 1, wherein the gesture interface (300) further comprises a spatial interface (320) configured to obtain an image of the user and consequently receive an input of a spatial gesture of the user, and the control unit (400) is configured to detect a plurality of fingers from the image, analyze changes in the positions of the plurality of fingers, and recognize the gesture of the user based on the changes in the positions of the plurality of fingers. [11] The input device according to claim 1, wherein the display unit (200) is configured to change a layout of the plurality of icons to be displayed in response to a multi-rotation gesture in which a hand is rotated. [12] The input device of claim 11, wherein a symbol layout comprises at least colors, shapes, positions, sizes and / or arrangements of the plurality of symbols. [13] The input device of claim 1, wherein the touch interface (310) is configured to change a color of the emitted light in response to a multi-rotation gesture in which a hand is rotated. [14] The input device of claim 1, wherein the control unit (400) is configured to determine the number of icons to be changed based on a size of the pinch gesture. [15] The input device according to claim 14, wherein the control unit (400) is configured to determine the symbols to be displayed on the display unit (200) based on a priority order stored in a pre-stored priority list. [16] A method for controlling an input device, comprising: Display a variety of icons; Detecting a user gesture on the input device; and Changing the number of icons to be displayed in response to the user's gesture if the recognized gesture is a pinch gesture, wherein detecting the user's gesture comprises detecting a change in the positions of a plurality of fingers using touch coordinates detected by a touch interface (310) of the input device, and detecting the user's gesture based on the change in the positions of the plurality of fingers, and wherein recognizing the user's gesture further comprises calculating an average distance between the plurality of fingers and a center point (C) provided on the touch interface (310) and recognizing the user's gesture based on a change in the average distance between the plurality of fingers and the center point (C). [17] The method of claim 16, wherein changing the number of icons comprises decreasing the number of icons to be displayed when the detected gesture is a pinch-close gesture in which a hand is cupped. [18] The method of claim 17, wherein detecting a gesture of the user comprises detecting a change in a distance between two fingers and detecting as the pinch-close gesture when the distance between the two fingers is decreased. [19] The method of claim 17, wherein recognizing a gesture of the user comprises determining a size of a gesture space formed by endpoints of a plurality of fingers and recognizing as the pinch-close gesture when a size of the gesture space is decreased. [20] The method of claim 17, wherein changing the number of icons comprises increasing the number of icons to be displayed when the detected gesture is a pinch-open gesture in which a hand is opened. [21] The method of claim 20, wherein detecting a gesture of the user comprises detecting a change in a distance between two fingers and detecting as the pinch-open gesture when the distance between the two fingers is increased. [22] The method of claim 20, wherein recognizing a gesture of the user comprises detecting a size of a gesture space formed by endpoints of a plurality of fingers and recognizing as the pinch-open gesture when the size of the gesture space is increased. [23] The method of claim 16, further comprising: changing a layout of the plurality of icons to be displayed in response to a multi-rotate gesture in which a hand is rotated. [24] The method of claim 16, further comprising: changing a color of the light of a gesture interface (300) in response to a multi-rotate gesture in which a hand is rotated.

Images