Vehicle command input device, system including the same, and vehicle command input method

Abstract

The present application relates to a vehicle command input device, a system including the same, and a vehicle command input method. The vehicle command input device includes a storage configured to store an algorithm, and a processor configured to execute the algorithm to recognize a user's motion based on an intensity of a force applied to a steering wheel, and to recognize and execute a vehicle command based on the user's motion. The storage is further configured to store data processed by the processor.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to Korean Patent Application No. 10-2020-0075888, filed on June 22, 2020, with the Korean Intellectual Property Office, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to a vehicle command input device, a system including the device, and a vehicle command input method, and more particularly, to a technique for providing vehicle services by measuring the force applied to the steering wheel. Background Technology

[0004] The vehicle is equipped with air conditioning to provide a comfortable driving environment for the driver or audio-visual navigation (AVN) to provide the driver with driving convenience and audio-visual enjoyment.

[0005] Typically, the input device for operating such air conditioning or AVN is located separately in the vehicle's central dashboard. Therefore, while driving, the driver needs to shift their forward-looking gaze to the input device and move their hands from the steering wheel to the input device to operate the air conditioning or AVN.

[0006] As mentioned above, operating the air conditioning or AVN while driving distracts the driver and makes them less focused on the road ahead, thereby increasing the likelihood of a traffic accident.

[0007] To reduce the risk of accidents caused by operating the air conditioning unit or AVN (Autonomous Vehicle Network), a remote controller can be installed in the steering wheel. However, the driver needs to shift their gaze to find the controller for the desired input, or search around to locate it, which distracts the driver from driving and reduces driver convenience.

[0008] Therefore, a technology has been developed to allow drivers to perform desired actions by tapping or swiping the steering wheel, or to provide vehicle services by entering voice keywords. However, when drivers are listening to music or have the windows open, ambient noise can cause input errors. Summary of the Invention

[0009] This disclosure aims to address the problems existing in the prior art while maintaining the advantages obtained through the prior art.

[0010] One aspect of this disclosure provides a vehicle command input device, a system including the device, and a vehicle command input method, wherein the device is able to clearly determine the user's intent because the user accurately inputs vehicle commands while holding the steering wheel of the vehicle without additional hand movements.

[0011] One aspect of this disclosure provides a vehicle command input device, a system including the device, and a vehicle command input method. When a vehicle command is input via a steering wheel and a signal related to vehicle safety or danger is generated, the device can enhance vehicle safety by allowing the user to stop or restart inputting the vehicle command.

[0012] The technical problems solved by the present invention are not limited to those described above, and any other technical problems not mentioned herein will be clearly understood by those skilled in the art to which this disclosure pertains based on the following description.

[0013] According to another aspect of this disclosure, a vehicle command input device may include: a storage device configured to store an algorithm; and a processor configured to execute the algorithm to identify a user's action based on the intensity of a force applied to a steering wheel, and to identify and execute vehicle commands based on the user's action. The storage device may be further configured to store data processed by the processor.

[0014] According to an embodiment, the processor can be configured to perform at least one of starting a voice recognition service, ending a voice recognition service, controlling the operation and level of the vehicle device, and responding to a voice recognition service based on the user's actions.

[0015] According to an embodiment, the user's actions may include at least one of the following actions: gripping, squeezing, pushing, pulling, gripping one side, and gripping in a preset pattern.

[0016] According to an embodiment, the processor can be configured to recognize the steering wheel as being held by the user's hand when a force applied to the inside or outside of the steering wheel meets a preset first condition.

[0017] According to an embodiment, the processor can be configured to recognize the steering wheel as being held by the user's hands when it senses a force applied to the inside or outside of the steering wheel by both hands or one hand.

[0018] According to an embodiment, the processor can be configured to recognize the steering wheel as being gripped by the user's hands when the forces applied simultaneously by both hands to the inner and outer sides of the steering wheel meet a preset second condition.

[0019] According to an embodiment, the second condition can be set to have a force strength greater than that of the first condition.

[0020] According to an embodiment, when the steering wheel is recognized as being gripped, the processor can perform at least one of the following based on the user's actions: start a voice recognition service, end a voice recognition service, control the operation and level of vehicle devices, and respond to a voice recognition service.

[0021] According to an embodiment, the processor can be configured to terminate a function or service that is being executed when the steering wheel is recognized as being gripped.

[0022] According to an embodiment, the processor can be configured to recognize the user's action as a pulling action when the force applied to the inside of the steering wheel is greater than the force applied to the outside of the steering wheel, and to recognize the user's action as a pushing action when the force applied to the outside of the steering wheel is greater than the force applied to the inside of the steering wheel.

[0023] According to an embodiment, the processor can be configured to identify pull and push actions by matching them with "yes" or "no" in a speech recognition service.

[0024] According to an embodiment, the processor can be configured to perform level control while the driver is gripping one side of the steering wheel.

[0025] According to an embodiment, the processor can be configured to perform level down control when gripping one side of the steering wheel, and level up control when gripping the other side of the steering wheel opposite to that side.

[0026] According to an embodiment, the level control may include at least one of volume control, screen brightness control, lighting control, sunroof opening control, window opening control, and album flip control.

[0027] According to an embodiment, the processor can be configured to perform a control operation to stop or restart the input of vehicle commands via the steering wheel when a signal related to vehicle safety or danger is generated or when the steering wheel input value for sudden acceleration / deceleration or sudden rotation increases sharply.

[0028] According to an embodiment, the processor can be configured to perform a control operation to output a warning when no at least one grip action on the steering wheel is recognized.

[0029] According to an embodiment, the processor can be configured to set conditions based on the intensity of the force applied to the steering wheel by each user's action to register conditions for each user's action.

[0030] According to an embodiment, the processor can be configured to set the condition to a constant or a range.

[0031] According to an embodiment, the processor can be configured to adjust the registration conditions for a user's gripping action based on the registration conditions for each user's action and a preset weight.

[0032] According to another embodiment of this disclosure, a vehicle system may include: a vehicle steering wheel; a pressure sensor for sensing pressure applied to the steering wheel; and a vehicle command input device for recognizing user actions based on the output of the pressure sensor, and for recognizing and executing vehicle commands based on the user actions.

[0033] According to an embodiment, the pressure sensor may include: a first sensor mounted on the inside of the steering wheel; and a second sensor mounted on the outside of the steering wheel.

[0034] According to another embodiment of this disclosure, a vehicle command input method may include: sensing the intensity of a force applied to a steering wheel; recognizing a user's action based on the intensity of the force applied to the steering wheel; and executing a vehicle command by recognizing a vehicle command based on the user's action. Attached Figure Description

[0035] The above and other objects, features, and advantages of this disclosure will become more apparent from the accompanying drawings and from the following detailed description:

[0036] Figure 1 This is a block diagram illustrating the configuration of a vehicle system including a vehicle command input device according to an embodiment of the present disclosure;

[0037] Figure 2 This is a diagram showing the location of the pressure sensor on the steering wheel according to an embodiment of the present disclosure;

[0038] Figure 3 This is a diagram illustrating the position of a user's hands on the steering wheel according to an embodiment of the present disclosure;

[0039] Figure 4 This is a diagram illustrating a gesture according to an embodiment of the present disclosure.

[0040] Figure 5 This is a diagram illustrating the start time point of speech recognition according to an embodiment of the present disclosure;

[0041] Figure 6 This is a diagram illustrating the response "yes" or "no" according to embodiments of this disclosure;

[0042] Figure 7 This is a diagram illustrating level control according to an embodiment of the present disclosure;

[0043] Figure 8 This is a flowchart illustrating a vehicle command input method according to an embodiment of the present disclosure;

[0044] Figure 9 This is a block diagram illustrating the configuration of a vehicle system including a vehicle command input device according to an embodiment of the present disclosure. Detailed Implementation

[0045] In the following, some embodiments of the present disclosure will be described in detail with reference to the exemplary accompanying drawings. When adding reference numerals to the components in each drawing, it should be noted that identical or equivalent components are indicated by the same reference numerals, even if they are shown in other drawings. Furthermore, in describing embodiments of the present disclosure, detailed descriptions of well-known configurations or functions will be omitted to avoid unnecessarily obscuring the essential points of the disclosure.

[0046] Additionally, in the following description of components according to embodiments of this disclosure, the terms “first,” “second,” “A,” “B,” “(a),” and “(b)” may be used. These terms are intended only to distinguish one component from another, and they do not limit the nature, sequence, or order of the components. Furthermore, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. Like terms defined in a general dictionary, such terms will be interpreted as having the same meaning as in the context of the relevant technical field, and will not be interpreted as having an ideal or overly formal meaning, unless explicitly defined in this application as having such an ideal or overly formal meaning.

[0047] In the following text, reference will be made to Figures 1 to 9 The embodiments of this disclosure will be described in detail.

[0048] Figure 1 This is a block diagram illustrating the configuration of a vehicle system including a vehicle command input device according to an embodiment of the present disclosure. Figure 2 This is a diagram showing the location of the pressure sensor on the steering wheel according to an embodiment of the present disclosure.

[0049] Reference Figure 1 According to embodiments of this disclosure, the vehicle command input device 100 can be implemented inside a vehicle. In this case, the vehicle command input device 100 can be integrally formed with the vehicle's interior control unit, or it can be implemented separately from the vehicle's interior control unit to connect to the vehicle's interior control unit via a separate connector.

[0050] The vehicle system may include: a vehicle command input device 100; a steering wheel 200 for vehicle steering control; and a pressure sensor 300.

[0051] The vehicle command input device 100 can recognize the user's actions (gestures) based on the strength of the force applied to the steering wheel 200, and can recognize and execute vehicle commands based on the user's actions.

[0052] The vehicle command input device 100 may include a communication device 110, a storage device 120, an interface 130, and a processor 140.

[0053] The communication device 110 is a hardware device implemented with various electronic circuits to transmit and receive signals via wireless or wired connections. According to this disclosure, the communication device 110 can perform network communication technology within a vehicle. In this case, vehicle network communication technology may include Controller Area Network (CAN) communication technology, Local Interconnect Network (LIN) communication technology, or FlexRay communication technology, and in-vehicle communication can be performed using these communication technologies.

[0054] For example, the communication device 110 communicates with the steering wheel 200 and the pressure sensor 300, and can also communicate with the storage device 120, the interface 130 and the processor 140, which are components in the vehicle command input device 100.

[0055] For example, the communication device 110 can receive safety or risk-related signals from components inside the vehicle and can provide those signals to the processor 140. In other words, the communication device 110 can receive Emergency Stop Signalling (ESS), sudden braking function signals from the Anti-lock Braking System (ABS), collision risk signals from Forward Collision-Avoidance Assist (FCA) related to vehicles ahead, signals from Electronic Stability Control (ESC) related to controlling unstable vehicle posture, rear gear signals, etc., and can provide those signals to the processor 140.

[0056] In addition, the communication device 110 can receive at least one signal from components inside the vehicle, such as speeding, prolonged speeding, sudden acceleration, sudden start, sudden braking, sudden stop, sudden left turn, sudden right turn, sudden U-turn, sudden overtaking, and sudden change of route, and provide the at least one signal to the processor 140.

[0057] In addition, the communication device 110 can receive pressure information sensed by the pressure sensor 300 and provide the pressure information to the processor 140 or the storage device 120.

[0058] Storage device 120 may store results sensed by pressure sensor 300, data obtained by processor 140, and data and / or algorithms required for operation by processor 140. For example, storage device 120 may store data and / or algorithms used for speech recognition.

[0059] For example, storage device 120 can store force intensity-related conditions for recognizing user actions, as well as information about the user's actions for each condition. In this case, the force intensity-related conditions can be preset and stored based on experimental values, and the conditions can be set as constants or ranges.

[0060] Additionally, the storage device 120 can be implemented as at least one type of storage medium, such as flash memory, hard disk, micro, and card type (e.g., security digital (SD) card or eXtreme digital card), random access memory (RAM), static RAM (SRAM), read-only memory (ROM), programmable ROM (PROM), electrically erasable programmable ROM (EEPROM), magnetic RAM (MRAM), disk and optical disk type storage media.

[0061] Interface 130 may include: an input device for receiving control commands from a user; and an output device for outputting the operating status and results of the vehicle command input device 100.

[0062] Input devices may include buttons, mice, joysticks, jog shuttles, and / or styluses, and may include soft keys implemented on a display. According to this disclosure, input devices may include microphones for speech recognition.

[0063] The output device may include a display and may include a voice output device such as a speaker for outputting the voice recognition results. For example, when the user's hands are not on the steering wheel, the processor 140 may control the output device to output a warning.

[0064] The display of the output device may include a touch sensor such as a touch film, touch pad, or touch panel, and the display can operate as a touch screen and can be implemented as an integrated input and output device. In this case, the display may include at least one of liquid crystal display (LCD), thin film transistor liquid crystal display (TFT LCD), organic light-emitting diode (OLED), flexible display, field emission display (FED), and three-dimensional display (3D display).

[0065] Processor 140 can be electrically connected to communication device 110, storage device 120, interface 130, etc., can electrically control each component, and can be a circuit that executes software commands. In one example, the software commands can be stored in storage device 120. Therefore, processor 140 can perform various data processing and calculations as described below. Processor 140 can be, for example, an electronic control unit (ECU), microcontroller unit (MCU), or another lower-level controller installed in a vehicle.

[0066] The processor 140 can recognize the user's actions (gestures) based on the intensity of the force applied to the steering wheel 200 sensed by the pressure sensor 300, and can recognize and execute vehicle commands based on the user's actions. The processor 140 can, for example, Figure 3 The strength of the force exerted by one or both hands on the steering wheel 200 is used to identify the user's actions. Figure 3 This is a diagram illustrating the position of a user's hand on the steering wheel according to an embodiment of the present disclosure.

[0067] The pressure sensor 300 essentially performs sensing operations under the assumption that the driver uses both hands to operate the right and left halves of the steering wheel.

[0068] Pressure sensors 300 are installed on the inner and outer sides of the steering wheel 200 to detect pressure changes such as... Figure 3 As shown by reference numeral 303 in the accompanying drawing, pressure is sensed when a user grips and rotates the steering wheel 200. In this case, the vehicle command input device 100 can recognize that the user is gripping the steering wheel 200 even if only one of the inner and outer sensors is identified by the pressure sensor 300. Figure 3 As shown by reference numeral 301, the user's hands grip the upper side of the steering wheel 200, and as shown by reference numeral 302, the right hand grips the upper side of the steering wheel 200 while the left hand grips the opposite side. In other words, regardless of the hand position, even if only one hand is gripping the steering wheel 200, the pressure sensor 300 can sense that the steering wheel 200 is being gripped. On the other hand, when neither the inner nor outer sensor senses pressure, the pressure sensor 300 can sense that the user is not gripping the steering wheel 200. Therefore, when the user is not gripping the steering wheel 200 with either hand, the vehicle command input device 100 can output a warning to instruct the user to grip the steering wheel 200.

[0069] Simultaneously, the user's actions can include at least one of the following: gripping, squeezing, pushing, pulling, gripping one side, and gripping in a preset pattern. (See below for further details.) Figure 4 Describe the details of each action.

[0070] The processor 140 can perform at least one of the following based on the user's actions: start a voice recognition service, end a voice recognition service, control the operation and level of the vehicle device, and respond to a voice recognition service.

[0071] When the force applied to the inside or outside of the steering wheel 200 meets a preset first condition, the processor 140 can recognize the steering wheel as being in a gripping state where the steering wheel 200 is held by the user's hand. And when the processor 140 senses the force applied to the inside or outside of the steering wheel 200 by the user's two hands or one hand, the processor 140 can recognize the steering wheel 200 as being in a gripping state where the steering wheel 200 is held by the user's hand.

[0072] When the force applied simultaneously by both hands to the inner and outer sides of the steering wheel 200 satisfies a preset second condition, the processor 140 can recognize the steering wheel as being in a gripping action where the user's hands are holding it. In this case, the first condition for the gripping action can be set to a value that is less than the second condition in the gripping action in terms of force intensity.

[0073] When the user's action based on the steering wheel 200 is recognized as a gripping action, the processor 140 can perform at least one of the following actions based on the user's action: start the voice recognition service, end the voice recognition service, control the operation and level of the vehicle device, and respond to the voice recognition service.

[0074] When the steering wheel is recognized as being gripped, the processor 140 can terminate the currently executing function or service. For example, the processor 140 can send a signal to start a voice recognition service and can begin the voice recognition service. For example, after providing the voice recognition service, when the steering wheel is recognized as being gripped, the processor 140 can terminate the voice recognition service.

[0075] When the force applied to the inside of the steering wheel 200 is greater than the force applied to the outside of the steering wheel 200, the processor 140 can identify the steering wheel as being in a pulling motion state, and when the force applied to the outside of the steering wheel 200 is greater than the force applied to the inside of the steering wheel 200, the processor 140 can identify the steering wheel as being in a pushing motion state.

[0076] Processor 140 can identify pull and push actions by matching them with "yes" or "no" in a speech recognition service. For example, when a pull action is identified, processor 140 can identify the user's intent as "no," and when a push action is identified, processor 140 can identify the user's intent as "yes."

[0077] The processor 140 can perform level control while the driver is gripping one side of the steering wheel. In this case, level control may include at least one of volume control, screen brightness control, lighting control, sunroof opening control, window opening control, or record flipping control, but this disclosure is not limited thereto. For example, level control may include control over all devices capable of performing level control within the vehicle.

[0078] When gripping one side of the steering wheel 200, the processor 140 can perform level down control, and when gripping the opposite side of the steering wheel 200, the processor 140 can perform level up control.

[0079] During the input of vehicle commands via steering wheel 200, when a signal related to vehicle safety or danger is generated, or when the steering wheel input value for sudden acceleration / deceleration or sudden rotation increases sharply, processor 140 can perform a control operation to stop or restart the input of vehicle commands via steering wheel 200. In other words, in the event of a dangerous incident or violation of regulations, processor 140 can stop gesture detection operations using steering wheel 200 by linking with the on-board unit.

[0080] When at least one of the following signals is generated: Emergency Stop (ESS) signal, sudden braking function signal from Anti-lock Braking System (ABS), signal from Forward Collision Assist (FCA) related to the risk of collision with the vehicle ahead, signal from Electronic Stability Control (ESC) related to the function of controlling unstable vehicle posture, and rear gear signal, the processor 140 can determine that a dangerous situation has occurred and stop using the steering wheel 200 for gesture detection operation.

[0081] In addition, when at least one of the following signals is generated: speeding, prolonged speeding, sudden acceleration, sudden start, sudden braking, sudden stop, sudden left turn, sudden right turn, sudden U-turn, sudden overtaking, and sudden change of route, the processor 140 can stop using the steering wheel 200 to perform gesture detection operations.

[0082] When no gripping action related to the steering wheel 200 is detected, the processor 140 can determine that the user is not gripping the steering wheel and can output a warning to guide the user to grip the steering wheel 200.

[0083] The processor 140 can set conditions for each user's action registration based on the intensity of the force applied to the steering wheel by each user's action, and can set these conditions to a constant or a range. In this case, the action registration conditions for each user will be described later with reference to Table 1.

[0084] Processor 140 can use the action registration conditions for each user and preset weights to correct the registration conditions for the gripping action in a user's actions. In this case, the action registration conditions for each user will be described later with reference to Table 2. Processor 140 can use the action registration conditions for each user and preset weights to correct the registration conditions for the gripping action in a user's actions, and the preset weights can be preset based on experimental values.

[0085] The pressure sensor 300 can be installed on the inside or outside of the steering wheel 200. (See reference...) Figure 2 Reference numeral 201 indicates that two pressure sensors 211 and 212 are provided. Figure 2 As shown by reference numeral 202 in the attached drawing, two pressure sensors 211 and 212 can be mounted on the inner side 221 and the outer side 222 of the steering wheel 200.

[0086] Figure 4 This is a diagram illustrating a gesture according to an embodiment of the present disclosure.

[0087] exist Figure 4 In the figure, reference numeral 401 indicates a "gripping" action, reference numeral 402 indicates a "squeezing" action, reference numeral 403 indicates a "pushing" action, and reference numeral 404 indicates a "pulling" action. Although Figure 4 The illustration shows four actions: gripping, holding, pushing, and pulling, but this disclosure is not limited to these. For example, various actions can be recognized. For instance, the vehicle command input device 100 can recognize actions such as gripping the steering wheel using a specific pattern, like Morse code, to initiate a voice recognition service or provide a scheduled service.

[0088] The vehicle command input device 100 can pre-register forces corresponding to gripping, squeezing, pushing, and pulling. In other words, the vehicle command input device 100 can pre-register internal forces applied to the inside of the steering wheel and external forces applied to the outside of the steering wheel, and can compare these forces with forces subsequently applied to the steering wheel by the user to identify actions. In this case, internal and external forces can be registered as specific force values ​​(constants) or force ranges. For example, the force ranges can be divided into 10 ranges. Actions are divided and identified based on the range to which the force of gripping the steering wheel belongs. These ten ranges can be set by gradually increasing the force from the first range to the tenth range. In this case, the force ranges can be divided more finely, or the force ranges can be divided in larger units.

[0089] When a conventional force is applied to either the inner or outer side of the steering wheel 200, or simultaneously to both sides, the vehicle command input device 100 recognizes the user's action as a gripping action. In this case, the conventional force refers to a force with an intensity within a predetermined range and can be determined in advance based on experimental values. As shown in Table 1 below, the vehicle command input device 100 can be pre-registered such that when the intensity of the inner force applied to the inner side of the steering wheel 200 is "A" and the intensity of the outer force applied to the outer side of the steering wheel 200 is "B", the user's action is recognized as a gripping action. As shown in Table 1 below, the vehicle command input device 100 can be pre-registered such that when the intensity of the inner force applied to the inner side of the steering wheel 200 corresponds to the fifth interval and the intensity of the outer force applied to the outer side of the steering wheel 200 corresponds to the sixth interval, the user's action is recognized as a gripping action. In this case, although there is a slight difference between "A" and "B", "A" and "B" have essentially the same value. The fifth and sixth force intervals are adjacent to each other. Therefore, it can be recognized that the strengths of the forces in the fifth and sixth intervals are similar to each other.

[0090] When a force equal to or greater than the reference force is simultaneously applied to the inner and outer sides of the steering wheel 200, the vehicle command input device 100 can recognize the user's action as a gripping action. As shown in Table 1, the vehicle command input device 100 can be pre-registered such that when the intensity of the internal force applied to the inner side of the steering wheel 200 is "C" and the intensity of the external force applied to the outer side of the steering wheel 200 is "D", the user's action is recognized as a gripping action. As shown in Table 1, the vehicle command input device 100 can be pre-registered such that when the intensity of the internal force applied to the inner side of the steering wheel 200 corresponds to the seventh interval and the intensity of the external force applied to the outer side of the steering wheel 200 corresponds to the ninth interval, the user's action is recognized as a gripping action. In this case, although there is a slight difference between "C" and "D", "C" and "D" have essentially the same value. The seventh and ninth force intervals are adjacent to each other. Therefore, it can be recognized that the intensities of the forces corresponding to the seventh and ninth intervals are similar to each other. In this case, the value "A" registered in the gripping action can be set to be less than the value "C" registered in the tightening action, and "B" can be set to be less than "D". In other words, the strength of the force in the gripping action can be set to be less than the strength of the force in the tightening action.

[0091] When the force applied to the outer side of the steering wheel 200 is relatively or absolutely greater than the force applied to the inner side of the steering wheel 200, the vehicle command input device 100 can recognize the user's action as a pushing action, and when the force applied to the inner side of the steering wheel 200 is relatively or absolutely greater than the force applied to the outer side of the steering wheel 200, the vehicle command input device 100 can recognize the user's action as a pulling action.

[0092] As shown in Table 1, the vehicle command input device 100 can be pre-registered such that when the strength of the internal force applied to the inside of the steering wheel 200 is "E" and the strength of the external force applied to the outside of the steering wheel 200 is "F", the user's action is recognized as a pushing action. As shown in Table 1, the vehicle command input device 100 can be pre-registered such that when the strength of the internal force applied to the inside of the steering wheel 200 is "G" and the strength of the external force applied to the outside of the steering wheel 200 is "H", the user's action is recognized as a pulling action. As shown in Table 1, the vehicle command input device 100 can be pre-registered such that when the strength of the internal force applied to the inside of the steering wheel 200 corresponds to a first interval and the strength of the external force applied to the outside of the steering wheel 200 corresponds to a ninth interval, the user's action is recognized as a pushing action. Simultaneously, the vehicle command input device 100 can be pre-registered such that when the strength of the internal force applied to the inside of the steering wheel 200 corresponds to an eighth interval and the strength of the external force applied to the outside of the steering wheel 200 corresponds to a zero interval, the user's action is recognized as a pulling action.

[0093] In this case, the force strength difference between "E" and "F" is significantly greater than the force strength difference between "G" and "H". When the force applied to the inside of the steering wheel 200 has a very large value, the vehicle command input device 100 can recognize the user's action as a pulling action, and when the force applied to the outside of the steering wheel 200 has a very large value, the vehicle command input device 100 can recognize the user's action as a pushing action.

[0094] Table 1

[0095]

[0096] Simultaneously, the vehicle command input device 100 can register the force intensity for gripping, squeezing, pushing, and pulling actions, and use weights to correct the force intensity in the gripping action based on the force intensity registered for each action as shown in Table 1 below. In this case, the vehicle command input device 100 can preset the weights for correction by adjusting the physical sensors.

[0097] Table 2

[0098]

[0099]

[0100] As shown in Table 2, when the internal force in the registered pushing action is greater than the internal force in the gripping action, the vehicle command input device 100 can maintain the range of forces for the registered gripping action. For example, when the internal force in the registered pushing action is greater than the internal force in the gripping action, and when the internal force in the gripping action corresponds to the fifth range and the external force in the gripping action corresponds to the sixth range, the vehicle command input device 100 can maintain the range of forces registered for identifying the gripping action without making corrections.

[0101] On the other hand, when the internal force in the pushing action is less than the internal force in the gripping action, as shown in Equation 1, the vehicle command input device 100 can use preset weights to expand the gripping range. In this case, the vehicle command input device 100 can preset the weights "w1", "w2", and "w3" using experimental values.

[0102] Equation 1

[0103] Grasp correction value = (Pushing internal force * w1 + Grasp internal force * w2) / w3

[0104] In addition, when the external force in the pulling action is greater than the external force in the gripping action, the vehicle command input device 100 can maintain the registered range of the gripping action force.

[0105] Meanwhile, when the external force in the pulling action is less than the external force in the gripping action, as shown in Equation 2, the vehicle command input device 100 can use weights to expand the gripping range.

[0106] Equation 2

[0107] Grip correction value = (pulling force * w1 + gripping force * w2) / w3

[0108] Figure 5 This is a diagram illustrating the start time point of speech recognition according to an embodiment of the present disclosure.

[0109] Reference Figure 5 When the user changes the state 501 of gripping the steering wheel 200 to the state 502 of gripping the steering wheel 200 while driving, the vehicle command input device 100 can recognize the start of voice recognition.

[0110] Figure 6 This is a diagram illustrating the response "yes" or "no" according to an embodiment of this disclosure.

[0111] Reference Figure 6When a user is asked to respond with "yes" or "no" as feedback for voice recognition, if the user receives a pushing action input as shown in the attached reference numeral 601, the vehicle command input device 100 can recognize the user's action as "yes," and if the user receives a pulling action as shown in the attached reference numeral 602, the user's action can be recognized as "no."

[0112] Figure 7 This is a diagram illustrating level control according to an embodiment of the present disclosure.

[0113] Reference Figure 7 When requesting the user to perform level control as feedback for voice recognition, if the user receives a gripping motion input as shown by reference numeral 701 on the left side, the vehicle command input device 100 can recognize the user's motion as "decreasing," and if the user receives a gripping motion input as shown by reference numeral 702 on the right side, the user's motion can be recognized as "increasing." In this case, level control may include volume control, screen brightness control, lighting control, sunroof opening control, window opening control, or record flipping control.

[0114] After level control is completed by gripping one side of the steering wheel 200, the vehicle command input device 100 terminates the level control mode when it receives action input from the user to grip both sides of the steering wheel 200 simultaneously.

[0115] In the following text, reference will be made to Figure 8 A vehicle command input method according to embodiments of the present disclosure will be described in detail. Figure 8 This is a flowchart illustrating a vehicle command input method according to an embodiment of the present disclosure.

[0116] In the following text, it will be described Figure 1 Vehicle command input device 100 executes Figure 8 The process. Additionally, in reference... Figure 8 As can be understood from the description, the operations described as being performed by the device are controlled by the processor 140 of the vehicle command input device 100.

[0117] Reference Figure 8 The vehicle command input device 100 determines whether a user has registered (S101). In other words, the vehicle command input device 100 determines whether a user has registered the force intensity (constant or range) of the gripping, squeezing, pushing, and pulling actions of the steering wheel 200 for each user.

[0118] When the user has not registered, the vehicle command input device 100 registers the strength of the gripping and squeezing forces (S102), and registers the strength of the pushing and pulling forces (S103). Then, the vehicle command input device 100 can use the registered strength of the gripping, squeezing, pushing, or pulling forces to correct the strength of the registered gripping or squeezing forces (S104).

[0119] As described above, when the registration and correction of each action are completed, the vehicle command input device 100 begins the detection of the gesture (S105).

[0120] The vehicle command input device 100 determines whether the strength of the force applied by the user to the steering wheel meets the strength of the force of the registered grip action (S106).

[0121] When the force applied by the user to the steering wheel meets the strength of the registered gripping action, the vehicle command input device 100 recognizes the user's action as a gripping action (S107). Thereafter, it continuously monitors changes in the strength of the force applied to the steering wheel 200, and when a change in the strength of the force applied to the steering wheel 200 is sensed (S108), the vehicle command input device 100 determines whether the strength of the force applied by the user to the steering wheel meets the strength of the registered gripping action (S109).

[0122] When the force applied to the steering wheel by the user meets the strength of the registered gripping action, the vehicle command input device 100 recognizes the user's action as a gripping action (S110). Therefore, the vehicle command input device 100 recognizes this as the starting point for voice recognition, outputs a signal sound to begin voice recognition, receives and recognizes voice commands from the user, and performs feedback on the recognized voice commands (S111). In this case, the signal sound to begin voice recognition can be output through interface 130.

[0123] For example, when a user enters the voice command "Turn on the air conditioning" after gripping the steering wheel, the vehicle command input device 100 can provide feedback such as "Please adjust the air conditioning temperature." Therefore, the user can adjust the force applied to the steering wheel to lower or raise the air conditioning temperature.

[0124] For example, when a user enters the voice command "Open navigation" after gripping the steering wheel, the vehicle command input device 100 can provide feedback "Please enter your destination." In this case, the user can enter their destination via voice command.

[0125] For example, when a user enters the voice command "The lights are dim" after gripping the steering wheel, the vehicle command input device 100 can provide feedback "Turn on the lights?". In this case, the user can respond with "yes" or "no" by pushing or pulling the steering wheel, and the vehicle command input device 100 can identify "yes" or "no" based on the pressure applied to the steering wheel 200.

[0126] Additionally, when the vehicle command input device 100 provides feedback of "requesting voice command again", the user can restart voice recognition after gripping the steering wheel 200.

[0127] The vehicle command input device 100 determines whether to receive the voice command, whether to receive "yes" or "no", or whether to receive level control based on the feedback of the voice command (S114).

[0128] When voice command input is required (S114, 1), the vehicle command input device 100 provides feedback again by receiving a voice command from the user (S113), and when a "yes" or "no" response is required (S114, 2), it senses a pushing or pulling motion of the steering wheel 200 (S115). Afterward, the vehicle command input device 100 determines whether additional service is needed. If additional service is needed, the vehicle command input device 100 returns to S113; if no additional service is needed, the vehicle command input device 100 terminates the process.

[0129] Additionally, when level control is required (s114, 3), the vehicle command input device 100 identifies the level command based on the strength of the force applied to the right and left sides of the steering wheel to execute level control (s117 and s118).

[0130] Subsequently, the vehicle command input device 100 determines whether it senses the gripping action of both hands on the steering wheel 200 (S119), and when the gripping action of both hands is sensed, it determines that the level control command is completed.

[0131] When a restriction occurs between S101 and S119, the vehicle command input device 100 can stop detecting gestures, can standby at the time when gesture detection is stopped, and when the restriction lasts for a specific time or longer, the vehicle command input device 100 can return to the initial step of inputting the gesture (S101).

[0132] Figure 9 This is a block diagram illustrating the configuration of a vehicle system including a vehicle command input device according to another embodiment of the present disclosure.

[0133] Figure 9The disclosed method uses a touch sensor 310 instead of a pressure sensor 300 to recognize gestures by utilizing the contact area between the user's hand and the steering wheel. For example, the vehicle command input device 100 can initiate voice recognition when the contact area with the user's hand is equal to or greater than a predetermined reference value; when the user's hand contacts the inside of the steering wheel, the vehicle command input device 100 can recognize "yes," and when the user's hand contacts the outside of the steering wheel, the vehicle command input device 100 can recognize "no." Furthermore, while the user's hand is in contact with one side of the steering wheel, the vehicle command input device 100 can perform level control by changing the contact area.

[0134] As described above, according to this disclosure, actions (gestures) are identified based on the strength of the force applied to the steering wheel of the vehicle, and vehicle commands are identified based on the related actions, thus enabling accurate identification of vehicle commands even when the user is listening to music or has the windows open in the vehicle.

[0135] Furthermore, according to this disclosure, when a signal related to vehicle safety or danger is generated, gesture recognition is stopped, thereby enhancing vehicle safety.

[0136] Furthermore, according to this disclosure, when a user is not holding the steering wheel while driving, a warning is provided to the user to guide safe driving.

[0137] According to this disclosure, since the user can accurately input vehicle commands without additional hand movements while holding the vehicle's steering wheel, the user's intention can be clearly determined.

[0138] Furthermore, according to this disclosure, when a signal related to vehicle safety or danger is generated when vehicle commands are input via the steering wheel, vehicle safety can be enhanced by allowing the user to stop or restart inputting vehicle commands.

[0139] Furthermore, it can provide various effects that can be understood directly or indirectly through this disclosure.

[0140] Therefore, exemplary embodiments of this disclosure are intended to explain the ideas and scope of this disclosure, and not to limit them, so that the ideas and scope of this disclosure are not limited to the embodiments. The scope of this disclosure should be interpreted based on the appended claims, and the scope of this disclosure should include all technical ideas equivalent to the scope of the claims.

[0141] In the foregoing, although the present disclosure has been described with reference to exemplary embodiments and accompanying drawings, the present disclosure is not limited thereto. Various modifications and changes can be made to the present disclosure by those skilled in the art without departing from the spirit and scope of the present disclosure as claimed in the appended claims.

Claims

1. A vehicle command input device, comprising: Storage devices, storage algorithms; as well as The processor executes the algorithm to identify the user's actions based on the intensity of the force applied to the steering wheel, and identifies and executes the vehicle commands based on the user's actions; The storage device further stores the data processed by the processor. Wherein, the processor: When the force applied to the inside or outside of the steering wheel meets a preset first condition, the steering wheel is identified as being in a gripping state where the steering wheel is held by the user's hand. When the force applied simultaneously by both hands to the inner and outer sides of the steering wheel meets the preset second condition, the steering wheel is identified as being in a gripped state where the steering wheel is held by the user's hands. The registration conditions for the gripping action in the user's actions are adjusted based on the registration conditions and preset weights for each user's actions. Wherein, the second condition is set such that the strength of the force is greater than the value of the first condition, and In this process, the weights used for correction are preset by adjusting the physical sensors.

2. The device according to claim 1, wherein, The processor is configured to: Based on the user's actions, perform at least one of the following: start the voice recognition service, end the voice recognition service, control the operation and level of the vehicle device, and respond to the voice recognition service.

3. The device according to claim 1, wherein, The user's actions include at least one of the following: gripping action, squeezing action, pushing action, pulling action, gripping one side action, and gripping action in a preset pattern.

4. The device according to claim 1, wherein, The processor is configured to: When a force is sensed applied to the inside or outside of the steering wheel by both hands or one hand, the steering wheel is identified as being in the gripped state where the steering wheel is held by the user's hands.

5. The device according to claim 1, wherein, The processor is configured to: When the steering wheel is recognized as being in the gripped state, at least one of the following is executed: start the voice recognition service, end the voice recognition service, control the operation and level of the vehicle device, and respond to the voice recognition service.

6. The device according to claim 5, wherein, The processor is configured to: When the steering wheel is identified as being in the gripped state, the function or service being executed is terminated.

7. The device according to claim 1, wherein, The processor is configured to: When the force applied to the inside of the steering wheel is greater than the force applied to the outside of the steering wheel, the user's action is identified as a pulling action; as well as When the force applied to the outside of the steering wheel is greater than the force applied to the inside of the steering wheel, the user's action is recognized as a pushing action.

8. The device according to claim 7, wherein, The processor is configured to: The pulling and pushing actions are identified by matching them with "yes" or "no" in the speech recognition service.

9. The device according to claim 1, wherein, The processor is configured to: Level control is performed while gripping one side of the steering wheel.

10. The device according to claim 9, wherein, The processor is configured to: Level descent control is executed when one side of the steering wheel is gripped; and Level up control is executed when gripping the other side of the steering wheel opposite to the first side.

11. The device according to claim 9, wherein, The level control includes: At least one of the following: volume control, screen brightness control, lighting control, sunroof opening control, window opening control, and record flipping control.

12. The device according to claim 1, wherein, The processor is configured to: During the input of vehicle commands via the steering wheel, when a signal related to vehicle safety or danger is generated, or when the steering wheel input value for sudden acceleration / deceleration or sudden rotation increases sharply, a control operation is performed to stop or restart the input of vehicle commands via the steering wheel.

13. The device according to claim 1, wherein, The processor is configured to: If no grip action is detected on the steering wheel, a control operation is performed to output a warning.

14. The device according to claim 1, wherein, The processor is configured to: Conditions are set based on the strength of the force applied to the steering wheel by each user's action to register conditions for each user's action.

15. The device according to claim 14, wherein, The processor is configured to: Set the condition to a constant or an interval.

16. A vehicle system comprising: The vehicle's steering wheel; A pressure sensor senses the pressure applied to the steering wheel; as well as The vehicle command input device identifies user actions based on the output of the pressure sensor, and identifies and executes vehicle commands based on the user's actions. The vehicle command input device includes: When the force applied to the inside or outside of the steering wheel meets a preset first condition, the steering wheel is identified as being in a gripping state where the steering wheel is held by the user's hand. When the force applied simultaneously by both hands to the inner and outer sides of the steering wheel meets the preset second condition, the steering wheel is identified as being in a gripped state where the steering wheel is held by the user's hands. The registration conditions for the gripping action in the user's actions are adjusted based on the registration conditions and preset weights for each user's actions. Wherein, the second condition is set such that the strength of the force is greater than the value of the first condition, and In this process, the weights used for correction are preset by adjusting the physical sensors.

17. The vehicle system according to claim 16, wherein, The pressure sensor includes: The first sensor is installed on the inside of the steering wheel; and The second sensor is mounted on the outside of the steering wheel.

18. A vehicle command input method, comprising: Sensing the intensity of the force applied to the steering wheel; The user's actions are identified based on the intensity of the force applied to the steering wheel; The vehicle command is executed by recognizing the vehicle command based on the user's actions; When the force applied to the inside or outside of the steering wheel meets a preset first condition, the steering wheel is identified as being in a gripping state where the steering wheel is held by the user's hand. When the force applied simultaneously by both hands to the inner and outer sides of the steering wheel meets the preset second condition, the steering wheel is identified as being in a gripped state where the steering wheel is held by the user's hands. The registration conditions for the gripping action in the user's actions are corrected using the action registration conditions and preset weights for each user. Wherein, the second condition is set such that the strength of the force is greater than the value of the first condition, and In this process, the weights used for correction are preset by adjusting the physical sensors.

Images