User interface system and method for vehicle

Abstract

The present invention discloses a user interface system for a vehicle and a method thereof. The user interface system includes: an input device for receiving input from a user in the vehicle; a display for displaying information in the vehicle; and a processor for, when receiving a request to input the user's personal information, determining whether the user's personal indication and personal input are supported, and as a result of the determination, supporting the use of the input device and the display to input personal information.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of priority from Korean Patent Application No. 10-2019-0071697 filed on June 17, 2019, in the Korean Intellectual Property Office, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to a user interface system for a vehicle and a method thereof. Background Art

[0004] With the development of information communication technology, information communication technology can be applied to vehicles to provide a payment function in the vehicle. Such a payment function in the vehicle requires a process of inputting information to ensure security, such as a personal identification number (PIN) for payment.

[0005] However, because existing payment functions in vehicles use input and display devices (user interfaces) that are exposed to all passengers, such as audio video navigation (AVN), there is a risk that security information may be exposed to passengers because the payment screen and input process are exposed to passengers in the vehicle.

[0006] Identification devices for identifying fingerprints, irises, and / or the like are applied to vehicles to prevent exposure of personal information, thereby reducing the risk that personal information may be exposed. However, adding identification devices separately is not economically feasible. Summary of the invention

[0007] The present disclosure aims to solve the above-mentioned problems occurring in the prior art while maintaining the advantages achieved by the prior art unchanged.

[0008] One aspect of the present disclosure provides a user interface system for a vehicle and a method thereof for reducing exposure of personal information to a passenger when inputting personal information.

[0009] The technical problems to be solved by the present inventive concept are not limited to the aforementioned problems, and any other technical problems not mentioned herein will be clearly understood by those skilled in the art to which the present disclosure pertains from the following description.

[0010] According to one aspect of the present disclosure, a user interface system may include: an input device that receives input from a user in a vehicle; a display that displays information in the vehicle; and a processor that, when receiving a request to input the user's personal information, determines whether to support the user's personal indications and personal input, and as a result of the determination, supports the use of the input device and the display to input personal information.

[0011] The input devices may include public input devices available to the user and passengers in the vehicle and personal input devices available only to the user. The display may include a public display viewable by both the user and the passengers.

[0012] The input device may comprise a common input device available to the user and the passenger. The display may comprise a common display viewable by both the user and the passenger.

[0013] The processor can determine whether personal indication can be supported using a public display, and when personal indication can be supported, personal information can be received via an input device and the received personal information can be displayed on the public display, and when personal indication cannot be supported, a risk of personal information being exposed can be warned.

[0014] The system may further include a sight tracking device for performing sight tracking of the passenger. The processor may determine whether the passenger is looking at the public display through sight tracking, when the passenger is not looking at the public display, may receive personal information via the input device and may display the received personal information on the public display, and when the passenger is looking at the public display, may warn of a risk that the personal information will be exposed.

[0015] The system may further include a passenger identification device for detecting passengers in the vehicle. When the passenger identification device does not detect a passenger in the vehicle, the processor may receive personal information via the input device, may display the received personal information on a public display, and may warn of a risk that the personal information will be exposed when a passenger is detected.

[0016] The processor may not display the personal information input via the public input device on the public display based on the predetermined configuration information.

[0017] The input device may include a common input device available to the user and the passenger. The display may include a public display viewable by the user and the passenger and a personal display viewable only by the user.

[0018] The processor may configure the input screen by mapping the display area of ​​the personal display and the input area of ​​the common input device, and may display the input screen on the personal display.

[0019] The processor may not display the input screen on the public display or may display an input screen different from the input screen on the public display.

[0020] When the personal display supports an augmented reality (AR) function, the processor may display a current situation of input on the personal display via a public input device, and may generate personal information using information of the personal display, which is mapped to input of the public input device.

[0021] When the personal display does not support the AR function, the processor may generate personal information using information of the personal display, which is mapped to the input of the public input device.

[0022] The input device may include a plurality of personal input devices, each personal input device being located at each seat in the vehicle. The processor may select any one of the plurality of input devices and may support input of personal information.

[0023] The processor may identify the user through a facial recognition device and may support input of personal information via a personal input device matched to the user's location.

[0024] According to another aspect of the present disclosure, a user interface (interface, interaction) method may include: when receiving a request to input personal information of a user in a vehicle, determining whether the user's personal indications are supported, determining whether the user's personal input is supported; and based on whether personal indications are supported and whether personal input is supported, supporting the use of an input device and a display to input personal information.

[0025] Determining whether to support the user's personal indication may include determining whether there is a personal display viewable only by the user in addition to a public display viewable by both the user and a passenger in the vehicle.

[0026] Determining whether the user's personal input is supported may include determining whether there is a personal input device available only to the user in addition to a common input device available to the user and a passenger in the vehicle.

[0027] Determining whether to support the user's personal input may also include, when the user's personal indication is not supported, determining whether the personal indication can be supported using a public display that can be viewed by both the user and the passenger.

[0028] Determining whether the personal indication can be supported using the public display may include receiving the personal information via an input device and displaying the received personal information on the public display when the personal indication can be supported using the public display.

[0029] The method may further include determining whether eye tracking of a passenger in the vehicle can be performed when the public display cannot be used to support personal indication, and determining whether the passenger is looking at the public display through eye tracking when the eye tracking of the passenger can be performed.

[0030] The method may further include outputting a warning regarding a risk that personal information will be exposed when the passenger looks at the public display.

[0031] The method may further include receiving personal information via an input device and displaying the received personal information on the public display when the passenger is not looking at the public display.

[0032] The method may further include determining whether a passenger in the vehicle can be identified when the passenger's line of sight tracking cannot be performed; and outputting a warning about a risk that personal information will be exposed when the passenger cannot be identified.

[0033] Determining whether a passenger can be identified may include detecting a passenger in a vehicle through passenger identification when the passenger can be identified; outputting a warning about the risk that personal information will be exposed when the passenger is detected; and receiving personal information via an input device and displaying the received personal information on a public display when the passenger is not detected.

[0034] Determining whether a user's personal indication is supported may include configuring an input screen by mapping a display area of ​​a personal display and an input area of ​​a public input device; displaying the input screen on the personal display; determining whether an AR function is being used through the personal display; when the AR function is used, displaying the current input situation on the personal display via the public input device; generating personal information using information of the personal display, which is mapped to the input of the public input device; and receiving the generated personal information and displaying the received personal information on the personal display.

[0035] The method may further include, after determining whether the AR function is used, generating personal information using information of the personal display when the AR function is not used, the information being mapped to an input of the common input device.

[0036] The method may also include, after determining whether personal input is supported, determining whether a gaze tracking function is supported when no personal display is present; determining whether the gaze tracking function is supported, when the gaze tracking function is supported; and outputting a warning about the risk that personal information will be exposed when the passenger looks at the public display.

[0037] The method may further include receiving personal information via a public input device and displaying the received personal information on the public display when the passenger is not looking at the public display.

[0038] The method may further include, after determining whether the gaze tracking function is supported, determining whether the passenger identification function is supported when the gaze tracking function is not supported; when the passenger identification function is supported, using the passenger identification function to detect passengers in the vehicle; and when no passengers in the vehicle are detected, displaying personal information input via a public input device on a public display.

[0039] The method may further include outputting a warning about a risk that personal information will be exposed when the passenger identification function is not supported or when a passenger in the vehicle is detected. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description in conjunction with the accompanying drawings:

[0041] Figure 1 is a block diagram showing a configuration of a user interface system for a vehicle according to an exemplary embodiment of the present disclosure;

[0042] Figure 2A , Figure 2B , Figure 2C as well as Figure 2D It is shown Figure 1 A block diagram of the configuration of the user interface shown; and

[0043] Figure 3A , Figure 3B as well as Figure 3C is a flowchart illustrating a user interface method for a vehicle according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0044] Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the exemplary drawings. When adding reference numerals to the components of each drawing, it should be noted that the same or equivalent components are represented by the same numerals even when shown on other drawings. In addition, when describing the embodiments of the present disclosure, detailed descriptions of well-known features or functions will be excluded so as not to unnecessarily obscure the gist of the present disclosure.

[0045] When describing components according to embodiments of the present disclosure, terms such as first, second, "A", "B", (a), (b), etc. may be used. These terms are intended only to distinguish one component from another, and these terms do not limit the nature, order, or sequence of the constituent components. Unless otherwise defined, all terms (including technical or scientific terms) used herein have the same meaning as those commonly understood by those skilled in the art to which the present disclosure belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning equivalent to the contextual meaning in the relevant art, and should not be interpreted as having an ideal or overformed meaning unless explicitly defined in this application as having an ideal or overformed meaning.

[0046] Figure 1 is a block diagram illustrating a configuration of a user interface system for a vehicle according to an exemplary embodiment of the present disclosure. FIG. 2A to FIG. 2D It is shown Figure 1 A block diagram of the configuration of the user interface is shown.

[0047] refer to Figure 1The user interface system may be loaded into a vehicle and may include an input device 110 , a display 120 , a memory 130 , a communication device 140 , a gaze tracking device 150 , a passenger identification device 160 , and a processor 170 .

[0048] The input device 110 may receive input from a passenger in the vehicle. In other words, the input device 110 may generate data according to the manipulation of the passenger. In this context, the passenger may include a user who should input personal information and a passenger who does not input personal information. The input device 110 may be implemented as a steering wheel, a button, a switch, a touch pad, a touch screen, a manipulator, etc.

[0049] The input device 110 may include a common input device 111 that is available to the user and the passenger. In addition, the input device 110 may also include a personal input device 112 that is available (operated) only by the user. The personal input device 112 may be provided only on the driver's seat or may be arranged on one or more passenger seats. Alternatively, the personal input device 112 may be arranged on all seats in the vehicle, i.e., the driver's seat and corresponding passenger seats.

[0050] The display 120 can display various information in the vehicle. The display 120 can be implemented as a liquid crystal display (LCD), a thin film transistor-LCD (TFT LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, a transparent display, a head-up display (HUD), a touch screen, a wearable display, a dashboard, etc.

[0051] The display 120 may include a speaker capable of outputting audio data. For example, the display 120 may output a message for providing a notification of a risk that personal information will be exposed on the display screen, and may output a warning sound via the speaker.

[0052] The display 120 may include a public display 121 that is exposed to all users and passengers and can be viewed by the users and passengers. The public display 121 may be located within the sight of the users and passengers. In addition, the display 120 may also include a personal display 122 that is only exposed to the user and can be viewed by the user. The personal display 122 may be located within the sight of the user and may be out of the sight of the passenger.

[0053] The input device 110 and the display 120 may be implemented in a combined form. The input device 110 and the display 120 may generally be referred to as a user interface 10. The user interface 10 may be implemented in the following four configurations.

[0054] First, if Figure 2AAs shown, the user interface 10 may be configured to have an input device 110 including a common input device 111 and a display 120 including a common display 121. In this case, the vehicle may support common input and common indication.

[0055] Secondly, if Figure 2B As shown, the user interface 10 may be configured to have an input device 110 including a public input device 111 and a personal input device 112 and a display 120 including a public display 121. In this case, the vehicle may support public input, personal input, and public indication.

[0056] Third, if Figure 2C As shown, the user interface 10 may be configured to have an input device 110 including a public input device 111 and a display 120 including a public display 121 and a personal display 122. In this case, the vehicle may support public input, public indication, and personal indication.

[0057] Finally, if Figure 2D As shown, the user interface 10 may be configured with an input device 110 including a public input device 111 and a personal input device 112 and a display 120 including a public display 121 and a personal display 122. In this case, the vehicle may support public input, personal input, public indication, and personal indication.

[0058] The memory 130 may store software programmed by the processor 170 to perform a predetermined operation. The memory 130 may store data (information) input from the input device 110. The memory 130 may store a mapping algorithm and the like.

[0059] The memory 130 may be implemented using at least one or more storage media (recording media), such as a flash memory, a hard disk, a secure digital (SD) card, a random access memory (RAM), a static RAM (SRAM), a read-only memory (ROM), a programmable ROM (PROM), an electrically erasable and programmable ROM (EEPROM), an erasable and programmable ROM (EPROM), a register, a removable hard disk, and a web storage.

[0060] The communication device 140 can communicate with an external electronic device (not shown). The communication device 140 can use wireless Internet technology (such as wireless local area network (WLAN) (wireless fidelity (Wi-Fi)) and / or wireless broadband (Wibro)), short-range communication technology (such as Bluetooth and / or near field communication (NFC)), mobile communication technology (such as long-term evolution (LTE), advanced LTE- and / or International Mobile Telecommunications-2020 (IMT-2020)), and / or wired Internet technology (such as local area network (LAN) and / or Ethernet).

[0061] The communication device 140 may receive a message for requesting personal information from the outside. When receiving the personal information request message, the communication device 140 may deliver the personal information request message to the processor 170.

[0062] The sight tracking device 150 may track the sight of the passenger using a camera (not shown) mounted on the vehicle. The sight tracking device 150 may use a previously stored sight tracking algorithm to estimate the point at which the passenger is looking. The sight tracking device 150 may use at least one or more of various known sight tracking techniques to track the sight of the passenger.

[0063] The passenger identification device 160 can determine whether each seat in the vehicle has a passenger. The passenger identification device 160 can use a camera, facial recognition technology, etc. to identify (recognize) a passenger. In addition, the passenger identification device 160 can use a pressure sensor installed on each seat to determine whether each seat has a passenger.

[0064] The processor 170 may receive a request to input the user's personal information. Herein, the personal information may be information requiring security, such as a personal identification number (PIN), a signature, and the like.

[0065] In the present disclosure, the processor 170 may be configured as a central processing unit (CPU) that controls the overall operation of each unit and surrounding devices (devices or systems). Each unit and surrounding device may be configured in the form of hardware, software, or a combination of hardware and software. Their functions and operations may be substantially controlled or interlocked by the processor 170.

[0066] When a request to input personal information is received, the processor 170 may determine whether the user's personal indication can be supported. The processor 170 may determine whether a personal display 122 exists in the vehicle. When the personal display 122 exists in the vehicle, the processor 170 may determine whether the personal display 122 is located within the user's line of sight. When the personal display 122 is located within the user's line of sight, the processor 170 may determine that personal indication can be supported. When the personal display 122 does not exist in the vehicle or although the personal display 122 exists in the vehicle, the personal display 122 is not located within the user's line of sight so that the personal display 122 is not available to the user, the processor 170 may determine that personal indication cannot be supported.

[0067] The processor 170 may determine whether the user's personal input may be supported. The processor 170 may determine whether there is a personal input device 112 in the vehicle that is available to the user for personal use. When the personal input device 112 is present in the vehicle and when the user can manipulate the personal input device 112, the processor 170 may determine that personal input may be supported. When the personal input device 112 is not present in the vehicle or when the user cannot manipulate the personal input device 112 although the personal input device 112 is present in the vehicle, the processor 170 may determine that personal input may not be supported.

[0068] When both the personal input device 112 and the personal display 122 are used, that is, when both personal input and personal indication are supported, the processor 170 may receive the user's personal information via the personal input device 112. In this case, the processor 170 may receive the personal information via the public input device 111. The processor 170 may display the received personal information on the personal display 122. When the personal information input is completed, the processor 170 may send the input-completed personal information to the requesting place for requesting the personal information.

[0069] For example, when attempting to perform payment using the payment information of the driver in the vehicle, the processor 170 may request the driver to input the payment information through the HUD (i.e., the personal display 122) exposed only to the driver. When the driver manipulates the personal input device 112 and inputs the payment information, the processor 170 may display the input information on the personal display 122.

[0070] Although the personal input device 112 and the personal display 122 are present in the vehicle, when the user does not use the personal input device 112, the processor 170 can output a warning for notifying that there is a risk that personal information will be exposed when personal information is input (hereinafter referred to as a "personal information exposure risk warning").

[0071] When the personal display 122 is capable of supporting an augmented reality (AR) function, the processor 170 may map the input area of ​​the public input device 111 and the display area of ​​the personal display 122 to configure an input screen. The processor 170 may output the input screen on the personal display 122. When the personal display 122 supports the AR function and the AR function is used, the processor 170 may display the input current situation of the public input device 111 on the personal display 122. The processor 170 may map the input position output from the public input device 111 to the display screen of the personal display 122 to determine the input data.

[0072] Although there is a personal display 122 that can be viewed by the user who is only an entity that inputs personal information, when there is no personal input device 112 that matches the personal display 122, the processor 170 may display a keypad having a key arrangement different from that of the common input device 111 on the personal display 122. In this case, the processor 170 may detect (sense) the position of a pointer (e.g., a finger) using a proximity sensor mounted on the common input device 111, and may map and display the position of the detected point on the input screen of the personal display 122. The processor 170 may determine the information of the point mapped on the input screen of the personal display 122 as input data.

[0073] Optionally, when the user wears an AR display (wearable display) (i.e., the personal display 122), and when the personal input device 112 is configured as a touch pad, the processor 170 can display a virtual keypad on the AR display screen, and can map the touch position input through the touch pad to the key information of the virtual keypad as input data to display the determined input data on the AR display.

[0074] When the personal display 122 does not support the AR function or the personal display 122 does not use the AR function although the personal display 122 supports the AR function, the processor 170 may map the input position output from the public input device 111 onto the display screen of the personal display 122 to determine the input data. The processor 170 may receive the determined input data as personal information, and may display the received personal information on the personal display 122.

[0075] When the personal display 122 does not exist in the vehicle, the processor 170 may determine whether the public display 121 can be used for personal use. In other words, the processor 170 may determine whether the public display 121 is located within the user's line of sight. When the public display 121 is located within the user's line of sight, the processor 170 may determine whether the personal input device 112 exists in the vehicle. When the personal input device 112 exists as a result of the determination, the processor 170 may receive personal information via the personal input device 112, and may display the received personal information on the public display 121.

[0076] When the public display 121 cannot be used for personal use, the processor 170 may determine whether the personal input device 112 is present in the vehicle. When the personal input device 112 is present in the vehicle, the processor 170 may determine whether data input via the personal input device 112 can be displayed on the public display 121. When the data input via the personal input device 112 cannot be displayed on the public display 121, the processor 170 may receive personal information via the personal input device 112 and not display the received personal information on the public display 121.

[0077] When data input via the personal input device 112 can be displayed on the public display 121, the processor 170 can determine whether gaze tracking can be performed. When gaze tracking can be performed, the processor 170 can determine that the passenger is looking at the public display 121 through the gaze tracking device 150.

[0078] When the passenger looks at the public display 121, the processor 170 may output a personal information exposure risk warning. When the passenger does not look at the public display 121, the processor 170 may receive personal information via the personal input device 112, and may output the received personal information on the public display 121. In this case, the processor 170 may receive personal information via the public input device 111.

[0079] When line-of-sight tracking cannot be performed, the processor 170 may determine whether it is possible to determine whether a passenger exists. When a passenger identification device 160 exists in the vehicle, the processor 170 may determine whether it is possible to determine whether a passenger exists. When a passenger in the vehicle is identified by the passenger identification device 160, the processor 170 may warn of the risk that personal information will be exposed. When there is no passenger identification device 160 in the vehicle or when the passenger identification device 160 does not identify a passenger in the vehicle, the processor 170 may receive personal information via the personal input device 112, and the received personal information may be displayed on the public display 121. In this case, the processor 170 may receive personal information via the public input device 111.

[0080] When there is a request to input personal information, the processor 170 can select any one of the personal input devices 112 arranged for each seat in the vehicle for personal use to input personal information. When the user cannot operate the selected personal input device 112, he or she can move to the seat where the personal input device 112 is located, and can input personal information through the personal input device 112.

[0081] Furthermore, the processor 170 may use facial recognition technology to identify the user who is to input personal information, and may enable the personal input device 112 mapped to the user's location for use by the individual to input the personal information.

[0082] FIG. 3A to FIG. 3C is a flowchart illustrating a user interface method for a vehicle according to an embodiment of the present disclosure.

[0083] First, in S110, Figure 1 The processor 170 of the vehicle may receive a request to input personal information of a user in the vehicle. For example, the processor 170 may receive a request to input personal information of a user in the vehicle. Figure 1 The communication device 140 receives a request for inputting user's personal information from the outside.

[0084] When there is a request to input the user's personal information, in S120, the processor 170 may determine whether there is a personal display 122 in the vehicle. In other words, the processor 170 may determine whether the vehicle can support personal indication.

[0085] When the personal display 122 is present in the vehicle, in S130, the processor 170 may determine whether the personal display 122 is within the user's line of sight. In this case, the processor 170 may determine whether the user's personal indication can be supported.

[0086] When the personal display 122 is within the user's line of sight, in S140, the processor 170 may determine whether the personal display 122 does not support an augmented reality (AR) function. The processor 170 may determine whether the personal display 122 is a display that supports an AR function.

[0087] When the personal display 122 does not support the AR function, in S150, the processor 170 may determine whether there is a personal input device 112 in the vehicle. In other words, the processor 170 may determine whether the vehicle supports personal input.

[0088] When the personal input device 112 is present in the vehicle, the processor 170 may determine whether the personal input device 112 is used in S160. The processor 170 may determine whether there is an input from the personal input device 112.

[0089] When the personal input device 112 is used, the processor 170 may receive the user's personal information via the personal input device 112 , and may display the received personal information on the personal display 122 in S170 .

[0090] When the personal input device 112 is not used, in S180, the processor 170 may output a personal information exposure risk warning. When there is no input from the personal input device 112, but when there is input from the public input device 111, the processor 170 may output a warning for providing a notification of the risk that personal information will be exposed.

[0091] In S120, when the personal display 122 is not present in the vehicle, in S210, the processor 170 may determine whether the public display 121 may be used for personal use. In other words, the processor 170 may determine whether the public display 121 may be used to support personal indication. When the public display 121 may be used for personal use, the processor 170 may perform the operation from S150. For example, when the public display 121 is within the user's line of sight, the processor 170 may determine that personal indication may be supported.

[0092] Meanwhile, when the public display 121 cannot be used for personal use, that is, when the public display 121 can be used only for public use, in S220, the processor 170 may determine whether there is a personal input device 112 in the vehicle. When the public display 121 is located out of the user's sight, the processor 170 may determine that personal indication cannot be supported. For example, when a user who will input payment information when paying in the vehicle is sitting in the driver's seat, the processor 170 may determine that the public display 121 cannot be used for personal use when it is determined that the public display 121 is located in the back seat in the vehicle.

[0093] When the personal input device 112 is present in the vehicle, in S230, the processor 170 may determine whether to display the input information on the public display 121. In this case, the processor 170 may ask the user whether to display the data input via the personal input device 112 on the public display 121 or may determine whether to display the data input via the personal input device 112 on the public display 121 according to predetermined configuration information.

[0094] When it is determined that the input information is displayed on the public display 121, in S240, the processor 170 may determine whether eye tracking can be performed. The processor 170 may determine Figure 1 Whether the sight tracking device 150 is loaded into the vehicle.

[0095] When the sight line tracking can be performed, in S250, the processor 170 can determine whether the passenger looks at the public display 121 through the sight line tracking. The processor 170 can detect the point the passenger looks at through the sight line tracking device 150, and can determine whether the detected point is located on the public display 121.

[0096] When the passenger looks toward the public display 121, the processor 170 may warn of the risk that personal information will be exposed in S180. The processor 170 may display a message for providing a notification of the risk that personal information will be exposed on the public display 121 or may output a warning sound. Alternatively, the processor 170 may output a warning sound while displaying a message for providing a notification of the risk that personal information will be exposed.

[0097] When the passenger does not look toward the public display 121 , the processor 170 may receive personal information via the personal input device 112 , and may display the received personal information on the public display 121 in S170 .

[0098] When the line of sight tracking cannot be performed in S240, the processor 170 may determine whether it is possible to determine whether there is a passenger in S260. The processor 170 may determine Figure 1 Whether the passenger identification device 160 is loaded into the vehicle.

[0099] When it is possible to determine whether there is a passenger, in S270, the processor 170 may determine whether there is a passenger in the vehicle. The processor 170 may determine whether there is a passenger through the passenger identification device 160. In addition, the processor 170 may identify (recognize) the passenger through the passenger identification device 160.

[0100] When there is a passenger, in S180 , the processor 170 may output a warning for providing a notification of a risk that personal information will be exposed. When there is no passenger, in S170 , the processor 170 may display personal information input via the personal input device 112 on the public display 121 .

[0101] When it cannot be determined whether the passenger exists in S260 , the processor 170 may output a warning for providing notification of a risk that personal information will be exposed.

[0102] In S130 , when the personal display 122 is not located within the user's line of sight, the processor 170 may perform the operation from S220 .

[0103] In S140 , when the personal display 122 supports the AR function, or in S150 , when the personal input device 112 does not exist in the vehicle, in S310 , the processor 170 may map the input area of ​​the common input device 111 and the display area of ​​the personal display 122 to configure an input screen.

[0104] In S320 , the processor 170 may display the configured input screen on the personal display 122 .

[0105] In S330, the processor 170 may determine whether to use the AR function. The processor 170 may ask the user whether to use the AR function, or may determine whether to use the AR function based on predetermined configuration information.

[0106] When the AR function is used, in S340 , the processor 170 may display the current situation of the input of the common input device 111 on the personal display 122 . In other words, the processor 170 may display the pointer track on the personal display 122 according to the manipulation of the common input device 111 .

[0107] In S350, the processor 170 may map the input position output from the public input device 111 to the display screen of the personal display 122 to determine the input data. In S170, the processor 170 may receive the determined input data as personal information, and may display the received personal information on the personal display 122.

[0108] According to an exemplary embodiment of the present disclosure, when personal information is input in a vehicle, the user interface system can determine whether personal indication and personal input are supported, and as a result of the determination, can support the input of personal information using an input device and a display, thereby minimizing the risk that personal information may be exposed to passengers and allowing passengers other than the driver to effectively input personal information.

[0109] In the above, although the present disclosure has been described with reference to exemplary embodiments and the accompanying drawings, the present disclosure is not limited thereto, but may be variously modified and changed by a person skilled in the art to which the present disclosure belongs without departing from the spirit and scope of the present disclosure claimed in the attached claims. Therefore, the exemplary embodiments of the present disclosure are provided to explain the spirit and scope of the present disclosure, rather than to limit them, so the spirit and scope of the present disclosure are not limited by the embodiments. The scope of the present disclosure should be interpreted based on the attached claims, and all technical ideas within the scope equivalent to the claims should be included within the scope of the present disclosure.

Claims

1. A user interface system, the system comprising: an input device configured to receive input from a user in the vehicle; a display configured to display information in the vehicle; as well as a processor configured to, when receiving a request to input the user's personal information, determine whether personal indication and personal input of the user are supported, and as a result of the determination, support input of the personal information using the input device and the display; wherein the input device comprises a personal input device available only to the user and a common input device available to the user and passengers in the vehicle, and the display comprises a personal display viewable only to the user and a common display viewable by the user and the passengers; wherein the processor is further configured to determine whether the personal display supports augmented reality functionality; When the personal display supports the augmented reality function, the processor maps a display area of ​​the personal display and a display area of ​​the public display, and determines an information point on the display area of ​​the personal display mapped to an input position output from the public display as input data, and receives the determined input data from the personal display as the personal information; wherein the common input device and the common display are located within the sight of the user and the passenger respectively seated in the vehicle, and Wherein the personal display is located within the line of sight of the user and not within the line of sight of the passenger.

2. The system according to claim 1, wherein: The processor determines whether the personal indication can be supported using the public display, receives the personal information via the input device when the personal indication can be supported, and displays the received personal information on the public display, and warns of the risk that the personal information will be exposed when the personal indication cannot be supported.

3. The system according to claim 1, further comprising: a gaze tracking device, configured to perform gaze tracking of the passenger, The processor determines whether the passenger is looking at the public display through the line of sight tracking, receives the personal information via the input device and displays the received personal information on the public display when the passenger is not looking at the public display, and warns the passenger of the risk that the personal information will be exposed when the passenger looks at the public display.

4. The system according to claim 1, further comprising: a passenger identification device configured to detect a passenger in the vehicle, wherein the processor receives the personal information via the input device, and displays the received personal information on the public display when the passenger identification device does not detect the passenger in the vehicle, and warns of the risk that the personal information will be exposed when the passenger is detected.

5. The system according to claim 2, wherein: The processor does not display the personal information input via the public input device on the public display based on predetermined configuration information.

6. The system according to claim 1, wherein: The processor configures an input screen by mapping a display area of ​​the personal display and an input area of ​​the common input device, and displays the input screen on the personal display.

7. The system according to claim 6, wherein: The processor does not display the input screen on the public display or displays an input screen different from the input screen on the public display.

8. The system according to claim 6, wherein: When the personal display supports an augmented reality function, the processor displays an input current situation on the personal display via the public input device, and generates the personal information using information of the personal display mapped to the input of the public input device.

9. The system according to claim 6, wherein: When the personal display does not support an augmented reality function, the processor generates the personal information using information of the personal display mapped to the input of the public input device.

10. The system according to claim 1, wherein: The input device comprises a plurality of personal input devices, one of the personal input devices being positioned at each seat in the vehicle, and The processor selects any one of the plurality of input devices and supports inputting the personal information.

11. The system according to claim 10, wherein: The processor identifies the user through a facial recognition device and supports input of the personal information via the personal input device matched with the user's location.

12. A user interface method, the method comprising: When receiving a request to input personal information of a user in the vehicle, determining whether a personal indication of the user is supported; determining whether personal input of the user is supported; as well as According to whether the personal indication is supported and whether the personal input is supported, supporting the input of the personal information using an input device and a display; wherein the input device comprises a personal input device available only to the user and a common input device available to the user and passengers in the vehicle, and the display comprises a personal display viewable only to the user and a common display viewable by the user and the passengers; wherein determining whether the personal display supports an augmented reality function; When the personal display supports the augmented reality function, mapping a display area of ​​the personal display and a display area of ​​the public display, determining an information point on the display area of ​​the personal display mapped to an input position output from the public display as input data, and receiving the determined input data from the personal display as the personal information; wherein the common input device and the common display are located within the sight of the user and the passenger respectively seated in the vehicle, and Wherein the personal display is located within the line of sight of the user and not within the line of sight of the passenger.

13. The method according to claim 12, wherein: Determining whether to support the user's personal input further includes: When the personal indication of the user is not supported, it is determined whether the personal indication can be supported using the public display that can be viewed by the user and the passenger.

14. The method according to claim 13, wherein: Determining whether the public display can be used to support the personal indication includes: When the personal indication can be supported using a public display, the personal information is received via the input device and the received personal information is displayed on the public display.

15. The method according to claim 14, further comprising: determining whether eye tracking of a passenger in the vehicle can be performed when the personal indication cannot be supported using the public display; as well as When the eye tracking of the passenger is capable of being performed, it is determined through the eye tracking whether the passenger is looking at the public display.

16. The method according to claim 15, further comprising: When the passenger looks toward the public display, a warning is output regarding the risk that the personal information will be exposed.

17. The method according to claim 15, further comprising: When the passenger is not looking at the public display, the personal information is received via the input device and the received personal information is displayed on the public display.

18. The method according to claim 15, further comprising: When the line of sight tracking of the passenger cannot be performed, determining whether the passenger in the vehicle can be identified; as well as When the passenger cannot be identified, a warning is output regarding the risk that the personal information will be exposed.

19. The method according to claim 18, wherein: Determining whether the passenger can be identified includes: detecting the passenger in the vehicle by passenger identification when the passenger can be identified; When the passenger is detected, outputting a warning about a risk that the personal information will be exposed; and When the passenger is not detected, the personal information is received via the input device and the received personal information is displayed on the public display.

20. The method according to claim 12, wherein: Determining whether to support the personal indication of the user includes: configuring an input screen by mapping a display area of ​​the personal display and an input area of ​​the common input device; displaying the input screen on the personal display; determining, via the personal display, whether an augmented reality function is being used; When the augmented reality function is used, the current input situation is displayed on the personal display via the public input device; generating the personal information using information of the personal display mapped to the input of the public input device; and The generated personal information is received and the received personal information is displayed on the personal display.

21. The method according to claim 20, further comprising: After determining whether to use the augmented reality function, when the augmented reality function is not used, the personal information is generated using information of the personal display mapped to the input of the public input device.

22. The method of claim 12, further comprising: After determining whether the personal input is supported, when the personal display does not exist, determining whether the gaze tracking function is supported; When the gaze tracking function is supported, determining whether the passenger is looking at the public display; as well as When the passenger looks toward the public display, a warning is output regarding the risk that the personal information will be exposed.

23. The method according to claim 22, further comprising: When the passenger is not looking at the public display, the personal information is received via the public input device and the received personal information is displayed on the public display.

24. The method of claim 22, further comprising: After determining whether the sight tracking function is supported, if the sight tracking function is not supported, determining whether the passenger identification function is supported; When the passenger identification function is supported, detecting passengers in the vehicle using the passenger identification function; as well as When a passenger in the vehicle is not detected, the personal information input via the public input device is displayed on the public display.

25. The method according to claim 24, further comprising: When the passenger identification function is not supported or when the riding of the passenger is detected, a warning is output regarding a risk that the personal information will be exposed.

Images