Vehicle, method of controlling a vehicle, and display of a vehicle

Abstract

The present application relates to a vehicle, a method of controlling a vehicle, and a display of a vehicle. The vehicle according to an embodiment includes a display unit displaying information related to the vehicle, a sensor unit detecting a position of a user of the vehicle, and a processor controlling the display unit, wherein the sensor unit is located at a bottom end of the display unit, and wherein the sensor unit includes at least one or more light emitting units emitting light and at least one or more sensors receiving light.

Description

[0001] Cross-application of related applications

[0002] This application claims the benefit of the earlier filing date and priority of Korean Patent Application No. 10-2022-0004668, filed on January 12, 2022, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This implementation is applicable to vehicles in all fields, and more specifically, for example, to technologies for identifying the location of a vehicle's user. Background Technology

[0004] The Society of Automotive Engineers (SAE) classifies autonomous driving levels into six levels, from Level 0 to Level 5. However, Level 5 full automation has not yet been commercialized.

[0005] Therefore, with current technology, drivers are expected to visually inspect all road signs and respond manually accordingly. This leads to a lack of driver focus and an increase in accidents. Summary of the Invention

[0006] Therefore, embodiments of this disclosure are directed to a device and method for identifying a user's location using at least one sensor, which substantially eliminates one or more problems caused by the limitations and disadvantages of the prior art.

[0007] To address the aforementioned problems, this disclosure is designed to automatically control a vehicle based on the type of sign information identified via a front-facing camera or the like, and various sensor information.

[0008] According to one embodiment of this disclosure, by identifying icing hazard sections based on road icing signs and temperature information received from temperature sensors, vehicles are designed to automatically enter winter mode.

[0009] The winter mode in this manual means, for example, changing the vehicle's driving mode to the optimal state in dangerous icy conditions.

[0010] More specifically, in standard (S) mode, the drivetrain is typically controlled to automatically and sequentially shift from first to fourth gear, starting from first gear. However, in winter (W) mode, the drivetrain is controlled to automatically start from second or third gear instead of first gear to prevent the wheels from spinning without traction when many cars repeatedly stop and start due to heavy traffic congestion in low temperatures.

[0011] According to another embodiment of this disclosure, the vehicle is designed to automatically close the sunroof by identifying a rockfall hazard zone based on signs for rockfall warning and wind speed information received from a wind speed sensor.

[0012] According to a further embodiment of this disclosure, the vehicle speed is designed to automatically decelerate based on signs for crosswind warning and wind speed information received from wind speed sensors.

[0013] Finally, in implementing this disclosure, sensing information is necessarily required, and therefore a scheme is proposed that minimizes frequent sensing.

[0014] The technical tasks available from this disclosure are not limited to those described above. Furthermore, those skilled in the art to which this disclosure pertains will clearly understand other unmentioned technical tasks from the following description.

[0015] Additional advantages, objectives, and features of this disclosure will be set forth in this disclosure and in the accompanying drawings. These aspects will also be understood by those skilled in the art based on the disclosure herein.

[0016] To achieve these objectives and other advantages, in one aspect of this disclosure, a vehicle according to an embodiment may include: a display unit for displaying vehicle-related information; a sensor unit for detecting the position of a user of the vehicle; and a controller or processor for controlling the display unit, wherein the sensor unit may be located below the display unit (or at the bottom of the display unit), and wherein the sensor unit may include at least one or more light-emitting units and at least one or more sensors for receiving light. In another aspect, a method for controlling a vehicle may include: emitting light to detect the position of a user's hand via the sensor unit; receiving light via the sensor unit; detecting the position of the user's hand based on the received light; displaying first menu information corresponding to a first area associated with the position of the user's hand via the display unit; and displaying second menu information corresponding to a second area associated with the position of the user's hand via the display unit, wherein the sensor unit may be located at the bottom of the display unit, and wherein the sensor unit may include at least one or more light-emitting units and at least one or more sensors for receiving light.

[0017] Therefore, this disclosure provides various effects and / or advantages.

[0018] The embodiments provide intuitive ease of use. They offer the effect of easily selecting menus that can be chosen in several steps with a single touch. They provide the effect of selecting menus without extending the hand.

[0019] The effects that can be obtained from this disclosure are not limited to those described above. Furthermore, those skilled in the art to which this disclosure pertains will clearly understand other effects not mentioned from the following description. Attached Figure Description

[0020] The accompanying drawings, included to provide a further understanding of this disclosure and incorporated in and constituting a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the principles of this disclosure. The above and other aspects, features, and advantages of this disclosure will become more apparent after considering the following description of preferred embodiments in conjunction with the accompanying drawings. In the drawings:

[0021] Figure 1 An overall block diagram of an autonomous driving control system applicable to any of the embodiments of the present disclosure is shown.

[0022] Figure 2 The diagram illustrates an example of an autonomous driving device applied to a vehicle according to any embodiment of the present disclosure.

[0023] Figure 3 A method for displaying a menu by recognizing a user's hand using vehicle sensors, according to an embodiment, is shown.

[0024] Figure 4 An example of providing pre-information based on the position of the user's hand, according to an embodiment, is shown;

[0025] Figure 5 An example of pre-information according to an implementation method is shown;

[0026] Figure 6 An example of pre-information according to an implementation method is shown;

[0027] Figure 7 An example of pre-information according to an implementation method is shown;

[0028] Figures 8 to 10 A proximity sensor for pre-information according to an embodiment is shown;

[0029] Figure 11 and Figure 12 An example of a sensing area according to an embodiment is shown;

[0030] Figure 13 The display UI / UX according to the implementation method is shown; and

[0031] Figure 14 A vehicle control method according to an embodiment is shown. Detailed Implementation

[0032] In the following description, with reference to the accompanying drawings, embodiments of the invention to which those skilled in the art will readily implement the invention. However, the invention can be embodied in several different forms and is not limited to the embodiments described herein. Furthermore, for clarity of explanation in the drawings, portions irrelevant to the description have been omitted, and similar reference numerals have been appended to similar portions throughout the specification.

[0033] Throughout the specification, when a component “includes” another component, it means that other components may be included, rather than excluded, unless otherwise stated.

[0034] Figure 1 It is an overall block diagram of an autonomous driving control system applicable to any of the embodiments of the present disclosure.

[0035] Figure 2 This is a diagram illustrating an example of an autonomous driving device according to any embodiment of the present disclosure being applied to a vehicle.

[0036] First, refer to Figure 1 and Figure 2 The structure and function of an autonomous driving control system (e.g., an autonomous vehicle) to which the autonomous driving device according to this embodiment can be applied are described.

[0037] like Figure 1 As shown, the autonomous driving vehicle 1000 can be implemented based on an autonomous driving integrated controller 600, which sends and receives data required for autonomous driving control of the vehicle through a driving information input interface 101, a driving information input interface 201, a passenger output interface 301, and a vehicle control output interface 401. However, the autonomous driving integrated controller 600 may also be referred to herein as a controller, a processor, or simply a controller.

[0038] The autonomous driving integrated controller 600 can obtain driving information through the driving information input interface 101 based on the passenger's operation of the user input unit 100 in the vehicle's autonomous driving mode or manual driving mode. For example... Figure 1 As shown, the user input unit 100 may include a driving mode switch 110 and a control panel 120 (e.g., a navigation terminal installed in the vehicle or a smartphone or tablet owned by the passenger). Therefore, driving information may include the vehicle's driving mode information and navigation information.

[0039] For example, the vehicle's driving mode (i.e., autonomous driving mode / manual driving mode or sport mode / economy mode / safety mode / normal mode) determined by the driver's operation of the driving mode switch 110 can be transmitted as driving information to the autonomous driving integrated controller 600 through the driving information input interface 101.

[0040] In addition, navigation information such as the destination and the route to the destination entered by the passenger through the control panel 120 (e.g., the shortest or preferred route selected by the passenger among the candidate routes to the destination) can be sent as driving information to the autonomous driving integrated controller 600 through the driving information input interface 101.

[0041] The control panel 120 may be implemented as a touchscreen panel providing a user interface (UI) through which the occupant inputs or modifies information for autonomous driving control of the vehicle. In this case, the driving mode switch 110 may be implemented as a touch button on the control panel 120.

[0042] Furthermore, the autonomous driving integrated controller 600 can obtain driving information representing the vehicle's driving state through the driving information input interface 201. Driving information may include the steering angle formed when the passenger operates the steering wheel, the accelerator pedal travel or brake pedal travel formed when the passenger presses the accelerator pedal or brake pedal, and various information representing the vehicle's driving state and behavior, such as vehicle speed, acceleration, yaw, pitch, and roll. Figure 1 As shown, driving information can be detected by the driving information detection unit 200, which includes a steering angle sensor 210, an accelerator position sensor (APS) / pedal driving sensor (PTS) 220, a vehicle speed sensor 230, an acceleration sensor 240, and a yaw / pitch / roll sensor 250.

[0043] In addition, vehicle driving information may include vehicle location information. The vehicle's location information can be obtained through a Global Positioning System (GPS) receiver 260 applied to the vehicle. This driving information can be transmitted to the autonomous driving integrated controller 600 via the driving information input interface 201 and can be used to control the vehicle's driving in either autonomous driving mode or manual driving mode.

[0044] The autonomous driving integrated controller 600 can transmit driving status information provided to the passenger to the output unit 300 via the passenger output interface 301, whether the vehicle is in autonomous driving mode or manual driving mode. That is, the autonomous driving integrated controller 600 transmits the vehicle's driving status information to the output unit 300, allowing the passenger to check the vehicle's autonomous driving or manual driving status based on the driving status information output by the output unit 300. The driving status information may include various types of information indicating the vehicle's driving status, such as the vehicle's current driving mode, transmission range, and speed.

[0045] If it is determined that the driver needs to be warned along with the aforementioned driving status information in either the vehicle's autonomous driving mode or manual driving mode, the autonomous driving integrated controller 600 transmits the warning information to the output unit 300 via the passenger output interface 301, enabling the output unit 300 to output the warning to the driver. To acoustically and visually output this driving status information and warning information, the output unit 300 may include a speaker 310 and a display 320, such as... Figure 1 As shown. In this case, the display 320 can be implemented as the same device as the control panel 120 or as a separate device from the control panel 120.

[0046] Furthermore, the autonomous driving integrated controller 600 can transmit control information for vehicle driving control to the lower control system 400 applied to the vehicle via the vehicle control output interface 401, whether the vehicle is in autonomous driving mode or manual driving mode. For example... Figure 1 As shown, the lower control system 400 for driving the vehicle may include an engine control system 410, a braking control system 420, and a steering control system 430. The autonomous driving integrated controller 600 transmits engine control information, braking control information, and steering control information as control information to the corresponding lower control systems 410, 420, and 430 via the vehicle control output interface 401. Therefore, the engine control system 410 can control the vehicle's speed and acceleration by increasing or decreasing the fuel supplied to the engine. The braking control system 420 can control the vehicle's braking by controlling the vehicle's braking power. The steering control system 430 can control the vehicle's steering via a steering mechanism applied to the vehicle (e.g., an electric power steering (MDPS) system).

[0047] As described above, the autonomous driving integrated controller 600 according to this embodiment can obtain driving information based on the driver's operation and driving information indicating the vehicle's driving state through the driving information input interface 101 and the driving information input interface 201, respectively, and sends driving state information and warning information generated based on the autonomous driving algorithm to the output unit 300 through the passenger output interface 301. Furthermore, the autonomous driving integrated controller 600 can transmit control information generated based on the autonomous driving algorithm to the lower control system 400 through the vehicle control output interface 401, thereby executing vehicle driving control.

[0048] To ensure stable autonomous driving, it is necessary to continuously monitor the vehicle's driving status by accurately measuring the driving environment and to control the driving based on the measured environment. Therefore, such as... Figure 1As shown, the autonomous driving device according to this embodiment may include a sensor unit 500 for detecting objects near the vehicle (such as nearby vehicles, pedestrians, roads, or fixed facilities (e.g., traffic lights, signs, traffic signs, or building fences)).

[0049] like Figure 1 As shown, the sensor unit 500 may include one or more of a LiDAR sensor 510, a radar sensor 520, or a camera sensor 530 to detect nearby objects outside the vehicle.

[0050] LiDAR sensor 510 transmits laser signals to the periphery of the vehicle and detects nearby objects outside the vehicle by receiving signals reflected and returned from a corresponding object. LiDAR sensor 510 can detect nearby objects within a preset distance, a preset vertical field of view, and a preset horizontal field of view, which are predefined according to their specifications. LiDAR sensor 510 may include a front LiDAR sensor 511, a top LiDAR sensor 512, and a rear LiDAR sensor 513 respectively mounted at the front, top, and rear of the vehicle; however, the mounting location of each LiDAR sensor and the number of LiDAR sensors installed are not limited to a specific embodiment. A threshold for determining the validity of the laser signals reflected and returned from the corresponding object can be pre-stored in the memory (not shown) of the autonomous drive integrated controller 600. The autonomous drive integrated controller 600 can determine the position (including distance to the corresponding object), speed, and direction of movement of the corresponding object by measuring the time taken for the laser signal emitted by LiDAR sensor 510 to reflect and return from the corresponding object.

[0051] Radar sensor 520 can radiate electromagnetic waves around the vehicle and detect nearby objects outside the vehicle by receiving signals reflected and returned from corresponding objects. Radar sensor 520 can detect nearby objects within a preset distance, a preset vertical field of view, and a preset horizontal field of view, which are predefined according to their specifications. Radar sensor 520 may include a front radar sensor 521, a left radar sensor 522, a right radar sensor 523, and a rear radar sensor 524 respectively installed at the front, left, right, and rear of the vehicle; however, the installation location of each radar sensor and the number of radar sensors installed are not limited to specific embodiments. Autonomous driving integrated controller 600 can determine the position (including distance to the corresponding object), speed, and direction of movement of the corresponding object by analyzing the power of the electromagnetic waves transmitted and received by radar sensor 520.

[0052] The camera sensor 530 can detect nearby objects outside the vehicle by photographing the area around the vehicle, and detect nearby objects within a range of preset distances, preset vertical fields of view and preset horizontal fields of view as defined by its specifications.

[0053] The camera sensor 530 may include a front camera sensor 531, a left camera sensor 532, a right camera sensor 533, and a rear camera sensor 534, respectively installed at the front, left, right, and rear of the vehicle. However, the installation location of each camera sensor and the number of camera sensors installed are not limited to specific embodiments. The autonomous drive integrated controller 600 can determine the position (including distance to the object), speed, and direction of movement of a corresponding object by applying predetermined image processing to the images captured by the camera sensor 530.

[0054] Furthermore, an interior camera sensor 535 for capturing images inside the vehicle can be installed at a predetermined location within the vehicle (e.g., a rearview mirror). The autonomous driving integrated controller 600 can monitor the behavior and status of the occupants based on images captured by the interior camera sensor 535 and output guidance or warnings to the occupants via the output unit 300.

[0055] like Figure 1 As shown, in addition to the LiDAR sensor 510, radar sensor 520 and camera sensor 530, the sensor unit 500 may further include an ultrasonic sensor 540, and also employs various types of sensors together to detect objects near the vehicle.

[0056] Figure 2 An example is shown in which, to aid in understanding this embodiment, a front LiDAR sensor 511 or a front radar sensor 521 is mounted at the front of the vehicle, a rear LiDAR sensor 513 or a rear radar sensor 524 is mounted at the rear of the vehicle, and a front camera sensor 531, a left camera sensor 532, a right camera sensor 533, and a rear camera sensor 534 are mounted at the front, left, right, and rear of the vehicle, respectively. However, as described above, the mounting location of each sensor and the number of sensors mounted are not limited to this specific embodiment.

[0057] In addition, to determine the state of the occupants inside the vehicle, the sensor unit 500 may also include biosensors for detecting the occupants' biological signals (e.g., heart rate, electrocardiogram, respiration, blood pressure, body temperature, electroencephalogram, photoplethysmography (or pulse wave), and blood glucose). Biosensors may include heart rate sensors, electrocardiogram sensors, respiration sensors, blood pressure sensors, body temperature sensors, electroencephalogram sensors, photoplethysmography sensors, and blood glucose sensors.

[0058] Finally, the sensor unit 500 further includes a microphone 550 having an internal microphone 551 and an external microphone 552 for different purposes.

[0059] For example, the internal microphone 551 can be used to analyze the voice of the occupants in the autonomous vehicle 1000 based on AI or to immediately respond to the occupants' direct voice commands.

[0060] Conversely, for example, an external microphone 552 can be used to appropriately respond to safe driving by analyzing various sounds generated from the outside of the autonomous vehicle 1000 using various analysis tools such as deep learning.

[0061] For reference only. Figure 2 The symbols shown can be executed with Figure 1 The same or similar functions shown. Figure 1 compared to, Figure 2 The relative positions of each component (based on the interior of the autonomous vehicle 1000) are shown in more detail.

[0062] Figure 3 A method for displaying a menu by recognizing a user's hand using vehicle sensors, according to an embodiment, is shown.

[0063] Figure 3 The sensor shown can correspond to Figure 1 and Figure 2 The sensor unit 500 shown is shown. Figure 3 The display 300 shown can correspond to Figure 1 and Figure 2 The display shown is 320.

[0064] According to the embodiments, the vehicle, vehicle control method, and vehicle display 300 can display information about the vehicle and its user. A sensor can identify the position of the user's hand 301, and the display can display menu information based on the user's hand position. The display may include a sensor for identifying the position of the user's hand. According to the embodiments, the vehicle, vehicle control method, and vehicle display can recognize the user's hand gestures and display menu information. When the user's hand moves in a predetermined direction, the vehicle, vehicle control method, and vehicle display can recognize the direction and support operations such as changing the display screen and rejecting call reception.

[0065] The vehicle, vehicle control method, and vehicle display according to the embodiments can be reduced to a method / device according to the embodiments.

[0066] The vehicle, vehicle control method, and vehicle display according to the embodiments can improve the following problems. For example, the display can be activated or deactivated when a user approaches based on sensors, and different other functions can be provided. A menu pre-information function can be further provided than simply providing a menu pop-up. Furthermore, normal swipe operations may require a trial-and-error process or instruction. The problems of frequent errors and reduced ease of use can be improved by considering the direction and shape of hand movements. For example, only long hand movement trajectories are set to be recognized as swipes, or when the trajectory is set to be short, it is possible to prevent simple hand movements from being mistakenly identified as swipes.

[0067] According to the implementation method, the vehicle, vehicle control method, and vehicle display can effectively provide menu pre-information functionality using proximity sensors to offer intuitive usability of in-vehicle infotainment (IVI) products. This provides intuitive ease of use without requiring separate instruction or experience. Furthermore, menus for step-by-step selection can be easily accessed with a single touch. Menus can be selected without extending the length of the hand, and menus can pop up near the driver or passenger. The limitations of sensor functionality for recognizing hand position can be compensated for by the UI and algorithms. High-quality design can be maintained by applying thin proximity sensors. Time-difference infrared LED emitting technology reduces the number of LEDs and PDs.

[0068] Figure 4 An example of providing pre-information based on the position of the user's hand, according to an implementation method, is shown.

[0069] according to Figures 1 to 3 The vehicle, vehicle control method, and vehicle display of the implementation method can be based on, for example... Figure 4 The user's location is shown to provide different functions.

[0070] For example, the proximity sensor of the vehicle, vehicle control method, and vehicle display according to the embodiment can identify that the user is within a distance (range) of 15 cm. This can be referred to as the proximity step. During the proximity step, the device according to the embodiment can display a pop-up menu 400. When the user's hand is within a distance (range) of 5 cm, pre-information 401 can be provided. The user can receive services by selecting the desired menu via the pre-information function. The distances of 15 cm and 5 cm can be set differently according to the embodiment. If an icon is selected from the pop-up menu, the corresponding menu may not pop up. Furthermore, the pop-up settings can be changed according to the position of the hand. That is, a pop-up menu can be provided at close range so as not to require the hand to extend.

[0071] The preview information 401 according to the embodiment may include more detailed items as submenus of the pop-up initial menu 401. For example, the preview information may correspond to the destination, search menu, etc. of the navigation menu.

[0072] According to the method / device of the implementation, the area can be distinguished based on the position of the user's hand and the distance of the monitor: proximity: basic menu pops up (approximately 15cm proximity), advance information: advance information additional pops up (approximately 5cm proximity).

[0073] Figure 5 An example of pre-information according to an implementation method is shown.

[0074] Figure 5 It shows Figure 4 The pre-information configuration described in [etc.].

[0075] Since the method / device according to the embodiment pops up a submenu in response to hand movement, there is an effect of easily extending the hand without separate instruction or experience. That is, the desired menu can be easily selected and intuitive usability is provided. The problem of selecting a specific menu through multiple paths can be improved. The function of selecting the desired menu with a single touch can be provided by providing "menu pre-information" information as a pop-up menu.

[0076] The menu pre-information according to the embodiment is a function to pre-display submenus with high usage frequency, and refers to an embodiment that identifies the position of the user's hand when it approaches and pops up the corresponding submenu. In this case, the pop-up submenu can be selected with a single touch. That is, the submenu delivery steps can be simplified. By identifying the position of the user's hand, the submenu 500 of the menu item 501 approached by the user's hand can be displayed.

[0077] Figure 6 An example of pre-information according to an implementation method is shown.

[0078] Figure 6 It shows that it can be changed. Figure 5 An example of the location of the pre-information.

[0079] According to the embodiments, the vehicle, the vehicle control method, and the vehicle's display can identify the position of the driver's hand to provide a menu close to the driver (600), or can identify the position of the passenger's hand to provide a menu close to the passenger (601).

[0080] In other words, a pop-up menu can appear near the user, allowing the monitor to be controlled from a comfortable position. As monitor sizes increase and space for physical buttons decreases, the menu display location can become important. Touching and controlling the monitor can be difficult due to its large size, potentially requiring outstretched hands. To address this, the implementation provides a pop-up menu closer to the driver when hands enter from the driver's side. Conversely, when hands enter from the passenger's side, the implementation provides a pop-up menu closer to the passenger's side.

[0081] Figure 7 An example of pre-information according to an implementation method is shown.

[0082] Figure 7 Detailed illustration Figures 4 to 6 Pre-information.

[0083] Approach Step: When the user's hand enters a predetermined distance (e.g., a first distance or a first range), a pop-up menu may be displayed according to the vehicle, vehicle control method, and vehicle display according to the embodiment. If the user wishes to delete the pop-up menu, the pop-up window can be deleted by receiving a signal from the user for selecting a specific icon.

[0084] The pre-information provisioning step involves displaying a submenu (pre-information) of the menu icon to which the user's hand is approaching, along with the main menu, when the user's hand enters a predetermined distance (e.g., a second distance or a second range). To facilitate user identification, the vehicle, vehicle control method, and vehicle display according to the embodiment may further provide the following functions: For example, the icon of the main menu to which the user's hand is approaching may be displayed larger than the surrounding icons of the main menu. That is, the size can be changed to be larger. When the user's hand is positioned between the first and second menus of the main menu, if the first menu is closer to the user's hand, the vehicle, vehicle control method, and vehicle display according to the embodiment may clearly display the pre-information of the first menu, while simultaneously displaying the pre-information of the second menu semi-transparently. The user can intuitively select a menu by viewing both the semi-transparent surrounding submenu and the high-resolution main and submenus at the same time.

[0085] Menu selection steps: The vehicle, vehicle control method and vehicle display according to the implementation method can receive input signals from the user and provide the user with the functions of the selected menu.

[0086] In other words, the technical limitations of accurately matching hand position and pop-up menus can be overcome by supplementing the screen UI. The size of the hand-positioned menu can be increased. If the user selects the wrong menu, it can be supplemented, allowing the user to actively move away from the incorrect position. The left and right sides of the selected menu's pre-selection information pop-up can also be displayed semi-transparently (Ghost) to facilitate menu selection. Even if the hand is not in the exact position of the selected menu, it can be supplemented, making it easy to select the desired submenu. A pop-up blocking function can be added to improve the problem of driver distraction caused by frequent pop-ups when the hand is raised.

[0087] Figures 8 to 10 A proximity sensor for pre-information is shown according to an embodiment.

[0088] Figures 8 to 10 It shows support based on Figures 1 to 7 The proximity sensor location and configuration of the vehicle, vehicle control method, and vehicle display operation described in the embodiments.

[0089] refer to Figure 8 The proximity sensor according to the embodiment can be located in a specific area of ​​the display. For example, it can be located in the lower area of ​​the display. For example, the thickness of the proximity sensor according to the embodiment can be in the range of 5 mm. The proximity sensor can be configured to be thin to increase user convenience and improve design aesthetics. The proximity sensor may include an infrared (IR) sensor.

[0090] refer to Figure 9 The image shows the sensor area A of the display in detail. Specifically, there is a proximity sensor (sensing area) with a thin thickness and a cover glass surrounding the sensor. Inside the sensor, there is a prism, a photodiode (PD), and a front cover (PC material). According to an embodiment, the PD may be a photodiode and may include an optical sensor that converts light energy into electrical energy, etc.

[0091] refer to Figure 10 According to the embodiments, the sensor may include a cover glass, an LCD, a panel, a proximity module (i.e., a housing, a prism, and a PCB including LEDs and PDs), a back cover, etc.

[0092] The sensing area (or sensing field) of the sensor according to the embodiment may have various regions / parts. The sensing area / field according to the embodiment may mainly include a first part and a second part. The first part may correspond to the area used for the proximity identification step. The second part may be divided into 12 more detailed sections. This may be the part used to grasp the position of the user's hand in detail for each menu in the pre-information step. The multiple sections according to the embodiment may be configured differently.

[0093] Figure 11 and Figure 12 An example of a sensing area / field according to an embodiment is shown.

[0094] Figure 11 and Figure 12 Implementation shown Figure 10 An example of a portion of the sensing area / field shown.

[0095] The vehicle, vehicle control method, and vehicle display according to the embodiments may include sensors having sensing areas / fields, such as... Figure 11 or Figure 12 .

[0096] Reference Figure 11 The sensor may include an infrared LED 1100 and a photodiode sensor 1101. The sensor may include at least one LED 1100 and at least one photodiode sensor 1101. The infrared LED 1100 can emit light, and the photodiode sensor 1101 can receive light reflected by the user / hand. The position of the user / hand can be detected by sensing the reflected light.

[0097] When the infrared LED emits light, the intensity of the infrared light reflected by the hand can be detected by the position sensor (PD), and the hand's position can be identified based on the PD's location and intensity. The LED can remain continuously lit. As the location recognition resolution increases, the number of PDs increases proportionally. For example, if the area is divided into 12 sections, 12 PDs might be needed. However, having multiple LEDs continuously lit can lead to inefficiencies as the number of sensors increases.

[0098] Reference Figure 12 This allows for more efficient sensor and sensing area / field detection. According to the implementation, the amount of LEDs and PDs can be reduced by applying time-difference infrared LED emission technology. According to an embodiment, the LEDs can emit light in sequence ① to ⑥ according to a time difference. By detecting the recognition time of the infrared light reflected from the hand, the hand position can be identified through the position of the LEDs. In this case, the intensity of the infrared light can be complexly identified, thereby accurately and effectively identifying the distance to the hand and the hand's position.

[0099] Figure 13 The display UI / UX according to the implementation method is shown.

[0100] Figure 13 It shows the result of Figure 11 and Figure 12 The sensing area / field enables display and preview functions.

[0101] The vehicle, vehicle control method, and vehicle display according to the implementation can use an algorithm for recognizing the hand position at the boundary point between menus. By utilizing LEDs and / or PDs, the technical limitations of accurately matching the hand and pop-up menu positions can be overcome. If the hand remains at the boundary between menus for a certain period, the first pop-up menu can be selected. The boundary handling can be varied according to settings for user convenience. The UI can be presented to the user by popping up a sufficiently large selected menu that exceeds the size of the surrounding menus. By enlarging the pop-up menu, if the user selects a menu that is not the expected one, they can be actively prompted to leave the corresponding menu.

[0102] like Figure 10 As shown, due to the sensing area / field according to the embodiment, 12 sections corresponding to the first and second steps with a width of 290mm and a spacing of 25mm can be provided. The number of fields can be changed according to different settings. When the user's hand position is located in the first step, a main menu (1300) pops up, and when the hand position is located in the second step, a sub-menu (1301) can pop up according to the corresponding section and the surrounding section in a manner that distinguishes resolution and / or size. As described above, facility complexity can be reduced, position recognition accuracy can be improved, and UI / UX can be conveniently provided for the user.

[0103] Figure 14 A vehicle control method according to an embodiment is shown.

[0104] The vehicle, vehicle control method, and vehicle display according to the above embodiments can control the vehicle and provide vehicle-related displays through the following methods.

[0105] The vehicle control method according to the embodiment may include step S1400 of emitting light to sense the position of a user's hand.

[0106] The vehicle control method according to the embodiment may include the step of receiving light, S1401.

[0107] The vehicle control method according to the embodiment may include step S1402, which involves detecting the position of a user's hand based on received light.

[0108] Through such Figure 11 , Figure 12 By transmitting and receiving light, the position of the user's hand can be accurately detected through reflected light.

[0109] The vehicle control method according to the embodiment may further include step S1403 of displaying first menu information corresponding to a first area of ​​the position of the user's hand.

[0110] The vehicle control method according to the embodiment may further include step S1404 of displaying second menu information corresponding to a second area of ​​the position of the user's hand.

[0111] like Figures 4 to 8 , Figure 10 , Figure 13 As shown in the figure, the position of the user's hand can be identified by separating areas with detailed features, and the information the user expects can be provided accurately and effectively in advance.

[0112] The vehicle's display according to an embodiment may include a display panel (i.e., a display screen) for displaying information about the vehicle and a sensor unit for detecting the position of a user's hand. The sensor unit may include at least one light-emitting unit and at least one sensor for receiving light. The number of light-emitting units may be greater than the number of sensors, and the sensors may be located in at least one of the left, middle, or right sides of the sensor unit. The light-emitting units may transmit light in a row-like state from left to right based on a time difference. The sensing area / field generated by the sensor unit may include a first area for detecting the proximity of the user's hand and a second area for detecting a specific position of the user's hand, and the second area may include multiple portions. In response to the first area, the display unit may display a main menu. In response to a portion of the second area, the display unit may display a submenu. The submenu may be displayed together with a surrounding menu associated with the main menu, and the surrounding menu and the submenu may be displayed at different resolutions.

[0113] The implementation is described from the perspective of methods and / or apparatus, and the descriptions of methods and apparatus are complementary.

[0114] For ease of description, the various figures have been divided and described; however, new embodiments may also be designed and implemented by incorporating the embodiments described in the various figures. As needed by those skilled in the art, computer-readable recording media containing programs for performing the above embodiments are also within the scope of the embodiments. The apparatus and methods according to the embodiments are not limited to the configurations and methods of the above embodiments, but rather the embodiments may be selectively combined with all or some of the embodiments to perform various modifications. Although preferred embodiments have been shown and described, the embodiments are not limited to the specific embodiments described above, and various modifications may be made by those skilled in the art without departing from the spirit of the embodiments claimed in the claims, and these modifications should not be understood solely from the technical concept or prospect of the embodiments.

[0115] Various components of the apparatus according to the embodiments can be implemented by hardware, software, firmware, or a combination thereof. Various components of the embodiments can be implemented using a single chip (e.g., a hardware circuit). According to the embodiments, components can be implemented using separate chips. According to the embodiments, at least one component of the apparatus can be configured with one or more processors capable of executing one or more programs, and said one or more programs can execute one or more of the operations / methods according to the embodiments or instructions for performing said operations / methods. Executable instructions for performing the methods / operations of the apparatus according to the various embodiments can be stored in a non-transient CRM or other computer program product configured to be executed by one or more processors, or stored in a temporary CRM or other computer program product configured to be executed by one or more processors. Furthermore, the memory according to the embodiments can be used as a concept that includes not only volatile memory (e.g., RAM) but also non-volatile memory, flash memory, PROM, etc. Furthermore, implementations in the form of carrier waves, such as those transmitted via the Internet, can be included. Furthermore, processor-readable recording media can be distributed across networked computer systems, and processor-readable code can be stored and executed in a distributed manner.

[0116] In this document, " / " and "," are interpreted as "and / or". For example, "A / B" is interpreted as "A and / or B", and "A, B" is interpreted as "A and / or B". Furthermore, "A / B / C" means "at least one of A, B, and / or C". Additionally, "A, B, C" also refers to "at least one of A, B, and / or C". Furthermore, "or" in this document is interpreted as "and / or". For example, "A or B" could mean 1) only "A", 2) only "B", or 3) "A and B". In other words, "or" in this document can mean "additionally or alternatively".

[0117] Terms such as "first," "second," etc., are used to describe various components of the embodiments. However, the various components according to the embodiments should not be interpreted as limited by the above terms. These terms are only used to distinguish one component from another. For example, a first user input signal may be referred to as a second user input signal. Similarly, a second user input signal may be referred to as a first user input signal. The use of these terms should be interpreted as not departing from the scope of the different embodiments. Both the first user input signal and the second user input signal are user input signals, but do not mean that they are the same user input signals unless explicitly indicated in the context.

[0118] The terms used to describe embodiments are for describing particular implementations and are not intended to limit them. As used in the description of embodiments and claims, the singular is intended to include the plural unless explicitly stated in the context. The expression “and / or” is used in a sense to include all possible combinations between the terms. The expression “comprising” describes the presence of features, quantities, steps, elements, and / or components, but does not imply the exclusion of additional features, quantities, steps, elements, and / or components. Conditional expressions such as “in the case of” and “when” used to describe embodiments are not limited to optional cases. They are used to describe actions performed in response to specific conditions when those conditions are met, or to interpret related definitions.

[0119] Furthermore, the operations according to the embodiments described herein can be performed by a transceiver including a memory and / or a processor according to the embodiments. The memory may store a program for processing / controlling operations according to the embodiments, and the processor may control the various operations described in this document. The processor may be referred to as a controller, etc. The operations of the embodiments can be performed by firmware, software, and / or combinations thereof, and the firmware, software, and / or combinations thereof may be stored in the processor or memory.

[0120] Meanwhile, the operations according to the above embodiments can be performed by the transmitting and / or receiving devices according to the embodiments. The transceiver may include a transceiver for transmitting and receiving media data, a memory for storing instructions (e.g., program code, algorithms, flowcharts, and / or data) for the processes according to the embodiments, and a processor for controlling the operation of the transceiver.

[0121] The processor may be referred to as a controller, etc., and may correspond to, for example, hardware, software, and / or a combination thereof. The operations according to the above embodiments can be performed by the processor. Furthermore, the processor may be implemented as an encoder / decoder, etc., for the operations of the above embodiments.

Claims

1. A vehicle comprising: The display unit is configured to display information; A sensor unit, disposed below the display unit and configured to detect the position of a user's hand in a sensing area in front of the display unit, the sensing area comprising: (1) a first area for detecting the approach of the user's hand and (2) a second area for detecting the position of the user's hand; the sensor unit comprising: (1) a plurality of light-emitting units configured to emit light toward the sensing area and (2) one or more sensors configured to sense light emitted toward the sensing area and reflected by the user's hand in the sensing area; and The controller is configured to control the display unit to perform: (1) displaying a main menu in response to detecting the proximity of the user's hand in the first area; and (2) displaying a sub-menu corresponding to the position of the user's hand in the second area in response to the sensor detecting the user's hand in the second area. The main menu includes multiple optional main menu items, and the submenu includes multiple optional submenu items corresponding to the position of the user's hand in the second area.

2. The vehicle according to claim 1, wherein: The number of light-emitting units is greater than the number of sensors, and Each of the sensors is located in at least one of the left, middle and right portions of the sensor unit.

3. The vehicle according to claim 1, wherein, The light-emitting units are arranged in a row and configured to emit light sequentially from the first end to the second end of the row.

4. The vehicle according to claim 1, wherein, The controller is configured to control the display unit to display the submenu and surrounding menus associated with the main menu together, the surrounding menus having a different resolution than the submenu.

5. A method for controlling a vehicle, the vehicle including a display unit and a sensor unit disposed below the display unit and configured to detect the position of a user's hand at a sensing area in front of the display unit, the sensor unit comprising: (1) a plurality of light-emitting units configured to emit light toward the sensing area and (2) one or more sensors configured to sense light emitted toward the sensing area and reflected by the user's hand in the sensing area, the method comprising: The sensor unit's multiple light-emitting units are controlled to emit light towards the sensing area; and Multiple sensors in the sensor unit are controlled to receive light emitted toward the sensing area and reflected by the user's hand; The position of a user's hand in the sensing area in front of the display unit is detected based on light received by one or more sensors of the sensor unit, the sensing area including: (1) a first area for detecting the approach of the user's hand and (2) a second area for detecting the position of the user's hand; In response to detecting the user's hand approaching the first area, the display unit is controlled to display the main menu; and In response to detecting the user's hand in the second area of ​​the sensing area, the display unit is controlled to display a sub-menu corresponding to the detected position of the user's hand in the second area. The main menu includes multiple optional main menu items, and the submenu includes multiple optional submenu items corresponding to the position of the user's hand in the second area.

6. The method according to claim 5, wherein: The number of light-emitting units is greater than the number of sensors, and Each of the sensors is located in at least one of the left, middle and right portions of the sensor unit.

7. The method according to claim 6, wherein: The light-emitting units are arranged in a row, and Controlling the sensor unit includes controlling the light-emitting unit to emit light sequentially from the first end to the second end of the row.

8. The method according to claim 5, wherein, Controlling the display unit to display the sub-menu information includes controlling the display unit to display the sub-menu together with surrounding menus associated with the main menu, wherein the surrounding menus have a different resolution than the sub-menu.

9. A display for a vehicle, comprising: The display unit includes a display panel configured to display information; as well as A sensor unit is disposed below the display panel and configured to detect the movement and position of a user's hand in a sensing area in front of the display unit. The sensing area includes: (1) a first area for detecting the approach of the user's hand and (2) a second area for detecting the position of the user's hand. The sensor unit includes a plurality of light-emitting units configured to emit light toward the sensing area and one or more sensors configured to sense light emitted toward the sensing area and reflected by the user's hand in the sensing area. The display unit is configured on the display panel to: (1) display a main menu in response to detecting the proximity of the user's hand in the first area; and (2) display a sub-menu corresponding to the position of the user's hand in the second area in response to the sensor detecting the user's hand in the second area. The main menu includes multiple optional main menu items, and the submenu includes multiple optional submenu items corresponding to the position of the user's hand in the second area.

10. The display according to claim 9, wherein: The number of light-emitting units is greater than the number of sensors, and Each of the sensors is positioned in at least one of the left, middle, and right sides of the sensor unit.

11. The display according to claim 9, wherein, The light-emitting units are arranged in a row and configured to emit light sequentially from the first end to the second end of the row.

12. The display according to claim 9, wherein, The display unit is further configured to display the sub-menu and a surrounding menu associated with the main menu together in response to the sensor detecting that the user's hand is in the second area, the surrounding menu having a different resolution than the sub-menu.

Images