Apparatus and method for controlling projection display

Abstract

The present invention relates to a projection image display control device and a method thereof. A projection image display control device according to the present invention comprises an input unit that receives projection image information and operation information, a memory in which a program for controlling a projection image display using projection image information and operation information is stored, and a processor that executes the program. The processor is characterized by determining an object to be operated within a projection image using operation information, determining whether the object to be operated is included within a shade, and transmitting a command signal to change the UI of the object to be operated that is included within the shade.

Description

Technology Field

[0001] The present invention relates to a projection image display control device and a method thereof. Background Technology

[0003] As in-vehicle displays become larger, there is an increasing number of attempts to utilize windshields and windows as displays, in addition to LCDs and OLEDs installed in standard cockpits.

[0004] According to conventional technology, when utilizing a windshield and a window as a display, an electrochromic film and a projection image using a projector are utilized, and operation is performed using air gestures.

[0005] However, due to technological advancements such as autonomous driving, vehicle interior structures are changing into various forms, creating a situation where any part of the interior space can be utilized as a display, thereby establishing an environment where various operations are possible.

[0006] When using a projection image according to conventional technology, if an operation signal such as touch is input to the content within the projection image, a shadow is generated on the projection image screen depending on the position of the projector's light source, and there is a problem in that the content to be operated is obscured by the shadow. The problem to be solved

[0008] The present invention is proposed to solve the aforementioned problems and aims to provide a projection image display control device and method that enable intuitive and comfortable operation of content within a projection image by providing feedback in terms of UI to avoid shading that occurs when operating (touching) content (objects) within the projection image. means of solving the problem

[0010] A projection image display control device according to the present invention comprises an input unit that receives projection image information and operation information, a memory in which a program for controlling a projection image display using projection image information and operation information is stored, and a processor that executes the program. The processor is characterized by determining an object to be operated within a projection image using operation information, determining whether the object to be operated is included within a shade, and transmitting a command signal to change the UI of the object to be operated that is included within the shade.

[0011] The input unit receives operation information generated by detecting the user's gesture.

[0012] The processor determines whether the target object is included within the shadow generated based on the position of the projector.

[0013] The processor transmits a command signal to modify at least one of the position and shape of the object to be manipulated.

[0014] In transmitting a command signal to change the position of an object to be manipulated, the processor transmits a command signal to change the position of the object to be manipulated to a preset position by taking into account the position of the shading.

[0015] The processor transmits a command signal including a command to modify the position of an object other than the target object.

[0016] A projection image display control method according to the present invention includes (a) a step of confirming an intention to operate an object within a projection image and (b) a step of performing UI feedback control by transmitting a command signal to adjust the UI for the object when the object is included in the shading.

[0017] Step (a) detects the user's gesture to determine the intention to manipulate the object.

[0018] (b) Step detects that an object is included within the shadow generated according to the position of the projector and transmits a command signal to change at least one of the position and shape of the object.

[0019] (b) When the object's position is deformed, the step transmits a command signal to deform the object's position to a preset position, taking into account the position of the shading.

[0020] (b) Step transmits a command signal containing a command to modify the position of an object other than the object. Effects of the invention

[0022] According to the present invention, by providing feedback in terms of UI while considering the shading that occurs during touch operation within a projection image, the problem of the target content being obscured by shading is resolved, thereby enabling touch operation on the projection image with intuitive and comfortable motion.

[0023] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description below. Brief explanation of the drawing

[0025] FIG. 1 is a drawing illustrating a projection image display control device according to an embodiment of the present invention. FIGS. 2 and FIGS. 3 are drawings illustrating the mounting positions of a projector according to an embodiment of the present invention. FIG. 4 is a drawing illustrating shading generated when using a projection image according to an embodiment of the present invention. FIGS. 5a to 5d, FIGS. 6, and FIGS. 7 are drawings illustrating UI feedback provided through projection image display control according to an embodiment of the present invention. FIG. 8 is a drawing illustrating a projection image display control method according to an embodiment of the present invention. FIG. 9 is a drawing illustrating a smart mobility vehicle according to an embodiment of the present invention. FIG. 10 is a front view schematically illustrating an internal system of a projection device for a smart mobility vehicle according to one embodiment of the present invention. FIG. 11 is a side view schematically illustrating an internal system of a projection device for a smart mobility vehicle according to one embodiment of the present invention. FIG. 12 is a schematic diagram illustrating the projection light path of a project in a projection device of a smart mobility vehicle according to one embodiment of the present invention. FIG. 13 is a diagram illustrating the configuration of internal and external displays in a projection device of a smart mobility vehicle according to an embodiment of the present invention. FIGS. 14 to 17 are drawings illustrating variations in the mounting of a projector inside a vehicle in a projection device of a smart mobility vehicle according to an embodiment of the present invention. FIG. 18 is an exemplary diagram illustrating the division of a display screen by function using a single projector in a projection device of a smart mobility vehicle according to an embodiment of the present invention. FIG. 19 is a schematic diagram illustrating a cockpit moving structure of a smart mobility vehicle according to an embodiment of the present invention. FIGS. 20 to 22 are drawings illustrating examples of the movement of a cockpit module and a steering wheel in a cockpit moving structure of a smart mobility vehicle according to an embodiment of the present invention. FIGS. 23 to 25 are schematic drawings illustrating a cockpit moving structure of a smart mobility vehicle according to an embodiment of the present invention. FIG. 26 is a drawing illustrating an example of unlocking part A shown in FIG. 25. FIGS. 27 and 28 are drawings illustrating examples of upward and downward movement of a cockpit module according to rotational driving in a cockpit moving structure of a smart mobility vehicle according to an embodiment of the present invention. FIGS. 29 and 30 schematically illustrate a steering unit capable of switching position between the driver's seat and the passenger seat in a steering device of a smart mobility vehicle according to an embodiment of the present invention. FIG. 31 is a schematic diagram illustrating a steering device in a smart mobility vehicle according to one embodiment of the present invention. FIG. 32 is a cross-sectional view of the BB in FIG. 31. FIG. 33 is a diagram illustrating the operational relationship between the components of a steering device in a smart mobility vehicle according to an embodiment of the present invention. FIG. 34 is a drawing partially illustrating the operational relationship between the components of a steering device in a smart mobility vehicle according to an embodiment of the present invention. FIGS. 35 and 36 are schematic drawings illustrating a steering wheel in a steering device of a smart mobility vehicle according to an embodiment of the present invention. FIGS. 37 and 38 are schematic drawings illustrating a prototype of a steering wheel in a steering device of a smart mobility vehicle according to an embodiment of the present invention. Specific details for implementing the invention

[0026] The aforementioned objectives of the present invention, as well as other objectives, advantages, and features, and the methods for achieving them, will become clear from the embodiments described in detail below together with the accompanying drawings.

[0027] However, the present invention is not limited to the embodiments disclosed below but can be implemented in various different forms, and the following embodiments are provided merely to easily inform those skilled in the art of the purpose, structure, and effects of the invention, and the scope of the rights of the present invention is defined by the description in the claims.

[0028] Meanwhile, the terms used in this specification are for describing the embodiments and are not intended to limit the invention. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text. As used in this specification, "comprises" and / or "comprising" do not exclude the presence or addition of one or more other components, steps, actions, and / or elements to the mentioned components, steps, actions, and / or elements.

[0030] FIG. 1 illustrates a projection image display control device according to an embodiment of the present invention.

[0031] A projection image display control device according to an embodiment of the present invention comprises an input unit (110) for receiving projection image information and operation information, a memory (120) for storing a program for controlling a projection image display using projection image information and operation information, and a processor (130) for executing the program. The processor (130) is characterized by determining an object to be operated within a projection image using operation information, determining whether the object to be operated is included within a shade, and transmitting a command signal to change the UI of the object to be operated that is included within the shade.

[0032] The input unit (110) receives operation information generated by detecting the user's gesture.

[0033] In this case, a sensor that detects user gestures can detect the intention to manipulate an object at a specific location, and as another example, it is possible to confirm the intention to manipulate an object at a specific location from the image of a camera capturing a projection area.

[0034] The processor (130) determines whether the object to be manipulated is included within the shadow generated according to the position of the projector.

[0035] The processor (130) transmits a command signal to modify at least one of the position and shape of the object to be manipulated.

[0036] The processor (130) transmits a command signal to change the position of the target object to a preset position by taking into account the position of the shading.

[0037] The processor (130) transmits a command signal including a command to change the position of an object other than the object to be manipulated.

[0039] FIGS. 2 and FIGS. 3 illustrate the mounting positions of a projector according to an embodiment of the present invention.

[0040] A projector according to an embodiment of the present invention can be mounted at various locations within a vehicle, and since shadows inevitably occur during the manipulation of the projection image depending on the projection position for the optimal image, feedback in terms of UI is provided to avoid this.

[0041] Referring to FIG. 2(a), the projector (210) can be mounted on the lower part of the vehicle body, referring to FIG. 2(b), the projector (210) can be mounted on the upper part of the vehicle body, and referring to FIG. 2(c), the projector (210) can be mounted on the side of the vehicle body.

[0042] As illustrated in FIG. 3, it is possible for the first projector (210a) to project an image from top to bottom, the second projector (210b) to project an image from bottom to top, the third projector (210c) to project an image from left to right, and the fourth projector (210d) to project an image from right to left.

[0044] FIG. 4 illustrates shading that occurs when using a projection image according to an embodiment of the present invention.

[0045] Referring to FIG. 4(a), the first projector (210a) projects an image from top to bottom, and when a user selects a specific object within the projected image using a hand, such as a touch operation, a shadow is formed from top to bottom.

[0046] Referring to FIG. 4(b), when the second projector (210b) projects an image from the bottom to the top and the user selects a specific object within the projected image, such as a touch operation, using their hand, a shadow is formed from the bottom to the top.

[0047] Referring to Fig. 4(c), the third projector (210c) projects an image from left to right, and when a user selects a specific object within the projected image, such as a touch operation, using their hand, a shadow is formed from left to right.

[0048] Referring to FIG. 4 (d), the fourth projector (210d) projects an image from right to left, and when a user selects a specific object within the projected image, such as a touch operation, using their hand, a shadow is formed from right to left.

[0050] FIGS. 5a to 5d, FIGS. 6, and FIGS. 7 illustrate UI feedback provided through projection image display control according to an embodiment of the present invention.

[0051] According to an embodiment of the present invention, a processor (130) uses projection image information and object manipulation information within the projection image to transmit a command signal to change the UI of content (icon, etc.) to be manipulated (touched) within the projection image and to apply a movement effect, and a projector uses this to implement the UI change and movement effect and project an image.

[0052] In this case, when implementing UI change and movement effects, the effect is applied preferentially to the area closest to the target content (icon) so that the user can intuitively recognize it.

[0053] Referring to FIG. 5a, when the first projector (210a) projects an image from top to bottom and the user selects a specific object (1) within the projected image using a hand, such as a touch operation, a shadow is formed from top to bottom and a part of the specific object (1) to be operated is included in the shadow. In accordance with the transmission of a command signal from the processor (130), the position of the specific object (1) to be operated is moved upward, left, or right so that it is not obscured by the shadow.

[0054] At this time, the specific object (1) to be manipulated can be moved in the upper left and upper right directions, rather than in the nearby upper, left, and right directions.

[0055] At this time, as the user's hand moves, the shading moves accordingly, so the processor (130) transmits a command signal to appropriately change the position of the specific object (1) to be operated, so that the user's hand can operate (touch) the specific object (1) to be operated using the user's hand without obscuring it as much as possible by the shading.

[0056] In addition, as the position of the specific object (1) to be manipulated is moved, the position of the object previously located around the specific object (1) to be manipulated is moved in conjunction.

[0057] Referring to FIG. 5b, when the second projector (210b) projects an image from the bottom to the top and the user selects a specific object (1) within the projected image using a hand, such as a touch operation, a shadow is formed from the bottom to the top, and a part of the specific object (1) to be operated is included in the shadow. In accordance with the transmission of a command signal from the processor (130), the position of the specific object (1) to be operated is moved to the left or right so that it is not obscured by the shadow.

[0058] At this time, the specific object (1) to be manipulated can be moved in the left lower direction and right lower direction, rather than in the nearby left and right directions.

[0059] Referring to FIG. 5c, when the third projector (210c) projects an image from left to right and the user selects a specific object within the projected image, such as by touch operation, a shadow is formed from left to right downward and a part of the specific object (1) to be operated is included in the shadow. In accordance with the transmission of a command signal from the processor (130), the position of the specific object (1) to be operated is moved upward and left so that it is not obscured by the shadow.

[0060] At this time, the specific object (1) to be manipulated can be moved in the upper left direction, upper right direction, and lower left direction, rather than in the upper and left directions which are close ranges.

[0061] Referring to FIG. 5d, when the fourth projector (210d) projects an image from right to left and the user selects a specific object within the projected image, such as by touch operation, a shadow is formed from right to left and a part of the specific object (1) to be operated is included in the shadow. In accordance with the transmission of a command signal from the processor (130), the position of the specific object (1) to be operated is moved upward and to right so that it is not obscured by the shadow.

[0062] At this time, the specific object (1) to be manipulated can be moved in the left upper direction, right upper direction, and left lower direction, rather than in the nearby up and back directions.

[0063] Referring to FIG. 6, when the first projector (210a) projects an image from top to bottom and the user selects a specific object within the projected image, such as by touch operation, a shadow is formed from top to bottom and a part of the specific object to be operated is included in the shadow. In accordance with the transmission of a command signal from the processor (130), the position of the specific object to be operated is moved upward and the shape of the icon is deformed, and at least one of the shape or size of the icon is deformed.

[0064] In addition, other objects around a specific object to be manipulated have their positions changed to be out of the shading, in conjunction with the deformation of at least one of the position and shape of the specific object to be manipulated.

[0065] Referring to FIG. 7, the first projector (210a) projects an image from top to bottom, and

[0066] As the user's hand moves as shown in (a), (b), (c), and (d) of Fig. 7, the shaded area moves along with it.

[0067] Referring to FIG. 7 (a) and (b), the first object (O1) is positioned within the shade by the user's hand, and the position and shape of the first object (O1) are changed according to the processor's command signal (O1-1).

[0068] Referring to Fig. 7(c), the second object (O2) is positioned within the shade by the user's hand, and the position and shape of the second object (O2) are changed according to the processor's command signal (O2-1).

[0069] Referring to FIG. 7 (d), the third object (O3) is positioned within the shade by the user's hand, and the position and shape of the third object (O3) are changed according to the processor's command signal (O3-1).

[0071] FIG. 8 illustrates a projection image display control method according to an embodiment of the present invention.

[0072] A projection image display control method according to an embodiment of the present invention includes a step of confirming an intention to operate an object within a projection image (S810) and, when the object is included in a shadow, a step of transmitting a command signal to adjust the UI for the object to perform UI feedback control (S820).

[0073] Step S810 detects the user's gesture to confirm the intention to manipulate the object.

[0074] Step S820 detects that an object is included within the shadow generated according to the position of the projector and transmits a command signal to change at least one of the position and shape of the object.

[0075] Step S820 transmits a command signal to change the object's position to a preset position, taking into account the position of the shading, when the object's position is changed.

[0076] Step S820 transmits a command signal containing a command to modify the position of an object other than the object.

[0078] According to conventional technology, as vehicle forms evolve, in-vehicle displays are becoming increasingly larger, and technologies are being developed to utilize displays across the entire area, including the display, windshield, and window.

[0079] However, according to conventional technology, when displaying an image from a fixed position, there is a problem in that the view is obstructed depending on the physique / position of the occupants (including the driver and co-passengers), resulting in a situation where the information displayed in the image cannot be properly perceived.

[0080] A projection device for a smart mobility vehicle according to one embodiment of the present invention includes: a windshield having an electrochromic film capable of adjusting shading according to power application so as to display an image towards the inside or outside of the vehicle; and a projector that projects a functional image containing vehicle operation information toward the windshield.

[0081] The windshield can be divided into an internal display area that displays images toward the interior of the vehicle and an external display area that displays images toward the exterior of the vehicle.

[0082] The electrochromic film includes an SPD (Suspended Particle Devices) film attached to the inner surface of the windshield and a PDLC (Polymer Dispersed Liquid Crystal) film attached to the inner surface of the SPD film.

[0083] It is desirable for the internal display area to be located above the external display area.

[0084] The internal and external display areas have separate electrical application paths.

[0085] The projector is implemented using a short focal length method that projects images toward internal and external display areas.

[0086] The projector is positioned around the floor of the vehicle where a viewing angle area can be secured, and has a projection light path between the internal and external display areas.

[0087] As another example, the projector may be placed in the cockpit of a vehicle capable of securing a viewing angle area and may have a projection light path between the internal and external display areas.

[0088] As another example, the projector may be positioned on the inner side of the vehicle's roof, where a viewing angle area can be secured, and may have a projection light path between the inner and outer display areas.

[0089] At this time, a reflective mirror capable of adjusting the position of the image projected to the inner and outer display areas may be placed on the projection light path.

[0090] A projection device of a smart mobility vehicle according to one embodiment of the present invention includes a windshield in which shading can be adjusted according to power application and internal and external display areas are divided; and a projector that projects a functional image containing vehicle operation information toward the windshield.

[0091] In this case, it is desirable for the projector to have a projection light path between the inner and outer display areas by adjusting the position of each front projection area.

[0092] The projection light path can consist of empty space where surrounding objects do not interfere.

[0093] The projector can selectively adjust the projection area so that the image displayed on the external display area is not visible to the occupants.

[0094] A projection device for a smart mobility vehicle according to another embodiment of the present invention includes an internal display that displays an image toward the driver's seat; an external display that displays an image toward the outside of the vehicle; and a projector that projects a beam toward the internal and external displays so that a functional image containing vehicle operation information is displayed on the internal and external displays.

[0095] Here, the projector can divide the screen by function by simultaneously projecting various function-specific videos containing vehicle operation information onto internal and external displays.

[0096] The internal and external displays may each have an electrochromic film capable of adjusting shading depending on the power application.

[0097] According to the present invention, driving information can be shared by displaying various forms of messages to the outside while providing convenience to the passenger.

[0098] In particular, images can be displayed more effectively on internal and external displays using a short-throw projector that can secure a field of view along the projection path.

[0100] Projection device of a smart mobility vehicle (Figs. 9 to 18)

[0101] FIGS. 9 to 18 illustrate a projection device of a smart mobility vehicle according to an embodiment of the present invention.

[0102] Referring to FIGS. 9 to 18, the projection device of a smart mobility vehicle basically includes a windshield (130) and a projector (140).

[0103] The windshield (130) may be divided into an internal display area that displays an image toward the interior of the vehicle (10) and an external display area that displays an image toward the exterior of the vehicle.

[0104] It is preferable that the internal display area be located above the external display area, and the internal display (110) is located thereon.

[0105] The external display area is located below the internal display area and may be located in the air vent (not shown) area located in front of the existing bumper (not shown). An external display (120) is located in this external display area.

[0106] The internal and external displays (110, 120) have separate electrical application paths.

[0107] The projector (140) projects a functional video containing vehicle operation information toward the windshield (130).

[0108] The projector (140) is configured in a short focal length manner to project an image toward the internal and external display areas.

[0109] The projector (140) is positioned around the floor of the vehicle where a viewing angle area can be secured and has a projection light path between the inner and outer display areas.

[0110] As another example, the projector (140) may be positioned within the cockpit of a vehicle capable of securing a viewing angle area and may have a projection light path between the inner and outer display areas. As yet another example, the projector (140') may be positioned on the inner side of the roof of a vehicle capable of securing a viewing angle area and may have a projection light path between the inner and outer display areas.

[0111] At this time, a reflective mirror capable of adjusting the position of the image projected to the inner and outer display areas may be placed on the projection light path.

[0112] The projector (140) may have a projection light path between the inner and outer display areas by adjusting the position of the front projection area.

[0113] Here, the projection light path can consist of an empty space where surrounding objects do not interfere.

[0114] The projector (140) can selectively adjust the projection area so that the image displayed on the external display area is not visible to the occupant.

[0115] In other words, in order to promote convenience and safety for the passenger while driving, the image of the external display (120) can be obscured from the vehicle interior, in addition to the image of the internal display (110) that is necessary for the passenger.

[0116] A projection device of a smart mobility vehicle according to another embodiment of the present invention includes an internal display (110), an external display (120), and a projector (140).

[0117] The internal display (110) displays an image toward the driver's seat.

[0118] The external display (120) displays an image to the outside of the vehicle (10).

[0119] The projector (140) projects a beam toward the inner and outer displays (110, 120) so that a video of a function containing vehicle operation information is displayed on the inner and outer displays (110, 120).

[0120] Here, the projector (140) can simultaneously project various functional images containing vehicle operation information onto internal and external displays (110, 120) to divide the functional screen.

[0121] The internal and external displays (110, 120) may each have an electrochromic film (131) that can adjust shading according to power application.

[0122] The electrochromic film (131) includes a first film (131a) attached to the inner surface of the windshield and a second film (131b) attached to the inner surface of the first film (131a).

[0123] At this time, the first film (131a) may be a Suspended Particle Devices (SPD) film with a dark color, and the second film (131b) may be a Polymer Dispersed Liquid Crystal (PDLC) film with a relatively brighter color than the first film (131a).

[0124] The first film (131a) can be switched to black when the power is turned off and to transparent when the power is turned on. At this time, the transparent color may vary depending on the degree of tinting of the vehicle.

[0125] The second film (131b) can be switched to an opaque white color when the power is turned off, and to a transparent color when the power is turned on.

[0126] In the case of the internal display (110), since information is acquired from an image formed on the surface, external light blocking is required to ensure visibility. On the other hand, in the case of the external display (120), since the image formed on the surface needs to be viewed from the outside, the external area must be exposed.

[0127] Meanwhile, when the windshield (130) becomes discolored due to the application of electricity, the voltage / current of the applied electricity can be adjusted to gradually apply a change in state between transparent and opaque to improve sensory quality. In this case, effects for the UI (User Interface) can be implemented. Additionally, if a change in the state of the windshield (130) is required depending on the situation, the change can be made immediately.

[0129] Cockpit moving structure of a smart mobility vehicle (Figs. 19 to 28)

[0130] FIG. 19 schematically illustrates a cockpit moving structure of a smart mobility vehicle according to one embodiment of the present invention.

[0131] Referring to FIG. 19, the cockpit moving structure is a form of next-generation smart mobility vehicle, in which the driver's seat is configured as a bench seat and the position of the configuration within the cockpit can be changed.

[0132] This cockpit moving structure includes a console (210), a cockpit module (220), and a steering wheel (230).

[0133] The console (210) is positioned in the dashboard area at the front of the vehicle interior.

[0134] The cockpit module (220) is positioned on the top of the console (210) and is structured to be movable up and down.

[0135] The steering wheel (230) is connected to the rear of the cockpit module (220) and is structured to allow left and right movement along the longitudinal direction of the cockpit module (220). Here, the longitudinal direction of the cockpit module (220) refers to the left and right length.

[0137] FIGS. 20 to 22 illustrate examples of the movement of a cockpit module and a steering wheel in a cockpit moving structure of a smart mobility vehicle according to an embodiment of the present invention.

[0138] Referring to FIGS. 20 to 22, the cockpit moving structure of a smart mobility vehicle (10) according to one embodiment of the present invention allows the cockpit module (220), connected to the console (210), to move up and down to fit the body shape of the occupant as shown in FIG. 20.

[0139] At this time, the console (210) is tilted toward the engine room (not shown) at a predetermined angle.

[0140] When the cockpit module (220) is raised, it moves forward (toward the engine room) and rotates upward through tilt-up and tele-in movements, which can increase the seating space for the occupant or extend the hand reach clearance.

[0141] When the cockpit module (220) is lowered, it moves backward (toward the occupant) and rotates downward through tilt-down and tele-out movements, which can have the effect of reducing the occupant's seating position space or shortening the hand reach clearance space.

[0142] As illustrated in FIGS. 21 and 22, the position of the cockpit module (220) is shown to be raised when facing forward and lowered when facing backward, but this is merely an example to explain the invention, and the invention is not limited to such structural mechanisms. Additionally, the cockpit module (220) can be adjusted to the corresponding position when unlocked from the console (210).

[0144] FIGS. 23 to 25 schematically illustrate a cockpit moving structure of a smart mobility vehicle according to an embodiment of the present invention, and FIG. 26 illustrates an example of unlocking part A shown in FIG. 25.

[0145] Referring to FIGS. 23 to 26, the console (210) includes a housing (211), a slider (212), an elastic member (213), a locking member (214), a lever (215), a guide bracket (216), and a mounting bracket (217).

[0146] The housing (211) forms the main body of the console (210) and has a guide hole (211a) formed as an elongated hole along the vertical direction on the inner upper side. This housing (211) is formed with a bent structure that slopes upward toward the front and has a structural feature that guides the vertical movement of the cockpit module (220).

[0147] The slider (212) can be raised and lowered on the guide hole (211a) of the housing (211). This slider (212) is structurally connected to the cockpit module (212).

[0148] The elastic member (213) is positioned at the bottom of the slider (212) and is configured to compensate for the weight of the cockpit module (212) to prevent the cockpit module (212) from sagging due to its own weight when the slider (212) is unlocked. This elastic member (213) may be any one of an air spring, a torsion spring, a compression spring, or a tension spring.

[0149] The locking member (214) restricts the movement of the slider (212) by locking and unlocking the slider (212). When the lever (215) is pulled backward, this locking member (214) can move laterally outward by means of a compression spring (214a) located laterally inward to unlock the slider (212).

[0150] The lever (215) is formed as a hand grip structure and is connected to the rear of the slider (212). This lever (215) is linked to the slider (212) and the locking member (214) in an interlink structure. For example, when the lever (215) is pulled to the rear of the slider (212), the lever (215) can unlock the locking member (214) from the slider (212).

[0151] It is preferable that the lever (215) be positioned so as not to interfere with each other when the steering wheel (230 in FIG. 24) moves left and right.

[0152] The guide bracket (216) guides the lifting and lowering of the slider (212). The upper part of the guide bracket (216) is connected so that the slider (212) can move, and the lower part of the guide bracket (216) is fixed to an elastic member (213). This guide bracket (216) may have an L-shaped cross-sectional structure.

[0153] The support (217) is positioned at the bottom of the guide bracket (216) and serves as a support for the guide bracket (216). The upper part of this support (217) may be formed in a shape that slopes downward toward the front.

[0154] As illustrated in FIGS. 25 and 26, the lifting control mechanism of the cockpit module (220), which is lifted and lowered according to the operation of the lever (215), is as follows.

[0155] When the occupant pulls the lever (215) backward (toward the occupant), one side of the first lever (215b) linked to the lever (215) is moved backward along with the lever (215) based on the rotation axis (215c), and the other side of the first lever (215b) is rotated forward based on the rotation axis (215c).

[0156] One side of the second lever (215d) moves forward in conjunction with the other side of the first lever (215b). At this time, a portion of the other side of the second lever (215d) is maintained so that the locking member (214) locks the slider (212), and when one side of the second lever (215b) moves forward, it moves forward in conjunction with it, and through this, the locking member (214) moves to the sideward outer side by means of a compression spring (214a) located on the sideward inner side, thereby unlocking the slider (212).

[0157] When the lock is released like this, if the occupant pushes the lever (215) forward, the cockpit module (220) changes its position upward as it moves forward, and conversely, if the occupant pulls the lever (215) backward, the cockpit module (220) changes its position downward as it moves backward.

[0158] At this time, the cockpit moving structure has a structure in which, when the lever (215) enters the rear preset section, the locking member (214) can re-lock the slider (212).

[0160] FIGS. 27 and 28 illustrate examples of the upward and downward movement of a cockpit module according to rotational driving in a cockpit moving structure of a smart mobility vehicle according to an embodiment of the present invention.

[0161] Unlike the embodiments described in FIGS. 23 to 26, the cockpit moving structure of the smart mobility vehicle illustrated in FIGS. 27 and 28 allows the occupant to move the cockpit module (220 in FIG. 19) up and down using a manual rotation method.

[0162] The console (210') includes levers (215') on both sides of the top that rotate in the forward and backward directions to control the lifting of the cockpit module (220 in FIG. 11).

[0163] Here, the console (210') may additionally include a housing (211'), a slider (212'), a rail (213'), a worm gear (214'), a spur gear (216'), a circular mount (217'), and a rack gear (218').

[0164] The housing (211') is a basic frame and has a receiving space inside.

[0165] A rail (213') is arranged along the vertical length of the inner upper side of the housing (211'). At this time, the rail (213') guides the lifting path of the slider (212'), and the slider (212') can be adjusted up and down along the path of the rail (213').

[0166] The worm gear (214') can rotate in conjunction with the lever (215'). It is preferable that this worm gear (214') be set to a self-locking mode to prevent reverse rotation.

[0167] The spur gear (216') is located at the top of the worm gear (214') and rotates in conjunction with the worm gear (214').

[0168] The circular stand (217') is structured to accommodate the lever (215') and can be configured so that the lever (215') is hidden through rotational or sliding motion.

[0169] The rack gear (218') is positioned on the side of the spur gear (216') and can be adjusted up and down by the rotation of the spur gear (216').

[0171] Steering device of a smart mobility vehicle (Figs. 29 to 38)

[0172] FIGS. 29 and 30 schematically illustrate a steering device of a smart mobility vehicle according to an embodiment of the present invention, wherein a handle portion capable of switching position between the driver's seat and the passenger seat.

[0173] Referring to FIGS. 29 and 30, the steering device of a smart mobility vehicle includes a cockpit module (310), a handle part (320), and a locking part (330).

[0174] The cockpit module (310) is located in front of the driver's seat and passenger seat in the vehicle. This cockpit module (310) includes a rail bracket (311) having a first flat section (311a; ①) located in front of the driver's seat and passenger seat, respectively, a second flat section (311b; ⑤), and an upwardly curved catch section (311c; ②, ③, ④) connecting the first and second flat sections (311a, 311b).

[0175] The first and second inclined sections (②, ④) at both ends of the catch section (311c) engage with the handle section (320) and restrict the rotation of the handle section (320).

[0176] The handle portion (320) is connected to the cockpit module (310) and can be positioned in the driver's seat and passenger seat directions along the longitudinal direction of the cockpit module (310).

[0177] The handle part (320) must have its rotation control restricted when passing through the locking section (311c; ②, ③, ④) according to the position change resulting from the user's operation. This is to improve driving safety.

[0178] The locking part (330) fixes the handle part (320) according to preset conditions. Here, the preset conditions refer to optimal standard data that considers the stationary or stopped state of the smart mobility vehicle, whether the driving road is a straight section, and driving safety.

[0179] Here, the driving road determination logic monitors the road conditions ahead, such as radar and lidar, and determines that the steering unit (320) can switch left / right when the road is a straight section. At this time, the locking unit (330) can unlock the steering unit (320) automatically and / or manually.

[0181] FIG. 31 is a schematic drawing of a steering device in a smart mobility vehicle according to one embodiment of the present invention, FIG. 32 is a cross-sectional view of FIG. 31, and FIG. 33 and FIG. 34 illustrate the operational relationship between the components of the steering device.

[0182] The handle portion (320) illustrated in FIGS. 31 to 34 may be structured to be lockable or rotatable via a paddle shift type steel wire connection. At this time, the handle portion (320) includes a base plate (321), a casing (322), a lever (323), and a steering wheel (324).

[0183] The base plate (321) can move left and right along the cockpit module (310). That is, the base plate (321) is movably connected to a plurality of rail brackets (311 in FIG. 22) formed along the longitudinal direction of the cockpit module (310).

[0184] The casing (322) is connected to the rear of the base plate (321) in an upwardly bent form. This casing (322) contains a connector portion (322a).

[0185] The lever (323) has a structure that interlocks with the locking part (330) and has a structure that protrudes from a portion of the lower part of the casing (322).

[0186] The steering wheel (324) is connected to the rear of the casing (322).

[0187] Looking at the mechanical locking structure of the handle portion (320) through FIG. 32, the locking portion (330) includes a fixing member (331) that moves up and down on the base plate (321) to fix or release the handle portion (320) to the cockpit module (310), and a wire (332) connecting the fixing member (331) and the connector portion (322a) of the casing (322).

[0188] When the lever (323) is pulled backward (toward the driver's seat), the connector part (322a) linked to the lever (323) pulls the wire (332) backward, and the fixing member (331) connected to the wire (332) moves upward, thereby unlocking the handle part (320).

[0189] At this time, the handle part (320) may be unlocked from the cockpit module (310) by an electric method using a solenoid or actuator, etc., rather than a mechanical method.

[0190] For example, the operation may be deactivated by a simple button operation, or the lock of the handle portion (320) may be unlocked according to a preset situation while connected to the smart devices (e.g., portable terminals) of the driver and passenger. Here, the steering wheel (324) of the handle portion (320) may be locked back to its initial state after moving a predetermined distance according to the position change.

[0192] FIGS. 35 and 36 are schematic drawings illustrating a steering wheel in a steering device of a smart mobility vehicle according to an embodiment of the present invention.

[0193] Referring to FIGS. 35 and 36, the steering wheel (324) includes a grip portion (324a), a function button (324b), a center portion (324c), a support portion (324d), a fixing portion (324e), and a hazard switch (324f).

[0194] The steering wheel (324) is equipped with a function button (324b) of the paddle shift type, which can control the locking of the locking part (330 in FIG. 24).

[0195] The center portion (324c) is steerably connected to the rear of the casing (322 in FIG. 24) and provides a mounting section for the portable terminal (20). When the portable terminal (20) is mounted in the mounting section of the center portion (324c), it can be paired with the vehicle through a vehicle control application installed on the portable terminal (20). Through this, the user (including the passenger) can select a desired option by touching the portable terminal (20) while gripping the steering wheel (324). Here, grip portions (324a) are formed at both ends of the center portion (324c) to provide a finger grip section for the user.

[0196] At this time, the center unit (324c) is electrically (wired / wireless) connected to the smart mobility vehicle, so that when the portable terminal (20) is mounted, it can automatically pair with the portable terminal (20) according to the pre-set terminal information.

[0197] The support portion (324d) is positioned at the bottom of the center portion (324c) to support the portable terminal (20).

[0198] The fixing part (324e) is positioned between both ends of the center part (324c) and the grip part (324a) to fix the portable terminal (20). At this time, the fixing part (324e) may be made of a hinged clamp type, or a separate cushioning member (not shown) may be provided in the section that contacts the portable terminal (20) to fix the portable terminal (20).

[0199] Looking at the dimensions of the steering wheel (324) shown in FIG. 36, the left and right length of the steering wheel (324) is about 196 mm, the length between one end of the base (324d) and the left grip portion (324a) is about 110 to 120 mm, and the length between the other end of the base (324d) and the right grip portion (324a) is about 110 to 120 mm.

[0200] Here, the left and right length of the base (324) may be approximately 70 mm. The dimensional information between the components of the steering wheel (324) shown in FIG. 36 is merely one example, and the present invention is not limited to these dimensions. However, the dimensional ratio between the components may be significant.

[0202] FIGS. 37 and 38 schematically illustrate a prototype of a steering wheel in a steering device of a smart mobility vehicle according to one embodiment of the present invention.

[0203] The steering wheel (324) in FIGS. 37 and 38 is a prototype, and the conditions for gripping the steering wheel (324) while driving and the conditions for operating the screen of the portable terminal were taken into consideration.

[0204] In this condition, consideration is that it should be easy for the user to touch or operate the screen of the portable terminal using their thumb while holding the steering wheel (324).

[0205] In addition, the grip portion (324a in FIG. 35) of the steering wheel (324) should allow the user to easily grasp the portable terminal mounted on the center portion (324c in FIG. 35). Each dimensional information according to the condition is in the form shown in FIG. 36, and as previously mentioned, the dimensions do not need to be limited to the present invention, but the dimensional ratio between the components may be significant.

[0206] When the portable terminal is mounted on the steering wheel (324), the arrangement of function buttons on the application within the portable terminal can be changed according to the user's settings so that the user can operate it easily.

[0208] Meanwhile, the projection image display control method according to an embodiment of the present invention may be implemented in a computer system or recorded on a recording medium. The computer system may include at least one processor, memory, a user input device, a data communication bus, a user output device, and a storage. Each of the aforementioned components communicates data through the data communication bus.

[0209] The computer system may further include network interfaces coupled to the network. The processor may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in memory and / or storage.

[0210] Memory and storage may include various forms of volatile or non-volatile storage media. For example, memory may include ROM and RAM.

[0211] Accordingly, the projection image display control method according to an embodiment of the present invention can be implemented as a method executable on a computer. When the projection image display control method according to an embodiment of the present invention is executed on a computer device, computer-readable instructions can execute the projection image display control method according to the present invention.

[0212] Meanwhile, the projection image display control method according to the present invention described above can be implemented as computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording media in which data that can be decoded by a computer system is stored. For example, ROM (Read Only Memory), RAM (Random Access Memory), magnetic tape, magnetic disk, flash memory, optical data storage device, etc. In addition, the computer-readable recording medium can be distributed to computer systems connected via a computer network and can be stored and executed as code that can be read in a distributed manner.

Claims

Claim 1 A projection image display control device comprising: an input unit receiving operation information generated by detecting projection image information and a gesture according to a user's hand; a memory storing a program for controlling a projection image display using the projection image information and operation information; and a processor for executing the program, wherein the processor determines an object to be operated within the projection image using the operation information, determines whether the object to be operated is included within a shadow, determines whether the object to be operated is included within a shadow generated during projection image operation according to the position of the projector outputting the projection image, modifies at least one of the position and shape of the object to be operated, and transmits a command signal to change the UI of the object to be operated included within the shadow by modifying the position of the object to be operated considering the position of the shadow, the position of the projection, and the position of the user's hand. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 delete Claim 6 A projection image display control device according to claim 1, wherein the processor transmits the command signal including a command to modify the position of an object other than the object to be manipulated. Claim 7 (a) a step of determining a target object for operation within a projection image based on operation information generated by detecting projection image information received through an input unit and a gesture according to a user's hand; and (b) a step of the processor determining whether the target object for operation is included within a shadow, determining whether the target object for operation is included within a shadow generated during projection image operation according to the position of a projector outputting the projection image, deforming at least one of the position and shape of the target object for operation, and transmitting a command signal to change the UI of the target object for operation included within the shadow by considering the position of the shadow, the position of the projection, and the position of the user's hand, thereby performing UI feedback control. Claim 8 delete Claim 9 delete Claim 10 delete Claim 11 A projection image display control method according to claim 7, wherein step (b) is a method of transmitting a command signal including a command that causes the processor to modify the position of an object other than the object.

Images