Multi human interface device having text input unit and pointer location information input unit

Abstract

A human interface device comprising the steps of: receiving a first gesture from a user through a text input area; generating first text-related information according to the first gesture; transmitting the first text information to a digital device connected to the human interface device via wired or wireless connection; receiving a second gesture from a user; switching the human interface device to a pointing position information input mode according to the second gesture; receiving a third gesture from a user through a pointing position information input area; generating information related to pointer position information according to the third gesture; transmitting the generated information related to pointer position information to a digital device connected to the human interface device via wired or wireless connection; receiving a fourth gesture from a user; and switching the human interface device to a text input mode according to the fourth gesture, wherein the text input area and the pointing position information input area share at least a portion in common.

Description

Technology Field

[0001] The present invention relates to a human interface for receiving text information or pointing location information from a user and transmitting it to a digital device capable of receiving text or pointing location-related information, such as a computer, laptop, tablet PC, or mobile phone. Background Technology

[0003] Text input devices, such as keyboards for text input on personal computers or portable digital devices, have been disclosed. Additionally, pointing devices, such as mouse devices for controlling the pointing position and performing functions of a pointer for controlling the said digital devices, have been disclosed. The problem to be solved

[0005] Conventional text input devices and pointing devices were provided as separate units, or the pointing input area was configured in a separate location distinct from the text input area of ​​the text input device. As a result, in work environments where text input, pointing location information input, and pointer execution command input are frequently switched, the user's hand movements occur more than necessary, leading to a decrease in work efficiency. means of solving the problem

[0007] In the present invention, a pointing position information input area of ​​a pointing device is provided on the upper surface of the text input area plane of a text input device, and a switching unit is provided to switch between a text input mode and a pointing position information input mode, thereby enabling pointing input while minimizing the movement of the user's hand by simply switching the input mode during text input, so that work efficiency can be improved. Effects of the invention

[0009] By integrating separately provided text input devices and pointing devices into a single human interface device, the unit cost and size of the product can be reduced, and work efficiency can be improved by eliminating unnecessary movements of user operation. Brief explanation of the drawing

[0011] FIG. 1 is an example diagram of a composite human interface device equipped with a pointing device and a text input device. Figure 2 is a flowchart illustrating an example of the sequence of operations according to the mode switching of a pointing device and a text device. FIG. 3 shows examples of the configuration of a text input device and a pointing device. Figure 4 shows examples of a mode switching unit integrated with a pointer execution command unit. Figure 5 shows examples of the structure of a pointer position information input device. Figure 6 is a configuration diagram of an infrared laser sensor module. Figure 7 is an example showing a pointer location information input area. FIG. 8 is a first embodiment of a pointer position information input device that can be separated from a text input device. FIG. 9 is a second embodiment of a pointer position information input device that can be separated from a text input device. FIG. 10 is a third example of a pointer position information input device that can be separated from a text input device. FIG. 11 is a front view and a perspective view of a human interface device with a bottom position type pointer position information input device applied. FIG. 12 is an example of a mode switching unit integrated with a pointer execution command unit. FIG. 13 is an example of utilizing a cover of a human interface device that applies a bottom-position type pointer position information input device. FIG. 14 is an example of a human interface device applied to a portable electronic device. Specific details for implementing the invention

[0012] The present invention relates to a complex human interface for receiving text information or pointing location information from a user and transmitting it to a digital device capable of receiving text or pointing location-related information, such as a computer, laptop, tablet PC, or mobile phone.

[0013] Keyboards consisting of multiple physical buttons connected to elastic bodies and switches are widely used as conventional text information input devices.

[0014] In addition, in digital devices equipped with a touch interface, a method is also used in which a virtual keyboard is displayed on a display, and when a part of the user's body is touched on the virtual keyboard displayed on the display, the user's gesture or electrical signal is detected to input text on the virtual keyboard displayed on the part touched by the user.

[0015] The above touch interface can recognize a user's touch by recognizing the movement of a part of the user's body, recognizing contact with a specific contact surface, detecting the flow of electric current through the user's body, or detecting that light or sound waves are blocked or interfered with by a part of the user's body.

[0016] Examples of touch interfaces include resistive touchscreens, capacitive touchscreens, optical touchscreens, and ultrasonic touchscreens.

[0017] A resistive or pressure-sensitive touchscreen is a type of touchscreen that operates by recognizing pressure.

[0018] Resistive touchscreens have the advantages of being inexpensive and allowing handwriting with a stylus pen or writing in small areas; however, because they rely on pressure, they are known to have the disadvantage of not recognizing presses that are too hard and having a slightly less responsive touch feel compared to capacitive touchscreens.

[0019] A resistive touchscreen consists of multiple layers.

[0020] Among these multiple layers, there is a conductive layer, and the conductive layer consists of two layers facing each other with an air layer in between.

[0021] When the outer screen is pressed, the two conductive layers come into contact with each other, and as a result, the resistance and current change, so that the touch is recognized.

[0022] Capacitive sensing, or capacitive touch, is a method of sensing motion by utilizing the capacitive coupling effect.

[0023] Unlike pressure-sensitive touchscreens, capacitive touchscreens are composed of highly conductive glass called indium tin oxide.

[0024] As sensors are attached to the four corners of the glass, current flows through the glass surface.

[0025] The principle of electrostatics is to detect changes in current through this.

[0026] At this time, when the finger touches the screen, electrons flowing through the glass flow into the body through the finger, and the sensor detects the location where the change occurred and operates.

[0027] Capacitive touch is known to offer smoother operation and scrolling compared to resistive touchscreens because it recognizes touch even with a light touch rather than requiring forceful pressing.

[0028] In addition, the capacitive touch method enables multi-touch, allowing multiple touches.

[0029] Since the capacitive touch method operates by utilizing changes in current, it may not work if used while wearing leather gloves that do not conduct electricity, or with fingernails or a stylus pen.

[0030] However, you can touch the screen by using a separate capacitive dedicated stylus pen.

[0031] Because the sensor is sensitive, it may be affected by surrounding devices.

[0032] Optical touchscreens operate by using infrared cameras mounted at the corners of the touchscreen and infrared illumination to measure coordinates based on the shadows of objects intended to be touched.

[0033] An ultrasonic touchscreen operates by emitting ultrasonic waves onto the screen to detect interference effects caused by a user's touch and measuring coordinates.

[0034] In addition, various touch input technologies that can be used to control the position information of a pointer by detecting the user's contact or movement and recognizing the position information of a part of the user's body may be used in the present invention.

[0035] FIG. 1 is an example diagram of a composite human interface device equipped with a pointing device and a text input device.

[0036] A text input device with an integrated pointing device may have a housing (100) for supporting a text input device and a pointer position information input area.

[0037] The housing has strength capable of withstanding user input pressure and may be composed of a control unit, memory unit, battery unit, encoding unit, transmission unit, etc., for receiving text input information and pointer position information and transmitting the information to a digital device connected to the text input device integrated with the pointing device via wired or wireless connection.

[0038] The above pointing device integrated text input device may be composed of a plurality of buttons (109) for receiving text input information from a user.

[0039] The above plurality of buttons (109) may be composed of physical buttons or virtual buttons.

[0040] The above physical button may be composed of a button connected to an elastic body, or the button itself may have elasticity so that it moves to a different position when receiving user input and returns to its original position when the user's pressure is removed.

[0041] The above physical button can be configured such that it is connected to an electrical switch, and when pressure is applied by a user, the button moves, causing the phase of the switch to change and generate a text input value for the corresponding button.

[0042] The physical button described above has an elastic structure without an electrical switch, moves to a position upon receiving pressure from a user, and returns to its original position when the user's pressure is removed. The user's text input information can be generated based on position information where the user's pressure or gesture is recognized by the touch input device described above.

[0043] The above virtual button can be configured by displaying a text input button on a display device.

[0044] The above virtual button can display any button by projecting light onto a transparent, translucent, or opaque object.

[0045] The above virtual button is not perceived by the user's eyes and has unique location information for each text, and can generate corresponding text input information based on the user's pressure or gesture information.

[0046] The above composite human interface device may have a text input area (107) and a pointing position information input area (108a, 108b) having at least a portion of a common area.

[0047] The pointing position information input area (108a, 108b) is an area located on the surface, top, or bottom of the button for text input, and as shown in FIG. 1, the pointing position information input area may have at least a part in common with the text input area.

[0048] The pointing position information input area may include the text input area, or the text input area may include the pointing position information input area.

[0049] The pointing position information input area and the text input area may have at least some common parts, at least some parts may be used as the pointing position information input area but not as the text input area, and at least some parts may be used as the text input area but not as the pointing position information input area.

[0050] A pointer position information input device (105) for forming a virtual text input area or a virtual pointing position information input area for text input or for pointing position information input or for text input and pointing position information input can be configured on the composite human interface device or outside the composite human interface device.

[0051] The above pointer location information input device (105) is composed of a device such as an infrared generator and an infrared receiver, an RGB camera, an ultrasonic generator and an ultrasonic receiver, or an infrared generator and an infrared camera, and can receive location information and gesture information by detecting a part of the user's body on the surface of the housing (100) or above the housing (100).

[0052] The above pointer position information input device may be modularized and composed of multiple modules to expand the pointer position information input area or to improve accuracy and sensitivity.

[0053] For example, a pointer position information input device (105b) for configuring a text input or pointing position information input area (108b) of the right hand may be provided.

[0054] Alternatively, it may have a pointer position information input device (105a) for configuring the text input or pointing position information input area (108a) of the left hand.

[0055] The text input area or pointing position information input area (108b) for the right hand may be characterized by including the area of ​​the J button of the English standard keyboard.

[0056] The text input area or pointing position information input area (108a) for the left hand may be characterized by including the area of ​​the F button of the English standard keyboard.

[0057] The above pointer position information input device may be characterized by including both the J and F button areas of an English standard keyboard when there is no distinction between the left hand and the right hand.

[0058] The pointing position information input area may be characterized in that, when the complex human interface device is connected to a plurality of digital devices having display units, the pointing position information input area is capable of moving the pointer position on the plurality of display units.

[0059] For example, the pointer position information input area can be divided so that it matches each display unit, or a separate button indicating the display unit can be operated to transmit the pointer position information from the corresponding display unit, or multiple display units can be recognized as a virtual single display unit so that the pointer can move on the virtual single display unit.

[0060] A composite human interface device may include a pointing position information input device that configures a pointing input area and receives pointer position information from a user, and may have a pointer execution command unit (101, 102) for executing at least one function on a button, image, space, icon, or text input window where a pointer moved by the pointing position information input device is located.

[0061] The pointer execution command unit may be composed of one or two buttons, each responsible for a first function and a second function, and may be located on the left, right, or center of the housing.

[0062] The first function above can function like a left click of a computer mouse, for example, and the second function can function like a right click of a computer mouse, for example.

[0063] The pointer execution command unit, consisting of the above one or two buttons, may be provided on both the left and right sides of the housing.

[0064] The above pointer execution command unit can be configured to operate by using the touch technology described above to recognize a touch of a part of the user's body, light blocking, ultrasonic interference, or a shadow of a part of the user's body.

[0065] The above pointer execution command unit may be composed of an elastic physical button.

[0066] The above pointer execution command unit can be operated by using at least one text button located within the text input area in addition to the pointing position information input area.

[0067] The above pointer execution command unit can operate by selecting a physical or virtual text button on the pointing position information input area.

[0068] For example, when using a virtual input device that can input location information in space as a pointing location information input device and a physical button as a text input device, a pointer execution command can be generated by inputting the pointer's location information on the virtual pointing location information input area in the pointing location information input mode and pressing the physical text button located at that position.

[0069] The above pointer execution command unit can receive pointer location information by a user's first gesture within the pointing location information input area and generate a pointer execution command by a user's second gesture at the same location.

[0070] The above pointer execution command unit can be configured so that the first function is executed by a first gesture of the user's body, a first voice, a first blink of the eyes, a first mouth shape, etc.

[0071] The above pointer execution command unit can be configured so that the second function is executed by a second gesture of the user's body, a second voice, a second blink of the eyes, a second mouth shape, etc.

[0072] The complex human interface device may be configured with a text input mode that receives text information through the text input device and a pointing position information input mode that receives pointing position information through the pointing position information input device.

[0073] The above text input mode and pointing position information input mode can be switched by the mode switching unit (103).

[0074] The above mode switching unit (103) may be configured as a switch located separately on the housing.

[0075] The above mode switching unit (103) can execute a mode switching by detecting that at least one text input button included in the text input device or multiple text inputs are received simultaneously.

[0076] The above mode switching unit (103) can switch modes by receiving control information from a digital device connected to the above complex human interface device via wired or wireless connection.

[0077] The above mode switching unit (103) may be configured integrally with the above pointer execution command unit (102).

[0078] For example, it can be configured to switch modes by detecting the first touch or first pressure by a first gesture, such as contact with a part of the user's body, on a first button that responds first to a first touch or first pressure and responds second to a second touch or second pressure, and to generate a pointer execution command by responding to the second touch or second pressure by a second gesture, such as pressing the button.

[0079] The above mode switching unit (103) may be configured with a temporary mode switching mode and a permanent mode switching mode.

[0080] For example, a temporary switching mode can be set to switch from text input mode to pointing position information input mode in response to a first touch or first pressure, and return to text input mode when the first touch or first pressure is removed.

[0081] Alternatively, a temporary switching mode can be set to switch from the pointing position information input mode to the text input mode in response to the first touch or first pressure, and return to the pointing position information input mode when the first touch or first pressure is removed.

[0082] A permanent switching mode can be configured to switch from text input mode to pointing position information input mode in response to a second touch, second pressure, or toggle switch, and to maintain the pointing position information input mode even when the second touch or second pressure is removed.

[0083] Temporary mode switching can be performed by receiving first control information from a digital device connected to a complex human interface device via wired or wireless connection.

[0084] Permanent mode switching can be performed by second control information received from a digital device connected to the complex human interface device via wired or wireless connection.

[0085] The above mode switching unit (103) can be configured as an integral part of the above pointer execution command unit.

[0086] For example, when a first touch or first pressure is detected on the pointer execution command unit, the device may be configured to temporarily switch from text input mode to pointer position information input mode, generate a pointer execution command when a second touch or second pressure is detected, and set to a permanent switching mode so that it operates in pointer position information input mode even after the third touch or third pressure is removed when a third touch or third pressure is applied.

[0087] At this time, it can be configured to allow the input of pointer execution commands even during permanent transition mode.

[0088] The mode switching unit may be configured on the left or right side of the housing (106a, 106b). The mode switching unit (106a, 106b) configured on the left or right side or on both the left and right sides of the housing may be configured to operate by detecting a user's touch input or pressure, such as a virtual button or a physical button.

[0089] The mode switching unit (106a, 106b) configured on the left or right side or both the left and right sides of the above housing can be configured to have an input area of ​​3 centimeters or more and less than 15 centimeters along the side of the housing.

[0090] If the length of the above mode switching part is less than 5 centimeters, it is desirable to set the position of the mode switching part to include the left space of the left tab key of the Windows standard keyboard.

[0091] The composite human interface device may have a transmission unit (104) that transmits data via wired or wireless connection to an external device or a digital device including the composite human interface device.

[0092] The above digital device can receive text input or receive pointer position information.

[0093] Figure 2 is a flowchart illustrating an example of the sequence of operations according to the mode switching of a pointing device and a text device.

[0094] The complex human interface device may have a separate power supply unit or receive power from an external source via wired or wireless connection, and may have a separate switch for controlling the power supply unit.

[0095] When power is supplied to the composite human interface device by the switch controlling the power supply unit, the composite human interface device can determine whether it is currently in text input mode or pointing position information input mode (200).

[0096] If the above judgment result indicates text input mode, the text input device can be activated and text input can be received from the user (201).

[0097] The text input of the user can be transmitted to a digital device connected via wired or wireless connection (202).

[0098] If a mode switch occurs during text input mode to a pointing position information input mode, the text input mode can be switched to a pointing position information input mode.

[0099] Alternatively, it can be configured to allow input of pointing location information simultaneously with text input.

[0100] When the mode is switched to the pointing location information input mode, pointing location information can be received by user input (204).

[0101] The above input pointer location information can be transmitted to a digital device connected via wired or wireless connection (205).

[0102] When the composite human interface device receives the first pointer execution command (206), it can transmit the first pointer execution command to a digital device connected via wired or wireless connection (207).

[0103] When the composite human interface device receives the second pointer execution command (208), it can transmit the first pointer execution command to a digital device connected via wired or wireless connection (209).

[0104] When the temporary mode switch is released or the permanent mode switch is released, the complex human interface device can switch to text input mode.

[0105] The power switch of the power supply unit above can be turned off when the power to the complex human interface device is cut off, when there is no connected digital device or the connection is broken, when there is no user input for a certain period of time, or by control of a digital device connected via wired or wireless connection.

[0106] FIG. 3 shows examples of the configuration of a text input device and a pointing device.

[0107] A composite human interface device may be composed of a first housing (301) including a power supply unit, a control unit, or a communication unit, and a second housing (302) for configuring a text input area and a pointing position information input area.

[0108] A composite human interface device may have a text input device that receives text input from a user and a text input area (303).

[0109] At this time, the text input area (303) can be composed of a virtual button or a physical button.

[0110] A pointing position information input device can be configured in the form of a pressure-sensitive or capacitive touchpad and positioned on the physical button of a text input device (304).

[0111] At this time, if the text input device is configured as a physical touchpad type such as a pressure-sensitive or capacitive type, the touchpad can be used as a text input device and a pointing position information input device, and the mode can be switched and used by the mode switching unit.

[0112] At this time, a physical touchpad, such as a pressure-sensitive or capacitive type, can be configured as a large-area touchpad type composite human interface device (300) comprising a touchpad (304) that includes multiple text button areas of a text input section.

[0113] Alternatively, a multiple touchpad type composite human interface device (310) may be configured with a physical touchpad, such as a pressure-sensitive or capacitive type, comprising a plurality of touchpads (311) including a text button area of ​​a text input section.

[0114] Alternatively, the pointing position information input can be configured as an upper camera-type composite human interface device (320) that forms the pointer position information input area (321) by means of an infrared camera or RGB camera (222) located at the top of the pointing position information input area.

[0115] At this time, the upper camera-type composite human interface device (320) can configure a virtual text input button (303) using the upper camera.

[0116] The above camera can be configured as a bottom camera (332) type composite human interface device (330) configured to form a pointing position information input area (331) by positioning the camera at the bottom of the second housing.

[0117] At this time, the bottom camera type composite human interface device (330) can use the bottom camera to configure a virtual text input button (303) that replaces a physical text button.

[0118] Alternatively, the device may be configured as a transmitting and receiving type composite human interface device (340) that receives pointing position information input through a pair of infrared receivers or ultrasonic receivers that receive information in which infrared or ultrasonic waves transmitted by an infrared transmitter or ultrasonic transmitter are blocked or interfered with by a part of the user's body.

[0119] At this time, the paired virtual pointing position information input area can be used as a virtual text button input means in place of a physical text button by the mode switching unit.

[0120] Figure 4 shows examples of a mode switching unit integrated with a pointer execution command unit.

[0121] A mode switching unit (400) integrated with a pointer execution command unit using touch input can be configured by a button-type pointer execution command unit having an elastic body (403) that moves in position by user pressure and returns to its original position when the pressure is removed, a button (402) that receives user pressure, and switches (404, 405) that move in position by user pressure and generate a pointer execution command when joined.

[0122] The pressure-distinguishing pointer execution command unit integrated mode switching unit (410) can be configured with an elastic body (403) that moves by user pressure and returns to its original position when the pressure is removed, a button (402) that receives user pressure, and a first switch (404, 405) that moves by user pressure and generates a pointer execution command when joined, and a second switch unit (411, 412) that generates a mode switching execution command when joined by user pressure that is smaller than user pressure.

[0123] In the pressure-distinguishing pointer execution command unit integrated mode switching unit (410), the button unit (402) can be moved and fixed so that it cannot return to its original position by means of an elastic body (403).

[0124] At this time, the position where the button is fixed can be set so that the second switch (411, 412) is connected and the first switch (404, 405) is not connected, so that when the button is fixed, it can be configured to operate in a permanent mode switching mode.

[0125] In the integrated mode switching unit (400) for pointer execution command unit using touch input, the permanent mode switching switch (414) can be configured to operate by moving the position such as sliding the button unit, and the pointer execution command switch (404, 405) can be configured to operate when additional pressure is applied while the permanent mode switching switch (414) is operated.

[0126] The pointer execution command unit integrated mode switching unit (410) is configured as a touch pad (421) and can operate as a mode switching unit when the contact area of ​​a part of the user's body touching the touch pad is within a first predetermined range and as a pointer execution command unit when it is within a second predetermined range.

[0127] Figure 5 shows examples of the structure of a pointer position information input device.

[0128] The pointer position information input device of the human interface device of the present invention may include a sensor module (501) including a light emitter and a camera.

[0129] The light emitter of the sensor module (501) serves to configure the light plane so that the path of the light is blocked or reflected by an obstacle, such as a user's finger, on the pointing position information input area (108) configured on the light plane composed of light emitted from the light emitter.

[0130] The camera of the sensor module includes an optical sensor that detects light blocked or reflected by the obstacle.

[0131] The above optical sensor may use a line camera capable of recognizing line images.

[0132] The above line camera is suitable for having an image sensor composed of 400 to 1000 elements in a line shape, and preferably ideally composed of 500 to 700 elements.

[0133] The above line camera is one-fifth to one-seventh of the above 500 to 700 elements

[0134] It may include multiple small line image sensors.

[0135] The light emitter is composed of a light-emitting element for forming a light plane at an upper position approximately 1 millimeter close to the character input button (303).

[0136] The pointing position information input area (108) is composed of part of the light plane.

[0137] For example, light-emitting devices such as infrared emitters, infrared laser emitters, laser emitters, ultraviolet emitters, and visible light emitters may be used.

[0138] Ideally, the light-emitting element should use an infrared laser emitter that does not require a reflector to be installed on the edge.

[0139] An infrared laser emitter is suitable for driving a laser with a wavelength of 800 to 850 nanometers at 0.3 to 1 milliwatt.

[0140] The light emitter passes the light from the infrared emitter through a line lens so that it can spread out in a plane.

[0141] A line lens may be further included in the light-emitting part of the light emitter so that the light emitted from the light-emitting element can form a light plane.

[0142] The above line lens is positioned so that the light emitted from the light-emitting element can form a light plane substantially parallel to the character input section.

[0143] The above pointer position information input device may further configure an optical filter (504) to transmit only light of a specific wavelength range from the light emitter.

[0144] An optical filter (504) is installed to allow light emitted from a light emitter to pass through, and can also be installed in front of the camera to prevent light not emitted from the light emitter from being received when light that is reflected or blocked by an obstacle is received by the camera.

[0145] Although the optical filters for the light emitter and camera mentioned above may be configured separately, it is preferable to design the light emitter and camera in close proximity so that a single optical filter can filter both the transmitted light and the received light.

[0146] The above optical filter can be installed perpendicular to the direction of light propagation of the light emitter.

[0147] The above optical filter can be installed at an angle of 30 to 60 degrees or 120 to 150 degrees to the direction of travel of the light emitter, taking into account design aspects.

[0148] The sensor module (501) can be installed so that the light from the light emitter is radiated directly onto the light plane (510). The sensor module (501) may further include a reflector (503) so that the light from the light emitter is refracted once and radiated onto the light plane (520). At this time, light that is blocked or reflected by an obstacle can also be refracted once by the reflector (503) and received by the camera.

[0149] The sensor module (501) may include two reflectors (503a, 503b) so that light from a light emitter is refracted twice and radiated onto a light plane (530). At this time, light that is blocked or reflected by an obstacle can also be refracted twice by the two reflectors (503a, 503b) and received by a camera.

[0150] By doing this, the sensor module can be installed inside the first housing (301).

[0151] At this time, an optical filter can be coated on the reflector (503) to replace a separate optical filter (504).

[0152] When the pointing position information input area (108) is activated by the sensor module (501), the user inputs pointing position information by moving their finger across multiple text input buttons (303).

[0153] At this time, in order for the user's finger movement not to be hindered by the spacing of the text input buttons (303), the spacing between the text input buttons (303) is ideally 0.1 millimeters to 1 millimeter.

[0154] Additionally, for the multiple text input buttons (303) located below the pointing position information input area (108), it is preferable that the upper surfaces of the multiple text input buttons be positioned on a flat plane.

[0155] The light source emitted from the sensor module (501) is reflected by a reflector or obstacle and then received by the camera passes through the light tunnel (502).

[0156] At this time, if the upper surface of the light tunnel is replaced with a part of the first housing (301), the thickness of the housing can be reduced.

[0157] The bottom surface and sides of the light tunnel can be designed as separate structures from the first housing.

[0158] Figure 6 is a configuration diagram of an infrared laser sensor module.

[0159] The infrared sensor module basically uses a light source (601) to emit light that covers a pointing position information area, and analyzes the light reflected or blocked by an obstacle to calculate the location of the obstacle using one or two cameras (603).

[0160] At this time, a line lens (602) that scatters light can be used so that the light emitted from the light source (601) can be emitted to a desired area.

[0161] It is preferable to use a line camera to detect conditions where a light source is reflected or blocked by an obstacle.

[0162] A guide light tunnel can be installed in front of the camera to help receive light in the desired area.

[0163] In the present invention, the light source may be infrared, ultraviolet, laser, etc.

[0164] The light source and camera can be replaced with ultrasound and an ultrasound receiver.

[0165] In the present invention, it is preferable to use an infrared laser as a light source so as not to install a reflector on the edge of the keyboard.

[0166] If you want to use infrared, you can install a reflector on the edge of the keyboard, increase the output of the light source by more than double compared to an optical touch module for a standard screen, or install an additional auxiliary light source.

[0167] The sensor module may have an auxiliary control board (604) that controls the light source and the camera and transmits the received signal of the camera to the main control board.

[0168] The above pointer position information input unit may be positioned to include a part of the extended surface of the above text input unit plane.

[0169] The text input unit is composed of a plurality of buttons that receive at least one text input, and the buttons may be configured in the form of physical buttons that generate a text selection signal while moving from a first position to a second position by pressure applied by a user and return to the first position by an elastic body.

[0170] The text input section above includes F4 and F5 buttons on a standard Windows keyboard, and the pointer position information input section above is characterized by having two cameras, and can be designed so that the button closest to the left camera among the two cameras is the F4 or F5 button among the buttons of the text input section.

[0171] Alternatively, the camera on the left above may be positioned below the space bar of a standard Windows keyboard, above the area where the gap between the F4 and F5 buttons is shifted downward.

[0172] By doing this, when the index finger of the right hand is positioned at the F position among the text input buttons, the phenomenon where the index finger of the left hand covers the camera when inputting pointer position information with the right hand can be reduced.

[0173] If the above pointer execution command unit is set to the button with the largest area among the text input units, for example, the space bar, it is convenient to execute the above pointer execution command unit with the left hand while, for example, inputting mouse position information with the right hand.

[0174] At this time, since the left hand may be operating the mode switching unit, it is preferable that the shortest distance between the mode switching unit and the pointer execution command unit is 8 to 15 centimeters.

[0175] The above mode switching unit may be provided separately from the button of the above text input unit and may switch between the above text input mode and the above pointer position information input mode by recognizing that a part of the user's body is touched on a part of the human interface body, and may operate in the pointer position information mode when touched and in the text input mode when not touched.

[0176] The above pointer execution command unit is composed of two buttons, and when the first button is pressed, a first function, for example, a left click of the mouse, is performed, and when the second button is pressed, a second function, for example, a right click of the mouse, is performed, wherein the first button is the button with the largest area among the text input unit buttons, for example, a space bar button, and if the second button is set as the first button located to the left or right of the first button, it is convenient to control with the thumb of the right hand and provides an easy user experience.

[0177] When the text input mode or the pointer location information input mode is switched by the above mode switching unit, an indication indicating the text input mode or the pointer location information input mode can be displayed.

[0178] The above pointer location information input mode may be displayed temporarily at the moment a touch of the mode switching unit occurs, or the pointer location information input area may be displayed from the time a touch of the mode switching unit occurs until the time it is released, and may be displayed as a sound, text, or lighting signal.

[0179] By doing this, the user recognizes what mode the keyboard is currently in, and in the pointer location information input mode, has the advantage of easily knowing where to input pointer location information.

[0180] The text input area of ​​the text input section above can be designed to be identical to the pointer position information input area of ​​the pointer position information input section above, or to include the pointer position information input area of ​​the pointer position information input section as shown in FIG. 1.

[0181] As one embodiment of configuring the above pointer position information input unit, it may be configured with one or two optical meters and a camera.

[0182] The optical signal received by the above camera can be passed through a light tunnel to block external noise light sources.

[0183] The light tunnel above can be configured before an optical signal is emitted from an optical emitter to a pointer position information input area, and can be installed in front of a camera that receives a user's input signal from the pointer position information input area.

[0184] At this time, a reflector can be placed to refract the optical signal emitted from the optical emitter or the optical signal received by the camera.

[0185] By using the above-mentioned reflector, degrees of freedom can be granted to the installation location and direction of the pointer location information input unit, thereby providing design space utilization and design benefits.

[0186] The pointer position information input unit can be configured such that the pointer position information input area is formed at least 0.1 to 5 millimeters above the text input unit by the optical emitter and the camera.

[0187] This allows pointer location information to be received only when there is a clear touch intent from the user.

[0188] When an infrared laser with a wavelength of 800 to 850 nanometers is used as the optical emitter and the device is designed to operate at 0.3 to 1 milliwatt, it exhibits excellent characteristics in terms of power consumption, cost, stability, safety, and visual aspects.

[0189] The optical emitter may further include a line lens that scatters the optical signal so that the optical signal forms a pointer position information input area parallel to the text input section.

[0190] The above pointer position information input unit can be designed to block external optical noise by using an optical filter that transmits only optical signals in the infrared region.

[0191] If the text input section is designed with a spacing of 0.1 millimeters to 1 millimeter between physical buttons, it can provide the user with a sufficiently smooth and flat tactile sensation while inputting the pointer position information.

[0192] Figure 7 is an example showing a pointer location information input area.

[0193] The human interface device of the present invention may be designed to further include a pointer location information input area display unit (701, 702) that visually displays the pointer location information input area during the pointer location information input mode.

[0194] The above mode switching unit is provided separately from the button of the above text input unit and can be designed to switch between the above text input mode and the above pointer position information input mode by recognizing that a part of the user's body is touched on a part of the above composite human interface housing, and to operate in the pointer position information input mode when touched and in the text input mode when not touched.

[0195] At this time, if the part of the body used for the above mode switching is the right hand (106b), the hand that inputs the above pointer position information (108a) can be designed to be the left hand.

[0196] In this case, it is desirable to design the pointer position information input area to be closer to the opposite corner of the corner where the mode switching part is located, and the same principle can be applied when the left and right hands are used in reverse. (106a, 108b) On the other hand, the part of the body used for the mode switching can be the right hand, and the hand inputting the pointer position information can also be designed to be the right hand.

[0197] In this case, it is desirable to design the pointer position information input area so that it is closer to the corner where the mode switching part is located than to the corner opposite the corner where the mode switching part is located, and the same principle can be applied to the left hand.

[0198] The above mode switching unit can determine the text input mode and the pointer position information input mode based on the number or position of user fingers recognized by the pointer position information input unit.

[0199] The number of recognized user fingers when determined as the pointer position information input mode is smaller than the number of recognized user fingers when determined as the text input mode.

[0200] For example, while controlling the mode switching unit with the left hand, the fingers of the left hand may not be touched from the text input button and the index finger of the right hand may be touched to input pointer position information, and in this case, the number of recognized user fingers becomes one.

[0201] On the other hand, when the fingers of the left and right hands are touched on the keyboard for text input, the number of the recognized user's fingers, ranging from 2 to 8 or fewer, is recognized.

[0202] The pointer location information input mode display unit may temporarily display the pointer location information input mode when switched to the pointer location information input mode by the mode switching unit, or visually display the pointer location information input area from the time it is switched to the pointer location information input mode until it is released.

[0203] The above pointer position information input mode display unit can be displayed by a visible light generator from the text input button, by reflected light from the text input button, or through the spacing between the text input buttons.

[0204] At this time, the input mode can be displayed even in text input mode, and the text input mode and the pointer position information input mode can be displayed to be distinguished.

[0205] The above pointer position information input mode display unit is composed of a non-visible light generator (701a, 701b) or a surface (702a, 702b) coated with a dye that optically reacts to the non-visible light and emits visible light, and the dye can be applied to the text input button or the gap between the text input buttons.

[0206] The above mode switching unit may further include a hand-side determination unit that determines whether the user inputs the pointer position information with their left hand or their right hand.

[0207] The display of the pointer position information input display unit can be changed according to the above hand-side judgment unit.

[0208] The button placement and operation of the pointer execution command unit can be dynamically switched according to the above hand-side judgment unit.

[0209] For example, if the pointer execution command unit includes mouse right-click and left-click, the button to perform the mouse right-click and left-click can be switched according to the judgment of the hand-side judgment unit above.

[0210] The above pointer position information input area display unit can display different pointer position information input areas (702a, 702b) according to the judgment result of the above hand side judgment unit.

[0211] The above mode switching unit can be designed to automatically switch to the text input mode if pointer location information is not entered by the user for a certain period of time during the pointer location information input mode, or if input is received via the text input button.

[0212] The pointer position information input area display unit can be visually displayed regardless of the mode of the mode switching unit by applying a dye to a part of the text input button or the text input area so that the pointer input area can be recognized even during text input mode.

[0213] FIG. 8 is a first embodiment of a pointer position information input device that can be separated from a text input device.

[0214] The pointer position information input device (810) of the present invention is designed to be separated from the text input device (800) and can be combined with (801) or separated from the text input device (802).

[0215] At this time, the power connection part (820) included in the pointer position information input device can receive power from the power source of the text input device (800).

[0216] The pointer position information input device (801) includes at least one pointer position information input device (105a, 105b) and may further include a control unit and an optical filter (504).

[0217] The above-mentioned detachable pointer position information input device (810) can be combined to form a pointing position information input area on a plane parallel to the text input area (801), and can be positioned on the left (803) or right (804) of the text input device to form a pointing position information input area on the floor surface on which the text input device is placed.

[0218] At this time, the pointing position information input device and the power connection part (820) are designed to change dynamically in response to changes in the position of the pointing position information input device.

[0219] FIG. 9 is a second embodiment of a pointer position information input device that can be separated from a text input device.

[0220] The pointer location information input device (900) includes a built-in power supply.

[0221] When the pointer position information input device (900) is in the first position information input mode (902), the housing of the pointer position information input device (900) can be designed with a constant height and angle so that the pointer position information input area is parallel to the text input area of ​​the text input device.

[0222] When the pointer position information input device (900) is in the second position information input mode (904), the housing of the pointer position information input device (900) can be designed at a constant height and angle so that the pointer position information input area is parallel to the floor surface on which the pointer position information input device (900) is placed.

[0223] At this time, preferably, the height of the optical filter (504) in the first position information input mode is higher than the height of the optical filter (504) in the second position information input mode.

[0224] When the pointer position information input device (900) is in the third position information input mode (906), the housing of the pointer position information input device (900) can be designed at a constant height and angle so that the pointer position information input area is perpendicular to the floor surface on which the pointer position information input device (900) is placed.

[0225] The pointer position information input device (900) may include a position information input mode sensor unit so as to distinguish at least two modes among a first position information input mode, a second position information input mode, and a third position information input mode depending on the state in which it is placed on a floor surface.

[0226] The above location information input mode sensor unit may be composed of a gravity-based sensor, a sensor that detects a surface placed on the floor, or a switch.

[0227] FIG. 10 is a third embodiment of a pointer position information input device that can be separated from a text input device.

[0228] The pointer position information input device (1000) may have a housing (1001) that encloses at least two sides of the text input device so that the text input device (800) can be mounted.

[0229] The pointer position information input device (1000) is composed of a pointer position information input device (105a, 105b), a mode switching unit (106), a control unit (1001), a housing (1002), and an optical filter (907) (1010).

[0230] After the text input device (800) is mounted on the pointer position information input device (1000) (1020), the optical filter (907) is positioned higher than the text input device (800) so that a light source can be transmitted through the optical filter to form a pointing position information input area parallel to the top of the text input device (800) input area.

[0231] At least one surface (1003) covering the text input device of the housing (1002) can be treated with a surface material such as a mirror, transparent glass or plastic, or a black light absorbing material so that a light source emitted from the pointer position information input device (105) can be reflected, transmitted, or absorbed depending on the type of pointer position information input device.

[0232] FIGS. 8, FIGS. 9, and FIGS. 10 are embodiments of a pointing position information input device detachable from a text input device and have the following components.

[0233] It has a pointer location information input section that receives information related to the pointer location from the user.

[0234] The pointer location information input unit receives the user's pointing location information entered through the pointing location information input area configured by the pointer location information input device.

[0235] It has a pointer execution command receiving unit that receives a signal from a pointer execution command unit that receives a user command to perform at least one function at the location where the pointer is located.

[0236] The pointer execution command unit may be composed of a button or touch switch included in the pointer position information input unit, or may be composed of a control unit that switches to a pointer execution command when a predefined input is received among user inputs received from a text input device.

[0237] It has a mode switching command receiving unit that receives a signal from a mode switching unit that switches to a pointer position information input mode.

[0238] The above mode switching unit may be configured in a pointing position information input device, in a text input device, or as a separate device.

[0239] It has a power supply unit that transmits power to the above pointer location information input unit, the above pointer execution command receiving unit, and the above mode switching command receiving unit.

[0240] The above power supply unit may be a power supply unit having its own battery or a connector that receives power from an external source.

[0241] It includes a pointer location information transmission unit that transmits information related to the pointer location input by the pointer location information input unit to a digital device connected to the human interface device via wired or wireless connection.

[0242] The pointer position information input area of ​​the above pointer position information input unit is set at a predetermined height and angle so that it can be positioned parallel to the top of at least a part of the text input area of ​​a text input device composed of a plurality of physical buttons.

[0243] If the mode switching unit is provided separately from the text input button of the text input device, it can be fixed to at least one side of the text input device, and can recognize that user input has been received by the mode switching unit and transmit to the mode switching command receiving unit via wired or wireless means that the pointer position information input mode is the mode switching command receiving unit.

[0244] The above pointer position information input unit is composed of an optical emitter and a camera, and the optical signal received by the camera can be designed to pass through a light tunnel and then through an optical filter.

[0245] The above human interface may have a position state recognition unit that recognizes position state information regarding the direction of gravity of the human interface, position state information regarding the floor on which the human interface is placed, or position state information of the human interface through user input.

[0246] The position state consists of at least two types, and in the case of the first position state, it switches to the first pointer position information input mode, and in the case of the second position state, it switches to the second pointer position information input mode.

[0247] The pointer position information input area at the first position state is positioned so as to be parallel to at least a part of the text input area of ​​the text input device.

[0248] The pointer position information input area in the above second position state refers to a positioned parallel to the floor surface on which the pointing position information input device is placed.

[0249] When switching to the second pointer position information input mode, the upper surface of the pointing position information input device is positioned so that it becomes the bottom surface during the first pointer position information input mode, and the calculation of the vertical coordinate of the pointing position information input is the same, but the calculation of the horizontal coordinate is performed by changing the direction of increase or decrease.

[0250] The above pointer execution command unit can use the space bar among the text input buttons of the text input device, and can additionally use another button adjacent to the space bar as a pointer execution command unit.

[0251] The above power supply unit can receive power from the text input device.

[0252] The predefined height and angle of the pointer position input area of ​​the first position state can be defined by a controller that allows adjustment within a predefined range by the user.

[0253] The above controller can adjust the angle by adjusting the joining angle between at least one side of the housing of the pointing position information input device and an adjacent side.

[0254] The above controller can adjust the height by adjusting the height of at least one side of the housing of the pointing position information input device.

[0255] The above controller can adjust the height and angle of the optical module of the pointing position information input section of the pointing position information input device to adjust the above-defined height and angle.

[0256] FIG. 11 is a front view of a human interface device with a bottom-position type pointer position information input device applied.

[0257] The human interface device described above is characterized by a text input unit composed of a plurality of physical buttons, a pointer location information input unit that receives information related to a pointer location from a user, a pointer execution command receiving unit that receives a signal from a pointer execution command unit that receives a command from a user to perform at least one function at the location where the pointer is located, a mode switching command receiving unit that receives a signal from a mode switching unit that switches to a pointer location information input mode, a power supply unit that supplies power to the pointer location information input unit, the pointer execution command receiving unit, and the mode switching command receiving unit, a pointer location information transmitting unit that transmits information related to a pointer location input by the pointer location information input unit to a digital device connected to the human interface device via wired or wireless connection, and the pointer location information input area of ​​the pointer location information input unit is positioned parallel (321) to the top of at least a part of the text input area of ​​the text input unit composed of the plurality of physical buttons, and the pointer location information input unit is composed of at least two sensor modules, and the at least two sensor modules are positioned on the lower left (1102) and right (1103) of the human interface device.

[0258] The above pointer position information input unit is composed of an optical emitter and a camera, and the optical signal received by the camera passes through a light tunnel.

[0259] The above mode switching unit is characterized by being provided separately from the text input button of the text input device.

[0260] The mode switching unit is located to the left of the text input area of ​​the text input device and is characterized by recognizing that user input has been received by the mode switching unit and transmitting the pointer position information input mode to the mode switching command receiving unit.

[0261] The physical button is characterized by being composed of a button top that receives pressure from a user's finger and an elastic body that applies physical force to return the button top to its original position when the user's finger pressure is removed.

[0262] The above composite human interface device is characterized by having a reflector or absorber (1101) that reflects or absorbs a light source generated from the pointer position information input unit on the left, right, and top sides of the text input area, and not having at least a part of it on the bottom side.

[0263] The above reflector is used when the light source generated from the pointer position information input unit is infrared, and an absorber is used when it is an infrared laser.

[0264] At least two sensor modules (1102, 1103) of the pointer position information input section are positioned to include at least a portion of the lower part of the left outer area and the right outer area of ​​the text input area. That is, the left sensor is characterized by including at least a portion to the left of the control button of a standard Windows keyboard and extending further down below the control button, that is, toward the corner of the housing where there is no key button. By doing so, the sensor modules enable the configuration of a composite human interface device with a minimum volume to maximize the aesthetic effect of the composite human interface.

[0265] In addition, positioning the sensor near the vertex of the text input area (1110) so that the sensor is oriented diagonally across the text input area allows for the formation of a wider pointer position information input area than positioning the sensor in the corner area so that it is oriented horizontally and vertically across the text input area. Furthermore, by moving the position of the part of the pointer position information input area between the sensors where the location information detection accuracy is relatively low, the pointer position information input area at the top of the text input area can be maximized overall.

[0266] Additionally, the sensor can be positioned at the bottom of the space bar of a standard keyboard, narrower than the width of the keyboard (1120). The width between the sensors determines the width of the pointer position information input area, and thus, compared to positioning at the corner (1110), the area of ​​the pointer position information input area is reduced, but a relatively high pointer position information detex resolution is obtained.

[0267] By eliminating light source reflectors or absorbers between sensors and lowering the height of the housing, it prevents the thumb from getting caught on the housing when pressing the space bar on a standard keyboard.

[0268] FIG. 12 is an example of a mode switching unit integrated with a pointer execution command unit.

[0269] When performing input tasks that involve frequent switching between text input mode and pointer location information input mode, the number of times mode switching and pointer execution commands are entered increases.

[0270] For example, in the case of a right-handed person, when they want to input pointer position information while inputting text in text input mode, they must switch modes with their left or right hand, input the pointer position information, and then input the pointer real name command with their left hand.

[0271] Generally, while performing fast tasks, the user inputs text, pointer location information, and pointer execution commands while keeping their eyes on the monitor. However, if the mode switching unit and pointer execution command input unit are provided separately, frequent hand movements occur, and the user may not be able to find the exact location, resulting in inability to perform functions properly or making the work cumbersome, such as looking at the keyboard.

[0272] To solve this, for example, in the case of a right-handed person, if the hand is placed on the mode switching unit with the left hand after text input in text input mode, a mode switching command is generated and the input changes to pointer input mode. Then, while the hand is placed on the mode switching unit, if pointer position information is entered with the right hand and pressure is applied to the mode switching unit, the pointer execution command unit can receive the user's input.

[0273] Thus, the user can share the location of the mode switching section for mode switching and the location of the pointer execution command section for pointer execution commands.

[0274] As an embodiment for this purpose, the mode switching unit is composed of a touch switch capable of receiving touch input from a user's hand, and the pointer execution command unit is composed of a switch that responds to pressure such as a tact switch and is located below the mode switching unit.

[0275] At this time, the first pointer execution command unit (1104) and the second pointer execution command unit (1105) are connected to each other by a conductive material capable of recognizing touch from the user's hand or are commonly connected by a mode switching unit (1201), so that mode switching occurs in the same way whether the user touches the first pointer execution command unit or the second pointer execution command unit.

[0276] In this case, the mode switching operates as pointer position information input mode while the touch is active, and as text input mode when the touch is released.

[0277] Mode switching by touch can be configured with other switches that operate with pressure smaller than that for pointer execution commands, or with a sensor that can sense the position of the user's finger, in addition to touch.

[0278] At this time, the mode switching and pointer execution command section may be located in an area distinct from the text input area.

[0279] Preferably, for right-handed users, it is located in the outer left area of ​​the text input area.

[0280] If the mode switching section and the pointer execution command section are located outside the text input area, the possibility of the pointer position information input section being confused with the pointer position information input is eliminated, and the pointer position information input area can be expanded.

[0281] The composite human interface device of the present invention may be equipped with a second mode switching unit (1202). The second mode switching unit is a switch that operates like a toggle switch and switches between a text input mode and a pointer position information input mode whenever input is received from a user. Thus, even if the user is not touching the mode switching unit with their left hand, pointer position information can be input using only their right hand.

[0282] At this time, when the composite human interface device is in text mode by the second mode switching unit, if a mode switching command by touch is received, the composite human interface device of the present invention operates in pointer position information input mode. In addition, when the composite human interface device by the second mode switching unit is in pointer position information input mode, if a mode switching command by touch is received, the pointer position information input mode is maintained, but when the mode switching command by touch is released or text input is received by the text input unit, it switches to text input mode.

[0283] At this time, when switching to text input mode by text input, at least the first text input is ignored and the text input mode can be switched when at least two or more text inputs are received.

[0284] At this time, when at least two text inputs are received and the device switches to text input mode, the complex human interface device transmits the text input, including at least the first text that was ignored, to the digital device, and then transmits the newly entered text input information to the digital device.

[0285] FIG. 13 is an example utilizing the cover of a composite human interface device.

[0286] A composite human interface device requires at least 1 to 2 millimeters of space on the top of a text input device plane composed of a physical device to form a pointer position information input area, and a border for positioning an absorber or reflector for absorbing or reflecting an optical signal may be required at the corners of at least 3 sides surrounding the text input area.

[0287] At this time, there is a difference of at least 1 to 2 millimeters between the height of the edges of at least 3 sides and the height of the text input area plane, and a space of the shape of a rectangular prism is formed at the top of the text input area.

[0288] The composite human interface device of the present invention may further be provided with a multi-purpose cover (1322) to protect the text input area from external impact in the space of the actual rectangular type (1310).

[0289] The above multi-purpose cover (1322) is separated from the above composite human interface device (1320) and can be connected and separated by a magnet or physical structure.

[0290] The above multi-purpose cover (1322) may have a structure that folds several times. Preferably, it may have a structure that folds twice, and the width of at least one divided area of ​​the multi-purpose cover may be smaller than the width of another area (1341).

[0291] This allows the tilt of the complex human interface device to be further reduced when mounted on the bottom to adjust the tilt of the complex human interface device after the multi-purpose cover is folded.

[0292] When the multi-purpose cover is folded and mounted on the bottom surface of the composite human interface device, the part of the folded surface that comes into contact with the ground may be provided with an inclined surface (1342) so that the contact area with the ground can be increased.

[0293] The user can adjust the tilt of the composite human interface device as desired by the number of times the multi-purpose cover (1322) is folded.

[0294] The above multi-purpose cover can house a rechargeable battery (1323) inside the cover.

[0295] The electrode of the power source of the rechargeable battery (1323) may be located at the bottom of the multi-purpose cover and may be located in a part of the area protruding more than the part covering the text input area (1331), and when the multi-purpose cover covers the text input device (1310), it is connected to the electrode provided at the top of the composite human interface device.

[0296] In addition, when the multi-purpose cover is folded and mounted on the bottom to adjust the tilt of the composite human interface device, it can be connected to an electrode provided on the bottom surface of the composite human interface device.

[0297] The above composite human interface device is connected to an external power source to supply power to the rechargeable battery (1323) inside the multi-purpose cover or to charge the multi-purpose cover separately.

[0298] At this time, the bottom surface of the composite human interface device may be provided with a protruding border area where the electrode (1331) is located, an area (1332) covering a text input area that has a height difference from the electrode, and a groove into which a magnet, a physical coupling device, or a cover is inserted so that it can be attached and detached at an accurate position.

[0299] The edges of the above-mentioned multi-purpose cover are coated with a material capable of removing fine dust, oil stains, moisture, etc., so that foreign substances on the absorption plate, reflector, optical emitter, or front of the camera can be removed whenever the device is attached to or detached from the composite human interface device.

[0300] If the above multi-purpose cover covers the text input area, it can be detected to turn off the power of the complex human interface device.

[0301] When the above-mentioned multi-purpose cover is mounted on the bottom surface of the composite human interface device, the power of the composite human interface device can be turned on.

[0302] In addition, if there is no user input for a certain period of time after the power is turned on, the power can be cut off or switched to standby mode.

[0303] When a multi-purpose cover covers the text input area (1310), the composite human interface device (1321) has a shape of a rectangular prism in the form of a substantially thin plate, and when placed on the ground, it does not have an incline or is designed to be smaller than when the multi-purpose cover is mounted on the bottom, thereby maximizing aesthetic effects and increasing portability.

[0304] Meanwhile, when the multi-purpose cover is folded and mounted on the underside of a complex human interface device, it can achieve a tilt similar to a standard keyboard.

[0305] The above multi-purpose cover can be configured to be detachable, but it can be designed to fold by turning down from the top surface to the bottom surface of the composite human interface device by means of a hinge.

[0306] FIG. 14 is an example of a human interface device applied to a portable electronic device, such as a portable electronic device or a tablet personal computer.

[0307] The composite human interface device (1420) of the present invention can be used as an input device for a portable electronic device.

[0308] A portable electronic device equipped with a composite human interface device of the present invention may be designed such that a display unit, comprising a display panel (1411) and a frame (1410) supporting the display panel, is connected to the composite human interface device of the present invention by a hinge (1427) and is covered and opened.

[0309] At this time, the display unit is inserted into the substantial cuboid space formed by the text input area of ​​the human interface device of the present invention and the reflector or absorber plate (1424). Then, the thickness of the portable electronic device using the human interface device of the present invention can be minimized.

[0310] To this end, the display unit of the portable electronic device must be designed so that its width is at least twice the thickness of the reflector or absorber plate (1423, 1424) smaller than the width of the human interface device (1420) of the present invention.

[0311] In other words, the design must be such that a display unit can be placed in the space where the multi-purpose cover is placed in Fig. 13.

[0312] The display unit has a feature (1413) that allows both corners to be rounded or cut diagonally.

[0313] The pointer position information input device (1421, 1422) has the feature of being positioned toward the outer corner of the rounded or diagonally cut portion when the display unit is folded.

[0314] This is so that when the portable electronic device is folded, it can be folded so as to maintain a thin thickness without being obstructed by the pointer position information input device (1421, 1422).

[0315] At this time, the mode switching unit and the pointer execution command unit may be located outside the side text input area of ​​the human interface device as described above, or the mode switching unit may be located on the side outside the text input area and the pointer execution command unit may be located on at least one of the text input buttons, or both the mode switching unit and the pointer command execution unit may be located on at least one of the text input buttons.

[0316] In addition, it can be more preferably positioned outside the text input area (1425, 1426). At this time, it is preferable to form the mode switching unit and the pointer execution command unit as a single unit as shown in FIG. 12, but it is also possible to position them separately.

[0317] At this time, if the mode switching unit or pointer execution command unit is located outside the text input area, the pointer position information input device (1421, 1422) must be set to exclude the area where the mode switching unit or pointer execution command unit is located so that when a user places a finger to control the mode switching unit or pointer execution command unit, the pointer position information input area does not malfunction as the user inputting pointer position information.

[0318] To this end, the area covered by the optical signal generated from the pointer position information input device can be adjusted so that the optical signal does not reach the mode switching unit or the pointer execution command unit.

[0319] Alternatively, the camera may be configured to adjust the optical signal reception angle or ignore optical signals received from a corresponding direction so that the camera does not receive optical signals caused by reflection, interference, or blocking between the user's finger located in the mode switching unit or pointer execution command unit and the optical signal.

[0320] The above portable electronic device is designed to have an absorbing plate or a reflecting plate at least three corners to absorb or reflect a light source generated from the pointer position information input device.

[0321] At this time, two sides are located on the side of the human interface device (1423, 1424), and another side can be positioned in a certain area (1412) of the corner of the display unit so that a light source generated by the pointer position information input device (1421, 1422) is sufficiently reflected or absorbed when the display unit is open within a certain angle on the side where the display unit is in contact with the human interface device.

[0322] In FIG. 14, the display unit can be configured as a flexible display unit and can be bent to cover the text input area of ​​the composite human interface device and wrapped around and fixed to the bottom surface of the composite human interface device.

[0323] In addition, the display unit in FIG. 14 can be replaced with the multi-purpose cover described in FIG. 13, and an absorbent or reflective body can be positioned at the corner portion of the multi-purpose cover that is joined to the composite human interface device, and can also be folded back by a hinge to be used for adjusting the height of the composite human interface device.

[0324] FIGS. 1 to 14 illustrate an example of a composite human interface device to be described in the present invention, and the type of text input device, pointing position information input device, and the technology used include those that can be modified or replaced by those skilled in the art without changing the basic purpose.

Claims

Claim 1 A portable electronic device system comprises a rechargeable device, an input device for receiving text input from a user, and a multi-purpose cover that is coupled to and separated from the input device by a magnet or physical structure and is coupled to the input device by the magnet or physical structure and is rotatable relative to the input device; the input device comprises a text input area for receiving the text input, a plurality of keycaps and electrodes located in the text input area; the multi-purpose cover is composed of at least two areas; when the input device and the multi-purpose cover are coupled by the magnet or physical structure, a first area among the at least two areas is coupled so as to be rotatable relative to the input device, and a second area among the at least two areas is coupled so as to be rotatable relative to the first area; the two areas have different sizes; the multi-purpose cover is electrically connected to the rechargeable device in at least one of the at least two areas; the multi-purpose cover is equipped with an electrode, and the electrode provided on the multi-purpose cover is connected to an electrode provided on the input device, thereby rechargeable A portable electronic device system characterized by transmitting power from the device to the input device, wherein the multi-purpose cover can rotate between a position where the inner surface of the multi-purpose cover covers a plurality of keycaps of the text input area and a position where the inner surface of the multi-purpose cover does not cover a plurality of keycaps of the text input area, and wherein when the multi-purpose cover rotates relative to the input device, a first rotation axis generated at the connection part between the multi-purpose cover and the input device is parallel to a second rotation axis generated at the connection part between the second area and the first area when the second area rotates relative to the first area. Claim 2 A portable electronic device system according to claim 1, characterized in that when the input device is connected to an external power source, power is transferred from the input device to the rechargeable device. Claim 3 A portable electronic device system according to claim 1, wherein the multi-purpose cover includes a third region, and the second region is capable of rotational movement relative to the third region. Claim 4 A portable electronic device system according to claim 1, characterized in that the multi-purpose cover is provided with a foreign substance removal material on at least a portion of its surface. Claim 5 A portable electronic device system according to claim 3, characterized in that the first rotation axis occurring at the connection part between the multi-purpose cover and the input device is parallel to the third rotation axis occurring at the connection part between the second region and the third region when the second region rotates relative to the third region. Claim 6 A portable electronic device system according to claim 1, characterized in that the area of ​​the first region is formed to be smaller than the area of ​​the second region. Claim 7 A portable electronic device system according to claim 1, characterized in that one end of the first region is rotatably coupled to the input device, and the other end of the first region is rotatably coupled adjacent to one end of the second region. Claim 8 A portable electronic device system according to claim 1, wherein the multi-purpose cover comprises at least one electrical connection member, and the at least one electrical connection member is electrically connected to the rechargeable device. Claim 9 A portable electronic device system according to claim 1, wherein the rechargeable device comprises a display unit. Claim 10 A portable electronic device system according to claim 9, characterized in that the width of the display unit is smaller than the width of the input device. Claim 11 A portable electronic device system comprises an input device for receiving text input from a user and a multi-purpose cover, wherein the multi-purpose cover comprises a rechargeable device and at least two flat plates and is capable of being coupled to and separated from the input device, wherein the input device comprises a text input area for receiving the text input and a plurality of keycaps located in the text input area, wherein the input device comprises an electrode and the electrode transmits power from the rechargeable device to the input device, wherein the at least two flat plates of the multi-purpose cover comprise a first flat plate and a second flat plate, wherein the first flat plate and the second flat plate have different sizes, and at least one of the first flat plate and the second flat plate accommodates the rechargeable device, wherein the multi-purpose cover is rotatable relative to the input device, and the second flat plate is coupled in a manner rotatable relative to the first flat plate, and between a position in which the inner surface of the multi-purpose cover covers a plurality of keycaps of the text input area and a position in which the inner surface of the multi-purpose cover does not cover a plurality of keycaps of the text input area A portable electronic device system characterized by being rotatable, wherein when the multi-purpose cover is rotated relative to the input device, a first rotation axis occurring between the multi-purpose cover and the input device is parallel to a second rotation axis occurring between the second plate and the first plate when the second plate is rotated relative to the first plate. Claim 12 A portable electronic device system according to claim 11, characterized in that when the input device is connected to an external power source, power is transferred from the input device to the rechargeable device. Claim 13 A portable electronic device system according to claim 11, wherein the multi-purpose cover includes a third flat plate, and the second flat plate is capable of rotational movement relative to the third flat plate. Claim 14 A portable electronic device system according to claim 13, wherein the first rotation axis occurring at the connection portion between the multi-purpose cover and the input device is parallel to the third rotation axis occurring between the second plate and the third plate when the second plate rotates relative to the third plate. Claim 15 A portable electronic device system according to claim 11, characterized in that the multi-purpose cover is provided with a foreign substance removal material on at least a portion of its surface. Claim 16 A portable electronic device system according to claim 11, characterized in that the area of ​​the first flat plate is formed to be smaller than the area of ​​the second flat plate. Claim 17 A portable electronic device system according to claim 11, characterized in that one end of the first plate is connected to one end of the second plate in a rotatable manner adjacent to it. Claim 18 A portable electronic device system according to claim 11, wherein the rechargeable device comprises at least one electrode, and the at least one electrode is connected to an electrode of the input device to transmit power from the rechargeable device to the input device. Claim 19 A portable electronic device system according to claim 11, wherein the rechargeable device comprises a display unit. Claim 20 A portable electronic device system according to claim 19, characterized in that the width of the display unit is smaller than the width of the input device.

Images