Mouse input capabilities for pen-based writing, reading, or pointing devices

By integrating optical mouse unit and pressure sensing element in the stylus, the problem of functional limitations of the existing stylus is solved, and seamless switching between the stylus and computer mouse operations is realized, improving the user experience.

CN114730222BActive Publication Date: 2025-02-14MICROSOFT TECHNOLOGY LICENSING LLC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202080079311.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-11-15
Filing Date
2020-10-30
Publication Date
2025-02-14
Estimated Expiration
2040-10-30

AI Technical Summary

Technical Problem

Existing stylus have functional limitations during use, such as hindering user vision, restricted cursor control and the need for additional equipment such as a laptop touchpad or wireless mouse.

Method used

A stylus is designed to integrate an optical mouse unit, a surface detection area and a pressure sensing element, which can provide input on the touch screen and switch operation modes through the orientation sensing device, thereby achieving operation similar to a computer mouse.

Benefits of technology

Through the integrated optical mouse unit, the stylus can perform mouse operations conveniently and intuitively, reducing dependence on additional devices and improving user experience and operation flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114730222B_ABST
    Figure CN114730222B_ABST
Patent Text Reader

Abstract

An apparatus and method for providing structure and functionality, respectively, to a stylus handheld writing, reading or pointing device to enable the device to be used to perform operations similar to a computer mouse for a computing device. The structure includes an optical sensor, a pressure sensing element for sensing pressure to detect a mouse click action, and an orientation sensor for switching the stylus from a stylus operating mode to a mouse operating mode.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] BACKGROUND OF THE INVENTION It is known in the art that a pen or stylus is used with a touch-enabled computing device (i.e., a host device). The writing tip of the stylus interacts with the touch screen of the host device. It is detected by the digitizer sensor when an electrostatic or capacitive coupling is established between the writing tip and a portion of the electrode junction matrix of the digitizer sensor. The coupling is caused by the proximity of the writing tip to the digitizer sensor. The position of the writing tip on the screen is related to the virtual information depicted on the touch screen.

[0002] The functionality of known styluses is limited. Sometimes, placing the stylus on the touch screen may obstruct the user's view. In addition, cursor control based on moving the writing tip on the touch screen may be limited due to the size of the screen and the resolution of the digitizer sensor. Often, users prefer to carry their wireless mouse with them rather than using a laptop touchpad. Summary of the invention

[0003] This summary is provided to introduce a selection of concepts in a simplified form, which are further described in the following detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. The claimed subject matter is also not limited to implementations that solve any or all of the disadvantages noted herein.

[0004] In some embodiments, the present disclosure relates to a stylus, comprising: a writing tip configured to provide input to a host device by touching and hovering over a touch screen of the host device; and a device for providing mouse-type input functionality to a pen-type device, the device comprising an integrated optical mouse unit for surface movement detection, a surface detection area, and a pressure sensing element for sensing pressure or force applied to the surface detection area to detect a mouse click action; wherein the device is configured to switch the stylus from a stylus operation mode to a mouse operation mode in response to an output from an orientation sensing device; and wherein the optical mouse unit is arranged at a rear end portion or a cap of the stylus. Therefore, the stylus can be used to perform operations similar to a computer mouse. Since at least a portion of the optical mouse unit is movable and acts as a button for mouse click input, no further mouse button is required on the surface of the stylus. In addition, the use of separate buttons on the stylus can cause inconvenience to the user. Pressing the entire stylus against the surface of the lower plane by the optical mouse unit allows the mouse function in the stylus to be used very conveniently and intuitively.

[0005] Throughout the present disclosure, a pen-type device may be any handheld pen-shaped writing, reading and / or pointing device (such as an active or passive stylus, ink pen, disc scanner, laser pointer, etc.).

[0006] According to another aspect, a method of providing mouse-type input functionality to a stylus includes providing input to a host device based on a writing pen tip touching and hovering over a touch screen of the host device; sensing surface movement at a surface detection area of ​​the stylus; sensing pressure or force applied to the surface detection area; triggering a mouse click function in response to the pressure or force sensing; and switching the stylus from a stylus operating mode to a mouse operating mode in response to output from an orientation sensing device.

[0007] Unless otherwise defined, all technical and / or scientific terms used herein have the same meaning as those commonly known to those of ordinary skill in the art. Although methods and materials similar or equivalent to those described herein can be used to practice or test embodiments of the present disclosure, exemplary methods and / or materials are described below. In addition, each material, method, and example is illustrative only and is not intended to be necessarily limiting. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] To assist in understanding the present disclosure and to show how these embodiments may be implemented, reference is made to the accompanying drawings, by way of example only, in which:

[0009] Figure 1 is a schematic block diagram of an example stylus with integrated mouse functionality,

[0010] Figure 2 is a simplified flow chart of an example method for operating a pen-type device having an optical mouse unit,

[0011] Figure 3A and 3B is a schematic diagram indicating an example optical system of a mouse unit,

[0012] Figure 4 is a schematic block diagram of an example stylus with integrated mouse functionality,

[0013] Figure 5 is a schematic block diagram of an example pen cap with an integrated optical mouse unit,

[0014] Figure 6 is a schematic block diagram of an example pen cap with an integrated optical mouse unit and a stylus eraser unit,

[0015] Figure 7 is a schematic block diagram of an example pen cap for a pen-type device with integrated mouse functionality, and

[0016] Figure 8 is a schematic block diagram of an example pen tip unit for a stylus with integrated mouse functionality. DETAILED DESCRIPTION

[0017] The present disclosure relates to the implementation of computer mouse functionality in a pen-type device, such as a stylus for a touch-sensitive display, an ink pen, a pencil, a pen-shaped scanner device, a laser pointer, and the like.

[0018] Handheld stylus peripheral devices ("styluses") used with electronic devices (including smart phones, tablets, watches, desktop computers, gaming devices, wearable devices, televisions, video conferencing systems, etc.) can be used to transmit user input to an electronic device ("host device"). Some host devices include a display with a built-in digitizer for sensing signals transmitted from a stylus (e.g., an "active stylus"). In these electronic devices, a user interacts with the digitizer system by positioning and moving the stylus on a sensing surface of the system (e.g., a tablet and / or a touch screen). The position of the stylus relative to the sensing surface is tracked by the digitizer system and interpreted as a user command. In some techniques, the position of the stylus can be determined based on the detection of capacitive coupling between electrodes of the stylus and one or more electrodes of the digitizer. For example, a device display may include a digitizer having multiple X and Y oriented conductors or resistive films to receive signals transmitted from electrodes of an active pen. In some techniques, in order to accurately identify the tip position, the transmitting electrodes are physically positioned within the writing tip of the stylus.

[0019] Styluses can be classified as passive or active styluses. Passive styluses utilize a sensing method based on changes in capacitive coupling between sensor electrodes deposited on a touch screen sensor and an input object (such as a rubber tip stylus or a finger). In contrast, an active stylus drives a unique modulated signal between the tip of the stylus and a grid or array of electrodes of a touch screen sensor (e.g., a digitizer system) and utilizes a sensing method based on changes in capacitive coupling between sensor electrodes. The digitizer system detects at least one position of the stylus based on the transmitted signal, and the detected position provides input to a host device (e.g., a computing device) associated with the digitizer system. The detected position can then be interpreted as a user command. Typically, the digitizer system is integrated with a display screen, for example to form a touch-sensitive display device.

[0020] Using a laptop touchpad to control a cursor on a display screen may be neither intuitive nor user-friendly. Therefore, users often prefer to carry their wireless mouse in their pocket to meetings, even though they may have a stylus that comes with their laptop device. In some embodiments, the mouse functionality is incorporated as part of an active or passive stylus that is both easy to manufacture and convenient for users to use as a "two-in-one" product. It is much more intuitive than a touchpad and much easier to use. No additional equipment is required, and the pen-shaped stylus or another pen-shaped device may include the ability to provide input similar to a computer mouse when the stylus is positioned relative to a surface so that a portion of the outer surface of the stylus housing is close to the surface. The stylus may include an optical mouse unit (with an optical emitter and detector on one side of the stylus to allow position tracking) and a communication unit for wireless communication with a host device.

[0021] Figure 1 is a schematic block diagram of an example stylus with integrated mouse functionality. Figure 1 A simplified block diagram of shows an example optical mouse unit (MU) 130 with an optical sensor, which may be enhanced by optional additional buttons 131 and optional scrolling functionality. In each example, the stylus may optionally include a capacitive sensing strip 134 integrated along the length of the housing of the stylus, which can be operated by a user's finger to provide scrolling commands by sliding the finger along the capacitive sensing strip 134. Optionally, an eraser unit (EU) 140 may be provided for erasing digital ink and highlights on a page displayed on the touch screen of the host device, for example by dragging an eraser portion of the stylus across the ink to be erased. As another option, the stylus may include an orientation sensing device 170 (e.g., a gyroscope) for detecting the orientation of the stylus in two or three-dimensional space.

[0022] The mouse unit 130 with the optical sensor may be integrated on a portion of the stylus housing that is tapered or angled toward the elongated cylindrical middle portion of the stylus. Optionally, in this orientation, the optical mouse unit 130 may be operated when the user holds the stylus in a typical writing position. Alternatively, the optical mouse unit 130 may be integrated along a portion of the housing that is not tapered and is only operable when the stylus is laid flat on a surface.

[0023] The stylus may optionally include one or two user-operated buttons 131 that may provide, for example, right-click and left-click functionality. The optical mouse unit 130, optional buttons 131, and optional sensing strip 134 may be controlled by a control unit 110 (e.g., implemented in a system on a chip (SOC), an application specific integrated circuit (ASIC), a microprocessing unit, etc.). A wireless communication unit (WU) 150 may be used to transmit control information to a computing device (host device) based on commands sensed with the optical mouse unit 130, optional buttons 131, and optional sensing strip 134.

[0024] Furthermore, the operations of the optical mouse unit 130, the button 131, the strap 134, and the wireless communication unit 150 may be powered by a stylus pen power supply (PS) 160. Optionally, the power supply 160 may be a rechargeable battery.

[0025] In various embodiments, the stylus is configured to provide input to a host device (not shown) based on the writing tip 136 touching and hovering over the touch screen of the host device, and is also configured to provide input to the host device based on the user actuating the pressure sensor (button sensor) 120 via the optical mouse unit (MU) 130 integrated on the stylus housing. The additional input provided by the pressure sensor 120 improves the functionality of the stylus when operating in a mouse operating mode to control a cursor displayed on a touch screen (mouse-type input function), and may also provide additional functionality.

[0026] The planar surface area on the stylus can surround the optical mouse unit 130, which can also be used as a click button (e.g., a double-click mouse button), which means that when the user uses the mouse unit 130 to reach the desired location, he / she does not have to double-click a separate button. Instead, the double-click or single-click operation can be achieved by applying force or pressure on the clickable optical surface of the mouse unit 130 via the entire stylus, and the clickable optical surface will be designed as a depressible surface with button detectability. The pressure or force applied to the depressible surface of the mouse unit 130 is detected by the pressure sensor 120. In each example, the optical mouse unit 130 can be implemented by miniaturizing the mechanical, optical and / or electrical core components of a conventional computer mouse and combining them with the existing mechanical and / or electrical components of the stylus. For example, most of the current hardware components of the stylus can remain unchanged, while some components can be reused in different ways so that the stylus can act as a mouse. What can be reused may be at least one of the power supply unit ((rechargeable) battery) 160, the wireless communication unit 150, the current stylus button 131, the eraser unit 140, and various stylus sensors (e.g., a tip sensor, a ring sensor, a pressure sensor). Newly added elements may be at least one of the optical mouse unit 130 having a light emitting element (e.g., an LED) and a light detecting element (e.g., a phototube), a mouse button sensor (pressure sensor), and contact elements for embodiments in which the optical mouse unit 130 is disposed in a detachable part (e.g., a tip unit or a pen cap) of a stylus or other pen-type device.

[0027] In various examples, the entire optical mouse unit 130 can be arranged in the small hole and can include a light-emitting element (e.g., a light-emitting diode (LED)) that emits, for example, blue light or red light. The surface area of ​​the optical mouse unit 130 can be tilted at a predetermined angle at the front end or rear end of the stylus or its cap or pen tip unit, and can be surrounded by a thin plastic button ring that contacts the stylus surface on one side and contacts the cap or stylus body on the other side. The ring button can be at a very small height (e.g., <1 mm) above the surface of the cap or stylus to act as a click button. The button ring can act as a click button when the entire cap or stylus is pressed against the button ring and is connected to the pressure sensor 120. Therefore, no more buttons are required to incorporate the mouse function into the stylus or other pen-type device.

[0028] In various examples, pressure sensor 120 may act as a primary button sensor for the stylus that detects other buttons in a stylus mode of operation or a ring button in a mouse mode of operation.

[0029] In various examples, the ring button of the optical mouse unit 130 may have a mechanical-acoustic click feedback, similar to a conventional click button on a conventional mouse device or other input device.

[0030] In various examples, the control unit 110 of the stylus may decode activation of a mouse click button at the optical mouse unit 130 according to at least one of the following rules:

[0031] 1 quick double click / press of the ring button = double click of the left mouse button;

[0032] 1 short (quick) click / press of the ring button = left mouse button click;

[0033] 1 long click / press of the ring button = right click of the mouse;

[0034] Click and move the pen simultaneously = drag operation.

[0035] In various examples, the entire optical mouse unit 130 may be configured as a movable button, or the button may be disposed close to the optical mouse unit 130 so that the button may be activated by a user's finger pressing a stylus toward a lower surface via the optical mouse unit 130 .

[0036] In other examples, an advanced stylus or ordinary pen or pen-shaped scanner device may have a special pen cap (such as an ordinary ink pen) that can be modified to include an optical mouse unit 130 and optionally also an eraser unit 140, as described below with reference to Figures 5 to 7 Such modified pen caps may be sold separately as add-ons to styluses, pens, or other pen-shaped writing, reading, or pointing devices.

[0037] According to some example embodiments, a user may seamlessly switch between using the writing tip 136 on a touch screen to provide input via an electrostatic channel and using the optical sensor of the optical mouse unit 130 on another surface to provide mouse-type input via an alternate wireless channel implemented by the wireless communication unit (WU) 150. In various examples, if the mouse unit 130 is implemented at the tail of the stylus, the stylus may automatically switch to mouse mode, for example, when it is flipped upside down from the tip side to the tail side. If the mouse unit 130 is implemented in a cap of the stylus, the stylus may automatically switch to mouse mode, for example, when a connection portion at the top of the cap is connected to a contact ring or other contact portion of the stylus body. If the mouse unit 130 is implemented as a removable tip head unit of the stylus, the stylus may automatically switch to mouse mode, for example, when a sufficient tip is connected to the stylus body.

[0038] The control unit 110 in the stylus pen can receive various control information from button sensors, writing tip 136, mouse unit 130, etc. This control information can be transmitted through an electrostatic channel when the writing tip 136 of the stylus pen is on the touch screen in the stylus pen operation mode, and can be transmitted through a wireless channel via the wireless communication unit 150 when the stylus pen is removed from the touch screen and operated in the mouse operation mode.

[0039] Reference now Figure 2 , which shows a simplified flow chart of an example method for operating a pen-type device having an optical mouse unit. An optical mouse unit (e.g. Figure 1 The mouse unit 130 in the embodiment may be controlled by a controller (e.g. Figure 1 The optical mouse unit may be selectively activated by the control unit 110 in the controller, and the wake-up command of the controller may initiate activation of the optical mouse unit (block S210). When the pen-type device is paired with the touch screen of the host device, the optical mouse unit may remain in sleep mode and may be activated, for example, based on sensing a pairing interruption, activation of a mouse button or a mouse selection button, a change in the orientation of the pen-type device, etc.

[0040] The pressure of the pen-type device on the surface of the optical mouse unit can be sensed by the pressure sensor (block S220), and based on this, a corresponding button click command can be provided to the controller (block S230). Based on the sensing data of the optical mouse unit, an XY displacement command is determined and provided to the controller (block S240). The button click command and the XY displacement command can then be transmitted to the host device via wired or wireless transmission (block S250). Finally, the controller can selectively turn off the mouse tracking of the optical sensor (block S260).

[0041] Figure 2 The operation can be repeated continuously or intermittently. In some implementations, the command of block S250 can be transmitted to the host device via Bluetooth, Wi-Fi, NFC, etc.

[0042] Figure 3A and 3B is a schematic diagram indicating an example optical system of an optical mouse unit that may be used in some embodiments. More specifically, Figure 3A shows a conventional optical system for detecting scattered light, while Figure 3B A specular optical system is shown, in which specular reflection (also called regular reflection or mirror-like reflection) of a wave (such as light) from a surface is applied.

[0043] In various embodiments, the optical mouse unit may include a light emitting diode (LED) that emits light through an optical window. The light emitted by the LED may be reflected or scattered from a surface (e.g., a desktop top) through the optical window and captured by an image sensor. Optionally, the image sensor may be associated with the optical element. A processor (e.g., Figure 1 The control unit 110 or Figure 1 A separate processor provided in the optical mouse unit 130) can compare a series of images to detect movement of the optical window.

[0044] In some example embodiments, the optical mouse unit may include a first image sensor positioned and oriented to capture images when the stylus is held in a writing position, and may include a second image sensor positioned and oriented to capture images when the stylus is laid flat on a surface. The processor may detect images captured from each image sensor and select data from the image sensor that provides the best results.

[0045] Optionally, the processor may select one of the two image sensors to actuate for tracking based on input received from orientation sensing device 170. In various embodiments, orientation sensing device 170 may also be used to switch between a stylus mode of operation and a mouse mode of operation based on the orientation of the stylus.

[0046] exist Figure 3A and 3B In an optical system of the present invention, an optical sensor can sense movement of a stylus or other pen-type device along a surface (other than a touch screen of a host device, such as a surface on a table top or a (laptop) computer). In some example embodiments, the optical sensor can be oriented and configured to track a user's hand moving the stylus when the stylus is placed horizontally on the surface or when the stylus is held in a writing position. The optical sensor can operate in the same or similar manner as a conventional optical mouse, and can detect two-dimensional movement on a surface and transmit displacement data as input to the host device via a wired or wireless communication channel based on the sensed movement. The input to the host device can control the position of a cursor on the touch screen of the host device without direct interaction between the stylus and the touch screen, and can also be used to provide electronic inking. In some example embodiments, inking using the optical sensor of the mouse unit can be performed at a higher resolution than inking based on an electrostatic interface with the touch screen.

[0047] Communication with the host device (e.g. via Figure 1 The wireless communication unit 150 may be implemented, for example, through a wireless connection (eg, Bluetooth Low Energy (BLE), Near Field Communication (NFC), other Radio Frequency (RF) or wireless communications).

[0048] Figure 4is a schematic block diagram of an example stylus 10 having a writing tip 136 for a stylus mode of operation and an integrated optical mouse unit 130 with a mouse click pressure sensor 120 for use in a mouse mode of operation. The optical mouse unit 130 may be located at the rear of the stylus 10, opposite the tip portion at the front of the stylus 10. Note that Figure 4 Only those components of the stylus 10 that are useful for explaining the various embodiments are shown in FIG. Other components are omitted for reasons of simplicity.

[0049] The stylus 10 also includes a control unit (CU) 110, a wireless communication unit (WU) 150, and the wireless communication unit (WU) 150 is configured to communicate with a host device (not shown) via Bluetooth, Wi-Fi, near field communication (NFC), etc. The wireless communication unit 150 may include a receiver for receiving communication commands, pairing requests, etc. from a wireless communication unit at the host device. The stylus 10 also includes a power supply unit (PS) 160, which may include a battery for powering various components of the stylus 10 (such as the wireless communication unit 150, the control unit 110, and the optical mouse unit 130). The battery may be rechargeable, replaceable, disposable, etc.

[0050] In some examples, stylus 10 may additionally or alternatively be wired to host device 20 via, for example, a universal serial bus (USB) connection and communicate with the host device via this connection.

[0051] Note that combined Figure 1 All examples, options and embodiments described for similar components shown in also apply to Figure 4 Components and follow-up Figures 5 to 8 components.

[0052] like Figure 4 As shown, the optical mouse unit 130 is integrated in the inclined portion of the surface of the housing of the stylus pen 10 at a predetermined angle α relative to the non-inclined cylindrical side of the stylus pen 10. The predetermined angle α may be selected so that when the user holds the stylus pen in a normal writing manner with the rear end facing downward (e.g., Figure 4The user's hand holding the pen device in the lower right part is schematically shown) so that the clickable upper surface area 132 of the optical mouse unit 130 is arranged parallel to the surface of the underlying plane. It is thus ensured that the mouse function of the stylus can be used in a convenient and intuitive manner by holding the stylus 10 as a normal writing pen in the opposite orientation. The mouse click can then be simply activated by pressing the movable optical mouse unit 130 with its integrated click button towards the underlying surface. The pressure is then detected by the pressure sensor 120 and a corresponding click command is signaled to the control unit 110. In addition, XY displacement data or commands for controlling a cursor on a display of the host device are signaled to the control unit 110 via a corresponding signaling connection.

[0053] In various examples, more mouse buttons and strip electrodes for mouse scrolling functionality may be provided on the stylus.

[0054] In other embodiments, the removable optical mouse unit 130 with or without an integrated click button function may be integrated into a detachable component (e.g., a pen cap or a pen tip unit) of a stylus or any other pen-type device. The detachable component may include a mounting mechanism (e.g., an insertion, assembly, fastening, engagement, and / or snap mechanism) for detachably mounting or connecting the detachable component to a pen-type device to provide a convenient and intuitive mouse input function.

[0055] Figure 5 is a schematic block diagram of an example pen cap 50 with an integrated optical mouse unit 130 for an active stylus (not shown). The pen cap 50 can be removably mounted to the front and / or rear end of the stylus and can be electrically connected to the internal components of the stylus (e.g., a control unit, a power supply unit, a wireless communication unit) via a connection portion 52 (e.g., a conductive ring or patch, etc.). The connection portion 52 may include a mounting mechanism for removable mounting and may include several separate elements for respectively and differently connecting to different internal components of the stylus. The stylus may already include a battery / charging mechanism, a communication unit, a controller, a pressure sensor (possibly for additional or all mouse button controls), which can be shared with the mouse function in the mouse operation mode. In various embodiments, the optical mouse unit 130 can be removable and can include integrated button click functionality. Then, an additional pressure sensor 120 for detecting mouse clicks can be provided. In alternative embodiments, buttons on the stylus housing can be shared for mouse click operations, or pressure sensors in the stylus can be shared for sensing mouse clicks via the optical mouse unit 130.

[0056] and Figure 4Similarly, the optical mouse unit 130 is integrated into the inclined portion of the surface of the housing of the pen cap 50 at a predetermined angle α relative to the non-inclined cylindrical side of the pen cap 50. The predetermined angle α can be selected so that when the user holds the stylus with the attached pen cap 50 in a normal writing manner, the clickable upper surface area 132 of the optical mouse unit 130 is arranged parallel to the surface of the underlying plane.

[0057] Thus, the convenient and intuitive mouse functionality can be incorporated into the cap of the stylus without the need for an additional mouse click button.

[0058] Figure 6 is a schematic block diagram of an example pen cap 52 having an integrated optical mouse unit 130 and an additional stylus eraser unit 140 .

[0059] Figure 6 The embodiment corresponds to Figure 5 In addition, an additional eraser unit 140 is provided. Figure 5 The above description of the pen cap 50 also applies to Figure 6 The pen cap 52.

[0060] The additional eraser unit 140 is also connected to the stylus pen via the connection portion 52. When the stylus pen is set to the eraser mode, the eraser unit 140 can be brought close to the touch screen of the host device to perform an erasing operation.

[0061] In embodiments where the eraser unit 140 is positioned opposite the optical mouse unit 130, selection between the eraser mode and the mouse operation mode may be triggered in response to the output of the orientation detection device 170 (eg, a gyroscope).

[0062] Thus, the convenient and intuitive mouse functionality is combined with the additional stylus eraser functionality in the cap of the stylus without the need for an additional mouse click button.

[0063] In other embodiments, the mouse functionality may be incorporated into the cap of a conventional ink pen.

[0064] Figure 7 is a schematic block diagram of an example pen cap 60 for a conventional ink pen with integrated mouse functionality.

[0065] and Figure 5 and Figure 6 The corresponding pen caps 50 and 52 are opposite, Figure 7The pen cap 60 in the embodiment is configured to be detachably mounted to a conventional pen-type device that does not have a typical stylus component that can be shared for implementing a mouse function. As a result, components such as a control unit (CU) 110, a wireless communication unit (WU) 150, and a power supply unit (PS) 160 are incorporated in the pen cap 60 together with an optical mouse unit 130 with or without an integrated mouse click function and a pressure sensor 120. Figure 5 The various components of the pen cap 50 (excluding the connecting portion 52) and Figure 1 and Figure 4 The description of the individual components also applies to Figure 7 In various examples, the angle of the surface of the pen cap 60 can be used to obtain a stable and flat detection area at the outer surface of the optical mouse unit 130 at a desired predetermined angle α for convenient and intuitive pen use.

[0066] In other embodiments, the optical mouse unit 130 may be a non-removable unit without an integrated click button function. Then, at least one separate mouse click button may be provided on the surface of the pen cap 60, as well as an optional strip electrode for implementing a mouse scroll function.

[0067] Thus, a convenient and intuitive mouse function may be incorporated into the cap of a conventional ink pen or other non-electric pen-type device. In other embodiments, the optical mouse unit 130 may be incorporated at an inclined or tapered surface of a tip unit of the stylus.

[0068] Figure 8 is a schematic block diagram of an example pen tip unit 70 for a stylus (not shown) with integrated mouse functionality.

[0069] In various examples, the optical mouse unit 130 is disposed in a replaceable pen tip unit 70 , which is arranged so that when a user holds the stylus in a typical writing manner, his / her fingers contact the surface of the stylus behind the pen tip unit 70 .

[0070] The nib unit 70 (which may include a writing nib (not shown)) may be removably mounted to the front end of the stylus and electrically connected to the internal components of the stylus (e.g., control unit, power supply unit, wireless communication unit) via a connection portion 72 (e.g., a conductive ring or patch, etc.). The connection portion 72 may include a mounting mechanism for removable mounting and may include several separate elements for respectively and differently connecting to different internal components of the stylus. The stylus already includes a battery / charging mechanism, a communication unit, a controller, a pressure sensor (possibly for additional or all mouse button controls), which may be shared with the mouse functionality in the mouse operation mode.

[0071] In various embodiments, the optical mouse unit 130 may be removable and may include integrated button click functionality. An additional pressure sensor 120 may then be provided for detecting mouse clicks. In alternative embodiments, a button on the stylus housing may be shared for mouse click operations, or a pressure sensor in the stylus may be shared for sensing mouse clicks via the optical mouse unit 130.

[0072] As another option in other embodiments, the optical mouse unit 130 may be fixedly incorporated into the pen tip unit 70, and the pen tip unit 70 may be movably connected to the stylus. Then, when the user presses the upper surface area of ​​the optical mouse unit 130 toward the surface below, the mouse click activation may be detected by sensing the pressure applied to the entire pen tip unit 70 toward the stylus housing (e.g., at the connection portion 72).

[0073] and Figures 4 to 7 Similarly, the optical mouse unit 130 is incorporated into the inclined portion of the surface of the housing of the pen tip unit 70 at a predetermined angle α relative to the non-inclined cylindrical side of the stylus housing. The predetermined angle α may be selected so that when the user holds the stylus with the attached pen tip unit 70 in a normal writing manner, the upper surface area 132 of the optical mouse unit 130 is arranged parallel to the surface of the underlying plane.

[0074] In other embodiments, the proposed conical stylus pen tip unit 70 with a predetermined angle α to the optical mouse unit 130 may replace a conventional pen tip unit with a writing tip and a conventional tilt angle. Alternatively, in an alternative embodiment, a combined pen tip unit 70 with a writing tip and an optical mouse unit 130 may be configured so that the entire stylus with the attached pen tip unit 70 may be rotated to use the mouse unit instead of a conventional stylus pen tip. More specifically, when the stylus is used in a mouse operation mode, the stylus may be rotated so that the upper surface area 132 of the mouse unit 130 faces the lower surface.

[0075] Thus, the convenient and intuitive mouse functionality can be incorporated into the tip unit of the stylus pen without the need for an additional mouse click button.

[0076] Thus, in some embodiments, a mouse function can be incorporated into a pen-type device without adding an additional button for the mouse click function. The entire flat upper surface portion 132 of the optical mouse unit 130 can itself be used as a button, which is pressed by pressing the entire stylus against the surface when the target position is reached, which is a very intuitive gesture. In various examples, the shape of the stylus or the corresponding part of the housing of the pen cap or the pen tip unit can be designed to have a desired angle, on the one hand providing an intuitive writing posture, and on the other hand providing an optical mouse unit 132 that can be placed tightly (e.g., substantially sealed) on the underlying surface.

[0077] Through embodiments associated with a pen cap or pen tip, enhanced mouse functionality may be provided to a conventional stylus or other pen-type device (with minimal modification) and provided separately as an add-on or supplemental device.

[0078] In various embodiments, a detector or detection function for an enhanced pen cap or pen tip unit may be provided so that the stylus automatically changes from a stylus operating mode to a mouse operating mode when an enhanced pen cap or pen tip unit is placed thereon.

[0079] The button or pressure sensor 120 for detecting mouse click activation may be a fluid pressure sensor, a resistive force sensor, a magnetic force sensor, or any other type of sensor that detects force or pressure applied to the upper surface area 132 of the optical mouse unit 130 or the entire pen tip unit 70 and outputs a click command, for example, when a predetermined pressure or force is exceeded. The signal output by the button or pressure sensor 120 may be a voltage from which a capacitance or other parameter may be derived. This derived parameter may be a function of the detected force or pressure.

[0080] In various examples, the stylus or pen cap or pen tip unit housing can be formed of materials suitable for encapsulating the components described herein. The housing can be formed of, for example but not limited to, plastic, rubber, metal, carbon fiber, etc., and / or any combination thereof.

[0081] According to at least some of the above embodiments, the use attractiveness of the pen-type device can be increased by the indirect motivation of having a combined mouse-type input function, which can be advantageously provided by simple add-on technology and shared use of existing components. A mouse click button can be redundant because the intuitive operating gesture of the pen allows the entire pen to be pressed on the mouse detection area as a mouse click button.

[0082] In summary, some embodiments relate to an apparatus and method that provides structure and functionality to a pen-type device to enable the device to be used to perform operations similar to a computer mouse for a computing device. The structure may include an optical sensor, a portion of the optical sensor surface that can perform the operation of a clickable button, and structure to support connection with a computing device.

[0083] It will be appreciated that the above embodiments are described by way of example only.

[0084] More generally, according to one aspect disclosed herein, there is provided an apparatus for providing mouse-type input functionality to a pen-type device, the apparatus comprising an integrated optical mouse unit for surface movement detection, a surface detection area, and a pressure sensing element for sensing pressure or force applied to the surface detection area to detect a mouse click action.

[0085] In various embodiments, the integrated optical mouse unit includes a surface detection area for surface movement detection.

[0086] In various embodiments, the apparatus further comprises a communication unit for transmitting information related to the detected mouse click action and the detected surface movement to a host device of the pen-type device.

[0087] In various embodiments, the optical mouse unit is movably supported and configured to function as a button for a mouse click action.

[0088] In various embodiments, the optical mouse unit is integrated on the tapered housing portion so that when the user holds the pen-type device in a writing position, an upper surface area of ​​the optical mouse unit is arranged parallel to the lower surface.

[0089] In various embodiments, the optical mouse unit is arranged in the hole and surrounded by a ring button on the housing surface to act as a click button.

[0090] In various embodiments, the button ring is configured to provide mechanical-acoustic click feedback.

[0091] In various embodiments, the click button is arranged near the optical mouse unit so as to be actuated by pressing the optical mouse unit against an underlying surface.

[0092] In various embodiments, the apparatus is configured to switch the pen-type device from a stylus mode of operation to a mouse mode of operation in response to output from the orientation sensing device.

[0093] According to another aspect disclosed herein, there is provided a stylus pen including the device of any embodiment disclosed herein, wherein the optical mouse unit is arranged at a rear end portion of the stylus pen.

[0094] According to another aspect disclosed herein, there is provided a pen cap for a pen-type device comprising the apparatus according to any embodiment disclosed herein.

[0095] In various embodiments, the pen cap further comprises a connection portion for connecting the optical mouse unit to a control unit of a pen-type device, wherein the pen-type device is a stylus pen.

[0096] In various embodiments, the pen cap further comprises an eraser unit for the stylus.

[0097] According to another aspect disclosed herein, there is provided a pen tip unit for a stylus pen including the device according to any embodiment disclosed herein.

[0098] According to another aspect disclosed herein, there is provided an apparatus for providing mouse-type input functionality to a pen-type device, the apparatus comprising an optical unit for surface movement detection, a surface detection area, and a mounting mechanism for allowing the apparatus to be releasably connected or removably mounted to a pen-type input device.

[0099] In various embodiments, the device may be included in a pen cap or pen tip unit of a pen-type input device. The mounting mechanism may be at least one of an inserting, fitting, fastening, engaging and / or snapping mechanism for detachably mounting to a pen-type device (which may be any handheld pen-shaped writing, reading or pointing device) so as to provide a convenient and intuitive mouse input function to the pen-type device.

[0100] According to another aspect disclosed herein, a method for providing mouse-type input functionality to a pen-type device is provided, the method comprising sensing surface movement at a surface detection area of ​​the pen-type device; sensing pressure or force applied to the surface detection area; and triggering a mouse click function in response to the pressure or force sensing.

[0101] In various embodiments, surface movement is sensed at a surface detection area of ​​an integrated optical mouse unit of the pen-type device.

[0102] According to another aspect disclosed herein, a computer program implemented on a computer-readable storage is provided, the computer program comprising codes configured to execute the method of any one of the embodiments disclosed herein when executed on one or more processors.

[0103] The examples and embodiments described herein may be implemented as logical steps in one or more computer systems. Logical operations may be implemented as: (1) a sequence of processor-implemented steps executed in one or more computer systems; and (2) interconnected machine or circuit modules within one or more computer systems. The implementation is a matter of choice depending on the performance requirements of the computer systems used for implementation. Therefore, the logical operations that make up the various examples or embodiments described herein may be variously referred to as operations, steps, objects, or modules. In addition, it should be understood that the logical operations may be performed in any order, added as needed, or omitted, unless explicitly stated or a specific order is inherently required by the claim language.

[0104] Other variations and applications of the disclosed technology may become apparent to those skilled in the art once this disclosure is given.The scope of the present disclosure is not limited to the above-described embodiments but is only limited by the appended claims.

Claims

1. A touch pen, comprising: a writing tip configured to provide input to a host device by touching and hovering over a touch screen of the host device; as well as An apparatus for providing mouse-type input functionality, the apparatus comprising an integrated optical mouse unit for surface movement detection at a surface detection area and a pressure sensing element for sensing pressure or force applied to the surface detection area to detect a mouse click action; wherein the apparatus is configured to switch the stylus from a stylus mode of operation to a mouse mode of operation in response to an output from an orientation sensing device; and The optical mouse unit is arranged at the rear end or the pen cap of the stylus pen; The optical mouse unit is incorporated into an inclined portion of the surface of the stylus housing at a predetermined angle relative to the non-inclined cylindrical side of the stylus housing so that when the user holds the pen-type device in a writing position, the upper surface area of ​​the optical mouse unit is arranged parallel to the lower surface.

2. The touch pen according to claim 1, characterized in that: Also included is a communication unit for transmitting information related to the detected mouse click action and the detected surface movement to a host device of the pen-type device.

3. The touch pen according to claim 1 or 2, characterized in that: The optical mouse unit is movably supported and configured to function as a button for the mouse click action.

4. The touch pen according to claim 3, characterized in that: The optical mouse unit is arranged in the hole and surrounded by a ring button which is on the housing surface to act as a click button.

5. The touch pen according to claim 4, characterized in that: The ring button is configured to provide mechanical-acoustic click feedback.

6. The touch pen according to claim 1 or 2, characterized in that: A click button is arranged near the optical mouse unit so as to be actuated by pressing the optical mouse unit against an underlying surface.

7. The touch pen according to claim 1, characterized in that: The pen cap includes a connecting portion for connecting the optical mouse unit to a control unit of the stylus pen.

8. The touch pen according to claim 7, characterized in that: The pen cap also includes an eraser unit for the stylus pen.

9. A method for providing mouse-type input functionality to a stylus as claimed in any one of claims 1 to 8, the method comprising: providing input to a host device based on a writing pen tip touching and hovering over a touch screen of the host device; sensing surface movement at a surface detection area of ​​the stylus; sensing pressure or force applied to the surface detection area; triggering a mouse click function in response to the pressure or force sensing; as well as The stylus is switched from a stylus mode of operation to a mouse mode of operation in response to output from the orientation sensing device.

10. A computer-readable storage medium having stored thereon codes configured to perform the method according to claim 9 when the codes are executed on one or more processors.

Citation Information

Patent Citations

  • Pen-shaped optical mouse

    US20060028456A1

  • Stylus With Inertial Sensor

    US20160139690A1

  • Multi-functional stylus

    US20190155410A1