Systems and devices for capturing handwriting

Abstract

Systems for capturing handwriting or other data corresponding to the movement of a stylus are provided. In some embodiments, such systems include an electronic inscription device with a flexible display screen that is extendable from and retractable into one or more housings. The device includes stylus position sensing circuitry for capturing data corresponding to movement of a stylus relative to the flexible display screen. In some embodiment, one or more of the housings include retraction and locking components that hold the screen in an extended position for use. In some embodiments, the stylus position sensing circuitry senses infrared signals from the tip of a stylus. In some embodiments, the system also includes a stylus with an infrared strobe tip.

Description

SYSTEMS AND DEVICES FOR CAPTURING HANDWRITINGCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of U.S. Provisional Patent Application Nos. 63 / 525,232, filed July 6, 2023 and 63 / 666,785, filed July 2, 2024, which are incorporated by reference as if disclosed herein in their entireties.BACKGROUND

[0002] Handwritten notetaking remains a crucial activity undertaken by a vast number of individuals. However, even with the digitization of almost everything else, much of the world’s notetaking, e.g., writing down thoughts, information, sketches, etc., remains a practice generally done on paper. When not done on paper, notetaking often occurs on bulky tablets roughly the same size of a composition notebook. Such tablets and composition notebooks are far less portable than a smartphone. Notetaking is generally hindered on smaller devices, however, since the screen is too small to be written on.

[0003] What is desired, therefore, is a system and device for conveniently capturing handwritten and other information that is both portable and includes a writing area that is sufficiently large.SUMMARY

[0004] Aspects of the present disclosure are directed to systems for capturing handwriting or other data corresponding to the movement of a stylus. In some embodiments, such systems include an electronic inscription device with a flexible display screen that is extendable from and retractable into one or more housings. The device includes stylus position sensing circuitry for capturing data corresponding to movement of a stylus relative to the flexible display screen. In some embodiments, one or more of the housings include retraction and locking components that hold the screen in an extended position for use. In some embodiments, the stylus position sensing circuitry senses infrared signals from the tip of a stylus. In some embodiments, the system also includes a stylus with an infrared strobe tip.BRIEF DESCRIPTION OF THE DRAWINGS

[0005] The drawings show embodiments of the disclosed subject matter for the purpose of illustrating the technology. However, it should be understood that the present application is not limited to the precise arrangements and instrumentalities shown in the drawings, wherein:

[0006] FIG l is a schematic view of a system according to an embodiment of the present technology;

[0007] FIG. 2a is cross-section view, taken from line 2A shown in FIG. 1, of a housing according to an embodiment of the present technology;

[0008] FIG. 2b is a cross-section view; taken from line 2B shown in FIG. 1, of a housing according to an embodiment of the present technology;

[0009] FIG. 3a is a view of a home screen according to an embodiment of the present technology; and

[0010] FIG. 3b is a view of a notebook screen according to an embodiment of the present technology.DETAILED DESCRIPTION

[0011] Referring now to FIG. 1 and the other figures, some embodiments of the present disclosure will be described. In some embodiments, a system 100 for capturing data corresponding to the movement of a stylus is provided. In some embodiments, the system comprises an electronic inscription device 101 and a stylus 102. The electronic inscription device 101 comprises a flexible display screen 103, at least one housing 104-1, an inscription circuitry 105, and a stylus positioning circuitry 106. In some embodiments, the housing 104-1 is configured to contain at least a portion of the flexible display screen when the flexible display screen is in a retracted position. The inscription circuitry is configured to translate data corresponding to the movement of the stylus relative to the flexible display screen to written content and to display the written content on the flexible writing screen.

[0012] In some embodiments, the flexible display screen 103 comprises a flexible OLED display, which is capable of being rolled up. In some embodiments, the screen 103 further comprises one or more thin-film encapsulation (TFE) components on one or both of the front and back sides of the OLED to act as barrier layers. In some embodiments, the TFE has surface roughness on its upper surface that mimics the feel of real paper. This enhances the writing experience with the stylus on the screen.

[0013] In some embodiments, the screen 103 has a retracted position in which it is at least partially contained within the housing 104-1. In some embodiments, substantially all of the screen 103 is contained in the housing 104-1 in the retracted position. In some embodiments, theelectronic inscription device 101 further comprises at least one screen retraction device 107 contained in the at least one housing 104-1. In some embodiments, the screen retraction device107 comprises a display rolling cylinder 108 configured to rotate relative to the at least one housing 104-1 and to hold a first edge 114 of the flexible display screen such that at least a portion of the flexible display screen wraps around the display rolling cylinder 108 when the cylinder is rotated in a retraction direction. The retraction direction in the embodiment shown in FIGs 1 and 2 is indicated by arrow 115.

[0014] FIG 2a shows a cross-sectional view of the housing 104-1. In this view, the screen 103 is shown wrapped around the display rolling cylinder 108 in a partially retracted position. In this and some other embodiments, the screen retraction device 107 further comprises inner cylinder 109, which is disposed within the display rolling cylinder 108 and secured so as to remain substantially stationary relative to the display rolling cylinder. In some embodiments, the inner cylinder 109 is attached at both ends to the end panels of the housing 104-1. In some embodiments, as shown in FIG. 2a, at least one helical torsion spring 110 is secured to the inner cylinder 109 and configured to exert a spring force against rotation of the display rolling cylinder108 in an extension direction. The extension direction in the embodiment shown in FIGs. 1 and 2 is indicated by arrow 116. First edge 114 is shown anchored to the display rolling cylinder 108.

[0015] In some embodiments, the electronic inscription device further comprises a locking device 117 for holding the display rolling cylinder in a stationary position. FIG. 2b shows a cutaway view of the housing 104-1 to schematically illustrate the locking device 117. In some embodiments, the locking device 117 comprises at least one locking rod 111 that is movable between a locked position A (solid lines in FIG. 2b) in which the locking rod is in contact with the rolling cylinder 108 and an unlocked position B (broken lines in FIG. 2b) in which the locking rod 111 is not in contact with the rolling cylinder 108. FIG. 2b shows two locking rods 111.

[0016] In the embodiment of FIG. 2b, the locking rods 111 are mounted on and extend from the inner cylinder 109. In some embodiments, the rods 111 are pushed outward into the locked position by a piston inside the inner cylinder 109. A piston 128 is shown schematically in FIG. 2a, which engages an inner end of a locking rod 111. In some embodiments, the piston 128 is disposed in an inner channel inside of the inner cylinder 109. In some embodiments, the inner channel is formed inside of a utility cylinder 129, which also carries wiring 130 for carrying electric power and / or electronic signals to and from the display screen 103. In someembodiments, the wiring 130 connects IR sensors 112 to circuitry in the second housing 104-2 by traversing through the screen 103 from the first housing 104-1 to the second housing 104-2.

[0017] In some embodiments, the locking rods 111 also include rubber grips 119 on the end of the rod that engages with the inner surface of the rolling cylinder 108 and increases the friction therebetween. In some embodiments, the rolling cylinder includes catch points 120 that include additional rubber contacts for further improving the friction between the locking rod tips 119 and the rolling cylinder 108. This makes the locked position A more secure.

[0018] FIG. 2b also shows schematic representations of the helical coil torsion springs 111, as well as the supports 121 that secure the inner cylinder to the housing 104-1. In the embodiment shown in the figures, three springs are used. In other embodiments, different numbers of springs are used. The number of springs used is variable based on the size and strength of the springs in connection with the spring force desired by the designer.

[0019] In some embodiments, the locking device 117 is actuated electronically. In some embodiments, the device 117 includes one or more rotary encoders mounted on the supports 121 that track the angular position of the rolling cylinder 108 as it rotates. In some embodiments, the encoders trigger a signal that actuates the locking rods 111 to extend into the locked position once a prescribed number of rotations is completed — indicating that the flexible display screen has been fully deployed. In some embodiments, a battery is included in housing 104-1 to provide power to the electronic actuation of the locking device 117. In some embodiments, the locking device 117 is actuated mechanically. For example, in some embodiments, the user pushes a spring-loaded button to move the piston 128 to actuate the locking rods.

[0020] In some embodiments, the system is designed with a single retracted position, in which substantially the entire flexible display screen 103 is contained in the housing 104-1 or both housing 104-1 and 104-2. In some embodiments, the system is designed to include a single extended position in which the entire flexible display screen 103 is deployed outside of the housings for use. In some embodiments, the system is designed to accommodate multiple extended positions, which enable the user to utilize different effective screen sizes. In such embodiments, the inscription circuitry and stylus position sensing circuitry adjust the screen activation to utilize only a portion of the screen.

[0021] As shown in FIG. 1, in some embodiments, the at least one housing 104-1 is a first housing, and the electronic inscription device 101 further comprises a second housing 104-2configured to hold a second edge 122 of the flexible display screen 103 and to contain the inscription circuitry 105 and at least a portion of the stylus position sensing circuitry 106, 112.

[0022] In some embodiments, the inscription circuitry comprises processor circuitry, memory circuitry, input / output circuitry, and data storage circuitry. In some embodiments, the processor circuitry includes one or more of the processing units such as one or more central processing units (CPU) and / or one or more graphics processing units (GPU). Processor circuitry is configured to perform operations of the system 100, via, for example, execution of software instructions stored in memory circuitry and / or data storage circuitry.

[0023] Memory circuitry (i.e., computer-readable storage media) may include a plurality of memory units, in a manner corresponding to the processing units of processor circuitry. Thus, each processing unit may have an associated memory unit configured to store a respective subset of data, as described herein. Memory circuitry may be configured to store data associated with the system 100 and its various components.

[0024] I / O circuitry may be configured to provide wired and / or wireless communication functionality between the system and external systems, and / or between the inscription circuitry and other components of the system. For example, I / O circuitry may be configured to receive externally sourced data for display on the flexible display screen, stylus movement data, battery data, and any other data as would be advantageous to the system 100. I / O circuitry may include one or more data input ports and associated communication programming, and, in some embodiments, ports for communication with one or more user input devices (e.g., keyboard, mouse, microphone, touch sensitive display, etc.). Data storage circuitry may be configured to store one or more of stylus movement data, written content data, and / or other data associated with the system. The data storage circuitry may include a machine readable storage device including any type of tangible, non-transitory storage device, for example, any type of disk including, optical disks, magneto-optical disks, semiconductor devices such as read-only memories (ROMs), random access memories (RAMs) such as dynamic and static RAMs, erasable programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), flash memories, solid state memory, magnetic or optical cards, or any type of storage devices suitable for storing electronic instructions.

[0025] The inscription circuitry 105 is configured to translate data corresponding to the movement of the stylus relative to the flexible display screen to written content and to display the written content on the flexible writing screen. In some embodiments, stylus movement data relative to the flexible display screen is captured by the stylus position sensing circuitry 106,which, in some embodiments includes infrared (IR) sensors 112, as well as processor, memory, and storage components as needed for the particular design. The IR sensors 112 detect IR signals emitted from, in some embodiments, the stylus 102. In some embodiments, a first plurality of IR sensors are positioned on the second housing 104-2, which provides field-of-view (FOV) coverage of the upper surface of the flexible display screen 103. In some embodiments, the second housing 104-2 includes six IR sensors 112 to limit the extent of any IR “deadzones” (i.e., areas where stylus detection is lacking) over the surface of the screen 103. In some embodiments, a second plurality of IR sensors 112 is positioned in the first housing 104-1. One such sensor in the housing 104-1 is shown schematically in FIG. 2a. In some embodiments in which IR sensors are located in both first and second housings 104-1, 104-2, the first plurality comprises four or five sensors and the second plurality comprises four or five sensors. In some embodiments, the sensors 112 located in the first housing 104-1 and any related circuitry located in the first housing are connected to the rest of the stylus position sensing circuitry 106 located in the second housing 104-2 by a ribbon cable integrated into the flexible display screen 103.

[0026] In the embodiment shown in FIG. 1, the first housing includes the screen retraction device, while the second housing 104-2 includes the majority of the components related to the circuitry enabling the device to function. In some embodiments, a battery 118 is included in the second housing 104-2. In some embodiments, stylus charging circuitry 123 is also included in the second housing 104-2. In some embodiments, the charging circuitry 123 includes a magnetic induction charging system, by which the stylus is magnetically docked to the second housing 104-2 so that induction charging circuitry can interact with the stylus to charge the stylus’ onboard battery 124. In some embodiments, the housing 104-2 includes a power button 131

[0027] In some embodiments, both the screen retraction device 107 in the first housing 104-1 is designed to retract substantially all of the flexible display screen 103 within it, so that, in the retracted position, the first and second housings are abutting each other. In some embodiments, both of the first and second housings include a retraction device so that a portion of the screen is retracted into each housing when the device is in the retracted position. In some embodiments, the circuitry components are also distributed between the two housings for space and weight efficiency. In some embodiments, the device includes only one housing that holds the retracted display screen and the circuitry components, and the display screen is provided with a pull-tab for extension from the housing.

[0028] In one embodiment, the first housing 104-1 is 0.5 inches in height, 0.5 inches in width, and 7 inches in length. In one embodiment the second housing 104-2 is 0.5 inches in height, 1.0inches in width, and 7 inches in length. Different sizes are used in other embodiments to accommodate different desired screen sizes. In some embodiments, the flexible display screen has an unrolled width of approximately 10 inches and a height of 6.6 inches.

[0029] In some embodiments, the stylus 102 comprises an infrared strobe tip 113 that transmits IR signals that are detectable by the IR sensors. The stylus position sensing circuitry, in some embodiments, continuously receives (via the IR sensors) and processes the IR signals from the stylus as the stylus is moved over the flexible display screen. This stylus movement data is translated into written content, e.g., the user’s handwriting, sketches, etc., that is displayed on the display screen 103. In some embodiments, different stylus detection technology is used. For example, a series of IR emitters and sensors are distributed along the edges of the display on each of the first and second housings. The system is able to detect interruptions to the IR signals emitted as the stylus moves across the display screen. In other embodiments, a capacitive tip and touchscreen system is utilized, similar to known electronic tablets, except that the touchscreen is flexible for retraction into one or more of the first and / or second housings.

[0030] In some embodiments, the stylus further comprises one or more of circuitry 125 configured to determine at least one of an angle of the stylus relative to one or more of the first and second housings, circuitry 126 configured to determine a distance between the stylus and each of one or more of the housings, and a pressure sensor for detecting pressure applied to the tip of the stylus. In some embodiments, the stylus comprises an accelerometer and / or a gyroscopic sensor. In some embodiments, the device 101 is configured to adjust the written content displayed based on the angle of the stylus and / or the pressure applied at the tip. For example, a heavier, thicker mark can be shown when higher tip pressures are detected. Further, shading and other effects are applied when the stylus is used at different angles.

[0031] FIG. 3 shows exemplary system display screen shots for an embodiment of the present technology. In FIG. 3a, a “home screen” 301 is shown, in which the user can select, add, delete, and otherwise manage notebooks stored on the system. In some embodiments, the user can create “notebooks” to store written and other information input into the system. The “notebooks” serve as, essentially, a folder for a number of individual note pages. The user can create and add notebooks within the storage limits of the system. In FIG. 3a, 302 indicates titles of notebooks, 303 indicates a notebook cover image, 304 indicates a “settings” virtual button for management of various system settings, 305 indicates a virtual button for adding a new notebook; and 306 indicates a scroll bar.

[0032] FIG. 3b shows an in-notebook screen 310. In some embodiments, the user would move the stylus over this screen to capture written information. This screen includes page flip buttons 311, to move between notebook pages, and a toolbar 312 for selecting different writing tools, colors, etc.

[0033] In some embodiments, the stylus includes components for inducing vibrations perceivable by the user in order to confer a high-quality feel to the user when using the device. When writing on paper, slight vibrations in the pencil or pen are perceivable by the writer. In order to mimic this feel, in some embodiments, a small, low-power and low-voltage eccentric rotating mass (ERM) is included in the bottom half of the stylus. ERMs are widely utilized inindustry to confer a slight rumble / vibration to the user. In some embodiments, the vibrations are low magnitude to avoid disrupting the writing experience; however, as the stylus moves along the surface of the display, this slight rumbling (also known as haptic feedback) is provided to the user to give the user information regarding: the fact that the stylus’s movements are being detected by the IR sensors and interpreted as writing outputs, and which writing ‘tool’ is being utilized at the time. (i.e. eraser, pencil, pen, etc.).

[0034] As used in any embodiment herein, the term “logic” may refer to an app, software, firmware and / or circuitry configured to perform any of the aforementioned operations. Software may be embodied as a software package, code, instructions, instruction sets and / or data recorded on non-transitory computer readable storage media. Firmware may be embodied as code, instructions or instruction sets and / or data that are hard-coded (e.g., nonvolatile) in memory devices.

[0035] “Circuitry”, as used in any embodiment herein, may include, for example, singly or in any combination, hardwired circuitry, programmable circuitry such as computer processors comprising one or more individual instruction processing cores (including, but not limited to, graphics processing units), state machine circuitry, software instructions, and / or firmware that stores instructions executed by programmable circuitry. The logic may, collectively or individually, be embodied as circuitry that forms part of a larger system, for example, an integrated circuit (IC), an application-specific integrated circuit (ASIC), a system on-chip (SoC), desktop computers, laptop computers, tablet computers, servers, smart phones, etc.

[0036] Memory circuitry may include one or more of the following types of memory: semiconductor firmware memory, programmable memory, non-volatile memory, read only memory, electrically programmable memory, random access memory, flash memory, magnetic disk memory, solid state memory, and / or optical disk memory. Either additionally oralternatively system memory may include other and / or later-developed types of computer- readable memory.

[0037] The terms and expressions which have been employed herein are used as terms of description and not of limitation, and there is no intention, in the use of such terms and expressions, of excluding any equivalents of the features shown and described (or portions thereof), and it is recognized that various modifications are possible within the scope of the claims. Accordingly, the claims are intended to cover all such equivalents.

[0038] Although the technology has been described and illustrated with respect to exemplary embodiments thereof, it should be understood by those skilled in the art that the foregoing and various other changes, omissions and additions may be made therein and thereto, without parting from the spirit and scope of the present technology.

Claims

CLAIMSWhat is claimed is:

1. A system for capturing data corresponding to the movement of a stylus, comprising: a stylus; and an electronic inscription device comprising: a flexible display screen, at least one housing configured to contain at least a portion of the flexible display screen when the flexible display screen is in a retracted position, an inscription circuitry; and a stylus position sensing circuitry configured to capture data corresponding to movement of the stylus relative to the flexible display screen; wherein the inscription circuitry is configured to translate data corresponding to the movement of the stylus relative to the flexible display screen to written content and to display the written content on the flexible writing screen.

2. The system of claim 1, wherein the electronic inscription device further comprises at least one screen retraction device contained in the at least one housing, the screen retraction device comprising a display rolling cylinder configured to rotate relative to the at least one housing and to hold a first edge of the flexible display screen such that at least a portion of the flexible display screen wraps around the display rolling cylinder when the cylinder is rotated in a retraction direction.

3. The system of claim 2, wherein the at least one screen retraction device further comprises: an inner cylinder disposed within the display rolling cylinder and secured so as to remain substantially stationary relative to the display rolling cylinder; and at least one helical torsion spring secured to the inner cylinder and configured to exert a spring force against rotation of the display rolling cylinder in an extension direction.

4. The system of claim 3, wherein the electronic inscription device further comprises a locking device for holding the display rolling cylinder in a stationary position, the locking device comprising:at least one locking rod movable between a locked position in which the locking rod is in contact with the rolling cylinder and an unlocked position in which the locking rod is not in contact with the rolling cylinder.

5. The system of claim 3, wherein the at least one housing is a first housing, and the electronic inscription device further comprises a second housing configured to hold a second edge of the flexible display screen and to contain the inscription circuitry and at least a portion of the stylus position sensing circuitry.

6. The system of claim 5, wherein the stylus position sensing circuitry comprises a first plurality of infrared (IR) sensors positioned on the second housing.

7. The system of claim 6, wherein the stylus position sensing circuitry further comprises a second plurality of IR sensors positioned on the first housing.

8. The system of claim 6, wherein the stylus comprises an infrared strobe tip, which transmits signals detectable by the IR sensors.

9. The system of claim 8, wherein the stylus further comprises one or more of circuitry configured to determine at least one of an angle of the stylus relative to at least one of the first and second housings, a distance between the stylus and each of one or more of the housings, and a pressure sensor for detecting pressure applied to the tip of the stylus.

10. An electronic inscription device comprising: a flexible display screen, at least one housing configured to contain at least a portion of the flexible display screen when the flexible display screen is in a retracted position, an inscription circuitry; and a stylus position sensing circuitry configured to capture data corresponding to movement of a stylus relative to the flexible display screen; wherein the inscription circuitry is configured to translate the data corresponding to the movement of a stylus relative to the flexible display screen to written content and to display the written content on the flexible writing screen.

11. The device of claim 10, further comprising at least one screen retraction device contained in the at least one housing, the screen retraction device comprising a display rollingcylinder configured to rotate relative to the at least one housing and to hold a first edge of the flexible display screen such that at least a portion of the flexible display screen wraps around the display rolling cylinder when the cylinder is rotated in a retraction direction.

12. The device of claim 11, wherein the at least one screen retraction device further comprises: an inner cylinder disposed within the display rolling cylinder and secured so as to remain substantially stationary relative to the display rolling cylinder; and at least one helical torsion spring secured to the inner cylinder and configured to exert a spring force against rotation of the display rolling cylinder in an extension direction.

13. The device of claim 12, further comprising a locking device for holding the display rolling cylinder in an extended position, the locking device comprising: at least one locking rod movable between a locked position in which the locking rod is in contact with the rolling cylinder and an unlocked position in which the locking rod is not in contact with the rolling cylinder.

14. The device of claim 12, wherein the at least one housing is a first housing, and further comprising a second housing configured to hold a second edge of the flexible display screen and to contain the inscription circuitry and at least a portion of the stylus position sensing circuitry.

15. The device of claim 14, wherein the stylus position sensing circuitry comprises a first plurality of infrared (IR) sensors positioned on the second housing.

16. The device of claim 15, wherein the stylus position sensing circuitry further comprises a second plurality of IR sensors positioned on the first housing.

17. The device of claim 16, further comprising that the stylus position sensing circuitry is configured to detect signals from an infrared strobe tip.

18. The device of claim 16, further comprising that the stylus position sensing circuitry is configured to receive electromagnetic signals from a stylus indicative of at least one of an angle of a stylus relative to at least one of the first and second housings, a distancebetween a stylus and each of one or more of the housings, and a pressure sensor for detecting pressure applied to the tip of a stylus.

Images