Writing instrument and associated writing analysis system

Abstract

A writing instrument and associated system are provided. The writing instrument includes associated hardware that captures data about writing strokes performed on a surface using the writing instrument. The writing instrument may be in communication with a remote system and / or a user device. The remote system and / or the user device (e.g., desktop computer, laptop computer, tablet, etc.) may process the data to determine when particular characters are written on the surface. Based on determining that the characters were written, the user device may perform certain actions depending on the specific characters that were written. For example, a user may write a hashtag symbol followed by the word "mail" to indicate that the user device should send an email. In this manner, handwriting performed on a non-digital surface may be used to cause actions to be performed by a user device.

Description

WRITING INSTRUMENT AND ASSOCIATED WRITING ANALYSIS SYSTEMTECHNICAL FIELD

[0001] The present disclosure is generally related to a writing instrument, and more particularly to a system including a writing instrument with electronic hardware for tracking writing strokes.BACKGROUND

[0002] In some scenarios, the use of both writing instruments (e.g., pencils, pens, etc.) and computing devices (e.g., desktop or laptop computers, tablets, etc.) may be desirable. For example, an employee in an office environment may desire to capture notes and tasks in a meeting without the use of a computer (for example, write down information in a notebook using a pen or pencil). The employee may also desire to transfer the hand-written notes to a digital format for storage on the computing device. Conventionally, in such scenarios, the employee may need to switch between the use of the writing instrument and the use of the computing device, which may lead to inefficiencies in tasks being performed.BRIEF DESCRIPTION OF THE DRAWINGS

[0003] Reference is made now to the drawings, which are meant to be exemplary and not limiting, and wherein like elements are numbered alike. The detailed description is set forth with reference to the drawings illustrating examples of the disclosure. Certain embodiments of the present disclosure may include elements, components, and / or configurations other than those illustrated in the drawings, and some of the elements, components, and / or configurations illustrated in the drawings may not be present in certain embodiments.

[0004] FIG. 1 is an example system, in accordance with one or more embodiments of the disclosure.

[0005] FIG. 2 is a use case for sending an email using a writing instrument, in accordance with one or more embodiments of the disclosure.

[0006] FIG. 3 is a use case for creating a note using a writing instrument, in accordance with one or more embodiments of the disclosure.

[0007] FIG. 4 is a use case for creating a digital image using a writing instrument, in accordance with one or more embodiments of the disclosure.

[0008] FIG. 5 is a use case for creating a digital list, in accordance with one or more embodiments of the disclosure.

[0009] FIG. 6 is a use case for scanning printed text using a writing instrument, in accordance with one or more embodiments of the disclosure.

[0010] FIG. 7 is another use case for capturing data about written text using a writing instrument, in accordance with one or more embodiments of the disclosure.

[0011] FIG. 8 is yet another use case, in accordance with one or more embodiments of the disclosure.

[0012] FIG. 9 is yet another use case, in accordance with one or more embodiments of the disclosure.

[0013] FIG. 10 is yet another use case, in accordance with one or more embodiments of the disclosure.

[0014] FIG. 11 is an example method, in accordance with one or more embodiments of the disclosure.

[0015] FIG. 12 is an example computing device, in accordance with one or more embodiments of the disclosure.

[0016] FIG. 13 depicts an ink-based digital writing instrument, in accordance with one or more example embodiments of the disclosure.

[0017] FIG. 14 depicts a cross-section of the ink-based digital writing instrument of FIG. 13, in accordance with one or more example embodiments of the disclosure.

[0018] FIG. 15 depicts a cross-section of a nosecone of the ink-based digital writing instrument of FIG. 13, in accordance with one or more example embodiments of the disclosure.

[0019] FIG. 16 depicts another cross-section of the nosecone of the ink-based digital writing instrument of FIG. 13, in accordance with one or more example embodiments of the disclosure.

[0020] FIGS. 17A-17C depict further cross-sections of the nosecone of the ink-based digital writing instrument of FIG. 13, in accordance with one or more example embodiments of the disclosure.

[0021] FIG. 18 depicts another cross-section of the ink-based digital writing instrument of FIG. 13, in accordance with one or more example embodiments of the disclosure.

[0022] FIG. 19 depicts another cross-section of the nosecone of the ink-based digital writing instrument of FIG. 13, in accordance with one or more example embodiments of the disclosure.

[0023] FIG. 20 depicts an exploded view of the ink-based digital writing instrument of FIG. 13, in accordance with one or more example embodiments of the disclosure.

[0024] FIG. 21 depicts internal components of a nosecone of an ink-based digital writing instrument, in accordance with one or more example embodiments of the disclosure.

[0025] FIG. 22 depicts a barrel of a nosecone being inserted onto an ink-based digital writing instrument, in accordance with one or more example embodiments of the disclosure.

[0026] FIG. 23 depicts a nosecone of an ink-based digital writing instrument including a switching mechanism, in accordance with one or more example embodiments of the disclosure.

[0027] FIG. 24 depicts an example switching mechanism for an ink-based digital writing instrument, in accordance with one or more example embodiments of the disclosure.

[0028] FIG. 25 depicts an example system architecture including an ink-based digital writing instrument and writing pad, in accordance with one or more example embodiments of the disclosure.

[0029] FIG. 26 depicts an example writing pad, in accordance with one or more example embodiments of the disclosure.

[0030] FIG. 27 depicts another example writing pad, in accordance with one or more example embodiments of the disclosure.

[0031] FIGS. 28A-28D depict another example writing pad, in accordance with one or more example embodiments of the disclosure.

[0032] FIG. 29 depicts another ink-based digital writing instrument, in accordance with one or more example embodiments of the disclosure.

[0033] FIG. 30 depicts a cross-section of the ink-based digital writing instrument of FIG. 29, in accordance with one or more example embodiments of the disclosure.

[0034] FIGS. 31A-32B depict example process flows, in accordance with one or more example embodiments of the disclosure.

[0035] FIG. 33 depicts another example system, in accordance with one or more example embodiments of the disclosure.

[0036] FIG. 34 depicts a flow diagram, in accordance with one or more example embodiments of the disclosure.

[0037] FIG. 35 depicts another flow diagram, in accordance with one or more example embodiments of the disclosure.

[0038] The present disclosure provides a more detailed and specific description with reference to the accompanying drawings. The drawings and specific descriptions of the drawings, as well as any specific or other embodiments discussed, are intended to be read in conjunction with the entirety of this disclosure.DETAILED DESCRIPTION

[0039] Certain embodiments of the present disclosure are now described with reference to the drawings. Although the following detailed description contains many specifics for purposes of illustration, a person of ordinary skill in the art will appreciate that many variations and alterations to the following details are within the scope of the disclosure. Accordingly, the following embodiments of the disclosure are set forth without any loss of generality to, and without imposing limitations upon, the appended claims.

[0040] A writing instrument and associated system are provided. The writing instrument may include some of the features of a traditional writing instrument (for example, the writing instrument may be a pen, pencil, marker, etc. that may be used to write on a surface). In contrast with traditional writing instruments, however, the writing instrument described herein may also include additional hardware and / or software configured to capture data regarding writing strokes performed using the writing instrument.

[0041] In embodiments, as the data produced by the writing instrument is processed (in some instances by a remote device in wireless communication with the writing instrument), one or more actions may be performed by a separate user device (e.g., a laptop computer, desktop computer, tablet, etc.) when a particular character or characters are identified as being written on a surface using the writing instrument. As an example, a user may use the writing instrument to write a hashtag followed by the word “mail” in a paper notebook. The hashtag may serve as a character that indicates an intent for an action to be performed by the user device. The word “mail” following the hashtag may indicate the specific action that is desired to be performed by the user device (e.g., preparing and sending an email). Based on identifying through the data that this character is written on the surface, the user device may prepare and send an email using an email application of the user device. Additional information may also be written in the notebook that may be used by the user device to perform the action, such as a recipient email address, subject line, email body, etc. In this manner, the writing instrument may be used to cause actionsto be performed by a user device based on writing provided on a non-digital surface. The use of a hashtag as the character is merely exemplary and any other character or characters may also be used.

[0042] The writing instrument may be used to cause any number of different types of actions to be performed by the user device depending on the characters that are written on the surface. As additional examples, a user may write a hashtag followed by the word “note” to cause the user device to create a digital note using a note application. A user may write a hashtag followed by the word “todo” to cause the user device to generate a list in a list application. A user may write a hashtag followed by the word “sketch” to cause the user device to create a digital copy of a picture drawn on the surface by the user. These example use cases are illustrated and described in additional detail with respect to FIGS. 2-5. These actions are merely exemplary and any other types of actions may also be performed by the user device based on the writing strokes of the writing instrument.

[0043] While reference is made herein to writing on a surface, the same methods may still be applicable even if writing is not performed on a surface. For example, a user may simply make the writing strokes associated with writing the character or characters (such as making the writing strokes mid-air) without the writing instrument coming into contact with a surface as well. Accordingly, the surface may not necessarily be required for the actions to be performed.

[0044] Additionally, the writing instrument described herein may also include an optical scanner that is used to scan any printed and / or written text. The scanned printed and / or written text may then be converted into a digital format and stored on a separate device for subsequent use. For example, a student may use the optical scanner of the writing instrument to scan printed text included in a textbook (as well as any information that is hand-written in the textbook, such as hand-written notes). The data produced by the optical scanner during the scanning process may then be transmitted to a separate device (such as a laptop or desktop computer, tablet, etc.). A digital representation of the printed text may then be generated and presented on the device. The digital representation of the printed text may also be stored on the device for future reference (for example, the printed text may be added to a note or word processing application of the device.

[0045] In embodiments, the optical scanner of the writing instrument may also be configured to capture elements beyond the printed text itself (such as stylistic features, etc.). For example, the optical scanner may also be configured to capture highlights provided over the printed text. As auser moves the optical scanner of the writing instrument over the printed text to scan the text, indications of any text that was highlighted by the user (or highlighted by another user) may be included in the data captured by the optical scanner. Thus, when the scanned text is converted into a digital format for presentation and / or storage via a separate device, the digital text may also include the same highlighting.

[0046] The optical scanner may also be configured to capture more granular data about the highlights (rather than merely producing data indicating that the highlights are present). For example, the data may indicate the color, size, etc. of the highlighting. That is, rather than simply showing a consistent color highlight in the digital representation of the printed text (such as yellow), the highlights shown over the digital text may be consistent with the actual highlight color provided over the printed text in the textbook.

[0047] In embodiments, the optical scanner may also be configured to capture any other stylistic features of the printed text as well. For example, the data produced by the optical scanner as the optical scanner is moved over the printed text may indicate that some of the text is bold, italicized, or underlined. As further examples, the data may also capture the font of the printed text. These formatting features of the printed text may be maintained in the converted digital text, such that the digital text presented via the separate device may maintain the formatting of the printed text.

[0048] In embodiments, the optical scanner may also be configured to capture data about writing performed in the textbook by a user. That is, while the writing instrument includes the optical scanner for scanning printed text, the writing instrument may still also be used as a traditional writing instrument as well. As writing strokes are performed in the textbook using the writing instrument (for example, a student may take notes in the margin of the textbook), data indicative of the writing strokes may also be produced by the writing instrument. This data may also be transmitted to the separate device and digital representations of the writing strokes may be produced and presented via the separate device.

[0049] The writing instrument including the optical scanner provides a number of advantages. A first example advantage is that the writing instrument is configured to be used in a traditional sense to write on a surface (e.g., take notes in a textbook), while also allowing data about the writing to be captured and converted into a digital format for presentation and storage via a separate device. The writing instrument is also configured to track the writing strokes performedusing the writing instrument on the surface (for example, notes taken in the textbook) and generate digital representations of those writing strokes via the separate device as well. In this manner, the writing instrument serves as a traditional writing instrument, a portable scanner, and an apparatus for capturing writing strokes to be converted to a digital format for presentation and / or storage on a separate device.

[0050] The present disclosure further describes an ink-based digital writing instrument that may be used to perform physical writing strokes on a writing surface (for example, a user may physically write on paper using the ink-based digital writing instrument, which may be in the form of a pen, or may write on a whiteboard using the ink-based digital writing instrument, which may be in the form of a dry-erase marker, etc.), while also generating a digital representation of the writing strokes for presentation and / or storage on a digital device (for example, a desktop or laptop computer, tablet, etc.). The writing instrument may include conventional elements of the particular type of writing instrument (for example, if the writing instrument is an ink pen, the writing instrument may include a reservoir to house an ink-based liquid that is used to write on paper). However, in contrast with conventional writing instruments, the ink-based digital writing instrument described herein may also include electrical components housed within the ink-based digital writing instrument that may be used to generate the digital representation of the performed writing strokes.

[0051] Particularly, in embodiments, the electrical components may include a capacitive assembly that is in electrical communication with an inductor. In embodiments, the inductor may be a conductive material, such as a wire, that is wound into one or more loops within the inkbased digital writing instrument. The inductor may include a ferrite material (or may otherwise be in electrical contact with a ferrite material). Although reference is made to a ferrite core, any other suitable type of material may also be used as a part of the inductor. The capacitive assembly and inductor may, in combination, form an LC or resonant circuit that may be configured to produce a magnetic field of a given frequency, such as a resonant frequency of the circuit. The frequency may depend on a number of different factors, such as the capacitance of the capacitive assembly, the inductance of the ferrite core, and / or any other factors described herein or otherwise. In some instances, the ink that is provided within the ink-based digital writing instrument may also impact the frequency produced by the resonant circuit depending on the properties of the ink.

[0052] The ink-based digital writing instrument may be provided as a part of an overall system also including a writing pad and the digital device. The writing pad may include an electrical grid (which may be in the form of one or more coils provided on and / or within a substrate as shown in FIG. 13) through which an oscillating current moves. A writing surface (such as paper or a dry-erase board, for example) may be provided over the electrical grid to provide a surface on which the user may perform physical writing strokes using the ink-based digital writing instrument.

[0053] Depending on the frequency at which the resonant circuit is resonating, a change within the electrical grid may be detected at a particular location. For example, the change may correspond to a location at which the ink-based digital writing instrument is provided on the writing pad (for example, when the ink-based digital writing instrument is used to write on the writing pad). The one or more coils provided as part of the electric grid may function as receiving coils such that inductive coupling may occur between at least one of the coils in the electrical grid and the ferrite core when the ink-based writing instrument is proximate to the writing pad.

[0054] A controller (which may be integrated into the writing pad or be a separate device) may be configured to receive data indicating these changes to the electrical grid at various points in time. For example, the controller may receive data indicating changes to the electrical properties associated with the one or more coils of the electric grid based on the magnetic field produced by the resonant circuit in the ink-based digital writing instrument. Accordingly, the controller may be able to ascertain the writing strokes that were performed and this data may be used to generate the digital representations of the same writing strokes. The digital representations may be digital copies of the writing strokes performed on the writing surface. For example, if the writing instrument is used to physically write the word “the” on paper, the digital representation may be the word “the” presented on a digital device (as a non-limiting example, the word may be presented through a word processing application).

[0055] The ink-based digital writing instrument and associated system (including the writing pad and digital device) may provide a number of benefits. As a first example, a user may prefer to write using a traditional writing instrument, but may also desire for the writing to be stored in a digital format for a number of different reasons.

[0056] As another example, the ink-based digital writing instrument may be used in a classroom setting in which a teacher desires for students to perform lessons using traditional writing instruments, but also wishes to receive digital copies of the writing performed by the students using the writing instrument. For example, if the students are solving math equations, the answers written on paper provided on the writing pad may be stored in digital format and provided to a teacher device for analysis and storage. This may allow the teacher to maintain a collection of completed student lessons in one software application to track student progress over time. The software application may also automatically analyze the responses provided by the student, such as determining if the student provided the correct answers to the math equations.

[0057] These are merely some specific use cases for the ink-based digital writing instrument, and the ink-based digital writing instrument may also be beneficial in any number of alternative use cases not mentioned herein as well.

[0058] Furthermore, artificial intelligence, such as machine learning or the like, may be used in conjunction with the mechanisms described herein. As a non-limiting example, a machine learning model may be trained to estimate the position of the writing instrument relative to the writing pad and / or predict future positions of the writing instrument. This information may be used along with information gathered from other mechanisms used to track the position of the writing instrument (such as inductive coupling, magnetic transceivers, various sensors, etc.), or may be used in a standalone capacity, in some instances.

[0059] The machine learning model may also be used to determine, once writing strokes have been performed, the information that a user intended to write using the writing instrument. For example, the machine learning model may be trained to predict certain letters, numbers, images, etc. (or combinations of such elements, such as sentences, equations, etc.) that the user intended to write. For example, if the user intended to write the word “the” using the writing instrument, the machine learning model may receive various types of data produced as the user performs the writing strokes. The machine learning model may, based on the data, determine that the user intended to write the word “the.” This determination may be used to assist in generating digital versions of the information that is written using the writing instrument. This may be particularly beneficial in instances in which the data captured using other mechanisms described herein is insufficient to determine the elements that the user intended to write. Even if the data capturedusing other mechanisms is sufficient, the machine learning model may be used as a verification mechanism.

[0060] The machine learning model may be trained to perform any of the analyses described herein. For example, the training data may include input data representative of different types of writing strokes. The training data may also include corresponding ground truth data. The machine learning model may produce an output (such as a prediction of the elements intended to be written using the writing instrument based on the input data) and the output may be compared to the ground truth (an indication of the actual element intended to be written). Based on the comparison, the machine learning model may be trained to more effectively perform such tasks when provided further input data. However, this method of supervised training is merely exemplary and the machine learning model may also be trained in any other suitable manner.The machine learning model may also be recursively trained in real-time to further improve over time.

[0061] In embodiments, the machine learning model may specifically be configured to use only current sensor data. This may be a memoryless models, which requires less training data. In other embodiments, the machine learning model may also use past and / or future data (for example, Long Short-Term Memory (LSTM) models). These models may constrain their predictions based on writing instrument motions used for training but also require more data. As an example, a Gated Recurrent Unit (GRU) may be used that analyzes past data to predict the movement of the writing instrument, typically used for predictions with short-term dependencies. As another example, a Bidirectional LSTM (BLSTM) may be used that analyzes past and future data to predict the movement of the writing instrument.

[0062] These are merely examples and any other machine learning models trained in any other suitable manner (including unsupervised training) may be used. Additionally, while reference is generally made herein to the use of a “machine learning model” (and specific types of models), this is not intended to be limiting and any suitable type of machine learning model (or other type of artificial intelligence in general) may be used.

[0063] In embodiments, a Kalman filter may be used to combine a kinematic model of the movement of the pen using a measurement model based on sensors associated with the writing instrument to estimate the position of the writing instrument. The Kalman filter may function by constructing a mathematical model of the system as a whole (for example, sensors of the writinginstrument, writing pad, etc ). State variables describe the position and movement of the writing instrument. If the position of the writing instrument and the movement of the writing instrument are known, the kinematic model can predict where the writing instrument is likely to be at points in the future. Measurements model how sensors in the writing instrument turn the state variables of the writing instrument into recorded numbers. When a measurement is performed by the sensors, this model can then estimate the most likely state variables that may produce this measurement.

[0064] While reference is made herein to use cases in educational settings (for example, notetaking and / or studying using a textbook), the writing instrument and associated system may be used in any other context as well.

[0065] Turning to the figures, FIG. 1 shows a system 100 including a writing instrument 102 as described herein. In embodiments, the system 100 includes the writing instrument 102, a controller 112, a computing device 120, and / or one or more user device(s) 130. However, these components of the system 100 are merely exemplary and are not intended to be limiting in any way. For simplicity, reference may be made hereinafter to a writing instrument 102, controller 112, computing device 120, and / or user device 130, etc., however, this is also not intended to be limiting and may still refer to any number of such elements.

[0066] The writing instrument 102 may be a pen, pencil, marker, and / or any other form of writing instrument that may be used to write on a surface, such as surface 110. As an example, the surface 110 may be a notebook in which text or drawings may be added using the writing instrument 102 (however, the surface 110 may also include any other type of surface, such as a whiteboard, etc.). In this manner, the writing instrument 102 may be used in a traditional sense to hand-write information on the surface 110.

[0067] In contrast with traditional writing instruments, however, the writing instrument 102 shown in FIG. 1 may also include associated hardware and / or software to cause certain actions to be performed by the user device 130. The hardware and / or software associated with the writing instrument 102 may allow the writing instrument 102 to wirelessly communicate with the computing device 120 and / or the user device 130. Particularly, the hardware and / or software may capture data about writing strokes performed on the surface 110 using the writing instrument 102. This data may be wirelessly transmitted to the computing device 120 and / or the user device 130 for processing. When the computing device 120 and / or user device 130identifies that particular that a particular character or characters were written on the surface 1 10 using the writing instrument 102, one or more actions may be performed by the user device 130. For example, if a user is taking hand-written notes in a notebook using the writing instrument 102, certain writing strokes performed using the writing instrument 102 may also cause actions to be performed at the user device 130. Thus, the writing instrument 102 may be used for both hand-written notes and to cause actions to be performed by the user device 130 when pre-defined characters or words are written in the notebook. Both may be performed without requiring the use to switch from the usage of the writing instrument 102 to the usage of the user device 130, which improves efficiency in tasks performed involving the writing instrument 102 and the user device 130.

[0068] As aforementioned, while reference is made herein to writing on a surface, the same methods may still be applicable even if writing is not performed on a surface. For example, a user may simply make the writing strokes associated with writing the character or characters (such as making the writing strokes mid-air) without the writing instrument 102 coming into contact with the surface 110 as well. Accordingly, the surface 110 may not necessarily be required for the actions to be performed.

[0069] In embodiments, a specific character may be pre-defined as indicating that the user desires for an action to be performed by the user device 130. For example, as shown in the use cases of FIGS. 2-4, this character may be a hashtag (“#”) that is written on the surface 110. When the user desires to transition from traditional hand-written notes to cause actions to be performed by the user device 130, the user may write the hashtag symbol on the surface 110 using the writing instrument 102 to signal to the computing device 120 and / or the user device 130 that subsequent writing strokes are intended to indicate actions to be performed by the user device 130.

[0070] Once the computing device 120 identifies that a writing stroke of the writing instrument 102 corresponds to the hashtag character (or any other designated character or characters), the computing device 120 may process subsequent writing strokes to identify an action to perform at the user device 130. For example, the computing device 120 may process subsequent writing strokes to determine if the subsequent writing strokes correspond to a written word that provides an indication of an action to be taken at the user device 130. Examples of such actions may include sending an email, creating a digital note or list, creating a digital image, and / or any othertypes of actions that may be performed by the user device 130. Use cases showing examples of such actions are illustrated and described in further detail with respect to FIGS. 2-5.

[0071] In embodiments, the writing instrument 102 may include one or more different hardware mechanisms for capturing data regarding writing strokes performed using the writing instrument 102. As a first example (as shown in FIG. 1), the writing instrument 102 may include a magnetic transceiver 104 (reference to any “transceiver” herein may similarly refer to only a transmitter or a receiver) that is in communication with a second magnetic transceiver 114 associated with the controller 112 (in some embodiments, the magnetic transceiver 114 and controller 112 may be separate components). The controller 112 and / or second magnetic transceiver 114 may be removably or permanently affixed to the surface 110 at any location on the surface 110. For example, the figure shows the controller 112 and / or second magnetic transceiver 114 disposed at a top edge of the surface 110, however, the controller 112 and / or second magnetic transceiver 114 may similarly be disposed on a bottom edge of the surface 110 or the left edge and / or right edge of the surface 110. The controller 112 and / or second magnetic transceiver 114 may also be disposed proximate to the surface 110 rather than being disposed on the surface 110 itself. The magnetic transceiver 114 magnetic transceiver 104 are shown as dashed boxes to indicate that they are optional hardware mechanisms for capturing data regarding writing strokes performed using the writing instrument 102. Similarly, the resonant circuit 109 (described below) is also shown as a dashed box.

[0072] As a second example, the writing instrument 102 may house a resonant circuit 109 (for example, including one or more capacitors and an inductor) configured to resonate at different frequencies. In some instances, the inductor may be provided as a ferrite component (or may be combined with a ferrite component). In such embodiments, the writing surface 110 may include an electrical grid (which may be in the form of one or more coils provided on and / or within a substrate) through which an oscillating current moves.

[0073] Depending on the frequency at which the resonant circuit 109 is resonating, a change within the electrical grid may be detected at a particular location. For example, the change may correspond to a location at which the writing instrument 102 is provided on the writing pad (for example, when the writing instrument 102 is used to write on the writing pad). The one or more coils provided as part of the electric grid may function as receiving coils such that inductivecoupling may occur between at least one of the coils in the electrical grid and the resonant circuit 109 when the writing instrument is proximate to the writing pad.

[0074] The controller 112 may be configured to receive data indicating these changes to the electrical grid at various points in time. For example, the controller may receive data indicating changes to the electrical properties associated with the one or more coils of the electric grid based on the magnetic field produced by the resonant circuit 109 in the writing instrument 102. Accordingly, the controller 112 may be able to ascertain the writing strokes that were performed and this data may be used to generate the digital representations of the same writing strokes. The digital representations may be digital copies of the writing strokes performed on the surface 110. For example, if the writing instrument 102 is used to physically write the word “the” on paper, the digital representation may be the word “the” presented on a digital device (as a non-limiting example, the word may be presented through a word processing application).

[0075] In embodiments, the resonant circuit 109 may be configured to resonate at a first frequency and a second frequency. Changes to the oscillating current of the writing surface may be detectable when the resonant circuit is resonating at the first frequency but may not be detectable when the resonant circuit is resonating at the second frequency. The resonant circuit may also be configured to resonate at any other number of frequencies as well.

[0076] Further, in embodiments, the first frequency may only be detectable when a reservoir of the writing instrument 102 includes a liquid used for writing (e.g., a writing instrument that is an ink pen may include ink-based liquid) and / or when the writing instrument 102 transfers the liquid onto the surface 110, and the first frequency is not detectable when the reservoir is empty. In yet further embodiments, the resonant circuit 109 may be configured to resonate at a fixed frequency, but the fixed frequency may only be detectable when the liquid is included in the reservoir and / or is being transferred onto the writing surface. However, in further embodiments, the frequency of the resonant circuit 109 may not be dependent on the ink-based liquid within the reservoir.

[0077] For example, the ink may also include properties that cause the ink to affect the function of the resonant circuit 109 included within the writing instrument 100. For example, the ink may also include ferrite or other types of materials. Thus, when the ink is present in the reservoir of the writing instrument 109, the resonant frequency produced by the resonant circuit may be different than when the ink is not present in the reservoir.

[0078] As the writing instrument 102 is used to write on the surface 110, data about the writing strokes that are performed may be captured in real-time. Data about the changing position may be analyzed to identify a particular writing stroke that is being performed by the writing instrument 102. For example, based on data about the changing position of the writing instrument 102 relative to the controller 112, it may be determined that the letter “A” was written using the writing instrument 102. Any other suitable mechanism for ascertaining the changing distance between two objects may also be used in place of the magnetic transceivers as well.

[0079] In embodiments, the writing instrument 102 may also include (or may only include) an optical scanner 106 that may also be used to capture information about writing strokes performed using the writing instrument 102 and / or printed text (for example, printed text that is already included in a textbook). The optical scanner 106 may be a portable scanner. For example, as the optical scanner passes over the text, the optical scanner 106 illuminates the text, and sensors (for example, a charge-coupled device (CCD) array or any other type of sensors) of the optical scanner 106 receive the text as a set of points of light.

[0080] The optical scanner 106 may also be configured to capture information about written or printed text using any other suitable mechanism. For example, the optical scanner 106 may include a camera that is used to capture images and / or video of any writing performed on the surface 110 using the writing instrument 102. The images and / or video may be transmitted to the computing device 120 using the wireless transceiver 108 and the computing device 120 may identify characters that were written on the surface 110 using the images and / or video.

[0081] Once any written or printed text is scanned by the optical scanner 106, the resulting data may be used to convert the printed and / or written text into a digital format and stored on a digital device for subsequent use. For example, a student may use the optical scanner 106 of the writing instrument 102 to scan printed text included in a textbook (as well as any information that is hand-written in the textbook, such as the aforementioned hand-written notes). The data produced by the optical scanner 106 during the scanning process may then be transmitted to the user device 130. The user device 130 may convert the printed text and / or written text into digital text for presentation via a user interface of an application 132 and / or storage at the user device 130 and / or any other device (e.g., computing device 120). In some instances, the data may be transmitted to an intermediary device, such as the computing device 120 for processing rather than being transmitted directly to the user device 130.

[0082] In embodiments, the conversion may be performed using optical character recognition (OCR). OCR is a process that converts data relating to printed and / or written text (e.g., an image of the text) into a machine-readable format. The OCR process converts the data into a two-color or black-and-white version. The image of the printed and / or written text is analyzed to identify light and dark areas, (the darker areas are classified as portions of the image that include text to be converted and the light areas are identified as the background of the image). The darker areas are then processed to identify alphabetic letters or numeric digits.

[0083] The OCR conversion may be performed based on pattern recognition and / or feature detection in some instances. Pattern recognition may be used when examples of text in various fonts and formats are provided as a point of comparison for the text included in the image. Feature detection may be used when the OCR applies rules regarding the features of a specific letter or number to recognize characters in the image. Features include, for example, the number of angled lines, crossed lines, or curves in a character. For example, the capital letter “A” is stored as two diagonal lines that meet with a horizontal line across the middle.

[0084] In embodiments, the computing device 120 may use data from the magnetic transceivers and the optical scanner 106 in combination to determine actions to be performed by the user device 130. Using multiple different types of data capture mechanisms in this manner may provide a verification mechanism to confirm the accuracy of one of the data capture mechanisms.

[0085] Furthermore, to provide for wireless communications between the writing instrument 102 and the computing device 120 and / or the user device 130 (as well as any other elements of the system 100), the writing instrument 102 may include a wireless transceiver 108 (any of the other elements of the system 100 may also include a wireless transceiver as well). The wireless transceiver 108 may allow for any of the data captured by the controller 112 and / or the writing instrument 102 to be transmitted to the computing device 120 and / or user device 130 for processing. The information may be transmitted over a network 140, for example. The network 140 may include, but not limited to, any one of a combination of different types of suitable communications networks such as, for example, broadcasting networks, cable networks, public networks (e.g., the Internet), private networks, wireless networks, cellular networks, or any other suitable private and / or public networks. Further, the network 140 may have any suitable communication range associated therewith and may include, for example, global networks (e.g.,the Internet), metropolitan area networks (MANs), wide area networks (WANs), local area networks (LANs), or personal area networks (PANs). In addition, network 140 may include any type of medium over which network traffic may be carried including, but not limited to, coaxial cable, twisted-pair wire, optical fiber, a hybrid fiber coaxial (HFC) medium, microwave terrestrial transceivers, radio frequency communication mediums, white space communication mediums, ultra-high frequency communication mediums, satellite communication mediums, or any combination thereof. Any of the other elements of the system 100 (for example, the controller 112, computing device 120, and user device 130) may also perform communications over the network 140.

[0086] The user device 130 may be any type of device, such as a smartphone, desktop computer, laptop computer, tablet, and / or any other type of device. The user device 130 may be configured to perform certain actions based on writing strokes performed by the writing instrument 102. Examples of such actions are provided in the use cases illustrated in FIGS. 2-7. In embodiments, the one or more actions may be performed by the user device 130 based on instructions received from the computing device 120. That is, the computing device may process data received from the writing instrument 102 and / or the controller 112 and may transmit instructions for actions to be performed by the user device 130. In other embodiments, the data may be transmitted directly from the writing instrument 102 and / or the controller 112 to the user device 130 and the user device may determine the one or more actions to perform. In further embodiments, the writing instrument 102 and / or the controller 112 may process any data and transmit instructions to the user device 130. For example, the writing instrument 102 may be configured to both capture data regarding writing strokes that are performed and also process the data. Upon processing the data, the writing instrument 102 may transmit instructions to the user device 130 to perform any associated actions (e.g., sending an email, creating a note, etc.). Any reference to the computing device 120 performing any processing or related functionality is not intended to be limiting and such processing may also be performed by the writing instrument 102, user device 130, etc.

[0087] The user device 130 may also include one or more applications 132 that may be used to perform the one or more actions. For example, an application 132 may be an email application 222 shown in FIG. 2, a note application 322 shown in FIG. 3, an image application 422 shown in FIG. 4, a list application 522 shown in FIG. 5, and / or any other type of application.

[0088] The computing device 120 may be any type of device or system (such as a local or remote server for example) used to perform any of the processing of data produced by the writing instrument 102 and / or the controller 112. For example, the computing device 120 may receive data captured by the magnetic transceiver 104, the optical scanner 106, the controller 112, etc. from the wireless transceiver 108 of the writing instrument 102. The computing device 120 may then process the data to determine actions to be performed by the user device 130. For example, the computing device 120 may identify when a hashtag is written on the surface 110. The computing device 120 may then identify subsequent writing strokes to determine the one or more actions to be performed by the user device 130. For example, as shown in the use case of FIG. 2, the word “mail’ may be written on the surface 110, which may indicate to the computing device 120 that it is desired for an email to be sent by the user device 130. The computing device may also perform any other types of data processing described herein. As aforementioned, any of this processing may also be performed by the writing instrument 102, tracking device, user device 130, etc.

[0089] Finally, any of the elements (for example, writing instrument 102, controller 112, computing device 120, and / or user device 130, etc.) of the system 100 may include any of the elements of the computing device 900 as well (for example, any of the elements of the system 100 may include one or more processors (processor(s)) 902, one or more memory devices 904, etc.

[0090] FIG. 2 is a use case 200 for sending an email using the writing instrument 102. The use case 200 illustrates an example of one or more actions that may be performed based on a specific character or characters being identified as being written using the writing instrument 102. Particularly, the one or more actions may include sending an email through a laptop computer 220 (which is an example of a user device 130) based on writing that is performed in a notebook 210 (which is an example of a surface 110) using the writing instrument 102. The action of sending the email may also include any other associated actions. For example, the one or more actions may also include opening an email application 222, adding a recipient email address 224, adding a subject line 226 of the email, adding text to a body of the email 228, adding attachments to the email, saving the email as a draft, adding a delay to the email, and / or any other actions associated with drafting the email, sending the email, etc.

[0091] Any of the one or more actions may be automatically performed at the laptop computer 220 without requiring any direct user interaction with the laptop computer 220. That is, any of the one or more actions associated with sending the email may be automatically performed by the laptop computer 220 based on writing performed in the notebook 210 using the writing instrument 102. In this manner, the user is only required to write the necessary information in the notebook 210 and the laptop computer 220 (and / or any other device) automatically performs the actions.

[0092] To initiate the one or more actions shown in the use case 200, wireless communications including data indicative of the writing strokes being performed by the writing instrument 102 may be transmitted between any combination of the writing instrument 102, the controller 112, the computing device 120, and the laptop computer 220. In embodiments, the computing device 120 may process the data to determine when a specific character is written in the notebook the writing instrument 102. For example, the character may be a hashtag 202 (which is shown in the figure as being written in the notebook 210).

[0093] Based on identifying the hashtag 202 as being written using the writing instrument 102, the computing device 120 may determine that the user intends for one or more actions to be performed by the laptop computer 220. The computing device 120 may determine the specific actions to be performed based on subsequent characters written using the writing instrument 102. For example, the data received by the computing device 120 may indicate that a second set of characters 205 was written using the writing instrument 102. In this instance, the second set of characters 205 includes the word “mail.” The computing device 120 may store in memory a listing of words and actions associated with those words. For example, the computing 212 device may have the word “mail” stored in memory along with an indication that any actions associated with sending an email using the laptop computer 220 are to be performed when the word “mail” is determined to have been written using the writing instrument 102. The computing device 120 may also access the words and associated actions from an external database or in any other suitable manner.

[0094] FIG. 2 also shows additional information 206 written in the notebook 210 using the writing instrument 102. Below the hashtag 204 and the second set of characters 205 (the word “mail”) is information written in the notebook 210 that may be used to perform the one or more actions associated with the second set of characters 205. For example, the additional information206 includes a recipient email address to which the email generated by the laptop computer 220 should be sent, a subject line of the email, and text to be included in a body of the email. This additional information 206 may also include any other relevant information.

[0095] The computing device 120 may use the second set of characters 205 and the additional information 206 to transmit instructions to the laptop 220 to perform the one or more actions (e.g., sending an email). For example, the instructions may indicate for the laptop computer 220 to open the email application 222, open a new email draft, add the recipient email address 224, add the subject line 226, add the email body text 228, etc. In embodiments, the second set of characters 205 and the additional information 206 may also be transmitted directly to the laptop computer 220, the laptop computer 220 may process the data, and the laptop computer 220 may perform the one or more actions based on the data. In further embodiments, the writing instrument 102 may also perform data processing and / or may transmit instructions to the laptop computer 220 as well.

[0096] FIG. 3 is a use case 300 for creating a digital note on a note application 332 of the laptop computer 220 using the writing instrument 102. The note application 332 shown in the figure is merely exemplary and any other type of word processing application may also be used. The creation of the digital note may be another example one or more actions that may be performed by the laptop computer 220 based on writing performed in the notebook 210 using the writing instrument 102.

[0097] Based on identifying the hashtag 302 as being written using the writing instrument 102, the computing device 120 may determine that the user intends for one or more actions to be performed by the laptop computer 220. The computing device 120 may determine the specific actions to be performed based on data indicating characters written using the writing instrument 102 subsequent to the hashtag 304. For example, the data may indicate that a second set of characters 305 was written using the writing instrument 102. In this instance, the second set of characters 305 forms the word “note.” In embodiments, the computing device 120 may have the word “note” stored in memory along with an indication that any actions associated with creating a digital note using the laptop computer 220 are to be performed when the word “note” is determined to have been written using the writing instrument 102. The computing device 120 may also access the words from an external database or in any other suitable manner.

[0098] FIG. 3 also shows additional information 306 written in the notebook 210 using the writing instrument 102. Next to the second set of characters 305 is a third set of characters 306 that form the words “Project X Note.” In this instance, the third set of characters 306 may represent a title of a note to be added to the note application 322. Below the hashtag 304 and the second set of characters 305 (the word “note”) is information written in the notebook 210 that may be used to perform the one or more actions associated with the second set of characters 305. For example, the additional information 307 includes written text “test note” to be added to the note application 322 by the laptop computer 220. As shown in the figure, the note application 322 includes digital text 324 (“test note”) in the note application 322. This text is added to a note tab 326 including the third set of characters 306.

[0099] FIG. 4 is a use case 400 for creating a digital image 424 in an image application 422 using a writing instrument 102. The creation of the digital image may be another example one or more actions that may be performed by the laptop computer 220 based on writing performed in the notebook 210 using the writing instrument 102. The use case 400 also illustrates that the actions performed by the laptop computer 220 may not necessarily be limited to text-based actions, but may also include actions associated with images and / or any other types of content.

[0100] Based on identifying the hashtag 402 as being written using the writing instrument 102, the computing device 120 may determine that the user intends for one or more actions to be performed by the laptop computer 220. The computing device 120 may determine the specific actions to be performed based on data indicating characters written using the writing instrument 102 subsequent to the hashtag 404. For example, the data may indicate that a second set of characters 405 was written using the writing instrument 102. In this instance, the second set of characters 405 forms the word “sketch.” In embodiments, the computing device 120 may have the word “sketch” stored in memory along with an indication that any actions associated with creating a digital note using the laptop computer 220 are to be performed when the word “sketch” is determined to have been written using the writing instrument 102. The computing device 120 may also access the words from an external database or in any other suitable manner.

[0101] FIG. 4 also shows additional information 406 written in the notebook 210 using the writing instrument 102. Below the hashtag 404 and the second set of characters 405 (the word “sketch”) is an image 406 drawn in the notebook 210 that may be used to perform the one or more actions associated with the second set of characters 405. For example, the image 306 is asketch of a vehicle added to the image application 422 by the laptop computer 220. As shown in the figure, the image application 422 includes a digital image 424 of the vehicle in the image application 422.

[0102] FIG. 5 is a use case 500 for creating a digital list 524 within a list application 522. The creation of the digital list may be another example one or more actions that may be performed by the laptop computer 220 based on writing performed in the notebook 210 using the writing instrument 102.

[0103] Based on identifying the hashtag 502 as being written using the writing instrument 102, the computing device 120 may determine that the user intends for one or more actions to be performed by the laptop computer 220. The computing device 120 may determine the specific actions to be performed based on data indicating characters written using the writing instrument 102 subsequent to the hashtag 504. For example, the data may indicate that a second set of characters 505 was written using the writing instrument 102. In this instance, the second set of characters 505 forms the word “todo.” In embodiments, the computing device 120 may have the word “todo” stored in memory along with an indication that any actions associated with creating a digital note using the laptop computer 220 are to be performed when the word “todo” is determined to have been written using the writing instrument 102. The computing device 120 may also access the words from an external database or in any other suitable manner.

[0104] FIG. 5 also shows additional information 506 written in the notebook 210 using the writing instrument 102. Below the hashtag 504 and the second set of characters 505 (the word “todo”) is additional information 506 written in the notebook 210 that may be used to perform the one or more actions associated with the second set of characters 505. For example, the additional information 506 maybe text indicating a listing of items to add to the digital list 524 in the list application 522.

[0105] With reference to the use cases of FIGS. 2-5, the laptop computer 220 may be an exemplary user device 130, however, any other type of user device 130 may also be applicable as well. For example, the one or more actions may similarly be performed by a desktop computer, tablet, etc. Additionally, while the use case 200 shows the surface 110 being a notebook 210, any other type of surface may also be used. For example, the surface 110 may also be a screen of a digital device, such as a tablet, touchscreen laptop or desktop, e-ink device, etc.

[0106] The use of the hashtag to indicate to the computing device 120 that the user desires for one or more actions to be performed by the laptop computer 220 is also merely exemplary. Any other single character, set of characters, or writing stroke in general may also be used to indicate to the computing device 120 that the user desires for one or more actions to be performed by the laptop computer 220.

[0107] While reference may be made herein to identification of characters written using the writing instrument 102, the computing device 120 may generally detect certain writing strokes performed by the writing instrument 102. That is, it may not necessarily be required that characters associated with a written language are written by the writing instrument 102 for any actions to be performed by the laptop computer 220. For example, the one or more actions may be performed based on any other pre-determined writing strokes (e.g., geometric shapes, lines, etc ).

[0108] Additionally, the different sets of characters shown in the use cases to indicate specific types of actions to be performed by the laptop computer 220 are also exemplary. Using the use case 200 as an example, the word “mail” is merely exemplary and any other word may also be used to trigger the one or more actions shown in the use case 200 (for example, “email,” “e- mail,” electronic mail,” “message,” etc.). Additionally, the computing device 120 may not necessarily need to determine that an exact word is written using the writing instrument 102 to initiate the one or more actions. The computing device 120 may also be configured to initiate the one or more actions based on identifying subsets of a group of characters. For example, if the word “electronic mail” is written in the notebook 210 and the word that triggers the computing device 120 to initiate the one or more actions is “mail,” the computing device may identify that the word “mail” is included within “email” and may still initiate the one or more actions even through the exact word “email” was not written in the notebook 210. Additionally, a model (such as artificial intelligence, machine learning, or the like) may be used to determine when a word is written that is intended to trigger an action to be performed by the laptop computer 220.

[0109] Furthermore, it is not necessarily required that any writing stroke be performed on a surface 110 (such as the notebook 210) for the one or more actions to be performed by the laptop computer 220. For example, a user may simply perform the writing strokes 202 midair without actually writing on a surface. Regardless of whether the writing strokes are written on a surfaceusing the writing instrument 102, the writing strokes may still be transmitted to the computing device 120 and processed.

[0110] FIG. 6 is a use case 600 for scanning printed text using a writing instrument 102. The use case 600 shows printed text (for example, first printed text 604, second printed text 606, and third printed text 208) provided in a textbook 610 (which may be an example type of surface 110). As the writing instrument 102 is moved across the printed text by the user, the printed text is scanned by the optical scanner 106, and the resulting data is transmitted to the laptop computer 220. The laptop computer 220 processes the data and generates digital representations of the first printed text 604, the second printed text 606, and the third printed text 608 (referred to as “digital text” for simplicity) based on the data. The digital text may then be presented via a user interface of the laptop computer 220 (such as application 622, which may be a note or a word processing application, for example). The digital text may also be stored on the user device 130 and / or a remote device, such as computing device 120.

[0111] In embodiments, the data may also be transmitted to the computing device 120 for processing as an alternative to being transmitted directly to the laptop computer 220 for processing. For example, the computing device 120 may process the data to generate the digital text and then may transmit the digital text to the laptop computer 220 for presentation via the application 222 and / or storage.

[0112] The use case 200 further illustrates that the optical scanner 106 of the writing instrument 102 may be used to capture elements beyond the printed text itself. For example, the second printed text 206 is highlighted. When the optical scanner 106 is passed over the second printed text 606, the optical scanner 106 not only produces data indicating that the text reads “This is a highlighted sentence,” but also produces data indicating that the text is highlighted. The indication of the highlighting is also provided to the laptop computer 220 and the second digital text 626 corresponding to the second printed text 206 is also shown as highlighted via the application 622. This is advantageous because a user may highlight certain portions of the text in the textbook 210 to emphasize those portions of text and it is beneficial to maintain this emphasis in the digital representation of the text as well.

[0113] In embodiments, stylistic elements of the printed text may also be captured by the optical scanner 106. For example, the third printed text 608 is bolded text. When the optical scanner 206 is passed over the third printed text 608, the optical scanner 106 not only produces dataindicating that the text reads “This is a bold sentence,” but also produces data indicating that the text is bolded. The indication that the text is bolded is also provided to the laptop computer 220 in the data and the third digital text 628 is also shown as bolded via the application 622. The optical scanner 106 may also capture other types of stylistic features, such as italicized text, underlined text, the front of the text, etc. Any of these features may be maintained in the digital text that is generated by the laptop computer 220.

[0114] FIG. 7 is a use case 700 for capturing data about writing performed using the writing instrument 102. For example, the use case 700 shows a user writing text in the textbook 610 using the writing instrument 102. As writing strokes are being performed in the textbook 610, data regarding the writing strokes may be captured by the writing instrument 102 and / or the controller 112. For example, as described with respect to FIG. 1, data regarding the writing strokes may be captured using magnetic transceivers of the writing instrument 102 and the controller 112. Data may also be captured using the optical scanner of the writing instrument 102. The data may also be captured using any other suitable mechanism.

[0115] The data may be transmitted from the writing instrument 102 and / or the controller 112 to the laptop computer 220 for processing. However, as aforementioned, the data may also be transmitted to the computing device 120 for processing and / or some or all of the processing may be performed by the writing instrument 102 and / or the controller 112 as well.

[0116] In embodiments, data including a combination of printed text 702 and written text 704 may be captured. The laptop computer 220 may be configured to distinguish between the printed text 702 and the written text 704 and may present the printed text 702 and written text 704 via the application 722 in different formats. For example, the printed text 302 may be shown as first digital text 724 within the application 722 and the written text 704 may be converted into a comment 726 that includes second digital text 728. For example, if a student is taking handwritten notes in the margins surrounding the printed text 702 in the textbook 610, the written text 704 may be converted into comments in the application to capture the hand-written notes within the application 722. The location in which the comment 726 is provided may correspond to the location of the comment with respect to the printed text 702 in the textbook 610. The representation of the written text 704 as a comment is merely exemplary and the written text 704 may also be presented in any other format after being converted to digital text.

[0117] FIG. 8 shows a use case 827 in which a physical button is provided on the device used by the student to complete tasks. The student may press the button (shown in scene 828) to indicate the start and / or end of a page (for example, a new page in the digital version of the writing strokes being performed using the digital writing device). When a written page is complete, the student may press the button to create a new page in the digital application (shown in scene 829). However, the use of the physical button is exemplary and any other type of mechanism may also be used.

[0118] FIG. 9 shows a use case 930 illustrating that both written text and drawn images (shown in scene 931) may be converted into digital representations that are stored and / or presented via a digital device (shown in scene 932). FIG. 10 shows a use case 1033 in which a sketch is drawn with annotations using the writing instrument (shown in scene 1034). The sketch and annotations are both converted into digital format and displayed on the digital application (shown in scene 1035).

[0119] FIG. 11 depicts an example method 1100. Some or all of the blocks of the process flows in this disclosure may be performed in a distributed manner across any number of devices or systems (for example, writing instrument 102, controller 112, computing device 120, user device 130, computing device 900, etc.). The operations of the method 1100 may be optional and may be performed in a different order.

[0120] At block 1102 of the method 1100, computer-executable instructions stored on the memory of a device may be executed to receive, by a device (for example, writing instrument 102, controller 112, computing device 120, user device 130, computing device 900, etc.), from a writing instrument (for example, writing instrument 102) comprising an apparatus configured to provide an indication of a writing stroke written on a surface (for example, surface 110) using the writing instrument, and via a first wireless communication, an indication of first character written using the writing instrument.

[0121] In embodiments, the apparatus may include the magnetic transceiver 104, the optical scanner 106, and / or any other hardware used to capture data regarding writing strokes performed using the writing instrument. The apparatus may be removably or permanently affixed to the writing instrument. That is, in embodiments, the writing instrument may be a traditional writing instrument, such as a pencil or pen, and the apparatus may be separate hardware that may beprovided on the writing instrument. However, in embodiments, the apparatus may be permanently integrated into the writing instrument.

[0122] Furthermore, it is not necessarily required that any writing stroke be performed on a surface. For example, a user may simply perform the writing strokes midair without actually writing on a surface.

[0123] At block 1104 of the method 1100, computer-executable instructions stored on the memory of a device may be executed to determine that the first character matches a predetermined character for performing an action. For example, the first character may include a hashtag that is written using the writing instrument 102 (as shown in the use cases of FIGS. 2-9). However, the first character is not necessarily limited to a hashtag and may also include any other type of character as well. Additionally, a character associated with a written language may not necessarily be required and any other type writing stroke may also be used as well (for example, a geometric shape, etc.).

[0124] At block 1106 of the method 1100, computer-executable instructions stored on the memory of a device may be executed to receive, by the device, from the apparatus, via a second wireless communication, and subsequent to receiving the first character, one or more second characters written using the writing instrument.

[0125] That is, one the character is identified that signals intent for an action to be performed by the user device (e.g., the hashtag), subsequent characters written using the writing instrument may provide an indication of the particular action to be performed by the user device. For example, as shown in the use case 200 of FIG. 2, a determination that a hashtag followed by “mail” was written in the notebook 210 caused an action of sending an email to be performed by the laptop computer 220.

[0126] At block 1108 of the method 1100, computer-executable instructions stored on the memory of a device may be executed to perform a first type of action by the device based on the one or more second characters. For example, as shown in the use cases of FIGS. 2-5, the laptop computer 220 may perform actions such as drafting and sending an email, generating a note, generating a digital list, creating a digital image, and / or any other different types of actions that may be performed by a user device 130.

[0127] FIG. 12 is a schematic block diagram of an illustrative computing device 1200. The computing device 1200 may include any suitable computing device capable of receiving and / orgenerating data including, but not limited to, a mobile device such as a smartphone, tablet, e- reader, wearable device, or the like; a desktop computer; a laptop computer; a content streaming device; a set-top box; or the like. The computing device 1200 may correspond to an illustrative device configuration for the devices of FIGS. 1-11 (for example, writing instrument 102, controller 112, computing device 120, user device 130, computing device 1200, etc.).

[0128] The computing device 1200 may be configured to communicate via one or more networks with one or more servers, search engines, user devices, or the like. In some embodiments, a single remote server or single group of remote servers may be configured to perform more than one type of content rating and / or machine learning functionality.

[0129] Example network(s) may include, but are not limited to, any one or more different types of communications networks such as, for example, cable networks, public networks (e.g., the Internet), private networks (e.g., frame-relay networks), wireless networks, cellular networks, telephone networks (e g., a public switched telephone network), or any other suitable private or public packet-switched or circuit-switched networks. Further, such network(s) may have any suitable communication range associated therewith and may include, for example, global networks (e.g., the Internet), metropolitan area networks (MANs), wide area networks (WANs), local area networks (LANs), or personal area networks (PANs). In addition, such network(s) may include communication links and associated networking devices (e.g., link-layer switches, routers, etc.) for transmitting network traffic over any suitable type of medium including, but not limited to, coaxial cable, twisted-pair wire (e.g., twisted-pair copper wire), optical fiber, a hybrid fiber-coaxial (HFC) medium, a microwave medium, a radio frequency communication medium, a satellite communication medium, or any combination thereof.

[0130] In an illustrative configuration, the computing device 1200 may include one or more processors (processor(s)) 1202, one or more memory devices 1204 (generically referred to herein as memory 1204), one or more input / output (I / O) interface(s) 1206, one or more network interface(s) 1208, one or more sensors or sensor interface(s) 1210, one or more transceivers 1212, one or more optional speakers 1214, one or more optional microphones 1216, and data storage 1220. The computing device 1200 may further include one or more buses 1218 that functionally couple various components of the computing device 1200. The computing device 1200 may further include one or more antenna(e) 1234 that may include, without limitation, a cellular antenna for transmitting or receiving signals to / from a cellular network infrastructure, anantenna for transmitting or receiving Wi-Fi signals to / from an access point (AP), a Global Navigation Satellite System (GNSS) antenna for receiving GNSS signals from a GNSS satellite, a Bluetooth antenna for transmitting or receiving Bluetooth signals, a Near Field Communication (NFC) antenna for transmitting or receiving NFC signals, and so forth. These various components will be described in more detail hereinafter.

[0131] The bus(es) 1218 may include at least one of a system bus, a memory bus, an address bus, or a message bus, and may permit exchange of information (e.g., data (including computerexecutable code), signaling, etc.) between various components of the computing device 1200. The bus(es) 1218 may include, without limitation, a memory bus or a memory controller, a peripheral bus, an accelerated graphics port, and so forth. The bus(es) 1218 may be associated with any suitable bus architecture including, without limitation, an Industry Standard Architecture (ISA), a Micro Channel Architecture (MCA), an Enhanced ISA (EISA), a Video Electronics Standards Association (VESA) architecture, an Accelerated Graphics Port (AGP) architecture, a Peripheral Component Interconnects (PCI) architecture, a PCI-Express architecture, a Personal Computer Memory Card International Association (PCMCIA) architecture, a Universal Serial Bus (USB) architecture, and so forth.

[0132] The memory 1204 of the computing device 1200 may include volatile memory (memory that maintains its state when supplied with power) such as random access memory (RAM) and / or non-volatile memory (memory that maintains its state even when not supplied with power) such as read-only memory (ROM), flash memory, ferroelectric RAM (FRAM), and so forth. Persistent data storage, as that term is used herein, may include non-volatile memory. In certain example embodiments, volatile memory may enable faster read / write access than non-volatile memory. However, in certain other example embodiments, certain types of non-volatile memory (e g., FRAM) may enable faster read / write access than certain types of volatile memory. In various implementations, the memory 1204 may include multiple different types of memory such as various types of static random access memory (SRAM), various types of dynamic random access memory (DRAM), various types of unalterable ROM, and / or writeable variants of ROM such as electrically erasable programmable read-only memory (EEPROM), flash memory, and so forth. The memory 1204 may include main memory as well as various forms of cache memory such as instruction cache(s), data cache(s), translation lookaside buffer(s) (TLBs), and so forth.Further, cache memory such as a data cache may be a multi-level cache organized as a hierarchy of one or more cache levels (LI, L2, etc.).

[0133] The data storage 1220 may include removable storage and / or non-removable storage including, but not limited to, magnetic storage, optical disk storage, and / or tape storage. The data storage 1220 may provide non-volatile storage of computer-executable instructions and other data. The memory 1204 and the data storage 1220, removable and / or non-removable, are examples of computer-readable storage media (CRSM) as that term is used herein.

[0134] The data storage 1220 may store computer-executable code, instructions, or the like that may be loadable into the memory 1204 and executable by the processor(s) 1202 to cause the processor(s) 1202 to perform or initiate various operations. The data storage 1220 may additionally store data that may be copied to memory 1204 for use by the processor(s) 1202 during the execution of the computer-executable instructions. Moreover, output data generated as a result of execution of the computer-executable instructions by the processor(s) 1202 may be stored initially in memory 1204, and may ultimately be copied to data storage 1220 for nonvolatile storage.

[0135] More specifically, the data storage 1220 may store one or more operating systems (O / S) 1222; one or more database management systems (DBMS) 1224; and one or more program module(s), applications, engines, computer-executable code, scripts, or the like such as, for example, one or more module(s) 1226. Some or all of these module(s) may be sub-module(s). Any of the components depicted as being stored in data storage 1220 may include any combination of software, firmware, and / or hardware. The software and / or firmware may include computer-executable code, instructions, or the like that may be loaded into the memory 1204 for execution by one or more of the processor(s) 1202. Any of the components depicted as being stored in data storage 1220 may support functionality described in reference to correspondingly named components earlier in this disclosure.

[0136] The data storage 1220 may further store various types of data utilized by components of the computing device 1200. Any data stored in the data storage 1220 may be loaded into the memory 1204 for use by the processor(s) 1202 in executing computer-executable code. In addition, any data depicted as being stored in the data storage 1220 may potentially be stored in one or more datastore(s) and may be accessed via the DBMS 1224 and loaded in the memory 1204 for use by the processor(s) 1202 in executing computer-executable code. The datastore(s)may include, but are not limited to, databases (e.g., relational, object-oriented, etc.), file systems, flat files, distributed datastores in which data is stored on more than one node of a computer network, peer-to-peer network datastores, or the like. In FIG. 12, the datastore(s) may include, for example, purchase history information, user action information, user profile information, a database linking search queries and user actions, and other information.

[0137] The processor(s) 1202 may be configured to access the memory 1204 and execute computer-executable instructions loaded therein. For example, the processor(s) 1202 may be configured to execute computer-executable instructions of the various program module(s), applications, engines, or the like of the computing device 1200 to cause or facilitate various operations to be performed in accordance with one or more embodiments of the disclosure. The processor(s) 1202 may include any suitable processing unit capable of accepting data as input, processing the input data in accordance with stored computer-executable instructions, and generating output data. The processor(s) 1202 may include any type of suitable processing unit including, but not limited to, a central processing unit, a microprocessor, a Reduced Instruction Set Computer (RISC) microprocessor, a Complex Instruction Set Computer (CISC) microprocessor, a microcontroller, an Application Specific Integrated Circuit (ASIC), a Field- Programmable Gate Array (FPGA), a System-on-a-Chip (SoC), a digital signal processor (DSP), and so forth. Further, the processor(s) 1202 may have any suitable microarchitecture design that includes any number of constituent components such as, for example, registers, multiplexers, arithmetic logic units, cache controllers for controlling read / write operations to cache memory, branch predictors, or the like. The microarchitecture design of the processor(s) 1202 may be capable of supporting any of a variety of instruction sets.

[0138] Referring now to functionality supported by the various program module(s) depicted in FIG. 12, the module(s) 1226 may include computer-executable instructions, code, or the like that responsive to execution by one or more of the processor(s) 1202 may perform functions including, but not limited to, processing data received by the writing instrument 102 and / or the controller 112, causing one or more actions to be performed by the user device 130, etc.

[0139] Referring now to other illustrative components depicted as being stored in the data storage 1220, the O / S 1222 may be loaded from the data storage 1220 into the memory 1204 and may provide an interface between other application software executing on the computing device 1200 and hardware resources of the computing device 1200. More specifically, the O / S 1222may include a set of computer-executable instructions for managing hardware resources of the computing device 1200 and for providing common services to other application programs (e.g., managing memory allocation among various application programs). In certain example embodiments, the O / S 1222 may control execution of the other program module(s) to dynamically enhance characters for content rendering. The O / S 1222 may include any operating system now known or which may be developed in the future including, but not limited to, any server operating system, any mainframe operating system, or any other proprietary or nonproprietary operating system.

[0140] The DBMS 1224 may be loaded into the memory 1204 and may support functionality for accessing, retrieving, storing, and / or manipulating data stored in the memory 1204 and / or data stored in the data storage 1220. The DBMS 1224 may use any of a variety of database models (e g., relational model, object model, etc.) and may support any of a variety of query languages. The DBMS 1224 may access data represented in one or more data schemas and stored in any suitable data repository including, but not limited to, databases (e.g., relational, object-oriented, etc.), fde systems, flat files, distributed datastores in which data is stored on more than one node of a computer network, peer-to-peer network datastores, or the like. In those example embodiments in which the computing device 1200 is a mobile device, the DBMS 1224 may be any suitable light-weight DBMS optimized for performance on a mobile device.

[0141] Referring now to other illustrative components of the computing device 1200, the input / output (I / O) interface(s) 1206 may facilitate the receipt of input information by the computing device 1200 from one or more I / O devices as well as the output of information from the computing device 1200 to the one or more I / O devices. The I / O devices may include any of a variety of components such as a display or display screen having a touch surface or touchscreen; an audio output device for producing sound, such as a speaker; an audio capture device, such as a microphone; an image and / or video capture device, such as a camera; a haptic unit; and so forth. Any of these components may be integrated into the computing device 1200 or may be separate. The I / O devices may further include, for example, any number of peripheral devices such as data storage devices, printing devices, and so forth.

[0142] The I / O interface(s) 1206 may also include an interface for an external peripheral device connection such as universal serial bus (USB), FireWire, Thunderbolt, Ethernet port or other connection protocol that may connect to one or more networks. The I / O interface(s) 1206 mayalso include a connection to one or more of the antenna(e) 1234 to connect to one or more networks via a wireless local area network (WLAN) (such as Wi-Fi) radio, Bluetooth, ZigBee, and / or a wireless network radio, such as a radio capable of communication with a wireless communication network such as a Long Term Evolution (LTE) network, WiMAX network, 3G network, ZigBee network, etc.

[0143] The computing device 1200 may further include one or more network interface(s) 1208 via which the computing device 1200 may communicate with any of a variety of other systems, platforms, networks, devices, and so forth. The network interface(s) 1208 may enable communication, for example, with one or more wireless routers, one or more host servers, one or more web servers, and the like via one or more of networks (for example, network 140).

[0144] The antenna(e) 1234 may include any suitable type of antenna depending, for example, on the communications protocols used to transmit or receive signals via the antenna(e) 1234. Non-limiting examples of suitable antennas may include directional antennas, non-directional antennas, dipole antennas, folded dipole antennas, patch antennas, multiple-input multiple-output (MIMO) antennas, or the like. The antenna(e) 1234 may be communicatively coupled to one or more transceivers 1212 or radio components to which or from which signals may be transmitted or received.

[0145] As previously described, the antenna(e) 1234 may include a cellular antenna configured to transmit or receive signals in accordance with established standards and protocols, such as Global System for Mobile Communications (GSM), 3G standards (e.g., Universal Mobile Telecommunications System (UMTS), Wideband Code Division Multiple Access (W-CDMA), CDMA2000, etc.), 4G standards (e.g., Long-Term Evolution (LTE), WiMax, etc.), direct satellite communications, or the like.

[0146] The antenna(e) 1234 may additionally, or alternatively, include a Wi-Fi antenna configured to transmit or receive signals in accordance with established standards and protocols, such as the IEEE 802.11 family of standards, including via 2.4 GHz channels (e.g., 802.1 lb, 802.11g, 802.1 In), 5 GHz channels (e.g., 802.1 In, 802.1 lac), or 60 GHz channels (e.g., 802.1 lad). In alternative example embodiments, the antenna(e) 1234 may be configured to transmit or receive radio frequency signals within any suitable frequency range forming part of the unlicensed portion of the radio spectrum.

[0147] The antenna(e) 1234 may additionally, or alternatively, include a GNSS antenna configured to receive GNSS signals from three or more GNSS satellites carrying time-position information to triangulate a position therefrom. Such a GNSS antenna may be configured to receive GNSS signals from any current or planned GNSS such as, for example, the Global Positioning System (GPS), the GLONASS System, the Compass Navigation System, the Galileo System, or the Indian Regional Navigational System.

[0148] The transceiver(s) 1212 may include any suitable radio component(s) for - in cooperation with the antenna(e) 1234 - transmitting or receiving radio frequency (RF) signals in the bandwidth and / or channels corresponding to the communications protocols utilized by the computing device 1200 to communicate with other devices. The transceiver(s) 1212 may include hardware, software, and / or firmware for modulating, transmitting, or receiving - potentially in cooperation with any of antenna(e) 1234 - communications signals according to any of the communications protocols discussed above including, but not limited to, one or more Wi-Fi and / or Wi-Fi direct protocols, as standardized by the IEEE 802.11 standards, one or more non- Wi-Fi protocols, or one or more cellular communications protocols or standards. The transceiver(s) 1212 may further include hardware, firmware, or software for receiving GNSS signals. The transceiver(s) 1212 may include any known receiver and baseband suitable for communicating via the communications protocols utilized by the computing device 1200. The transceiver s) 1212 may further include a low noise amplifier (LNA), additional signal amplifiers, an analog-to-digital (A / D) converter, one or more buffers, a digital baseband, or the like.

[0149] The sensor(s) / sensor interface(s) 1210 may include or may be capable of interfacing with any suitable type of sensing device such as, for example, inertial sensors, force sensors, thermal sensors, and so forth. Example types of inertial sensors may include accelerometers (e.g., MEMS-based accelerometers), gyroscopes, and so forth.

[0150] It should be appreciated that the program module(s), applications, computer-executable instructions, code, or the like depicted in FIG. 12 as being stored in the data storage 1220 are merely illustrative and not exhaustive and that processing described as being supported by any particular module may alternatively be distributed across multiple module(s) or performed by a different module. In addition, various program module(s), script(s), plug-in(s), Application Programming Interface(s) (API(s)), or any other suitable computer-executable code hostedlocally on the computing device 1200, and / or hosted on other computing device(s) accessible via one or more networks, may be provided to support functionality provided by the program module(s), applications, or computer-executable code depicted in FIG. 12 and / or additional or alternate functionality. Further, functionality may be modularized differently such that processing described as being supported collectively by the collection of program module(s) depicted in FIG. 12 may be performed by a fewer or greater number of module(s), or functionality described as being supported by any particular module may be supported, at least in part, by another module. In addition, program module(s) that support the functionality described herein may form part of one or more applications executable across any number of systems or devices in accordance with any suitable computing model such as, for example, a client-server model, a peer-to-peer model, and so forth. In addition, any of the functionality described as being supported by any of the program module(s) depicted in FIG. 12 may be implemented, at least partially, in hardware and / or firmware across any number of devices.

[0151] It should further be appreciated that the computing device 1200 may include alternate and / or additional hardware, software, or firmware components beyond those described or depicted without departing from the scope of the disclosure. More particularly, it should be appreciated that software, firmware, or hardware components depicted as forming part of the computing device 1200 are merely illustrative and that some components may not be present or additional components may be provided in various embodiments. While various illustrative program module(s) have been depicted and described as software module(s) stored in data storage 1220, it should be appreciated that functionality described as being supported by the program module(s) may be enabled by any combination of hardware, software, and / or firmware. It should further be appreciated that each of the above-mentioned module(s) may, in various embodiments, represent a logical partitioning of supported functionality. This logical partitioning is depicted for ease of explanation of the functionality and may not be representative of the structure of software, hardware, and / or firmware for implementing the functionality. Accordingly, it should be appreciated that functionality described as being provided by a particular module may, in various embodiments, be provided at least in part by one or more other module(s). Further, one or more depicted module(s) may not be present in certain embodiments, while in other embodiments, additional module(s) not depicted may be present and may support at least a portion of the described functionality and / or additional functionality. Moreover, whilecertain module(s) may be depicted and described as sub-module(s) of another module, in certain embodiments, such module(s) may be provided as independent module(s) or as sub-module(s) of other module(s).

[0152] Program module(s), applications, or the like disclosed herein may include one or more software components including, for example, software objects, methods, data structures, or the like. Each such software component may include computer-executable instructions that, responsive to execution, cause at least a portion of the functionality described herein (e.g., one or more operations of the illustrative methods described herein) to be performed.

[0153] A software component may be coded in any of a variety of programming languages. An illustrative programming language may be a lower-level programming language such as an assembly language associated with a particular hardware architecture and / or operating system platform. A software component comprising assembly language instructions may require conversion into executable machine code by an assembler prior to execution by the hardware architecture and / or platform.

[0154] Another example programming language may be a higher-level programming language that may be portable across multiple architectures. A software component comprising higher- level programming language instructions may require conversion to an intermediate representation by an interpreter or a compiler prior to execution.

[0155] Other examples of programming languages include, but are not limited to, a macro language, a shell or command language, a job control language, a script language, a database query or search language, or a report writing language. In one or more example embodiments, a software component comprising instructions in one of the foregoing examples of programming languages may be executed directly by an operating system or other software component without having to be first transformed into another form.

[0156] A software component may be stored as a file or other data storage construct. Software components of a similar type or functionally related may be stored together such as, for example, in a particular directory, folder, or library. Software components may be static (e.g., pre- established or fixed) or dynamic (e.g., created or modified at the time of execution).

[0157] Software components may invoke or be invoked by other software components through any of a wide variety of mechanisms. Invoked or invoking software components may comprise other custom-developed application software, operating system functionality (e.g., devicedrivers, data storage (e.g., fde management) routines, other common routines and services, etc.), or third-party software components (e.g., middleware, encryption, or other security software, database management software, file transfer or other network communication software, mathematical or statistical software, image processing software, and format translation software).

[0158] Software components associated with a particular solution or system may reside and be executed on a single platform or may be distributed across multiple platforms. The multiple platforms may be associated with more than one hardware vendor, underlying chip technology, or operating system. Furthermore, software components associated with a particular solution or system may be initially written in one or more programming languages, but may invoke software components written in another programming language.

[0159] Computer-executable program instructions may be loaded onto a special-purpose computer or other particular machine, a processor, or other programmable data processing apparatus to produce a particular machine, such that execution of the instructions on the computer, processor, or other programmable data processing apparatus causes one or more functions or operations specified in the flow diagrams to be performed. These computer program instructions may also be stored in a computer-readable storage medium (CRSM) that upon execution may direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement one or more functions or operations specified in the flow diagrams. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational elements or steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process.

[0160] Additional types of CRSM that may be present in any of the devices described herein may include, but are not limited to, programmable random access memory (PRAM), SRAM, DRAM, RAM, ROM, electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the information and which can be accessed. Combinations of any of the above are also included within the scope of CRSM. Alternatively, computer-readable communication media (CRCM)may include computer-readable instructions, program module(s), or other data transmitted within a data signal, such as a carrier wave, or other transmission. However, as used herein, CRSM does not include CRCM.

[0161] FIG. 13 depicts a writing instrument 1300 including a housing 1302, a nosecone 1304 disposed at a distal end of the housing 1302, and a grip 1306 provided on the nosecone 1304. In embodiments, writing instrument 1300 may be an ink-based digital writing instrument that is configured to both perform writing strokes on a physical writing pad and also cause a digital reproduction of the writing to be generated for presentation and / or storage on a digital device, such as a desktop or laptop computer, tablet, etc. Particularly, the writing instrument 1300 is shown as being a pen that may be used to write on a writing surface, such as paper, using an inkbased liquid that is stored within a reservoir of the pen (shown as reservoir 1402 in FIG. 14). The writing instrument 1300 may also include a writing instrument tip 1301 through which the linkbased liquid may transfer from the writing instrument 1300 to the writing surface while writing strokes are being performed on the writing surface. The shape and size of the writing instrument 1300 shown in the figure is merely exemplary, and any other shape and size of writing instrument may also be used (including various shapes and sizes of the components of the writing instrument, such as the housing 1302, nosecone 1304, grip 1306, etc.). The writing instrument 1300 may include any number of suitable materials or combinations of materials, such as plastics, metals, etc.

[0162] The grip 1306 may be a portion of the writing pad 1300 that a user may grasp to more effectively hold and write with the writing instrument 1300. The grip 1306 may be configured to slide along an exterior of the writing instrument 1300 (for example, along the housing 1302) such that the grip 1306 may be added to and removed from the writing instrument 1300 as desired by a user. However, in some instances, the grip may be permanently affixed to the writing instrument 1300. The grip 1306 may be retrofittable to a plurality of ink-based writing instruments and / or any other type of writing instrument. The grip 1306 may include any suitable type of material, such as rubber, plastic, etc.

[0163] FIG. 14 depicts a cross-section of the writing instrument 1300 of FIG. 13. The crosssection shows the reservoir 1402 that is provided within the housing 1302 of the writing instrument 1300. The reservoir 1402 may hold any type of suitable ink-based liquid that may be used to write on a writing pad using the writing instrument 1300. For example, the ink-basedliquid may include an oil or water-based ink, or any other type of ink that may be provided within a pen (or other suitable writing instrument). This ink-based liquid may be selectively added to and removed from the reservoir 1402 by removing a cap 1404 provided at a proximal end of the writing instrument 1300, for example. The reservoir 1402 may also be used to hold any other type of liquid used with a writing instrument. For example, the writing instrument 2900 is a dry-erase marker, including a dry-erase liquid.

[0164] In embodiments, the writing instrument 1300 also includes a capacitive assembly that is disposed within the housing 1302. The capacitive assembly may be disposed within the nosecone 1304 of the writing instrument 1300. The nosecone 1304 may also be removably coupled to the housing 1302 such that the capacitive assembly is configured to be separated from the housing 1302 with the nosecone 1304. In embodiments, the capacitive assembly may also be disposed within the grip 1306 of the writing instrument 1300 or at any other location on or within the writing instrument 1300. FIG. 15 depicts a close-up view of a cross-section of the nosecone 1304 of the writing instrument 1300 of FIG. 13.

[0165] The capacitive assembly may be a portion of an LC or resonant circuit formed by the capacitive assembly and a ferrite component 1408 (as aforementioned, ferrite is merely exemplary and any other suitable type of component may also be used, including any other type of core, copper wire wound into coils, etc.). The capacitive assembly may be provided on a printed circuit board 1406, which may be in electrical communication with the ferrite component 1408 to form the resonant circuit. For example, a wire (such as a copper wire or any other type of suitable wire) may be soldered to the printed circuit board and electrically connected to the ferrite component 1408 to complete the circuit between the capacitive assembly and the ferrite component 1408.

[0166] In embodiments, the resonant circuit is configured to resonate at different frequencies based on certain conditions. For example, the resonant circuit may be configured to produce frequencies between 0-531kHz (however, this frequency range is merely exemplary and not limiting). The writing instrument 1300 may be a part of a broader system including, for example, the writing instrument 1300, a writing pad, and / or a digital device, such as a desktop or laptop computer, tablet, etc. (additional details about the writing pad and digital device may be provided with respect to at least FIGS. 25-28D). The writing pad may include an electrical grid including one or more coils, wherein an oscillating current moves across the electrical grid.

[0167] Depending on the frequency at which the resonant circuit is resonating, a change within the electrical grid may be detected at a particular location. As aforementioned, the one or more coils provided as part of the electric grid may function as receiving coils such that inductive coupling may occur between at least one of the coils in the electrical grid and the ferrite core when the writing instrument 1300 is proximate to the writing pad (for example, when the writing instrument 1300 is used to write on the writing pad). A controller provided at the writing pad may be configured to detect the changes to the properties associated with the one or more coils of the electrical grid. In this manner, the system may be able to identify the writing strokes being performed on the writing pad using the writing instrument and may be able to generate digital representations of the writing strokes. These digital representations may then be presented and / or stored at the digital device.

[0168] In embodiments, the resonant circuit may be configured to resonate at a first frequency and a second frequency. The controller may detect the changes in the properties associated with the one or more coils of the writing pad when the resonant circuit is resonating at the first frequency but may not detect the changes when the resonant circuit is resonating at the second frequency. The resonant circuit may also be configured to resonate at any other number of frequencies as well.

[0169] Further, in embodiments, the first frequency may only be detectable when the reservoir 1402 includes the ink-based liquid and / or when the writing instrument 1300 transfers the inkbased liquid onto the writing pad, and the first frequency is not detectable when the reservoir is empty. For example, the ink may also include properties that cause the ink to affect the function of the resonant circuit included within the writing instrument 1300. For example, the ink may also include ferrite or other types of materials. Thus, when the ink is present in the reservoir of the ink-based digital writing instrument, the resonant frequency produced by the resonant circuit may be different than when the ink is not present in the reservoir.

[0170] In yet further embodiments, the resonant circuit may be configured to resonate at a fixed frequency, but the fixed frequency may only be detectable when the ink-based liquid is included in the reservoir 1402 and / or is being transferred onto the writing surface.

[0171] In embodiments, a slidable switch may be provided on the exterior and / or interior of the writing instrument 1300. In embodiments in which the slidable switch is provided on the exterior of the writing instrument 1300, the slidable switch is configured to be moved between multiplepositions based on the usage of the writing instrument 1300. That is, when pressure is applied to the writing instrument 1300 by pressing the writing instrument against the writing pad, the pressure is transferred through the writing instrument 1300 to cause a change in the resonant frequency through the operation of the switch. In this manner, the user may manually control whether digital representations of the writing strokes performed using the writing instrument 1300 are generated. An example switching mechanism is provided in FIGS. 23-24.

[0172] Depending on the position of the slidable switch, the resonant circuit may be configured to resonate at the first frequency or the second frequency. For example, when the slidable switch is in a first position, the resonant circuit may be configured to resonate at the first frequency that is detectable by the controller. When the slidable switch is in the second position, the resonant circuit may be configured to resonate at the second frequency that is not detectable by the controller. The resonant circuit may also be configured to resonate at any other number of frequencies (or not resonate at all) based on the position of the slidable switch.

[0173] The switch may cause these changes in the resonant frequency of the resonant circuit in any suitable manner. For example, actuating the switch between the first position and the second position may cause a change in the capacitance of the capacitive assembly (such as opening and closing a portion of the circuit such that additional capacitors are connected to and disconnected from the capacitive assembly based on the position of the switch).

[0174] In embodiments in which the slidable switch is provided in the writing instrument 1300, the slidable switch may be movable from the first position to the second position (and vice versa) based on a spring-loaded mechanism provided within the writing instrument 1300.

[0175] In embodiments, mechanisms other than inductive coupling may be used as alternatives (or used in combination with inductive coupling) to track the position of the writing instrument 1300. As another example, the writing instrument 1300 may include a magnetic transceiver (reference to any “transceiver” herein is not intended to be limiting and may similarly refer to only a transmitter or a receiver) that is in communication with a second magnetic transceiver associated with the controller (in some embodiments, the magnetic transceiver and controller may be separate components).

[0176] The controller and / or second magnetic transceiver may be removably or permanently affixed to the writing pad at any location on the writing pad. For example, the controller and / or second magnetic transceiver may be disposed at a top edge of the writing pad, however, thecontroller and / or second magnetic transceiver may similarly be disposed on a bottom edge of the writing pad or the left edge and / or right edge of the writing pad. The controller and / or second magnetic transceiver may also be disposed proximate to the writing pad rather than being disposed on the surface itself. The controller and magnetic transceivers may also be provided at any other location on the writing instrument 1300 and / or the writing pad as well (or provided as separate, standalone components).

[0177] The position of the writing instrument may also be tracked using any other suitable mechanism. As yet another example, an optical sensor or sensors, such as a camera, may be used to track the position of the writing instrument 1300. Further examples of different types of sensors that may be used are provided with respect to at least FIGS. 33-35 as well. Such information may also be communicated between the writing instrument 1300 and writing pad (e g., the controller associated with the writing pad) using wired or wireless communications protocols as well.

[0178] FIG. 16 depicts another cross-section of the nosecone 1304 of the writing instrument 1300 of FIG. 13. Particularly, the cross-section of FIG. 16 shows components inside the nosecone 1304 that are located underneath the components shown in the cross-section of FIG. 15. That is, the reservoir 1402 may extend through the nosecone 1304 within the structure on which the capacitive assembly is provided (this is more clearly shown in the exploded view of FIG. 20).

[0179] FIGS. 17A-17C depict further cross-sections of the nosecone 1304 of writing instruments 1300. The cross-sections of FIGS. 17A-17C illustrate that the dimensions of the components of the capacitive assembly, as well as their positioning within the nosecone 1304, may vary among different embodiments. For example, FIG. 17A illustrates an embodiment in which the diameter of the ferrite component 1408 is 12.5mm, the thickness of the ferrite component 1408 is 1mm, and the length of the ferrite component 1408 is 12mm. The ferrite core 1408 is provided at a distance of approximately 6mm from the electrical grid of the writing pad when the writing instrument 1300 is in contact with the writing pad.

[0180] FIG. 17B illustrates an embodiment in which the diameter of the ferrite component 1408 is also 12.5mm, the thickness of the ferrite component 1408 is 1mm, and the length of the ferrite component 1408 is 12mm. The ferrite core 1408 is also provided at a distance of approximately 6mm from the electrical grid of the writing pad when the writing instrument 1300 is in contactwith the writing pad. However, the shape of the nosecone 1304 is different than the shape of the nosecone 1304 shown in FIG. 17A and the printed circuit board 1406 is provided at a different location within the nosecone 1304 than the printed circuit board in FIG. 17A. FIG. 17B thus also illustrates that the locations of the components of the capacitive assembly within the nosecone 1304 may vary depending on the size and shape of the particular nosecone 1304 that is used.

[0181] FIG. 17C illustrates another embodiment in which the diameter of the ferrite component 1408 is also 14.5mm or 12.5mm, the thickness of the ferrite component 1408 is 1mm, and the length of the ferrite component 1408 is 20mm. The ferrite core 1408 is also provided at a distance of approximately 8mm from the electrical grid of the writing pad when the writing instrument 1300 is in contact with the writing pad. These dimensions and distances illustrated in FIGS. 17A-17C are merely exemplary and are not intended to be limiting.

[0182] FIG. 18 depicts another cross-section of the writing instrument 1300 of FIG. 13. Particularly, FIG. 18 shows a top-down view of the writing instrument 1300 including the printed circuit board 1406. The size, shape, and location of the printed circuit board 1406 as shown in FIG. 18 is merely exemplary. FIG. 19 depicts a close-up view of the cross-section of the nosecone 1304 of the writing instrument 1300 of FIG. 18.

[0183] FIG. 20 depicts an exploded view of the writing instrument 1300 of FIG. 13. The exploded view shows the reservoir 1402 and nosecone 1304, as well as components that may be included within the nosecone 1304. In embodiments, the nosecone 1304 may include a barrel 2002 and a tip 2004. The barrel 2002 and / or the tip 2004 may be threaded such that the tip 2004 may be removably screwed into the barrel 2002 (or vice versa). The barrel 2002 and the tip 2004 may also be removably coupled using any other suitable mechanism.

[0184] Within the nosecone 1304 may be provided a first hollow structure 2006 and a second hollow structure 2008. The first hollow structure 2006 may be configured to hold the printed circuit board 1406 that may form a portion of the resonant circuit. For example, the first hollow structure 2006 may include one or more protrusions 2010 that may interface with one or more corresponding slots (for example, slot 2012) in the printed circuit board 206 to secure the printed circuit board 1406 to the first hollow structure 2006. The printed circuit board 1406 may also be removably secured to the first hollow structure 2006 using any other suitable mechanism (for example, an adhesive, etc ). The first hollow structure 2006 may also include a threaded portion 2014 such that the first hollow structure 2006 may also be removably screwed into the barrel2002 (or vice versa). The first hollow structure 2006 may also be secured within the barrel 2002 using any other suitable mechanism.

[0185] The second hollow structure 2008 may be configured to hold the ferrite core 1408 that also forms a portion of the resonant circuit. In embodiments, the ferrite core 1408 may be provided around the second hollow structure 2008. The second hollow structure 2008 may be removably inserted within the first hollow structure 2006 and the tip 2004 such that the second hollow structure 2008 may be secured within the nosecone 1304. However, the second hollow structure 2008 may also be secured within the nosecone 1304 using any other suitable mechanism.

[0186] In embodiments, all of the components of the nosecone 1304 (for example, the barrel 2002 and the tip 2004) as well as the structures found within the nosecone 1304 (for example, the first hollow structure 2006 and the second hollow structure 2008) may be hollow such that the reservoir 1402 and writing instrument tip 1301 may be removably inserted through the nosecone such that the writing instrument tip 1301 may then be used to perform writing strokes on a writing surface.

[0187] FIG. 21 depicts internal components of a nosecone 1304 of a writing instrument.Particularly, the figure shows a writing instrument 1300 that is constructed using the elements of the exploded view shown in FIG. 20 without the barrel 2002 of the nosecone 1304. The nosecone 1304 may include a retaining clip that is used to hold the grip 1304 in place. Also shown is an example switch 2104. In embodiments, the switch 2104 may be actuated based on pressure provided by the grip 1304 when a user provides a gripping force against the grip 1304. The switch 2104 may also be actuated in any other suitable manner, such as when a pressure force is provided to the writing instrument 1300 when the writing instrument presses against a surface to perform a writing stroke. FIG. 22 shows that the barrel 2002 may be removably inserted onto the writing instrument 1300.

[0188] FIG. 23 depicts another nosecone 2300 of a writing instrument (for example, writing instrument 1300 or any other writing instrument described herein or otherwise) including a switching mechanism 2302. FIG. 24 depicts a cross-sectional view of the example switching mechanism 2302. The plate 2304 may be fixed in the grip 2301, which may move relative to the body of the writing instrument when the writing instrument makes contact with a surface (e.g., paper, etc.). In embodiments, the plate 2304 may always be in contact with a spring pin 2306 butmay not necessarily always be in contact with a fixed length contact 2307. As the writing instrument comes into contact with the surface, the grip 2301 continues to move towards the nib of the writing instrument until the plate 2304 contacts the fixed length contact 2307, thus electrically connecting the two pins to form a closed switch.

[0189] Although the writing instrument 1300 is shown as a pen that allows a user to perform writing strokes using an ink-based liquid, any other suitable type of writing instrument may also be used. For example, FIG. 29 shows another example type of writing instrument 2900 in the form of a dry-erase marker. The dry -erase marker may also include a housing 2902 and a reservoir 2904. Dry-erase ink may be provided within the reservoir 2904 and may be used to perform writing strokes on a dry -erase board, such as a whiteboard. The writing instrument 2900 may also include a cap 2906 in which similar elements found in the nosecone of the writing instrument 1300 may be provided (for example, capacitive assembly, etc.).

[0190] FIG. 25 depicts an example system 2500. The system 2500 may include, for example, one or more writing instruments (such as writing instrument 1300, writing instrument 2900, and / or any other writing instrument described herein or otherwise), one or more writing pads 2504 (such as writing pad 2600, writing pad 2700, writing pad 2800, and / or any other writing pad described herein or otherwise), one or more digital devices 2506, and / or one or more remote servers 2507. However, these components of the system 2500 are merely exemplary and are not intended to be limiting in any way. For simplicity, reference may be made hereinafter to a writing instrument, a writing pad 2504, a digital device 2506, a remote server 2507, etc., however, this is not intended to be limiting and may still refer to any number of such elements.

[0191] The writing instrument may include any of the various types of writing instruments described herein. For example, the writing instruments may be ink-based digital writing instruments that include conventional elements of writing instruments as well as electrical components used to generate digital representations of writing strokes performed using the writing instruments (such as the resonant circuit including the capacitive assembly and the ferrite core 1408). The system 2500 specifically shows a pen 2501 and a dry-erase marker 2502 as example writing instruments.

[0192] The writing pad 2504 may be any type of surface on which writing strokes from the various types of writing instruments may be performed. For example, FIG. 26 shows a writing pad 2600 in the form of a dry-erase board on which writing strokes may be performed using adry -erase marker (such as dry-erase marker 2502, writing instrument 2900, etc ). FIG. 27 shows a writing pad 2700 including paper on which writing strokes may be performed using an inkbased liquid pen (such as pen 2501, writing instrument 1300, etc.). FIGS. 28A-28D show a writing pad 2800 in the form of a notebook that may be foldable into numerous different configurations. The notebook may also include a dry-erase board and / or paper on which writing strokes may be performed. These are merely non-limiting examples of different types of writing pads.

[0193] The writing pad 2504 may include an electrical grid through which an oscillating current may move. The electric grid may be formed using one or more coils that are provided on and / or within a substrate. The current may be provided by a power source, such as a battery, for example. The coils forming the electric grid may be provided in any suitable arrangement, dimensions, shapes, etc. For example, the writing pad 2504 shown in FIG. 25 includes a substrate 2508 including one or more coils (such as coil(s) 2510 and coil(s) 1312). FIG. 25 includes two sets of coils (coil(s) 2510 and coil(s) 2512) provided on either side of the substrate 2508 to illustrate that, in some embodiments, writing strokes may be detected on both sides of the writing pad 2504(for example, a front and back of the writing pad). This configuration may also be applicable where the writing pad 2504 is foldable, such as shown in FIGS. 28A-28D. However, this is not intended to be limiting and, in other embodiments, one or more coils may only be provided on one side of the substrate 2508 as well.

[0194] In some embodiments, the substrate 2508 (including the one or more coils on or within the substrate 2508) may be integrated into the writing pad. However, in other embodiments, the substrate 2508 may be removably provided on the writing pad. For example, the substrate 2508 may include a flexible material. A benefit of providing the substrate 2508 as a removable component is that the substrate may be transferrable to different writing pads rather than being permanently affixed within a single writing pad.

[0195] Depending on the type of writing instrument that is intended to be used with the writing pad, a particular type of writing surface may be provided on top of the substrate 2508. For example, the writing pad 2600 is intended for use with a writing instrument that uses an inkbased liquid, such as the pen 2501. Accordingly, the writing surface used on the writing pad 2600 may include paper 2503 on which writing strokes using ink-based liquid may be performed. In such embodiments, a flexible cling surface 2516 may also be provided on top ofthe one or more coils (shown as being provided on top of coil(s) 2510) such that a surface is provided between the one or more coils and the paper 2503 on which the writing strokes are being performed. The flexible cling surface 2516 may be a flexible / foldable sheet having the coils(s) 2510 disposed inside. The flexible cling surface 2516 may also be integrated into the writing pad 2504 along with the substrate 2508 (including the one or more coils) or may be removably disposed on top of the writing pad 2504 along with the substrate 2508.

[0196] In embodiments, at least one side of the flexible cling surface 2516 may include a material that provides friction to mitigate the movement of the flexible cling surface 2516 relative to a surface on which the flexible cling surface 2516 rests. This “no-slip” feature may also be provided on any other cling surface or any other portion of a writing pad as described herein.

[0197] As another example, FIG. 27 shows a writing pad 2700 for use with a writing instrument that uses a dry-erase ink 2505, such as a dry-erase marker 2502 (for example, the writing instrument 2900). Accordingly, a dry-erase surface 2518, such as a whiteboard, may be provided on the substrate 2508. The dry-erase surface 2518 may also include a flexible material.

[0198] FIGS. 28A-28C show that a writing pad may also be foldable into multiple different configurations. For example, FIG. 28A shows the writing pad in an unfolded configuration. The foldable writing pad may also include the substrate including the one or more coils. In embodiments, a single substrate may span the two sides of the foldable writing pad 2800. However, in other embodiments, distinct substrates may be provided on either side of the foldable writing pad 2800. Similar to the writing pads 2600 and 2700, the substrate may be integrated into the writing pad 2800 or may be removably disposed on the writing pad 2800.

[0199] In embodiments, a single type of writing surface may be provided on both sides of the writing pad 2800. For example, a flexible cling surface and paper may both be provided on both sides of the writing pad 2800 (similarly, distinct flexible cling surfaces and paper may be provided on either side of the writing pad 2800). In other embodiments, multiple different types of writing surfaces may be provided on either side of the writing pad 2800 as well. For example, a flexible cling surface and paper may be provided on one side of the writing pad 2800, and a dry -erase surface may be provided on another side of the writing pad 2800. Such a configuration may be beneficial if it is desired to provide a single writing pad that is configured to be used with different types of writing instruments.

[0200] FIG. 28C shows the writing pad 2800 in a folded configuration. In embodiments, in which both sides of the writing pad 2800 include a substrate with one or more coils, the folded configuration may allow a user to perform writing strokes on the front and back of the writing pad 2800 and may provide a more compact form factor during usage of the writing pad 2800.

[0201] The writing pad 2504 may also include a controller 2520 configured to detect interruptions to the oscillating current in the electrical grid formed by the one or more coils on and / or within the substrate 2508. In embodiments, the controller 2520 may be integrated into the writing pad 2504. However, the controller 2520 may also be provided separately from the writing pad 2504. For example, the controller 2520 may be integrated into the digital device 2506, remote server 2507, etc. The controller 2520 may also be a standalone device as well.

[0202] In embodiments, the controller 2520 may determine writing strokes that are performed by detecting the locations of interruptions in the oscillating current that occur over time. That is, the controller 2520 may detect the change in location of interruptions in the oscillating current over time to determine the movement of the ink-based digital writing instrument.

[0203] The digital device 2506 may include any type of suitable device that may receive data from the writing pad 2504 (particularly, from the controller 2520) for presentation and / or storage. For example, the digital device 2506 may include a desktop computer, laptop computer, tablet, smart television, and / or any other type of device. The digital device 2506 may receive data indicating the writing strokes being performed on the writing pad 2504 using a given writing instrument. Based on this data, the digital device 2506 may generate digital representations of the writing strokes being performed. However, the generation of the digital representations of the writing strokes may also be performed by any other component of the system 2500, such as the writing pad itself 2504, the remote server 2507, etc.

[0204] In embodiments, the digital device 2506 may include one or more software applications. For example, as aforementioned, the ink-based digital writing instrument may be used in a classroom setting in which a teacher desires for students to perform lessons using traditional writing instruments, but also wishes to receive digital copies of the writing performed by the students using the writing instrument. For example, if the students are solving math equations, the answers written on paper provided on the writing pad may be stored in digital format and provided to a teacher device for analysis and storage. This may allow the teacher to maintain a collection of completed student lessons in one software application to track student progress overtime. The software application may also automatically analyze the responses provided by the student, such as determining if the student provided the correct answers to the math equations.

[0205] In one or more embodiments, any of the elements of the system 2500 (for example, one or more writing instruments, one or more writing pads, one or more digital devices, one or more remote servers, and / or any other element described with 2550 to FIG. 25 or otherwise) may be configured to communicate via a communications network 2550. The communications network 2550 may include, but not limited to, any one of a combination of different types of suitable communications networks such as, for example, broadcasting networks, cable networks, public networks (e.g., the Internet), private networks, wireless networks, cellular networks, or any other suitable private and / or public networks. Further, the communications network 2550 may have any suitable communication range associated therewith and may include, for example, global networks (e g., the Internet), metropolitan area networks (MANs), wide area networks (WANs), local area networks (LANs), or personal area networks (PANs). In addition, communications network 2550 may include any type of medium over which network traffic may be carried including, but not limited to, coaxial cable, twisted-pair wire, optical fiber, a hybrid fiber coaxial (HFC) medium, microwave terrestrial transceivers, radio frequency communication mediums, white space communication mediums, ultra-high frequency communication mediums, satellite communication mediums, or any combination thereof.

[0206] In one or more embodiments, the controller 2520 may also include at least one or more processors (processor(s)) 2522, one or more memory devices 2524 (generically referred to herein as memory 2524), one or more network interface(s) 2526, one or more transceivers 2528, and data storage 2530. The controller 2520 may further include one or more buses that functionally couple various components of the controller 2520. The controller 2520 may further include one or more antenna(e) 2534 that may include, without limitation, a cellular antenna for transmitting or receiving signals to / from a cellular network infrastructure, an antenna for transmitting or receiving Wi-Fi signals to / from an access point (AP), a Global Navigation Satellite System (GNSS) antenna for receiving GNSS signals from a GNSS satellite, a Bluetooth antenna for transmitting or receiving Bluetooth signals, a Near Field Communication (NFC) antenna for transmitting or receiving NFC signals, and so forth. These various components will be described in more detail hereinafter.

[0207] The bus(es) may include at least one of a system buses, the memory bus, an address bus, or a message bus, and may permit exchange of information (e.g., data (including computerexecutable code), signaling, etc.) between various components of the controller 2520. The bus(es) may include, without limitation, the memory bus or the memory controller, a peripheral bus, an accelerated graphics port, and so forth. The bus(es) may be associated with any suitable bus architecture including, without limitation, an Industry Standard Architecture (ISA), a Micro Channel Architecture (MCA), an Enhanced ISA (EISA), a Video Electronics Standards Association (VESA) architecture, an Accelerated Graphics Port (AGP) architecture, a Peripheral Component Interconnects (PCI) architecture, a PCI-Express architecture, a Personal Computer Memory Card International Association (PCMCIA) architecture, a Universal Serial Bus (USB) architecture, and so forth.

[0208] The memory 2524 of the controller 2520 may include volatile memory (memory that maintains its state when supplied with power) such as random-access memory (RAM) and / or non-volatile memory (memory that maintains its state even when not supplied with power) such as read-only memory (ROM), flash memory, ferroelectric RAM (FRAM), and so forth. Persistent data storage, as that term is used herein, may include non-volatile memory. In certain example embodiments, volatile memory may enable faster read / write access than non-volatile memory. However, in certain other example embodiments, certain types of non-volatile memory (e g., FRAM) may enable faster read / write access than certain types of volatile memory.

[0209] In various implementations, the memory 2524 may include multiple different types of memory such as various types of static random-access memory (SRAM), various types of dynamic random-access memory (DRAM), various types of unalterable ROM, and / or writeable variants of ROM such as electrically erasable programmable read-only memory (EEPROM), flash memory, and so forth. The memory 2524 may include main memory as well as various forms of cache memory such as instruction cache(s), data cache(s), translation look-aside buffer(s) (TLBs), and so forth. Further, cache memory such as a data cache may be a multi-level cache organized as a hierarchy of one or more cache levels (LI, L2, etc ).

[0210] The data storage 2530 may include removable storage and / or non-removable storage, including, but not limited to, magnetic storage, optical disk storage, and / or tape storage. The data storage 2530 may provide non-volatile storage of computer-executable instructions and otherdata. The memory 2524 and the data storage 2530, removable and / or non-removable, are examples of computer-readable storage media (CRSM) as that term is used herein.

[0211] The data storage 2530 may store computer-executable code, instructions, or the like that may be loadable into the memory 2524 and executable by the processor(s) 2522 to cause the processor(s) 2522 to perform or initiate various operations. The data storage 2530 may additionally store data that may be copied to memory 2524 for use by the processor(s) 2522 during the execution of the computer-executable instructions. Moreover, output data generated as a result of execution of the computer-executable instructions by the processor(s) 2522 may be stored initially in memory 2524, and may ultimately be copied to data storage 2530 for nonvolatile storage.

[0212] More specifically, the data storage 2530 may store one or more operating systems (O / S) 2534; one or more database management systems (DBMS) 2536; and one or more program module(s), applications, engines, computer-executable code, scripts, or the like such as, for example, one or more module(s) 2538. Some or all of these module(s) may be sub-module(s). Any of the components depicted as being stored in data storage 2530 may include any combination of software, firmware, and / or hardware. The software and / or firmware may include computer-executable code, instructions, or the like that may be loaded into the memory 2524 for execution by one or more of the processor(s) 2522. Any of the components depicted as being stored in data storage 2530 may support the functionality described in reference to correspondingly named components earlier in this disclosure.

[0213] The data storage 2530 may further store various types of data utilized by components of the controller 2520. Any data stored in the data storage 2530 may be loaded into the memory 2524 for use by the processor(s) 2522 in executing computer-executable code. In addition, any data depicted as being stored in the data storage 2530 may potentially be stored in one or more datastore(s) and may be accessed via the DBMS 2536 and loaded in the memory 2524 for use by the processor(s) 2522 in executing computer-executable code. The datastore(s) may include, but are not limited to, databases (e.g., relational, object-oriented, etc.), file systems, flat files, distributed datastores in which data is stored on more than one node of a computer network, peer-to-peer network datastores, or the like. In FIG. 25 the datastore(s) may include, for example, purchase history information, user action information, user profile information, a database linking search queries and user actions, and other information.

[0214] The processor(s) 2522 may be configured to access the memory 2524 and execute computer-executable instructions loaded therein. For example, the processor(s) 2522 may be configured to execute computer-executable instructions of the various program module(s), applications, engines, or the like of the controller 2520 to cause or facilitate various operations to be performed in accordance with one or more embodiments of the disclosure. The processor(s) 2522 may include any suitable processing unit capable of accepting data as input, processing the input data in accordance with stored computer-executable instructions, and generating output data. The processor(s) 2522 may include any type of suitable processing unit including, but not limited to, a central processing unit, a microprocessor, a Reduced Instruction Set Computer (RISC) microprocessor, a Complex Instruction Set Computer (CISC) microprocessor, a microcontroller, an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), a System-on-a-Chip (SoC), a digital signal processor (DSP), and so forth. Further, the processor(s) 2522 may have any suitable microarchitecture design that includes any number of constituent components such as, for example, registers, multiplexers, arithmetic logic units, cache controllers for controlling read / write operations to cache memory, branch predictors, or the like. The microarchitecture design of the processor(s) 2522 may be capable of supporting any of a variety of instruction sets.

[0215] FIGS. 31A-31B depict example process flows 3100 and 3120 showing example operations that may be performed by the controller 2520. The operations of the process flows 3100 and 3120 may be optional and may be performed in a different order.

[0216] The process flows 3100 and 3120 may be specific to a writing pad including a whiteboard (the terms dry-erase board and whiteboard may be used interchangeably) and a writing instrument that is a dry-erase marker (such as writing instrument 2900, for example). However, the process flows 3100 and 3120 may also be applicable to any other types of writing instruments and / or writing surfaces as well. At block 3102 of the process flow 3100, computerexecutable instructions stored on the memory of a device may be executed to detect presence of the dry-erase marker at the whiteboard via a fixed frequency. In embodiments, the whiteboard may be a writing pad including a whiteboard surface and an electrical grid underneath the whiteboard surface (as shown in FIG. 25, for example). An oscillating current may move across the electrical grid (for example, as described with respect to FIGS. 25-28D). The writing instrument configured to write on the whiteboard and include a resonant circuit configured toresonate at the fixed frequency. A reservoir of the writing instrument may include a dry-erase ink-based liquid. The fixed frequency may be detectable by the controller 2520 when the reservoir includes the dry-erase ink-based liquid, and the fixed frequency may not be detectable by the controller 2520 when the reservoir is empty. The fixed frequency may be detectable by the controller 2520 when the writing instrument is a particular distance from the electric grid. The distance may be a distance at which the fixed frequency produced by the resonant circuit in the writing instrument is able to cause a change in the oscillating current moving through the electrical grid. For example, the distance may be less than an inch (or any other suitable distance).

[0217] At block 3104 of the process flow 3100, computer-executable instructions stored on the memory of a device may be executed to determine that the dry-erase marker is writing on the whiteboard. That is, the controller 2520 may be configured to detect positions on the electric grid of the writing pad at which the oscillating current is changed. By tracking the positions of these detected changes over time, the controller 2520 may be able to ascertain the writing strokes that are being performed on the whiteboard using the writing instrument. Additional details about how the writing strokes are identified are provided in the process flow 3120.

[0218] At block 3106 of the process flow 3100, computer-executable instructions stored on the memory of a device may be executed to determine that the fixed frequency is not present for a first threshold length of time. At block 3108 of the process flow 3100, computer-executable instructions stored on the memory of a device may be executed to determine that the dry-erase marker has ceased writing on the whiteboard. That is, the controller 2520 may determine that the writing instrument has ceased performing writing strokes on the whiteboard based on the determination that the fixed frequency is not present for the threshold length of time.

[0219] Turning to process flow 3120, at block 3122 of the process flow 3120, computerexecutable instructions stored on the memory of a device may be executed to detect presence of the dry-erase marker at the whiteboard via the fixed frequency at a first time interval. At block 3124 of the process flow 3120, computer-executable instructions stored on the memory of a device may be executed to determine a first digital writing data point for the first time interval.

[0220] At block 3126 of the process flow 3120, computer-executable instructions stored on the memory of a device may be executed to detect presence of the dry-erase marker at the whiteboard via the fixed frequency at a second time interval. At block 3128 of the process flow3120, computer-executable instructions stored on the memory of a device may be executed to determine a second digital writing data point for the second time interval. At block 3130 of the process flow 3120, computer-executable instructions stored on the memory of a device may be executed to determine a first line connecting the first digital writing data point and the second digital writing data point.

[0221] At block 3132 of the process flow 3120, computer-executable instructions stored on the memory of a device may be executed to determine that a first threshold length of time has elapsed since the second time interval. At block 3134 of the process flow 3120, computerexecutable instructions stored on the memory of a device may be executed to detect presence of the dry-erase marker at the whiteboard via the fixed frequency at a third time interval. At block 3136 of the process flow 3120, computer-executable instructions stored on the memory of a device may be executed to determine a third digital writing data point for the third time interval, wherein the third digital writing data point is disconnected from the second digital writing data point. That is, blocks 3132 through 3136 may be used to determine when the user is performing a subsequent writing stroke that is intended to be distinct from the first writing stroke (for example, writing a different letter in a word that is being written on the whiteboard, etc. By checking whether the first threshold length of time has elapsed in block 3132, it may be determined that the user is no longer performing the first writing stroke and has moved on to a different writing stroke. For example, if the user is writing the word “at,” the first writing stroke may involve writing the letter “a” and the second writing stroke may involve writing the letter “t.”

[0222] FIGS. 32A-32B depict a further example process flow 3200 showing example operations that may be performed by the controller. The operations of the process flow 3200 may be optional and may be performed in a different order.

[0223] The process flow 3200 may be specific to a writing pad including paper and a writing instrument that is a pen (such as writing instrument 1300, for example). However, the process flow 3200 may also be applicable to any other types of writing instruments and / or writing surfaces as well. At block 3202 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to detect a first interruption to the oscillating current at the first frequency during a first time interval.

[0224] At block 3204 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to determine a first digital writing point at the first time interval. At block 3206 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to detect a second interruption to the oscillating current at the first frequency during a second time interval. At block 3208 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to determine a second digital writing point at the second time interval.

[0225] At block 3210 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to determine a first line connecting the first digital writing point and the second digital writing point.

[0226] At block 3212 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to detect the second frequency during a third time interval.

[0227] At block 3214 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to determine the writing instrument did not write during the third time interval.

[0228] At block 3216 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to detect a third interruption at a third time interval.

[0229] At block 3218 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to determine that the writing instrument is writing on the flexible inductive pad.

[0230] At block 3220 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to determine that the first frequency is not present for a first threshold length of time. At block 3222 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to determine that the writing instrument has ceased writing on the flexible inductive pad.

[0231] At block 3224 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to determine that a first threshold length of time has elapsed since the second time interval.

[0232] At block 3226 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to detect a third interruption at a third time interval.

[0233] At block 3228 of the process flow 3200, computer-executable instructions stored on the memory of a device may be executed to determine a third digital writing data point for the third time interval, wherein the third digital writing data point is disconnected from the second digital writing data point.

[0234] The process flows 3100, 3120, and 3200 may also be performed by any other system or device described herein, such as the digital device 2506, remote server 2507, etc.

[0235] FIG. 33 depicts another example system 3300. The system 3300 includes at least a writing instrument 3302, a writing pad 3310, a controller 3320, and a digital device 3330. Elements of the system 3300 may also be interchangeable with elements of system 2500, in some instances.

[0236] The writing instrument 3302 may be the same as, or similar to, any other writing instrument described herein. For example, as shown in the figure, the writing instrument 3302 may include a resonant circuit and / or a magnetic transceiver (or standalone magnetic transmitter(s) and / or receiver(s)), as described elsewhere herein. The system 3300 illustrates that the writing instrument 3302 may also include various other types of sensors used to capture data about the movement of the writing instrument 3302. The writing instrument 3302 may also include various types of sensors, such as an intentional measurement unit (IMU), an optical sensor, a pressure sensor an accelerometer, a gyroscope and / or any other types of sensors (or combinations of different types of sensors). The sensors may be provided at any suitable location on and / or within the writing instrument 3300. Although reference is made to single sensors (e.g., “an” optical sensor), multiple of such sensors may also be used.

[0237] The controller 3320 may be the same as or similar to any other controller described herein. The controller 3320 may be configured to receive data from the writing instrument 3302 (for example, from the resonant circuit and / or a magnetic transceiver, sensor(s), etc.). The controller 3320 may be configured to analyze the data to determine the position of the writing instrument 3302 relative to the writing pad 3310, determine information that is being written using the writing instrument 3302, and / or any other functions performed by a controller described herein or otherwise. The controller 3320 may be provided at the writing pad 3310, at the digital device 3330, at the writing instrument 3302, as a standalone element in the system architecture 3300, etc.

[0238] The writing pad 3310 may be the same as, or similar to, the writing pad 2504 (and / or any other writing pad described herein or otherwise). That is, the writing pad 3310 may be any type of surface on which writing strokes from the writing instrument 3302 may be performed.

[0239] The digital device 3330 may be the same as, or similar to, the digital device 2506 (and / or any other digital device described herein or otherwise. For example, the digital device 3330 may include a desktop computer, laptop computer, tablet, smart television, and / or any other type of device. The digital device 3330 may receive data indicating the writing strokes being performed on the writing pad 3310 using a given writing instrument 3302. Based on this data, the digital device 3330 may generate digital representations of the writing strokes being performed. However, the generation of the digital representations of the writing strokes may also be performed by any other component of the system architecture 3300, such as the writing pad 3310, etc.

[0240] As aforementioned, the digital device 3330 may include one or more software applications. For example, as aforementioned, the ink-based digital writing instrument may be used in a classroom setting in which a teacher desires for students to perform lessons using traditional writing instruments, but also wishes to receive digital copies of the writing performed by the students using the writing instrument. For example, if the students are solving math equations, the answers written on paper provided on the writing pad may be stored in digital format and provided to a teacher device for analysis and storage. This may allow the teacher to maintain a collection of completed student lessons in one software application to track student progress over time. The software application may also automatically analyze the responses provided by the student, such as determining if the student provided the correct answers to the math equations.

[0241] FIG. 34 depicts an example flow diagram 3400. The flow diagram 3400 illustrates example operations associated with the use of a Kalman filter as described herein. Particularly, the flow diagram 3400 may also illustrate example operations that may be performed with reference to the system 3300. The flow diagram 3400 may begin with data acquisition, which may involve obtaining position data for the writing instrument (for example, via inductive coupling, magnetic transceiver s), sensor data, etc.). The acquired data may then be calibrated to match a real-world frame of reference. The system may determine the position of the writing instrument based on a relative position between the magnetic transceivers (and / or any other typesof data). Data from various sensors of the writing instrument, such as the IMU and optical sensors may be refused to refine the position of the writing instrument. The writing performed by the writing instrument may then be digitized based on a combination of the sensor data and the data from the magnetic transceivers. An accuracy of the digitized writing may then be determined.

[0242] FIG. 35 depicts another example flow diagram 3500. The flow diagram 3500 illustrates example operations associated with the use of a Kalman filter as described herein. Particularly, the flow diagram 3500 may also illustrate example operations that may be performed with reference to the system 3300. The flow diagram 3500 may begin with data import and preprocessing. Sensor data from the writing instrument (e.g., IMU, optical flow, etc.), as well as any other types of data, may be imported. This data may then be set to a correct sample rate, resampled by interpolation, normalized, and split into training and testing data sets. A machine learning model may then be trained on the data (as aforementioned, the general reference to “machine learning model’ is not intended to be limiting). The trained machine learning model subsequently provides estimates of normalized coordinates for the writing instrument. Postprocessing and evaluation may involve unnormalizing estimated coordinates using a normalizing scaler.

[0243] Any reference to a “pen” in flow diagrams 3400-3500 may refer to a writing instrument and reference to a “tip” may refer to a tip of the writing instrument. Additionally, the steps shown in the flow diagrams 3400-3500 are merely exemplary. The steps may also be performed in any other suitable arrangement.

[0244] Though the disclosed examples include particular arrangements of a number of parts, components, features, and aspects, the disclosure is not limited to only those examples or arrangements shown. Any one or more of the parts, components, features, and aspects of the disclosure may be employed alone or in other arrangements of any two or more of the same.

[0245] Although certain product features, functions, components, and parts have been described herein in accordance with the teachings of the present disclosure, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all embodiments of the teachings of the disclosure that fairly fall within the scope of permissible equivalents.

[0246] Unless otherwise noted, the terms used herein are to be understood according to conventional usage by those of ordinary skill in the relevant art. In addition to the definitions ofterms provided below, it is to be understood that as used in the specification and in the claims, “a” or “an” may mean one or more, depending upon the context in which it is used.

[0247] Throughout this application, the term “include,” “include(s)” or “including” means “including but not limited to.” Note that certain embodiments may be described relating to a single glass, but the corresponding description should be read to include embodiments of two or more glasses. Different features, variations, and multiple different embodiments are shown and described herein with various details. What has been described in this application at times in terms of specific embodiments is done for illustrative purposes only and without the intent to limit or suggest that what has been conceived is only one particular embodiment or specific embodiments. It is to be understood that this disclosure is not limited to any single specific embodiments or enumerated variations. Many modifications, variations and other embodiments will come to mind of those skilled in the art, and which are intended to be and are in fact covered by this disclosure. It is indeed intended that the scope of this disclosure should be determined by a proper legal interpretation and construction of the disclosure, including equivalents, as understood by those of skill in the art relying upon the complete disclosure present at the time of filing.

[0248] Although embodiments have been described in language specific to structural features and / or methodological acts, it is to be understood that the disclosure is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as illustrative forms of implementing the embodiments. Conditional language, such as, among others, “can,” “could,” “might,” or “may,” unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments could include, while other embodiments do not include, certain features, elements, and / or steps. Thus, such conditional language is not generally intended to imply that features, elements, and / or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without user input or prompting, whether these features, elements, and / or steps are included or are to be performed in any particular embodiment.

[0249] What has been described herein in the present specification and drawings includes examples of systems, apparatuses, methods, devices, and / or techniques. It is, of course, not possible to describe every conceivable combination of components and / or methods for purposesof describing the various elements of the disclosure, but it may be recognized that many further combinations and permutations of the disclosed elements are possible. Accordingly, it may be apparent that various modifications may be made to the disclosure without departing from the scope thereof. In addition, or as an alternative, other embodiments of the disclosure may be apparent from consideration of the specification and annexed drawings, and practice of the disclosure as presented herein. It is intended that the examples put forth in the specification and annexed drawings be considered, in all respects, as illustrative and not limiting. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

[0250] Embodiments may include a system to convert ink-based writing to digital writing, the system comprising: a flexible inductive pad comprising an electrical grid, wherein an oscillating current moves across the electrical grid; a controller; and a writing instrument comprising: a housing; a resonant circuit disposed in the housing, wherein the resonant circuit is configured to resonate at a first frequency and a second frequency; a slidable switch configured to cause the resonant circuit to switch between the first frequency and the second frequency; and a reservoir comprising an ink-based liquid, wherein the reservoir is removably coupled to the housing; wherein the first frequency is detectable by the controller when the reservoir comprises the inkbased liquid, and the first frequency is not detectable by the controller when the reservoir is empty.

[0251] Embodiments may include a controller is configured to: detect a first interruption to the oscillating current at the first frequency during a first time interval; determine a first digital writing point at the first time interval; detect a second interruption to the oscillating current at the first frequency during a second time interval; determine a second digital writing point at the second time interval; and determine a first line connecting the first digital writing point and the second digital writing point.

[0252] Embodiments may include a controller is further configured to: detect the second frequency during a third time interval; and determine the writing instrument did not write during the third time interval.

[0253] Embodiments may include a controller is further configured to: detect a third interruption at a third time interval; determine that the writing instrument is writing on the flexible inductivepad; determine that the first frequency is not present for a first threshold length of time; and determine that the writing instrument has ceased writing on the flexible inductive pad.

[0254] Embodiments may include a controller is further configured to: determine that a first threshold length of time has elapsed since the second time interval; detect a third interruption at a third time interval; determine a third digital writing data point for the third time interval; wherein the third digital writing data point is disconnected from the second digital writing data point.

[0255] Embodiments may include an electrical grid that is a first electrical grid disposed on a first side of the flexible inductive pad, and wherein the flexible inductive pad further comprises: a second electrical grid disposed on a second side of the flexible inductive pad.

[0256] Embodiments may include a flexible inductive pad that is disposed in a folded configuration, such that the electrical grid is disposed on an outer surface of the flexible inductive pad, the system further comprising: an insulator material disposed between a first side of the flexible inductive pad and a second side of the flexible inductive pad.

[0257] Embodiments may include a system comprising: a writing instrument comprising an apparatus configured to provide an indication of a writing stroke written on a surface using the writing instrument; memory that stores computer-executable instructions; and one or more processors configured to access the memory and execute the computer-executable instructions to: receive, by a device, from the apparatus, and via a first wireless communication, an indication of first character written using the writing instrument; determine that the first character matches a pre-determined character for performing an action; receive, by the device, from the apparatus, via a second wireless communication, and subsequent to receiving the first character, one or more second characters written using the writing instrument; and perform a first type of action by the device based on the one or more second characters.

[0258] Embodiments may include one or more processors are further configured to execute the computer-executable instructions to: receive, by the device, from the apparatus, via a third wireless communication, and subsequent to receiving the first character, one or more third characters written using the writing instrument; and perform a second type of action by the device based on the one or more third characters, wherein the second type of action is different than the first type of action.

[0259] Embodiments may include one or more second characters includes a first string of characters indicating that an electronic-mail message is to be sent by the device, wherein the oneor more processors are further configured to execute the computer-executable instructions to: receive, by the device, from the apparatus, and via a third wireless communication, one or more third characters written using the writing instrument; and send, by the device, the electronic-mail message including at least some of the one or more third characters.

[0260] Embodiments may include one or more second characters includes a first string of characters indicating that a note is to be created by the device, wherein the one or more processors are further configured to execute the computer-executable instructions to: receive, by the device, from the apparatus, and via a third wireless communication, one or more third characters written using the writing instrument; and create, by the device, the note including the one or more third characters.

[0261] Embodiments may include one or more second characters includes a first string of characters indicating that a list is to be created by the device, wherein the one or more processors are further configured to execute the computer-executable instructions to: receive, by the device, from the apparatus, and via a third wireless communication, one or more third characters written using the writing instrument; and create, by the device, the list including the one or more third characters.

[0262] Embodiments may include one or more processors are further configured to execute the computer-executable instructions to: receive, by the device, from the apparatus, and via a third wireless communication, a sketch drawn using the writing instrument; and create, by the device, an image based on the sketch. The first character can be a hashtag. The apparatus may comprise a magnetic receiver, wherein the system further comprises a magnetic transmitter disposed on the surface, and wherein the first character is determined based on a distance between the magnetic transmitter and the magnetic receiver. The apparatus may comprise an optical tracker, wherein the first character is determined using the optical tracker.

[0263] Embodiments may include a method comprising: receiving, by a device, from a writing instrument comprising an apparatus configured to provide an indication of a writing stroke written on a surface using the writing instrument, and via a first wireless communication, an indication of first character written using the writing instrument; determining that the first character matches a pre-determined character for performing an action; receiving, by the device, from the apparatus, via a second wireless communication, and subsequent to receiving the firstcharacter, one or more second characters written using the writing instrument; and performing a first type of action by the device based on the one or more second characters.

[0264] Embodiments may include receiving, by the device, from the apparatus, via the wireless communication, and subsequent to receiving the first character, one or more third characters written using the writing instrument; and performing a second type of action by the device based on the one or more third characters, wherein the second type of action is different than the first type of action.

[0265] Embodiments may include one or more second characters includes a first string of characters indicating that an electronic-mail message is to be sent by the device, wherein the method further comprises: receiving, by the device, from the apparatus, and via the wireless communication, one or more third characters written using the writing instrument; and sending, by the device, the electronic-mail message including at least some of the one or more third characters.

[0266] Embodiments may include one or more second characters includes a first string of characters indicating that a note is to be created by the device, wherein the method further comprises: receiving, by the device, from the apparatus, and via the wireless communication, one or more third characters written using the writing instrument; and creating, by the device, the note including the one or more third characters.

[0267] Embodiments may include one or more second characters includes a first string of characters indicating that a list is to be created by the device, wherein the method further comprises: receiving, by the device, from the apparatus, and via the wireless communication, one or more third characters written using the writing instrument; and create, by the device, the list including the one or more third characters.

[0268] Embodiments may include one or more second characters includes a first string of characters indicating that a note is to be created by the device, wherein the method further comprises: receiving, by the device, from the apparatus, and via the wireless communication, a sketch drawn using the writing instrument; and creating, by the device, an image based on the sketch.

Claims

CLAIMSWhat is claimed is:

1. A writing instrument comprising: a housing; a resonant circuit disposed in the housing, wherein the resonant circuit is configured to resonate at a first frequency and a second frequency; a slidable switch configured to cause the resonant circuit to switch between the first frequency and the second frequency; and a reservoir comprising an ink-based liquid, wherein the reservoir is removably coupled to the housing; wherein the first frequency is detectable when the reservoir comprises the ink-based liquid, and the first frequency is not detectable when the reservoir is empty.

2. The writing instrument of claim 1, wherein the resonant circuit resonates at the first frequency when the writing instrument transfers the ink-based liquid onto a surface, and at the second frequency the writing instrument is in a default state.

3. The writing instrument of any one of claims 1 to 2, further comprising: a nosecone disposed at an end of the housing; wherein the resonant circuit is disposed in the nosecone.

4. The writing instrument of any one of claims 1 to 3, wherein the nosecone is removably coupled to the housing, and the resonant circuit is configured to be separated from the housing with the nosecone.

5. The writing instrument of any one of claims 1 to 4, wherein the slidable switch is disposed inside the housing.

6. The writing instrument of any one of claims 1 to 5, wherein the slidable switch is disposed exterior to the housing.

7. The writing instrument of any one of claims 1 to 6, further comprising: a writing instrument grip configured to slide along an exterior of the writing instrument.

8. The writing instrument of any one of claims 1 to 7, wherein the writing instrument grip is retrofittable to a plurality of ink-based writing instruments.

9. The writing instrument of any one of claims 1 to 8, wherein the writing instrument grip comprises a rubber coated housing.

10. The writing instrument of any one of claims 1 to 9, wherein the resonant circuit is disposed in the writing instrument grip.

11. A dry-erase writing system comprising: a whiteboard comprising: an electrical grid, wherein an oscillating current moves across the electrical grid; and a controller configured to detect interruptions to the oscillating current; and a dry-erase marker configured to write on the whiteboard, the dry-erase marker comprising: a housing; a resonant circuit configured to resonate at a fixed frequency; and a reservoir comprising an dry-erase ink-based liquid; wherein the fixed frequency is detectable by the controller when the reservoir comprises the dry-erase ink-based liquid, and the fixed frequency is not detectable by the controller when the reservoir is empty.

12. The dry-erase writing system of claim 11, wherein the dry-erase marker further comprises a cap, and wherein the resonant circuit is disposed in the cap.

13. The dry-erase writing system of any one of claims 11 to 12, wherein the controller is further configured to:detect presence of the dry-erase marker at the whiteboard via the fixed frequency; determine that the dry-erase marker is writing on the whiteboard; determine that the fixed frequency is not present for a first threshold length of time; and determine that the dry-erase marker has ceased writing on the whiteboard.

14. The dry-erase writing system of any one of claims 11 to 13, wherein the controller is further configured to: detect presence of the dry-erase marker at the whiteboard via the fixed frequency at a first time interval; determine a first digital writing data point for the first time interval; detect presence of the dry-erase marker at the whiteboard via the fixed frequency at a second time interval; determine a second digital writing data point for the second time interval; and determine a first line connecting the first digital writing data point and the second digital writing data point.

15. The dry-erase writing system of any one of claims 11 to 14, wherein the controller is further configured to: determine that a first threshold length of time has elapsed since the second time interval; detect presence of the dry-erase marker at the whiteboard via the fixed frequency at a third time interval; determine a third digital writing data point for the third time interval; wherein the third digital writing data point is disconnected from the second digital writing data point.

Images