Electronic pens and electronic devices

Abstract

We provide electronic devices and electronic pens that can improve user experience and convenience. [Solution] The electronic pen comprises a housing held by the user, a sensor, a communication module, and a pen controller. The sensor is located in the housing and detects the user's biometric information. The communication module is located in the housing and communicates with the pen sensor for position indication. The pen controller is located inside the housing and includes a storage unit for storing user registration information, an authentication unit, and a transmission unit. The authentication unit authenticates that the user indicated by the biometric information is registered in the registration information by comparing the biometric information detected by the sensor with the registration information. The transmission unit transmits the authentication result from the authentication unit to the pen sensor via the communication module.

Description

Technical Field

[0006] ,

[0001] The present invention relates to an electronic device that receives a position indication by an electronic pen and displays it on a screen, and an electronic pen.

Background Art

[0002] Conventionally, an electronic device including a pen sensor that detects a position indication by an electronic pen and a display panel that performs screen display according to the detection by the pen sensor has been known. Also known is an electronic pen that gives a position indication to an electronic device equipped with a pen sensor.

[0003] Regarding this, Patent Document 1 discloses a stylus (electronic pen) that has a stylus-side electrode and performs transmission and reception with an electronic device having a sensor-side electrode through electrostatic coupling between the stylus-side electrode and the sensor-side electrode. Also, Patent Document 1 discloses an electronic device that has a sensor-side electrode and performs transmission and reception with a stylus (electronic pen) through electrostatic coupling between the stylus-side electrode and the sensor-side electrode.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the technology described in Patent Document 1 above, although the electronic pen can give a position indication to the electronic device, no functions other than the position indication using the electronic pen and the electronic device are disclosed. Therefore, in the technology described in Patent Document 1, there is still room for improvement in various user experiences using the electronic pen and the electronic device and the convenience when the user uses the electronic pen and the electronic device.

[0006] This invention has been made in view of these problems, and its objective is to provide an electronic device and an electronic pen that can improve user experience and convenience. [Means for solving the problem]

[0007] To solve the above problems, the electronic pen according to the first invention is an electronic pen that provides position instructions to a pen sensor, and comprises a housing that is held by a user, a sensor provided in the housing that detects the user's biometric information, a communication module provided in the housing that communicates with the pen sensor, a storage unit that stores the user's registration information, an authentication unit that authenticates that the user indicated by the biometric information is registered in the registration information by comparing the biometric information detected by the sensor with the registration information, and a pen controller provided inside the housing that transmits the authentication result from the authentication unit to the pen sensor via the communication module.

[0008] Furthermore, in the electronic pen according to the second invention, the sensor is a fingerprint sensor, and the registration information includes fingerprint information indicating the user's fingerprint.

[0009] Furthermore, in the electronic pen according to the third invention, the sensor is a camera, and the registration information includes facial image information showing the user's facial image.

[0010] Furthermore, in the electronic pen according to the fourth invention, the sensor is a vein sensor, and the registration information includes vein information indicating the user's vein pattern.

[0011] Furthermore, the electronic pen according to the fifth invention further comprises a receiving unit that receives document information indicating a document that the user has electronically signed from the pen sensor via the communication module, and a history registration unit that stores the document information received by the receiving unit as signature history information in the storage unit, associating it with information indicating a user authenticated by the authentication unit.

[0012] Furthermore, the electronic device according to the sixth invention comprises a display panel for displaying an object to be displayed, a pen sensor provided so as to overlap the display area of ​​the display panel and for detecting position indication by an electronic pen, a signature receiving unit that receives an electronic signature by the electronic pen on a document displayed in the display area via the pen sensor, a signer acquisition unit that acquires signer information indicating the signer of the electronic signature, and a storage unit that stores the signer information as signature history information by associating it with document information indicating the document on which the electronic signature has been made.

[0013] Furthermore, in the electronic device relating to the seventh invention, the signatory information includes first identification information relating to the electronic pen.

[0014] Furthermore, in the electronic device relating to the eighth invention, the signatory information includes the authentication information of the user of the electronic pen.

[0015] Furthermore, in the electronic device according to the ninth invention, the signature receiving unit accepts the electronic signature when the authentication information indicates that the user's authentication was successful, and stops accepting the electronic signature when the authentication information indicates that the user's authentication failed.

[0016] Furthermore, the electronic device according to the tenth invention further includes an authentication unit that authenticates the user when the combination of first identification information relating to the electronic pen and second identification information different from the first identification information is a predetermined combination, and the storage unit stores the authentication result by the authentication unit as the authentication information.

[0017] Furthermore, in the electronic device relating to the eleventh invention, the authentication information is the result of biometric authentication performed on the user.

[0018] Furthermore, the electronic device according to the twelfth invention is an electronic device that can communicate with a server device that stores information related to an electronic pen, and comprises: a display panel that displays a display object; a pen sensor provided so as to overlap the display area of ​​the display panel and for detecting position indication by the electronic pen; a gesture detection unit that detects a gesture operation by the electronic pen via the pen sensor to specify a designated area indicating a part of the drawing object displayed in the display area; an extraction unit that extracts drawing information of the designated area when the gesture detection unit detects the gesture operation; and a transmission unit that transmits the drawing information extracted by the extraction unit to the server device.

[0019] Furthermore, in the electronic device according to the thirteenth invention, the drawing information includes orientation information, including the position, tilt, and pressure of the electronic pen on the pen sensor, and time-series data of drawing parameters relating to a virtual drawing tool used to draw the drawing object.

[0020] Furthermore, the electronic device according to the fourteenth invention further comprises a receiving unit that receives the drawing information from the server device, and an adjustment unit that adjusts the drawing parameters of the drawing tool to the drawing parameters indicated by the drawing information received by the receiving unit.

[0021] Furthermore, in the electronic device relating to the fifteenth invention, the drawing information is image data indicating the designated area of ​​the drawing object.

[0022] Furthermore, the electronic device according to the sixteenth invention comprises a display panel for displaying an object, a pen sensor provided so as to overlap the display area of ​​the display panel for detecting position indication by an electronic pen, a gesture detection unit for detecting gesture operations including movement or rotation of the electronic pen, and an extraction unit for extracting information indicated by the specified portion when a first gesture operation is detected by the gesture detection unit via the pen sensor for specifying a portion of a drawing object displayed in the display area using the electronic pen.

[0023] Also, in the electronic device according to the seventeenth invention, the extraction unit extracts color information regarding the color within the partial region.

[0024] Further, in the electronic device according to the eighteenth invention, when the gesture detection unit detects a second gesture operation different from the first gesture operation after the extraction unit extracts the color information within the partial region, the electronic device further includes an adjustment unit that adjusts the range of the region according to the second gesture operation.

[0025] Furthermore, in the electronic device according to the nineteenth invention, when the gesture detection unit detects a third gesture operation different from the first gesture operation after the extraction unit extracts the color information within the region, the electronic device further includes an adjustment unit that adjusts the extracted color according to the third gesture operation.

[0026] Also, in the electronic device according to the twentieth invention, display content including an object capable of receiving an operation is displayed on the display panel. When the first gesture operation for designating the object is detected by the gesture detection unit, the extraction unit extracts image data of the designated object, and the electronic device includes a transmission unit that transmits the image data extracted by the extraction unit to the electronic pen.

[0027] Moreover, in the electronic device according to the twenty - first invention, when the extraction unit extracts the image data, the electronic device further includes a display control unit that controls the display operation of the display panel such that the object disappears after moving toward the indicated position of the pen sensor of the electronic pen on the display area. After the display of the object is erased from the display area by the display control unit, the transmission unit transmits a control command for displaying the object on a display provided on the electronic pen to the electronic pen.

[0028] Furthermore, the electronic pen according to the 22nd invention is an electronic pen that provides position instructions to a pen sensor, comprising: a pen tip; a housing connected to the pen tip and held by a user; a rotation input device provided on the pen tip side of the housing and receiving the user's operation input by a rotatable rotating member; a communication module provided on the housing and communicating with the pen sensor; and a transmission unit that transmits predetermined control commands to the pen sensor via the communication module in response to the user's operation input received by the rotation input device.

[0029] Furthermore, in the electronic pen according to the twenty-third invention, the rotation input device is a trackball, and the transmitting unit transmits control commands to the pen sensor according to the rotation direction of the trackball.

[0030] Furthermore, in the electronic pen according to the twenty-fourth invention, the rotation input device includes a wheel member that rotates along a rotation axis in response to the user's operation input, and a rotation detection member that detects the rotation of the rotation axis, and the transmission unit transmits a control command corresponding to the rotation direction of the wheel member to the pen sensor.

[0031] Furthermore, the electronic pen according to the twenty-fifth invention further comprises a position detection unit that detects changes in the position of the pen tip using a sensor provided in the housing, and a position calculation unit that calculates the position of the pen tip relative to the pen sensor from the changes in the position of the pen tip detected by the position detection unit, and the transmission unit transmits the calculation result of the position calculation unit to an electronic device having the pen sensor using a wireless communication device different from the communication module when the distance between the pen sensor and the pen tip is greater than or equal to a predetermined distance.

[0032] Furthermore, in the electronic pen according to the 26th invention, the sensor is an inertial measurement unit having a 3-axis accelerometer and a 3-axis gyroscope.

[0033] Furthermore, the electronic pen according to the 274th invention includes a connecting member provided in the housing that detachably connects the housing to an electronic device having the pen sensor, a connection detection unit that detects the connection state of the housing to the electronic device, and a transmitting unit that transmits different control commands to the electronic device when the housing is connected to the electronic device, using a different wireless communication device than the communication module, when the housing is connected to the electronic device and when the housing is detached from the electronic device.

[0034] Furthermore, the electronic pen according to the 28th invention further comprises a plurality of light-emitting elements provided in the pen tip, each emitting light in a different color, and a light-emitting control unit that causes the light-emitting elements to emit light in a color indicated by a control command transmitted from the pen sensor.

[0035] Furthermore, the electronic pen according to the 29th invention is an electronic pen that provides position instructions to a pen sensor provided on an electronic device, and comprises a housing that is held by a user, a plurality of sensors provided on the housing, a communication module provided on the housing that communicates with the pen sensor, and a pen controller having a generation unit that generates user state information indicating the user's state based on a combination of the detection results of the plurality of sensors, and a transmission unit that transmits the user state information generated by the generation unit to the electronic device via the pen sensor.

[0036] Furthermore, in the electronic pen according to the 30th invention, the sensor is a pressure sensor, the user state information indicates the state of the user's grip on the housing, and the device further includes a vibrating member provided on the housing that vibrates when the user state information satisfies predetermined conditions.

[0037] Furthermore, in the electronic pen according to the 31st invention, the user state information is a concentration level indicating the degree of the user's concentration on the drawing task performed via the pen sensor, the generation unit calculates adjustment values ​​for the drawing parameters of a virtual drawing tool used for drawing by the user from the concentration level, and the transmission unit transmits the adjustment values ​​calculated by the generation unit to the electronic device via the pen sensor.

[0038] Furthermore, in the electronic pen according to the 32nd invention, the adjustment value includes an upper and lower limit of the range of values ​​that the drawing parameter can take, and the generation unit determines whether the user's level of concentration is above a reference value and changes the upper and lower limits according to the result of the determination.

[0039] Furthermore, the electronic device according to the 33rd invention includes a display panel for displaying an object to be displayed, a pen sensor provided so as to overlap the display area of ​​the display panel and for detecting position indication by an electronic pen, a state detection unit for determining whether the change in the position of the electronic pen detected by the pen sensor satisfies predetermined conditions, and a vibration control unit for vibrating a vibrating member provided so as to overlap the display area or provided on the electronic pen when the state detection unit determines that the change in the position of the electronic pen satisfies the predetermined conditions.

[0040] Furthermore, in the electronic device relating to the 34th invention, the predetermined condition is that the amount of movement of the electronic pen on the pen sensor is less than or equal to a reference distance within a reference time.

[0041] Furthermore, the electronic device according to the 35th invention further comprises a storage unit for storing display content having a plurality of objects, and a display control unit for displaying the display content on the display panel, wherein the state detection unit detects which of the objects in the display content the position of the electronic pen on the pen sensor corresponds to, and the display control unit displays presentation information associated with the object detected by the state detection unit on the display panel.

[0042] Furthermore, in the electronic device according to the 36th invention, the vibrating member is provided on the electronic pen, and the vibration control unit transmits a control signal from the pen sensor to the electronic pen to vibrate the vibrating member at a predetermined period when the change in the position of the electronic pen satisfies the predetermined conditions.

[0043] Furthermore, in the electronic device according to the 37th invention, a plurality of vibrating members are provided so as to overlap the display area, and the vibration control unit controls the operation of the vibrating members so as to vibrate the position of the electronic pen detected by the pen sensor on the display panel when the change in the position of the electronic pen satisfies the predetermined conditions.

[0044] Furthermore, the electronic pen according to the 38th invention is an electronic pen that provides position indication to a pen sensor, comprising: a pen tip having a first electrode and a second electrode that transmit and receive signals with the pen sensor; and a housing that is formed in a cylindrical shape and has an outer casing to which the pen tip can be attached and detached, the housing comprising: a first conductor that is electrically connected to the first electrode when the pen tip is connected to the outer casing; a second conductor that is electrically connected to the second electrode when the pen tip is connected to the outer casing; and a pen controller that is electrically connected to the first conductor and the second conductor and controls the transmission and reception of the signals.

[0045] Furthermore, in the electronic pen according to the 39th invention, the first electrode is formed as a core body constituting the central axis of the pen tip, the second electrode is a ring electrode formed in a cylindrical shape so as to cover the outer circumference of the first electrode, the first conductor is formed as a core body constituting the central axis of the outer casing, and the second conductor is formed in a cylindrical shape so as to cover the outer circumference of the first conductor.

[0046] Furthermore, in the electronic pen according to the fortieth invention, the pen tip is formed in a cylindrical shape and further has a ground electrode provided between the first electrode and the second electrode so as to cover the outer circumference of the first electrode and the inner circumference of the second electrode, and the housing further has a third conductor electrically connected to the ground electrode and the pen controller.

[0047] Furthermore, the electronic pen according to the forty-first invention comprises a cylindrical housing having a window portion for transmitting light from the inside to the outside, a cylindrical cartridge that is detachable from the housing and is provided inside the housing, and has a circuit board, an illumination unit provided on the cartridge that emits light in response to an electrical signal transmitted from the circuit board, and a light guide path that transmits the light emitted from the illumination unit to the inside of the window portion.

[0048] Furthermore, in the electronic pen according to the forty-second invention, the light guide path has a core portion, a cladding portion made of a material with a higher refractive index than the core portion and provided to cover the core portion, and a covering portion made of an opaque material and provided to cover the cladding portion.

[0049] Furthermore, in the electronic pen according to the forty-third invention, the optical guide path is an optical waveguide formed as a flexible cable.

[0050] Furthermore, in the electronic pen according to the forty-fourth invention, the light guide path is formed in a plate shape with its longitudinal direction aligned with the pen shaft, and a slit is provided on the outer surface of the housing side so as to be aligned with the pen shaft.

[0051] Furthermore, in the electronic pen according to the forty-fifth invention, the light guide path is formed in a cylindrical shape and is provided so as to cover the outer circumference of the cartridge, and a slit is provided on the outer circumference so as to follow the circumferential direction. [Effects of the Invention]

[0052] According to the present invention, electronic devices and electronic pens can improve user experience and convenience. [Brief explanation of the drawing]

[0053] [Figure 1] This figure shows an example of the overall configuration of the position detection system according to the first embodiment. [Figure 2]This diagram shows the hardware configuration of the electronic device according to the first embodiment, along with an electronic pen. [Figure 3] This diagram shows the hardware configuration of the electronic pen according to the first embodiment, along with the electronic device. [Figure 4A] This figure shows a first example of the arrangement of sensors in an electronic pen according to the first embodiment. [Figure 4B] This figure shows a second example of the arrangement of sensors in an electronic pen according to the first embodiment. [Figure 4C] This figure shows a third example of the arrangement of sensors in an electronic pen according to the first embodiment. [Figure 4D] This figure shows a fourth example of the arrangement of sensors in an electronic pen according to the first embodiment. [Figure 5] This figure shows an example of the functional configuration of the pen controller of an electronic pen according to the first embodiment. [Figure 6] A flowchart illustrating an example of the processing flow by the pen controller according to the first embodiment. [Figure 7] This figure shows an example of the functional configuration of a host processor in an electronic device according to the first embodiment. [Figure 8] A flowchart illustrating an example of a series of processing steps performed by a host processor according to the first embodiment. [Figure 9] This figure shows the overall configuration of the position detection system according to the second embodiment. [Figure 10] This figure shows an example of the functional configuration of a host processor in an electronic device according to the second embodiment. [Figure 11] A flowchart illustrating an example of the processing flow by the host processor according to the second embodiment. [Figure 12A] This diagram illustrates gesture operations for specifying a designated area of ​​a drawing object. [Figure 12B] This diagram illustrates gesture operations for adjusting the range of a specified area of ​​a drawing object. [Figure 13A] This is a diagram illustrating the movement operations of display content objects. [Figure 13B] This is a diagram illustrating the control of displaying content objects on a display using an electronic pen. [Figure 14A] This figure shows a first example of the hardware configuration of an electronic pen according to the third embodiment. [Figure 14B] Figure 14A is a cross-sectional view of the electronic pen along the XIVB-XIVB line. [Figure 14C] This figure shows a second example of the hardware configuration of an electronic pen according to the third embodiment. [Figure 14D] Figure 14C is a cross-sectional view of the electronic pen along the XIVD-XIVD line. [Figure 14E] This figure shows a third example of the hardware configuration of an electronic pen according to the third embodiment. [Figure 15] This figure shows an example of the functional configuration of the pen controller of an electronic pen according to the third embodiment. [Figure 16] A flowchart illustrating an example of the processing flow by the pen controller according to the third embodiment. [Figure 17] This figure shows an example of the arrangement of sensors in an electronic pen according to the fourth embodiment. [Figure 18] This figure shows an example of the functional configuration of the pen controller of an electronic pen according to the fourth embodiment. [Figure 19] A flowchart illustrating an example of the processing flow by the pen controller according to the fourth embodiment. [Figure 20] This figure shows an example of the functional configuration of a host processor in an electronic device according to the fourth embodiment. [Figure 21] A flowchart illustrating an example of a series of processing steps performed by a host processor according to the fourth embodiment. [Figure 22A] This figure shows an example of display content shown on an electronic device according to the fourth embodiment. [Figure 22B] Figure 22A shows the display content with the presented information displayed. [Figure 23]This diagram shows the hardware configuration of an electronic device when a vibrating element is provided so as to overlap the display area. [Figure 24] This is a cross-sectional view showing an example of the hardware configuration of an electronic pen according to the fifth embodiment. [Figure 25A] This figure shows an example of the hardware configuration of an electronic pen according to the sixth embodiment. [Figure 25B] Figure 25A is a cross-sectional view of the electronic pen along the IIXVB-IIXVB line. [Figure 26] This figure shows a first example of a specific configuration of the light guide path according to the sixth embodiment. [Figure 27A] This figure shows a second example of the specific configuration of the light guide path according to the sixth embodiment. [Figure 27B] This is a cross-sectional view of the optical guide path shown in Figure 27A, along the line IIXVIIB-IIXVIIB. [Figure 27C] This is a cross-sectional view of the optical guide path along IIXVIIC-IIXVIIC shown in Figure 27A. [Figure 28A] This figure shows a third example of the specific configuration of the light guide path according to the sixth embodiment. [Figure 28B] This is a cross-sectional view of the optical guide path shown in Figure 28A, along the IIXVIIIB-IIXVIIIB line. [Figure 28C] This is a cross-sectional view of the optical guide path shown in Figure 28A, along the IIXVIIIC-IIXVIIIC line. [Modes for carrying out the invention]

[0054] Hereinafter, embodiments of the present invention (hereinafter referred to as "First Embodiment," "Second Embodiment," "Third Embodiment," "Fourth Embodiment," "Fifth Embodiment," or "Sixth Embodiment") will be described with reference to the attached drawings. To facilitate understanding of the description, the same reference numerals are used for identical components and steps in each drawing whenever possible, and redundant explanations are omitted.

[0055] ---First Embodiment--- First, let me describe the first embodiment.

[0056] <Overall Structure> Figure 1 shows an example of the overall configuration of the position detection system 1000 according to the first embodiment. As shown in Figure 1, the position detection system 1000 comprises an electronic device 1 and an electronic pen 5.

[0057] Electronic device 1 is a computer owned by the user, such as a tablet, smartphone, or personal computer. Electronic device 1 comprises a casing 11 and a display panel 12.

[0058] The housing 11 is a component that houses each of the components of the electronic device 1. The housing 11 forms the outer casing of the electronic device 1.

[0059] The display panel 12 is located on the top side of the housing 11 and is configured to display monochrome images, color images, monochrome videos, or color videos, including text, images, and videos. The display panel 12 can be, for example, a liquid crystal panel, an organic EL (Electro-Luminescence) panel, electronic paper, or a quantum dot panel. The liquid crystal panel may be a backlight type, a mini-LED (Light Emitting Diode) type, or a micro-LED type.

[0060] The electronic pen 5 is a pen-type pointing device. Specifically, the electronic pen 5 is an AES (Active Electrostatic) stylus. The user can draw pictures or write characters on the display panel 12 of the electronic device 1 by pressing the tip of the electronic pen 5 against the display panel 12 of the electronic device 1 and moving it.

[0061] <Hardware Configuration> Figure 2 shows the hardware configuration of the electronic device 1 according to the first embodiment, along with the electronic pen 5. As shown in Figure 2, in addition to the housing 11 and display panel 12 described above, the electronic device 1 further includes a pen sensor 13, a sensor controller 14, and a host processor 15. The electronic device 1 also includes memory, a communication module, and the like, although these are not shown. In Figures 2 and 3, when viewing the display panel 12 of the electronic device 1 from the front, the upward direction is defined as the Y-axis direction, the rightward direction as the X-axis direction, and the front direction as the Z-axis direction.

[0062] The pen sensor 13 is, for example, a capacitive sensor in which multiple detection electrodes are arranged in a planar manner. The pen sensor 13 is installed so as to overlap the display area of ​​the display panel 12 in a planar view and detects the position of the electronic pen 5.

[0063] Furthermore, the pen sensor 13 is a capacitive type sensor in which, for example, multiple detection electrodes are arranged in a planar manner. The pen sensor 13 is composed of, for example, multiple linear detection electrodes 131 for detecting the position on the X axis of the sensor coordinate system and multiple linear detection electrodes 132 for detecting the position on the Y axis.

[0064] The detection electrodes 131 and 132 may be made of a transparent conductive material containing ITO (Indium Tin Oxide), or they may be made of a wire mesh sensor. The pen sensor 13 may also be a self-capacitance sensor in which block-shaped electrodes are arranged in a two-dimensional grid, instead of the mutual capacitance sensor described above.

[0065] The sensor controller 14 controls the operation of the electronic pen 5 by the pen sensor 13 to detect its position and pressure. The sensor controller 14 also performs bidirectional communication between the electronic pen 5 and the sensor controller 14 by controlling the reception and transmission of data to the pen sensor 13. The sensor controller 14 also communicates with the host processor 15.

[0066] The sensor controller 14 is composed of, for example, a communication device, a storage device, a CPU (Central Processing Unit), and memory. The sensor controller 14 functions in various functional configurations when the CPU executes a predetermined program stored in memory or the storage device. The communication device consists of a communication interface for communicating with external devices. The storage device consists of a hard disk or the like and stores various programs, various information, and processing result information necessary for executing processing in the sensor controller 14.

[0067] The host processor 15 is composed of arithmetic processing units including a CPU, a GPU (Graphics Processing Unit), and an MPU (Micro-Processing Unit). The host processor 15 executes the operating system of the electronic device 1 and various applications such as drawing software by executing programs stored in memory (not shown). The host processor 15 also functions as various functional configurations described later by executing programs stored in memory (not shown).

[0068] The drawing software includes a function to generate stroke data based on coordinates sequentially supplied from the sensor controller 14, render it, and display it on the display. The drawing software also includes a function to adjust the rendering results based on data such as pen pressure values ​​supplied from the sensor controller 14 (for example, a function to adjust the line width according to the pen pressure value).

[0069] The hardware configuration of the electronic pen 5 will be described with reference to Figure 3. Figure 3 is a diagram showing the hardware configuration of the electronic pen 5 according to the first embodiment together with the electronic device 1. As shown in Figure 3, the electronic pen 5 includes, for example, a housing 500, a power supply 51, a vibrating member 52, a sensor 54, an input device 55, a pen controller 56, electrodes 57 and 58, and an electrode switch 59. An input device 55 and a sensor 54 are provided on the surface of the housing 500. Inside the housing 500, a power supply 51, a vibrating member 52, a pen controller 56, electrodes 57 and 58, and an electrode switch 59 are provided.

[0070] The power supply 51 is any type of power supply, such as a battery or a rechargeable power supply, that supplies power to the electronic pen 5.

[0071] The vibrating member 52 is a haptic device that vibrates according to a control command and transmits the vibration to the user holding the electronic pen 5. Specifically, the vibrating member 52 is, for example, an eccentric motor, a linear actuator, a solenoid, or a piezoceramic.

[0072] Sensor 54 includes a sensor that measures the force applied to the electronic pen 5. In Figure 3, one sensor 54 is provided on the electronic pen 5, but this is not limited to this, and the electronic pen 5 may be provided with multiple sensors 54.

[0073] Sensor 54 includes, for example, a pressure sensor, a rotation sensor, and an acceleration sensor. The pressure sensor is a sensor that detects the pressure applied to the tip of the electronic pen 5. The rotation sensor is a three-axis gyro sensor that detects the rotation of the electronic pen 5. The acceleration sensor is a three-axis sensor that detects the acceleration applied to the electronic pen 5. Together with the acceleration sensor, the rotation sensor constitutes an inertial measurement unit that detects the translational and rotational motion in the orthogonal three-axis directions applied to the electronic pen 5.

[0074] Furthermore, sensor 54 includes, for example, a capacitive sensor that detects the approach or contact of a user's finger. Sensor 54 also includes a sensor that detects the biometric information of the user holding the electronic pen 5. The sensor that detects biometric information will be described later, so its explanation is omitted here.

[0075] The input device 55 is a component capable of receiving user input. The input device 55 is, for example, a button switch that can be pressed or a slide switch that can be slid. The input device 55 transmits an electrical signal to the pen controller 56 in response to the user's input.

[0076] The communication module 561 is a module that performs bidirectional communication with the electronic device 1. The communication module 561 is configured to include a transmit (TX) circuit and a receive (RX) circuit that communicate with the electronic device 1 via at least one of electrodes 57 and 58. Electrodes 57 and 58 are used to communicate with the electrodes of the pen sensor 13 of the electronic device 1.

[0077] The pen controller 56 controls the operation of the electronic pen 5. The pen controller 56 includes a control module 562, a memory 563, and a storage device 564. The pen controller 56 functions in various functional configurations described later when the control module 562 executes a predetermined program stored in the memory 563 or storage device 564, etc.

[0078] The control module 562 controls the operation of the communication module 561 and the electrode switch 59 in bidirectional communication with the sensor controller 14 of the electronic device 1. The control module 562 also controls the updating of setting information whenever the user changes the settings of the electronic pen 5, such as the color and line width of the electronic pen 5. The control module 562 also manages the operation data of the electronic pen 5, such as the pressure applied to the tip of the pen, the rotation state of the electronic pen 5, and the battery level. The control module 562 also performs operations to read various data from the storage device 564 and to store various data in the storage device 564.

[0079] The storage device 564 is, for example, a computer-readable instruction recording medium (a non-temporary computer-readable instruction recording medium) such as flash memory. The storage device 564 stores various programs and information necessary for executing processing in the control module 562, as well as information on processing results. The storage device 564 also stores information related to the predetermined functions of the electronic pen 5, setting information related to the user-adjustable settings of the electronic pen 5, and operation data of the electronic pen 5.

[0080] Electrodes 57 and 58 are located at different positions within the housing 500 of the electronic pen 5. Specifically, electrode 57 is positioned along the pen axis of the electronic pen 5, exposed from the tip of the pen's tip. Electrode 57 is used for indicating coordinate values ​​on the display panel 12 of the electronic pen 5 and for communication with the sensor controller 14.

[0081] The electrode 58 is provided in the housing 500 above the electrode 57 and below the gripping portion where the user holds the electronic pen 5, spaced apart from the electrode 57. The electrode 58 is a ring electrode formed in an annular shape and is provided between the electrode 57 and the inner circumference of the housing 500. The electrode 58 is used to measure the posture value of the electronic pen 5.

[0082] The orientation values ​​include, for example, a tilt value indicating the inclination of the electronic pen 5 and an orientation value indicating the orientation of the electronic pen 5 on the display panel 12. The orientation value indicates the orientation of the pen tip of the electronic pen 5 when the display panel 12 is viewed from the Z-axis direction. The tilt value is the angle of the electronic pen 5 in the Z-axis direction with respect to the display surface of the display panel 12.

[0083] The electrode switch 59 is a switch that switches the operation of electrodes 57 and 58 between transmission mode and reception mode.

[0084] Here, with reference to Figures 4A to 4D, an embodiment of an electronic pen 5 having a sensor 54 for detecting the user's biometric information will be described. Figure 4A is a diagram showing a first example of the arrangement of the sensor 54 in the electronic pen 5 according to the first embodiment. The electronic pen 5 shown in Figure 4A has, along the pen shaft B1, a pen tip 501, a housing 500, and a tail plug 502, from the front end.

[0085] The pen tip 501 is connected to one end of the housing 500. The tail plug 502 is connected to the other end of the housing 500, opposite to the end to which the pen tip 501 is connected. In addition, a sensor 54 is provided on the surface of the housing 500 at the position on the pen tip 501 side, formed in a line along the longitudinal direction of the housing 500.

[0086] In Figure 4A, sensor 54 is a fingerprint sensor that detects the user's fingerprint as the user's biometric information. Specifically, sensor 54 is a fingerprint sensor such as a capacitive sensor, optical sensor, or ultrasonic sensor. Sensor 54 detects the user's fingerprint when the user's fingertip moves in contact with the detection surface of sensor 54 from the pen tip 501 side to the tail cap 502 side. Alternatively, sensor 54 may detect the user's fingerprint when the user's fingertip moves in contact with the tail cap 502 side to the pen tip 501 side.

[0087] The fingerprint detected by sensor 54 is, for example, the index finger of the user's hand, but is not limited to this; it may also be the middle finger, ring finger, little finger, thumb, etc. Furthermore, the fingerprint detected by sensor 54 may be anywhere on the surface of the finger where ridges are formed. For example, sensor 54 may detect not only the ridges on the pad of the finger, but also the ridges on the outer side of the finger or the inner side of the finger as fingerprints.

[0088] Figure 4B shows a second example of the arrangement of the sensor 54 in the electronic pen 5 according to the first embodiment. In the second example, the position of the sensor 54 on the housing 500 is different from that of the first example. In the second example, the sensor 54 is provided on the tail plug side of the surface of the housing 500.

[0089] Figure 4C shows a third example of the arrangement of the sensor 54 in the electronic pen 5 according to the first embodiment. In the third example, the sensor 54 is formed in an annular shape that covers the outer circumference of the housing 500. In Figure 4C, the sensor 54 is provided on the pen tip 501 side of the surface of the housing 500, but it may also be provided on the tail plug 502 side of the surface of the housing 500, as in the second example.

[0090] In the third example, the user places their finger in contact with the sensor 54 and rotates the electronic pen 5 around the pen shaft B1 as the axis of rotation, thereby causing the sensor 54 to detect the user's fingerprint.

[0091] Figure 4D shows a fourth example of the arrangement of the sensor 54 in the electronic pen 5 according to the first embodiment. In the fourth example, the sensor 54 is a camera for detecting the user's facial image as the user's biometric information. In the fourth example, the sensor 54 is provided at the end of the tail cap 502 opposite to the pen tip 501.

[0092] <Functional configuration of the electronic pen 5 according to the first embodiment> Next, the functional configuration of the electronic pen 5 in the first embodiment will be described. Figure 5 is a diagram showing an example of the functional configuration of the pen controller 56A of the electronic pen 5 according to the first embodiment. As shown in Figure 5, the pen controller 56A includes, as a functional configuration, a storage unit 200A, an authentication unit 210, a transmission unit 220, a reception unit 230, and a history registration unit 240. Furthermore, functions other than those of the memory unit 200A are realized by the control module 562 executing a program stored in the memory device 564 of the pen controller 56A, etc.

[0093] The storage unit 200A has a functional configuration that stores various data used by the pen controller 56A for user authentication processing. Specifically, the storage unit 200A stores registration information 201 and signature history information 202.

[0094] Registration information 201 is information that has been pre-registered as biometric information used in the user authentication process. Registration information 201 includes, for example, fingerprint information showing the user's fingerprint, facial image information showing the user's facial image, and vein information showing the user's finger vein pattern. Fingerprint information includes, for example, the endpoints and branching points of the finger ridges as feature points, and patterns such as the relative positions and directions of the feature points. Vein information is, for example, image data showing the pattern of the user's finger veins.

[0095] Signature history information 202 is information that shows the history of the user's electronic signature on a document using the electronic pen 5. Specifically, signature history information 202 is information that associates information about the user who electronically signed the document with document information that shows information about the document. Furthermore, signature history information 202 may also include time information such as the date and time the electronic signature was made.

[0096] Here, the document is an electronic document in digital format, such as text or images, displayed on the electronic device 1. The electronic signature is performed by the user using an electronic pen 5 to write their name or other signature on the document displayed on the display panel 12 of the electronic device 1.

[0097] Document information includes, for example, information such as the document's file name and file type. User information includes the username, the user ID associated with the user, and the pen ID pre-associated with the electronic pen 5.

[0098] The authentication unit 210 authenticates the user by biometric authentication. Specifically, the authentication unit 210 authenticates that the user indicated by the biometric information is registered in the registration information 201 by comparing the user's biometric information detected by the sensor 54 with the registration information 201 stored in the storage unit 200A. The authentication unit 210 generates an authentication result as the output of the authentication process, indicating whether authentication was successful or not.

[0099] The transmitting unit 220 transmits the user authentication result from the authentication unit 210 to the pen sensor 13 of the electronic device 1 via the communication module 561.

[0100] The receiving unit 230 receives document information, information about the user who electronically signed the document, and information about the date and time the electronic signature was made, from the pen sensor 13 of the electronic device 1 via the communication module 561.

[0101] The history registration unit 240 generates signature history information 202 by associating the document information received by the receiving unit 230 with the user information and date / time information received by the receiving unit 230. The history registration unit 240 stores the generated signature history information 202 in the storage unit 200A. If signature history information 202 is already stored in the storage unit 200A, the history registration unit 240 adds the contents of the generated signature history information 202 to the already stored signature history information 202.

[0102] <Flow of operations performed by the electronic pen 5 according to the first embodiment> The functional configuration of the pen controller 56A has been described above. Next, the specific processing flow of the pen controller 56A will be described in detail. Figure 6 is a flowchart showing an example of a series of processing steps by the pen controller 56A according to the first embodiment. Note that the content and order of the following steps can be changed as appropriate.

[0103] (Step SP10) The receiving unit 230 of the pen controller 56A determines whether or not it has received an authentication request from the electronic device 1 via the communication module 561 to authenticate the user. If the determination is positive, the process proceeds to step SP12. If the determination is negative, the series of processes shown in Figure 6 ends.

[0104] (Step SP12) The pen controller 56A receives the detection of the user's biometric information from the sensor 54. The pen controller 56A detects biometric information such as the user's fingerprints, facial image, and vein pattern using the sensor 54. Then, the process proceeds to step SP14. If the sensor 54 does not detect any biometric information from the user for a certain period of time, the series of processes shown in Figure 6 will end.

[0105] (Step SP14) The pen controller 56A, using the authentication unit 210, determines whether the user's biometric information detected by the sensor 54 matches the registration information 201 stored in the storage unit 200A. If the determination is positive, the process proceeds to step SP16. Conversely, if the determination is negative, the process proceeds to step SP26.

[0106] (Step SP16) The pen controller 56A generates an authentication result indicating that user authentication was successful, via the authentication unit 210. Then, the process proceeds to step SP18.

[0107] (Step SP18) The pen controller 56A transmits the user authentication result to the electronic device 1 via the communication module 561 using the transmission unit 220. Then, the process proceeds to step SP20.

[0108] (Step SP20) The pen controller 56A determines whether the user has performed an electronic signature on the document displayed on the display panel 12 of the electronic device 1 using the electronic pen 5. Specifically, the receiving unit 230 of the pen controller 56A determines whether it has received a signal from the electronic device 1 via the communication module 561 indicating that an electronic signature has been performed. If the determination is positive, the process proceeds to step SP22. Conversely, if the determination is negative, the series of processes shown in Figure 6 ends.

[0109] (Step SP22) The pen controller 56A receives information about the digital signature from the electronic device 1 via the communication module 561 using the receiving unit 230. The information about the digital signature includes information about the document on which the digital signature was applied, information about the user who applied the digital signature, and information about the date and time the digital signature was applied. Then, the process proceeds to step SP24.

[0110] (Step SP24) The pen controller 56A generates signature history information 202 using the history registration unit 240 and stores it in the storage unit 200A. Specifically, the history registration unit 240 of the pen controller 56A generates signature history information 202 by associating the information of the user who performed the electronic signature and the date and time the electronic signature was performed with the document information received by the receiving unit 230. Then, the history registration unit 240 of the pen controller 56A stores the generated signature history information 202 in the storage unit 200A. The series of processes shown in Figure 6 then ends.

[0111] (Step SP26) The pen controller 56A generates an authentication result indicating that user authentication failed, via the authentication unit 210. Then, the process proceeds to step SP28.

[0112] (Step SP28) The pen controller 56A transmits the user authentication result to the electronic device 1 via the communication module 561 using the transmission unit 220. This completes the series of processes shown in Figure 6.

[0113] <Effects of the electronic pen 5 according to the first embodiment> The electronic pen 5 according to the first embodiment comprises a housing 11 held by the user, a sensor 54, a communication module 561, and a pen controller 56A. The sensor 54 is provided in the housing 11 and detects the user's biometric information. The communication module 561 is provided in the housing 11 and communicates with the pen sensor 13. The pen controller 56A is provided inside the housing 11 and comprises a storage unit 200A, an authentication unit 210, and a transmission unit 220. The storage unit 200A stores the user's registration information 201. The authentication unit 210 authenticates that the user indicated by the biometric information is registered in the registration information 201 by comparing the biometric information detected by the sensor with the registration information 201. The transmission unit 220 transmits the authentication result from the authentication unit 210 to the pen sensor 13 via the communication module 561.

[0114] With this configuration, the electronic pen 5 can perform biometric authentication without requiring a special biometric authentication device when the user of the electronic device 1 and the electronic pen 5 is requested to do so. Therefore, the electronic pen 5 can improve user convenience.

[0115] Furthermore, in the electronic pen 5 according to the first embodiment, the sensor 54 is a fingerprint sensor. In addition, the registration information 201 includes fingerprint information indicating the user's fingerprint.

[0116] With this configuration, the electronic pen 5 can perform fingerprint authentication without requiring a special fingerprint authentication device when a user of the electronic device 1 and the electronic pen 5 is requested to do so. Therefore, the electronic pen 5 can improve user convenience.

[0117] Furthermore, in the electronic pen 5 according to the first embodiment, the sensor 54 is a camera. In addition, the registration information 201 includes facial image information showing the user's facial image.

[0118] With this configuration, the electronic pen 5 can perform biometric authentication using facial image information when the electronic device 1 and the user using the electronic pen 5 are required to authenticate using a facial image, even if the electronic device 1 is not equipped with an imaging device such as a camera. Therefore, the electronic pen 5 can improve user convenience.

[0119] Furthermore, in the electronic pen 5 according to the first embodiment, the sensor 54 is a vein sensor. In addition, the registration information 201 includes vein information indicating the user's vein pattern.

[0120] With this configuration, the electronic pen 5 can perform vein authentication when a user of the electronic device 1 and the electronic pen 5 is requested to do so, without requiring a special device for vein authentication. Therefore, the electronic pen 5 can improve user convenience.

[0121] Furthermore, the electronic pen 5 according to the first embodiment further comprises a receiving unit 230 and a history registration unit 240. The receiving unit 230 receives document information indicating a document that the user has electronically signed from the pen sensor 13 via the communication module 561. The history registration unit 240 stores the document information received by the receiving unit 230 as signature history information 202 in the storage unit 200A, associating it with information indicating the user authenticated by the authentication unit 210.

[0122] In this configuration, the electronic pen 5 stores the history of the user's electronic signatures as signature history information 202. Therefore, the electronic pen 5 can reduce the effort required for the user to manage electronically signed documents. Furthermore, the electronic pen 5 can simplify the management of electronically signed documents.

[0123] <Functional configuration of the electronic device 1 according to the first embodiment> Next, the functional configuration of the electronic device 1 according to the first embodiment will be described. Figure 7 is a diagram showing an example of the functional configuration of the host processor 15A of the electronic device 1 according to the first embodiment. As shown in Figure 7, the host processor 15A includes, as a functional configuration, a storage unit 600A, a signature receiving unit 610, a signer acquisition unit 620, a history registration unit 630, an authentication unit 640, and a display control unit 650. Furthermore, functions other than those of the memory unit 600A are realized by the CPU executing programs stored in the memory device of the host processor 15A.

[0124] The storage unit 600A has a functional configuration for storing various data used in various processes performed by the host processor 15A in electronic signatures using the electronic pen 5. Specifically, the storage unit 600A stores document information 601, signer information 602, identification information 603, and signature history information 604.

[0125] Document information 601 is information about a document to which an electronic signature has been applied. Document information 601 includes information such as the document's file name and file type.

[0126] Signer information 602 is information about the signer who performed the electronic signature. Some specific examples of signer information 602 are given below. If the signer is identified by the electronic pen 5, signer information 602 may include, for example, the electronic pen ID 6031 for identifying the electronic pen 5. If the signer is identified by user authentication, signer information 602 may include, for example, the user's authentication information 6033.

[0127] Identification information 603 is various pieces of information used to identify the signer. Identification information 603 includes, for example, an electronic pen ID 6031, a driver ID 6032, and authentication information 6033. Electronic pen ID 6031 is an identification ID pre-assigned to each electronic pen (5). Driver ID 6032 is an identification ID that is pre-assigned to each electronic device. Authentication information 6033 is information related to the authentication of the user of the electronic pen 5. Authentication information 6033 includes information such as the user's name, user ID, and whether authentication was successful or not. Authentication information 6033 may also be the result of user authentication by biometric authentication.

[0128] The signature history information 604 is the same as the signature history information 604 stored in the pen controller 56A of the electronic pen 5 described above, so its explanation will be omitted.

[0129] The signature reception unit 610 accepts electronic signatures from users. Specifically, the signature reception unit 610 accepts electronic signatures that users perform on documents displayed on the display area of ​​the display panel 12 of the electronic device 1 using the electronic pen 5, via the pen sensor 13. The signature reception unit 610 stores information indicating the document to which the electronic signature was applied as document information 601 in the storage unit 600A.

[0130] The signature reception unit 610 may accept the electronic signature if the authentication information 6033 indicates that the user's authentication was successful, and may stop accepting the electronic signature if the authentication information 6033 indicates that the user's authentication failed.

[0131] The signatory acquisition unit 620 acquires signatory information 602, which indicates the signatory who performed the electronic signature received by the signature reception unit 610. The signatory acquisition unit 620 stores the acquired signatory information 602 in the storage unit 600A.

[0132] The history registration unit 630 generates signature history information 604 by associating the document information 601 and information regarding the execution date and time of the electronic signature received by the signature reception unit 610 with the signer information 602 obtained by the signer acquisition unit 620. The history registration unit 630 stores the generated signature history information 604 in the storage unit 600A.

[0133] The authentication unit 640 performs user authentication. For example, the authentication unit 640 sends a control command to the electronic pen 5 via the pen sensor 13 to perform biometric authentication processing of the user using the sensor 54. The authentication unit 640 receives the authentication result from the electronic pen 5 via the pen sensor 13 and stores the authentication result as authentication information 6033 in the storage unit 600A.

[0134] Furthermore, the authentication unit 640 may authenticate the user using the identification information 603. Specifically, the authentication unit 640 may authenticate the user if the combination of the electronic pen ID 6031 and the driver ID 6032 included in the identification information 603 is a predetermined combination set in advance for the user to be authenticated.

[0135] Furthermore, the authentication unit 640 may authenticate the user by combining multiple authentication processes as described above. For example, the authentication unit 640 may authenticate the user if the authentication result by biometric authentication indicates that the user's authentication was successful and the electronic pen ID 6031 is a predetermined ID. Furthermore, the authentication unit 640 may, for example, accept a password input when the electronic pen ID 6031 is a predetermined ID, and authenticate the user if the accepted input is a keyword that has been pre-associated with the user.

[0136] The display control unit 650 displays the content to be displayed in the display area of ​​the display panel 12. The content to be displayed is, for example, a document to be electronically signed.

[0137] The functional configuration of the host processor 15A of the electronic device 1 has been described above. Next, the specific processing flow of the host processor 15A will be described in detail. Figure 8 is a flowchart showing an example of a series of processing steps by the host processor 15A according to the first embodiment. Note that the content and order of the following steps can be changed as appropriate.

[0138] (Step SP600) The host processor 15A performs user authentication processing using the authentication unit 640. Specifically, the authentication unit 640 of the host processor 15A sends a control command to the electronic pen 5 via the pen sensor 13 to perform biometric authentication processing of the user using the sensor 54. Subsequently, the authentication unit 640 of the host processor 15A receives the authentication result from the electronic pen 5 via the pen sensor 13. The authentication unit 640 stores the authentication result as authentication information 6033 in the storage unit 600A. Note that the authentication processing by the authentication unit 640 is not limited to biometric authentication; it may also be any other authentication method described above for the authentication unit 640. Then, the process moves on to step SP602.

[0139] (Step SP602) The host processor 15A displays the document to be electronically signed by the display control unit 650 in the display area of ​​the display panel 12. The document to be electronically signed is stored, for example, in the storage unit 600A. Then, the process proceeds to step SP604.

[0140] (Step SP604) The signature reception unit 610 of the host processor 15A determines whether a signature request has been made by a user to electronically sign a document. A signature request is made, for example, by user input on a document displayed in the display area. If the determination is positive, the process proceeds to step SP606. Conversely, if the determination is negative, the series of processes shown in Figure 8 ends.

[0141] (Step SP606) The host processor 15A determines whether the user has been authenticated by the signature reception unit 610. Specifically, the signature reception unit 610 of the host processor 15A determines whether the authentication information 6033 indicates that the user's authentication was successful. If the determination is positive, the process proceeds to step SP608. Conversely, if the determination is negative, the process proceeds to step SP614.

[0142] (Step SP608) The host processor 15A receives an electronic signature on the document using the electronic pen 5 via the signature reception unit 610. Subsequently, the host processor 15A stores information about the electronically signed document as document information 601 in the storage unit 600A via the signature reception unit 610. Then, the process proceeds to step SP610.

[0143] (Step SP610) The host processor 15A obtains signer information 602, which indicates the signer who electronically signed the document, using the signer acquisition unit 620. The host processor 15A stores the signer information 602 in the storage unit 600A using the signer acquisition unit 620. Then, the process proceeds to step SP612.

[0144] (Step SP612) The host processor 15A generates signature history information 604 using the history registration unit 630. Specifically, the history registration unit 630 of the host processor 15A generates signature history information 604 by associating the signer information 602 and information indicating the date and time the electronic signature was made with the document information 601. Subsequently, the history registration unit 630 of the host processor 15A stores the generated signature history information 604 in the storage unit 600A. Then, the series of processes shown in Figure 8 is completed.

[0145] (Step SP614) The host processor 15A stops accepting electronic signatures for the document via the signature acceptance unit 610. The sequence of processes shown in Figure 8 then ends.

[0146] In the process flow shown in Figure 8, we have explained an example where the acceptance of the electronic signature is stopped if user authentication fails or the user is not authenticated. In the process flow when the user authentication process is not performed, steps SP600, SP606, and SP614 are omitted from the process flow described above.

[0147] <Effects of the electronic device 1 according to the first embodiment> The electronic device 1 according to the first embodiment includes a display panel 12 for displaying an object, a pen sensor 13, a signature reception unit 610, a signer acquisition unit 620, and a storage unit 600A. The pen sensor 13 is provided so as to overlap the display area of ​​the display panel 12 and detects position indication by the electronic pen 5. The signature reception unit 610 receives electronic signatures by the electronic pen 5 on the document displayed in the display area via the pen sensor 13. The signer acquisition unit 620 acquires signer information 602 indicating the signer of the electronic signature. The storage unit 600A stores the signer information 602 as signature history information 604 by associating it with document information 601 indicating the document on which the electronic signature has been made.

[0148] In this configuration, electronic device 1 stores a history of the electronic signatures that the user has made on documents. Therefore, electronic device 1 can reduce the effort required of the user to manage electronically signed documents. Furthermore, electronic device 1 can simplify the management of electronically signed documents.

[0149] Furthermore, in the electronic device 1 according to the first embodiment, the signatory information 602 includes first identification information (electronic pen ID 6031) relating to the electronic pen 5.

[0150] In this configuration, electronic device 1 identifies the signer by considering the electronic pen 5 as the signer of the electronic signature. Therefore, electronic device 1 does not need to perform authentication processing to identify the user, and the effort required for the user to electronically sign documents is reduced.

[0151] Furthermore, in the electronic device 1 according to the first embodiment, the signer information 602 includes the authentication information 6033 of the user of the electronic pen 5.

[0152] In this configuration, electronic device 1 identifies the signer using the user's authentication information 6033. Therefore, electronic device 1 can improve the security of electronic signatures on documents while facilitating the management of electronically signed documents.

[0153] Furthermore, in the electronic device 1 according to the first embodiment, the signature receiving unit 610 accepts an electronic signature when the authentication information 6033 indicates that user authentication was successful, and stops accepting the electronic signature when the authentication information 6033 indicates that user authentication failed.

[0154] In this configuration, electronic device 1 will not accept an electronic signature if user authentication fails. Therefore, electronic device 1 can further enhance the security of electronic signatures on documents while simplifying the management of electronically signed documents.

[0155] Furthermore, the electronic device 1 according to the first embodiment further includes an authentication unit 640 that authenticates the user when the combination of first identification information (electronic pen ID 6031) related to the electronic pen 5 and second identification information (such as driver ID 6032 or a keyword) that is different from the first identification information is a predetermined combination. The storage unit 600A also stores the authentication result by the authentication unit 640 as authentication information 6033.

[0156] In this configuration, the electronic device 1 uses a combination of multiple identification information 603 in the authentication process of the user performing the electronic signature. Therefore, the electronic device 1 can further improve the security of the electronic signature on the document while also facilitating the management of the electronically signed document.

[0157] Furthermore, in the electronic device 1 according to the first embodiment, the authentication information 6033 is the authentication result obtained through biometric authentication for the user.

[0158] Therefore, since electronic device 1 uses biometric authentication for user authentication, it can further improve the security of electronic signatures on documents while also facilitating the management of electronically signed documents.

[0159] ---Second Embodiment--- Next, a second embodiment will be described.

[0160] <Overall Structure> Figure 9 shows the overall configuration of the position detection system 1000 according to the second embodiment. As shown in Figure 9, the position detection system 1000 according to the second embodiment comprises a server device 3, a plurality of electronic devices 1, and a plurality of electronic pens 5.

[0161] Server device 3 is a cloud-type server for storing and managing various information related to electronic devices 1 and electronic pens 5. Server device 3 is connected to multiple electronic devices 1 via the communication network NT. In Figure 9, the position detection system 1000 includes one server device 3, but it is not limited to this, and various information about the electronic device 1 and electronic pen 5 may be stored and managed by multiple server devices 3.

[0162] The hardware configuration of the electronic device 1 and the electronic pen 5 is the same as in the first embodiment, so its description is omitted here. The electronic pen 5 is wirelessly connected to the electronic device 1 for communication. In this example, the electronic device 1 and the electronic pen 5 are connected on a one-to-one basis, but this is not the only option. Multiple electronic pens 5 may be associated with one electronic device 1, or multiple electronic devices 1 may be associated with one electronic pen 5.

[0163] <Functional configuration of the electronic device 1 according to the second embodiment> Figure 10 shows an example of the functional configuration of the host processor 15B of the electronic device 1 according to the second embodiment. As shown in Figure 10, the host processor 15B includes a storage unit 600B, a gesture detection unit 710, an extraction unit 720, a transmission unit 730, a reception unit 740, an adjustment unit 750, and a display control unit 760. Furthermore, functions other than those of the storage unit 600B are realized by the CPU executing programs stored in the storage device of the host processor 15B.

[0164] The storage unit 600B has a functional configuration for storing various data used in various processes executed by the host processor 15B according to the second embodiment. Specifically, the storage unit 600B stores drawing objects 701, drawing information 702, drawing parameters 703, display content 704, and color information 705.

[0165] The drawing object 701 is an object that is displayed in the display area of ​​the display panel 12 when the user draws using the electronic pen 5 and the electronic device 1. Specifically, the drawing object 701 is, for example, a part or all of an image drawn by a virtual drawing tool such as illustration software or image editing software.

[0166] The drawing information 702 includes time-series data of the orientation information of the electronic pen 5 and drawing parameters 703 related to a virtual drawing tool used to draw the drawing object 701. Specifically, the drawing information 702 is ink data related to the virtual drawing by the electronic pen 5. The orientation information of the electronic pen 5 includes, for example, information on the position, tilt, and pressure of the electronic pen 5 on the pen sensor 13. Note that the drawing information 702 is not limited to ink data of the electronic pen 5. The drawing information 702 may, for example, be image data indicating a specified area of ​​the drawing object 701.

[0167] The drawing parameters 703 are parameters used when drawing with a virtual drawing tool, such as line thickness, color, and the type of virtual drawing brush, from the ink data of the electronic pen 5. Examples of virtual drawing brush types include pencils, brushes, pens, and felt-tip pens. The user of the electronic device 1 can draw with different line types by selecting the type of virtual drawing brush.

[0168] The display content 704 is content displayed in the display area of ​​the display panel 12 of the electronic device 1. The display content 704 includes, for example, an object 7041 that can be operated in response to user input.

[0169] Color information 705 is information that indicates the color within a portion of the display content 704. Color information 705 may be, for example, RGB (Red, Green, Blue) values ​​or a color code expressed in hexadecimal.

[0170] The gesture detection unit 710 detects gesture operations, including movement or rotation of the electronic pen 5. The gesture detection unit 710 can detect not only one type of gesture operation, but also multiple types of gesture operations. Gesture operation is, for example, an operation to specify a designated area of ​​a drawing object 701 or a part of an object 7041 displayed in the display area. Specifying a designated area is performed, for example, by drawing a circle around a part of the drawing object 701 or object 7041 with the electronic pen 5. Gesture control is, for example, the operation of rotating the electronic pen 5. Furthermore, gesture operation is, for example, an input to a capacitive sensor 54 provided on the electronic pen 5.

[0171] The extraction unit 720 extracts information from the specified target when the gesture detection unit 710 detects a gesture operation that specifies a designated area of ​​the drawing object 701 or a part of the object 7041. The information extracted by the extraction unit 720 is, for example, drawing information 702 of a specified area of ​​drawing object 701. The information extracted by the extraction unit 720 is, for example, color information 705 regarding the color within a portion of object 7041. The information extracted by the extraction unit 720 is, for example, image data representing object 7041 of display content 704.

[0172] The transmitting unit 730 transmits the drawing information 702 extracted by the extraction unit 720 to the server device 3. The transmitting unit 730 also transmits image data representing the object 7041 extracted by the extraction unit 720 to the electronic pen 5. When transmitting the image data to the electronic pen 5, the transmitting unit 730 uses a wireless communication device different from the communication module 561. The wireless communication device is a unit that performs wireless communication, such as Bluetooth® or infrared communication, and is located inside the housing 11 of the electronic device 1. The electronic pen 5 also has a unit that performs wireless communication with the electronic device 1 located inside its housing 500.

[0173] The receiving unit 740 receives drawing information 702 from the server device 3. The receiving unit 740 may also receive data with a large data capacity, such as image data, from the electronic pen 5 using a wireless communication device different from the communication module 561 described above.

[0174] The adjustment unit 750 adjusts the range of the specified area of ​​the drawing object 701 and the display content 704 in accordance with the gesture operation detected by the gesture detection unit 710. The adjustment unit 750 also adjusts the color indicated by the color information 705 extracted by the extraction unit 720 in accordance with the gesture operation detected by the gesture detection unit 710. Note that the gesture operation for specifying a designated area, the gesture operation for adjusting the range of the designated area, and the gesture operation for adjusting the color indicated by color information 705 are all different gesture operations. Furthermore, the detection of gesture operations that adjust the range of the specified area and gesture operations that adjust the color indicated by color information 705 are only effective after a gesture operation that specifies the area has been detected.

[0175] The display control unit 760 controls the operation of displaying the display content 704 and drawing objects 701 in the display area of ​​the display panel 12.

[0176] The functional configuration of the host processor 15B has been described above. Next, the specific processing flow in the host processor 15B will be described in detail. Figure 11 is a flowchart showing an example of a series of processing steps by the host processor 15B according to the second embodiment. In Figure 11, the process of transmitting the extracted drawing information 702 to the server device 3 and the process of receiving the drawing information 702 transmitted from the server device 3 are described. Note that the content and order of the following steps can be changed as appropriate.

[0177] (Step SP700) The host processor 15B displays the drawing object 701 in the display area of ​​the display panel 12 using the display control unit 760. Then, the process proceeds to step SP702.

[0178] (Step SP702) The host processor 15B determines whether or not the gesture detection unit 710 has detected a gesture operation that specifies a designated area representing a part of the drawing object 701 drawn by the electronic pen 5. If the determination is positive, the process proceeds to step SP704. Conversely, if the determination is negative, the process proceeds to step SP708.

[0179] (Step SP704) The host processor 15B extracts drawing information 702 from a specified area using the extraction unit 720.

[0180] Here, the details of extracting drawing information 702 will be explained with reference to Figures 12A and 12B. Figure 12A is a diagram illustrating a gesture operation to specify a designated area A1 of a drawing object 701. In Figure 12A, the electronic pen 5 is used to specify a designated area A1 for the drawing object 701 so as to surround the apple located on the right side of the display panel 12. In Figure 12A, the extraction unit 720 of the host processor 15 extracts image data indicating the designated area A1 as drawing information 702.

[0181] Figure 12B is a diagram illustrating a gesture operation to adjust the range of the designated area A2 of the drawing object 701. In Figure 12B, the electronic pen 5 is used to specify the designated area A2 of the drawing object 701 so as to surround the apple located near the center of the display panel 12. In Figure 12B, the extraction unit 720 of the host processor 15 extracts the ink data within the designated area A2 as drawing information 702.

[0182] Furthermore, in Figure 12B, the user rotates the electronic pen 5 counterclockwise when viewed from the end cap 502 side, with the pen shaft as the axis of rotation. In Figure 12B, the range of the designated area A2 widens in accordance with the rotation of the electronic pen 5. Although not shown in Figure 12B, if the electronic pen 5 rotates clockwise when viewed from the end cap 502 side, with the pen shaft as the axis of rotation, the range of the designated area A2 will narrow.

[0183] Furthermore, although not shown in Figure 12B, the range of the designated area A2 may be widened or narrowed not only by rotational movement but also by movement of the electronic pen 5, or by operation input to the sensor 54 or input device 55 provided on the electronic pen 5. Also, although not shown in Figure 12B, the extraction unit 720 of the host processor 15 extracts drawing information 702 within the designated area A2 after receiving a gesture operation related to color adjustment.

[0184] Returning to Figure 11, the process moves on to step SP706.

[0185] (Step SP706) The host processor 15B transmits the extracted drawing information 702 to the server device 3 via the communication network NT using the transmission unit 730. The server device 3 stores the drawing information 702 received from the electronic device 1. Then, the processing proceeds to step SP708.

[0186] (Step SP708) The host processor 15B determines, via the receiving unit 740, whether or not there is a reception request from the server device 3 to receive drawing information 702. The reception request is made by user input to the electronic device 1. If the determination is positive, the process proceeds to step SP710. Conversely, if the determination is negative, the sequence of processes shown in Figure 11 ends.

[0187] (Step SP710) The host processor 15B receives drawing information 702 stored in the server device 3 via the communication network NT from the server device 3 using the receiving unit 740. The host processor 15B also adjusts the drawing parameters 703 to the parameters indicated by the received drawing information 702 using the adjustment unit 750. Then, the series of processes shown in Figure 11 is completed.

[0188] <Effects of the electronic device 1 according to the second embodiment> In the second embodiment described above, the electronic device 1 is capable of communicating with the server device 3 and comprises a display panel 12 for displaying an object to be displayed, a pen sensor 13, a gesture detection unit 710, an extraction unit 720, and a transmission unit 730. The pen sensor 13 is provided so as to overlap the display area of ​​the display panel 12 and detects position indication by the electronic pen 5. The gesture detection unit 710 detects a gesture operation on the drawing object 701, via the pen sensor 13, that designates a designated area A1 or A2 indicating a part of the drawing object 701 using the electronic pen 5. When the gesture detection unit 710 detects a gesture operation, the extraction unit 720 extracts drawing information 702 of the detected designated area A1 or A2. The transmission unit 730 transmits the drawing information 702 extracted by the extraction unit 720 to the server device 3.

[0189] In this configuration, the electronic device 1 stores the drawing information 702 of the drawing object 701 drawn by the user in the server device 3, allowing it to share the drawing information 702 with other electronic devices 1 and the electronic pen 5. Therefore, the electronic device 1 can improve user convenience.

[0190] In the second embodiment, the drawing information 702 includes time-series data of the orientation information of the electronic pen 5 and the drawing parameters 703. The orientation information includes the position, tilt, and pressure of the electronic pen 5 on the pen sensor 13, and the drawing parameters 703 are parameters relating to the virtual drawing tool used to draw the drawing object 701.

[0191] With this configuration, the electronic device 1 can share the orientation information of the electronic pen 5 and the time-series information of the drawing parameters 703 with the server device 3. Therefore, the electronic device 1 can further improve user convenience.

[0192] In the second embodiment, the electronic device 1 further comprises a receiving unit 740 and an adjustment unit 750. The receiving unit 740 receives drawing information 702 from the server device 3. The adjustment unit 750 adjusts the drawing parameters 703 of the drawing tool to the drawing parameters 703 indicated by the drawing information 702 received by the receiving unit 740.

[0193] With this configuration, the electronic device 1 can perform drawing using drawing parameters 703 that conform to the drawing information 702 stored in the server device 3. Therefore, the electronic device 1 can further improve user convenience.

[0194] In the second embodiment, the drawing information 702 is image data indicating a designated area A1 or A2 of the drawing object 701.

[0195] In this configuration, the electronic device 1 shares a portion of the drawing objects 701 drawn by the user with the server device 3. Therefore, the electronic device 1 can improve user convenience.

[0196] In the second embodiment, the gesture detection unit 710 detects gesture operations including movement or rotation of the electronic pen 5. The extraction unit 720 extracts information representing the specified portion when the gesture detection unit 710 detects a first gesture operation in which the electronic pen 5 specifies a portion of the drawing object 701 via the pen sensor 13.

[0197] With this configuration, the electronic device 1 extracts information through gesture operations, including the movement or rotation of the electronic pen 5, thus enabling intuitive and easy extraction of information from the drawing object 701. Therefore, the electronic device 1 can improve the user experience.

[0198] In the second embodiment, the extraction unit 720 extracts color information 705 relating to the color within a portion of the region.

[0199] With this configuration, the electronic device 1 can intuitively and easily extract color information 705 from the drawing object 701. Therefore, the electronic device 1 can improve the user experience.

[0200] Furthermore, in the second embodiment, if the gesture detection unit 710 detects a second gesture operation that is different from the first gesture operation after the extraction unit 720 has extracted color information 705 within a portion of the region, the system further includes an adjustment unit 750 that adjusts the range of the region according to the second gesture operation.

[0201] With this configuration, the electronic device 1 can intuitively and easily adjust the range of the area of ​​the drawing object 701. Therefore, the electronic device 1 can further improve the user experience.

[0202] In the second embodiment, the electronic device 1 further includes an adjustment unit 750 that adjusts the extracted color according to the third gesture operation when the gesture detection unit 710 detects a third gesture operation that is different from the first gesture operation after the extraction unit 720 has extracted the color information 705 within the region.

[0203] With this configuration, electronic device 1 can intuitively and easily adjust the colors of the color information 705. Therefore, electronic device 1 can improve the user experience.

[0204] Another embodiment of the second embodiment will be described with reference to Figures 13A and 13B. Figure 13A is a diagram illustrating the movement operation of object 7041 of the display content 704. Figure 13B is a diagram illustrating the display control of object 7041 of the display content 704 on the display DP using the electronic pen 5B.

[0205] As shown in Figure 13A, in another embodiment of the second embodiment, the electronic pen 5B has a display DP capable of displaying images, videos, etc., provided on the side of the housing 500.

[0206] Furthermore, the display content 704 includes objects 7041 and 7042. Object 7041 is an object that can accept user input. The display control unit 760 receives position instructions for object 7041 via the pen sensor 13 from the electronic pen 5B.

[0207] The display control unit 760 moves object 7041 within the display content 704 in accordance with the movement of the electronic pen 5 while positioning is being indicated for object 7041 by the electronic pen 5B. In Figure 13A, it is assumed that object 7041 moves toward object 7042 due to positioning indicated by the electronic pen 5B.

[0208] Object 7042 is an object that functions as a trigger to switch the display control of object 7041 when object 7041 overlaps with it.

[0209] As shown in Figure 13B, the display control unit 760 controls the display operation so that when object 7041 is moved to object 7042 by operation input from the electronic pen 5B, the display of object 7041 is turned off from the display panel 12.

[0210] Furthermore, the display control unit 760 sends a control command to the electronic pen 5B to display object 7041 on the display DP provided on the electronic pen 5B. In addition, the display control unit 760 sends image data of object 7042 to the electronic pen 5B via wireless communication.

[0211] The electronic pen 5B receives control commands from the electronic device 1. The electronic pen 5B also receives image data of object 7042 via a wireless communication device. The electronic pen 5B then displays object 7042 on the display DP.

[0212] With the electronic device 1 configured as described above, it becomes possible to manipulate the object 7041 from the electronic device 1 to the electronic pen 5B, thereby improving the user experience for the user using the electronic pen 5B.

[0213] ---Third Embodiment--- Next, the third embodiment will be described.

[0214] <First example of the hardware configuration of the electronic pen 5C according to the third embodiment> The hardware configuration of the electronic pen 5C according to the third embodiment will be described with reference to Figures 14A to 14E. Figure 14A shows a first example of the hardware configuration of the electronic pen 5C according to the third embodiment. Figure 14B is a cross-sectional view of the electronic pen 5C shown in Figure 14A along the line XIVB-XIVB. As shown in Figures 14A and 14B, in the first example of the electronic pen 5C according to the third embodiment, a rotation input device 551 is provided on the surface of the housing 500C on the pen tip side 501.

[0215] The rotary input device 551 is a device that receives user input from a user holding the housing 500C of the electronic pen 5C via a rotatable rotating member 5511. In the first example, the rotary input device 551 is a trackball. The rotary input device 551 includes a rotating member 5511, a recess 5512 for positioning the rotating member 5511 on the surface of the housing 500C, and an optical sensor 5513.

[0216] The rotating member 5511 is a spherical member. The rotating member 5511 is rotatably and detachably connected to the recess 5512. While connected to the recess 5512, the rotating member 5511 receives user input. The rotating member 5511 rotates within the recess 5512 in response to the user input.

[0217] The recess 5512 is a hemispherical bowl-shaped portion formed on the surface of the housing 500C on the pen tip side. The area near the opening of the recess 5512 on the surface side of the housing 500C is formed in a slightly narrowed shape to prevent the rotating member 5511 from falling out.

[0218] The optical sensor 5513 is a sensor for optically detecting the rotation of the rotating member 5511. The optical sensor 5513 transmits the detection result of the rotation of the rotating member 5511 to the pen controller 56B (see Figure 15). The optical sensor 5513 is installed in a hole provided in the bottom surface of the recess 5512.

[0219] <Second example of the hardware configuration of the electronic pen 5C according to the third embodiment> Figure 14C shows a second example of the hardware configuration of the electronic pen 5C according to the third embodiment. Figure 14D is a cross-sectional view of the electronic pen 5C shown in Figure 14C along the line XIVD-XIVD. As shown in Figures 14C and 14D, in the second example of the electronic pen 5C according to the third embodiment, a rotation input device 552 is provided on the surface of the housing 500C on the pen tip 501 side.

[0220] The rotary input device 552 is a device that receives user input from a user gripping the housing 500 of the electronic pen 5C via a rotatable rotating member 5521. In the second example, the rotary input device 552 is a wheel member or a jog dial (registered trademark). The rotary input device 552 has a rotating member 5521, a rotating shaft 5522, and a rotation detection member 5523.

[0221] The rotating member 5521 is an annular member formed to be rotatable along the rotation axis 5522. The rotation axis 5522 is connected to the center of the ring of the rotating member 5521. The rotating member 5521 rotates along the rotation axis 5522 in response to user input.

[0222] The rotating shaft 5522 is a component that transmits the rotation of the rotating member 5521 to the rotation detection member 5523. The rotating shaft 5522 rotates in accordance with the rotation of the rotating member 5521. The rotating shaft 5522 is also rotatably connected to the rotation detection member 5523.

[0223] The rotation detection member 5523 is a member for detecting the rotation of the rotating shaft 5522. The rotation detection member 5523 is, for example, a gear for rotation detection or a bearing with a rotation sensor. The rotation detection member 5523 transmits the detection result of the rotation of the rotating member 5521, which is transmitted via the rotating shaft 5522, to the pen controller 56B (see Figure 15).

[0224] <Third example of the hardware configuration of the electronic pen 5C according to the third embodiment> Figure 14E shows a third example of the hardware configuration of the electronic pen 5 according to the third embodiment. In the third example, a light-emitting member 542 is provided on the pen tip 501 of the electronic pen 5C.

[0225] The light-emitting member 542 includes multiple light-emitting elements that emit light according to control commands from the pen controller 56B (see Figure 15). The light-emitting elements are, for example, LEDs. Each of the multiple light-emitting elements emits light in a different color. The light-emitting member 542 projects the light emitted from the light-emitting elements from the pen tip 501 outwards from the electronic pen 5C. Specifically, the light-emitting element may be provided on the surface of the pen tip 501. Alternatively, the light-emitting element may be provided inside the pen tip 501. The light-emitting member 542 may expose the light emitted from the light-emitting element inside the pen tip 501 to the outside of the electronic pen 5C through a transparent material provided on the surface of the pen tip 501.

[0226] In the third embodiment, an inertial measurement unit is provided inside the housing 500C of the electronic pen 5C as a sensor 54 for detecting the position and orientation of the electronic pen 5C. The sensor 54 may be provided anywhere inside the housing 500C.

[0227] The inertial measurement unit includes a 3-axis accelerometer and a 3-axis gyroscope. The 3-axis accelerometer detects acceleration along the three axes: X, Y, and Z. The 3-axis gyroscope detects angular acceleration when the X axis is the axis of rotation, when the Y axis is the axis of rotation, and when the Z axis is the axis of rotation.

[0228] In the third embodiment, the housing 500C of the electronic pen 5C is further provided with a connecting member (not shown) for physically connecting the electronic pen 5C and the electronic device 1, and a sensor 54 for detecting the connection state.

[0229] The connecting member is, for example, a magnet. Alternatively, the connecting member may be, for example, a detachable adapter attached to a connecting adapter provided on the housing 11 of the electronic device 1. Here is an example of an adapter. In one example, the adapter is a hook-shaped member that can be attached to and detached from a ring-shaped member. In another example, the adapter is a plug member that can be attached to and detached from a rail member. In yet another example, it is a protrusion that can be attached to and detached from a recess provided in the housing 11 and fitted into it. In yet another example, the adapter is a hook-and-loop fastener.

[0230] The sensor 54 for detecting the connection status detects whether the electronic pen 5C is connected to the electronic device 1 via a connecting member. The sensor 54 for detecting the connection status is, for example, a magnetic sensor. The sensor 54 for detecting the connection status transmits the detection result to the pen controller 56B (see Figure 15).

[0231] <Functional configuration of the electronic pen 5C according to the third embodiment> Figure 15 shows an example of the functional configuration of the pen controller 56B of the electronic pen 5C according to the third embodiment. As shown in Figure 15, the pen controller 56B includes a storage unit 200B, a transmission unit 310, a position detection unit 320, a position calculation unit 330, a connection detection unit 340, and a light emission control unit 350. Furthermore, functions other than those of the memory unit 200B are realized by the control module 562 executing programs stored in the memory device 564 of the pen controller 56B, etc.

[0232] The memory unit 200B has a functional configuration that stores various data used by the pen controller 56B for various processing of the electronic pen 5C. Specifically, the memory unit 200B stores location information 301 and connection status information 302.

[0233] Position information 301 is information indicating the position of the electronic pen 5C on the pen sensor 13. Position information 301 is, for example, coordinate values ​​indicating the position and orientation of the electronic pen 5C as determined by the inertial measurement unit. Position information 301 includes, for example, three values: coordinate values ​​indicating the position in the X-axis direction, coordinate values ​​indicating the position in the Y-axis direction, and coordinate values ​​indicating the position in the Z-axis direction. The position in the Z-axis direction indicates the height of the electronic pen 5C relative to the pen sensor 13. Furthermore, the position indicated by the coordinate values ​​is not limited to a position within the detection surface of the pen sensor 13, but may also include a position on a virtual plane that includes the area outside the detection surface of the pen sensor 13.

[0234] The connection status information 302 indicates whether or not the electronic device 1 is connected to the electronic pen 5C via its connecting component.

[0235] The transmitting unit 310 transmits various control commands to the electronic device 1 to the pen sensor 13 of the electronic device 1 via the communication module 561.

[0236] Specifically, the transmitting unit 310 transmits a predetermined control command to the pen sensor 13 in response to the user's operation input to the rotation input device 551 or 552. If the rotating member 5511 is a trackball, the transmitting unit 310 transmits a control command to the pen sensor 13 according to the rotation direction of the trackball. If the rotating member 5521 is a wheel member or a jog dial (registered trademark), the transmitting unit 310 transmits a control command to the pen sensor 13 according to the rotation direction of the rotating member 5521.

[0237] Furthermore, the transmitting unit 310 transmits the calculation result of the position calculation unit 330, which will be described later, to the electronic device 1 via a wireless communication device different from the communication module 561. Specifically, when the calculation result of the position calculation unit 330 indicates that the distance between the pen sensor 13 and the pen tip 501 is greater than or equal to a predetermined distance, the transmission unit 310 transmits the calculation result to the electronic device 1 via the wireless communicator. Further, when the calculation result of the position calculation unit 330 indicates that the distance between the pen sensor 13 and the pen tip 501 is less than the predetermined distance, the transmission unit 310 transmits a signal indicating a position instruction to the pen sensor 13 via the communication module 561. Note that information on the predetermined distance serving as a reference for the distance between the pen sensor 13 and the pen tip 501 is stored in, for example, the storage unit 200B.

[0238] In addition, the transmission unit 310 transmits a control command to the electronic device 1 via a wireless communicator different from the communication module 561 according to the connection state of the housing 500C of the electronic pen 5 to the electronic device 1. Specifically, the transmission unit 310 determines whether the housing 500 is connected to the electronic device 1 via a connection member by referring to the connection state information 302. When the connection state information 302 indicates that the housing 500C is connected to the electronic device 1, the transmission unit 310 transmits a control command different from the case where the housing 500C is removed from the electronic device 1 to the electronic device 1 by the wireless communicator.

[0239] As described above, the wireless communicator is, for example, a unit that performs wireless communication such as Bluetooth (registered trademark) or infrared communication, and is provided inside the housing 500C.

[0240] The position detection unit 320 detects a change in the position of the pen tip 501 of the electronic pen 5C by a sensor 54 (for example, an inertial measurement unit) provided inside the housing 500C in order to detect the position and orientation of the electronic pen 5C.

[0241] The position calculation unit 330 calculates the position of the pen tip 501 with respect to the pen sensor 13 from the change in the position of the pen tip 501 detected by the position detection unit 320.

[0242] The connection detection unit 340 detects the connection status of the housing 500C to the electronic device 1. Specifically, the connection detection unit 340 receives detection results from the sensor 54 that detects the connection status to the electronic device 1 of the housing 500C via the connecting member. The connection detection unit 340 detects the connection status by referring to the received detection results.

[0243] The light emission control unit 350 receives a control command for the light-emitting member 542 via the pen sensor 13 of the electronic device 1. The light emission control unit 350 causes the multiple light-emitting elements contained in the light-emitting member 542 of the electronic pen 5C to emit light in the color indicated by the control command. Specifically, the light emission control unit 350 performs on / off control of the emission and pulse width modulation control so that the brightness is specified when the light is emitted for each of the multiple light-emitting elements of the light-emitting member 542 that emit light in different colors. As a result, the light emission control unit 350 causes the light-emitting member 542 to emit light in the color indicated by the control command.

[0244] The control command may include, for example, a command to cause the display panel 12 corresponding to the location indicated by the electronic pen 5C to the electronic device 1 to emit light in the same color as the color currently displayed. The control command may also include a command to cause the electronic device 1 to emit light in the same color as the color selected by the user for drawing, when the electronic device 1 is displaying drawing content for drawing.

[0245] <Flowchart of operations performed by the electronic pen 5C according to the third embodiment> The functional configuration of the pen controller 56B has been described above. Next, the specific processing flow of the pen controller 56B will be described in detail. Figure 16 is a flowchart showing an example of a series of processing steps by the pen controller 56B according to the third embodiment. Figure 16 describes the transmission process to the electronic device 1 according to the distance between the electronic pen 5C and the pen sensor 13. Note that the content and order of the following steps can be changed as appropriate.

[0246] (Step SP800) The pen controller 56B uses the position detection unit 320 to detect changes in the position of the pen tip 501 of the electronic pen 5C from the sensor 54, which is an inertial measurement unit. Then, the process moves on to step SP802.

[0247] (Step SP802) The pen controller 56B calculates the position of the pen tip 501 of the electronic pen 5C relative to the pen sensor 13 using the position calculation unit 330. Specifically, the position calculation unit 330 first calculates a vector value including the distance and direction of movement of the pen tip 501 from the detection result of the position detection unit 320. Next, the position calculation unit 330 adds the calculated travel distance and direction of travel to the coordinate value indicated by the position information 301 stored in the storage unit 200B, including the vector value. Next, the position calculation unit 330 updates the position information 301 stored in the storage unit 200B, using the sum of the vector values ​​as data indicating the current position of the pen tip 501. Then, the process moves on to step SP804.

[0248] (Step SP804) The pen controller 56B determines, via the transmission unit 310, whether the distance between the pen tip 501 and the pen sensor 13 is greater than or equal to a predetermined distance. Specifically, the transmission unit 310 determines whether the distance between the pen tip 501 and the pen sensor 13 is greater than or equal to a predetermined distance by referring to the position information 301 stored in the storage unit 200B. If the determination is positive, the process proceeds to step SP806. Conversely, if the determination is negative, the process proceeds to step SP808.

[0249] (Step SP806) The transmitting unit 310 of the pen controller 56B transmits the calculated position of the pen tip 501 of the electronic pen 5C to the electronic device 1 using a wireless communication device different from that of the communication module 561. Specifically, the transmitting unit 310 transmits position information 301 to the electronic device 1 using a wireless communication device different from that of the communication module 561. Then, the sequence of processes shown in Figure 16 is completed.

[0250] (Step SP808) The transmission unit 310 of the pen controller 56B transmits a signal to the electronic device 1 via the communication module 561 indicating the position of the pen tip 501 of the electronic pen 5C relative to the pen sensor 13. Then, the sequence of processes shown in Figure 16 is completed.

[0251] <Effects and benefits of the electronic pen 5C according to the third embodiment> In the third embodiment described above, the electronic pen 5C comprises a pen tip 501, a housing 500C connected to the pen tip 501 and held by the user, a rotation input device 551 (or 552), a communication module 561, and a transmission unit 310. The rotation input device 551 (or 552) is provided on the pen tip 501 side of the housing 500C and receives user operation input via a rotatable rotating member 5511 (or 5521). The communication module 561 is provided on the housing 500C and communicates with the pen sensor 13. The transmission unit 310 transmits predetermined control commands to the pen sensor 13 via the communication module 561 in response to user operation input received by the rotation input device 551 (or 552).

[0252] With this configuration, the electronic pen 5C can perform various controls with a simple operation: the user holds the electronic pen 5C and rotates the rotation input device 551 with their fingers. Therefore, the electronic device 1 can improve the user experience and user convenience.

[0253] In the third embodiment, the rotary input device 551 is a trackball. The transmitter 310 transmits a control command corresponding to the rotation direction of the trackball to the pen sensor 13.

[0254] According to this configuration, the electronic pen 5C can realize various controls by a simple operation on the trackball with the fingers while the user holds the electronic pen 5C. Therefore, the electronic device 1 can further improve the user experience.

[0255] In the third embodiment, the rotary input device 552 includes a wheel member that rotates along the rotation axis 5522 in response to a user's operation input, and a rotation detection member 5523 that detects the rotation of the rotation axis 5522. The transmitter 310 transmits a control command corresponding to the rotation direction of the wheel member to the pen sensor 13.

[0256] According to this configuration, the electronic pen 5C can realize various controls by a simple operation on the wheel member with the fingers while the user holds the electronic pen 5C. Therefore, the electronic device 1 can further improve the user experience.

[0257] In the third embodiment, the electronic pen 5C further includes a position detection unit 320 and a position calculation unit 330. The position detection unit 320 detects a change in the position of the pen tip 501 by a sensor 54 provided in the housing 500C. The position calculation unit 330 calculates the position of the pen tip 501 with respect to the pen sensor 13 from the change in the position of the pen tip 501 detected by the position detection unit 320. When the distance between the pen sensor 13 and the pen tip 501 is separated by a predetermined distance or more, the transmitter 310 transmits the calculation result of the position calculation unit 330 to the electronic device 1 having the pen sensor 13 by a wireless communication device different from the communication module 561.

[0258] With this configuration, the electronic pen 5C transmits its position to the electronic device 1 even when the distance between the electronic pen 5C and the pen sensor 13 becomes too great, making communication via the pen sensor 13 impossible or unstable. This allows the electronic pen 5C to provide positional instructions to the pen sensor 13 at distances where communication via the pen sensor 13 becomes unstable. Therefore, the electronic pen 5C can improve the distance at which it can indicate its position relative to the pen sensor 13.

[0259] In the third embodiment, the sensor provided inside the housing 500C is an inertial measurement unit having a 3-axis accelerometer and a 3-axis gyroscope.

[0260] Therefore, by using the inertial measurement unit, the accuracy of calculating the position of the electronic pen 5C is improved, thereby increasing the distance at which the position can be indicated to the pen sensor 13 and further improving the accuracy of the position indication.

[0261] In the third embodiment, the electronic pen 5C further comprises a plurality of light-emitting elements provided within the pen tip 501, each emitting light in a different color, and a light-emitting control unit 350 that causes the light-emitting elements to emit light in a color indicated by a control command transmitted from the pen sensor 13.

[0262] In this configuration, the electronic pen 5C illuminates the pen tip 501 in various colors in response to control commands from the electronic device 1. Therefore, the electronic device 1 can further enhance the user experience.

[0263] ---Fourth Embodiment--- Next, the fourth embodiment will be described.

[0264] <Example of sensor arrangement for the electronic pen 5 according to the fourth embodiment> Figure 17 shows an example of the arrangement of sensors 54 in the electronic pen 5 according to the fourth embodiment. As shown in Figure 17, the electronic pen 5 according to the fourth embodiment has a plurality of sensors 54 provided on the housing 500. In addition, the electronic pen 5 has sensors 541 provided on the pen tip 501 and the tail cap 502.

[0265] Sensor 54 is, for example, a pressure sensor. If it is a pressure sensor, sensor 54 detects the pressure applied to the housing 500 by the fingers gripping the housing 500 when the user grips the housing 500. Sensor 54 may also be a capacitive sensor. If it is a capacitive sensor, sensor 54 detects the degree of contact between the fingers gripping the housing 500 and the sensor 54. Sensor 54 may also be a temperature sensor. If it is a temperature sensor, sensor 54 detects the temperature in the vicinity of the temperature sensor.

[0266] The sensor 541 provided on the pen tip 501 is, for example, a pressure sensor. When the sensor 541 is a pressure sensor, it detects the pressure applied to the pen tip 501 when the pen tip 501 is in contact with the pen sensor 13. Furthermore, the sensor 541 provided on the pen tip 501 may be, for example, a temperature sensor. The sensor 541 provided on the end cap 502 may be, for example, an optical sensor such as a camera.

[0267] In this example, three sensors 54 are provided, but this is not limited to this. Two or four or more sensors 54 may be provided. Furthermore, the multiple sensors 54 may be a combination of several types from among pressure sensors, capacitive sensors, and temperature sensors.

[0268] <Functional configuration of the electronic pen 5 according to the fourth embodiment> Figure 18 shows an example of the functional configuration of the pen controller 56C of the electronic pen 5 according to the fourth embodiment. As shown in Figure 18, the pen controller 56C includes a storage unit 200C, a generation unit 410, and a transmission unit 420. Furthermore, functions other than those of the memory unit 200C are realized by the control module 562 executing a program stored in the memory device 564 of the pen controller 56C, etc.

[0269] The memory unit 200C has a functional configuration for storing various data used in various processes performed by the pen controller 56C. Specifically, the memory unit 200C stores user status information 401 and adjustment values ​​402.

[0270] User state information 401 is information indicating the user's state. User state information 401 includes, for example, a concentration level indicating the degree of concentration the user has on the drawing task performed by the user using the electronic pen 5 via the pen sensor 13. Furthermore, user status information 401 includes, for example, the user's grip on the housing 500. The user's gripping state refers to the position of the user's fingers and how they are holding the housing 500.

[0271] The adjustment value 402 is a value used to adjust the drawing parameters of a virtual drawing tool used by the user to perform drawing via the pen sensor 13 using the electronic pen 5. The adjustment value 402 includes the upper and lower limits of the range of values ​​that each drawing parameter can take. Drawing parameters include, for example, the intensity of the color during drawing, the viscosity of the virtual ink, the degree of smudging during drawing, and the magnitude of the vibration of the tactile feedback from the vibrating member 52 during drawing. The degree of blurring refers to the degree of blurring of lines when drawing using a virtual drawing tool. In other words, the degree of blurring is the degree of friction the user feels when drawing. The smaller the degree of blurring, the less friction the user feels when drawing.

[0272] The generation unit 410 generates user status information 401 based on a combination of detection results from multiple sensors 54. Specifically, the generation unit 410 generates user status information 401 from a combination of detection results from, for example, a pressure sensor, a capacitive sensor, a temperature sensor, etc. The generation unit 410 stores the generated user status information 401 in the storage unit 200C.

[0273] Here are some examples of generating user state information 401, including concentration level, from various sensor combinations. The generation unit 410, for example, performs normalization processing on each sensor so that the values ​​indicating the detection results of each sensor fall within a range of, for example, 0 to 1. Note that the normalization range of 0 to 1 is merely an example, and any value can be used. Next, the generation unit 410 inputs the normalized detection values ​​of each sensor into a predetermined function for calculating the concentration score. The generation unit 410 uses the output result of the predetermined function as the concentration score. The predetermined function calculates the concentration score such that the higher the pressure value detected by the pressure sensor, the higher the temperature value detected by the temperature sensor, and the higher the detection level value detected by the capacitive sensor, the higher the concentration score. Specifically, the predetermined function calculates the concentration score by, for example, multiplying each of the input values.

[0274] Furthermore, if the user state information 401 includes concentration levels, the generation unit 410 calculates adjustment values ​​402 for drawing parameters from the concentration levels. The generation unit 410 stores the generated adjustment values ​​402 in the storage unit 200C.

[0275] Next, we will describe an example of generating user state information 401, which includes the user's gripping state. In this example, it is assumed that the housing 500 is provided with at least three pressure sensors as sensors 54. The generation unit 410 stores the detected values ​​of the three sensors 54 directly in the storage unit 200C as user state information 401 indicating the user's gripping state.

[0276] Furthermore, the generation unit 410 determines whether the detection values ​​of the three sensors 54 indicated by the user status information 401 fall within the predetermined reference range of the detection values ​​of the three sensors 54.

[0277] The generation unit 410 determines that the user's grip on the electronic pen 5 housing 500 is ideal if all three sensor 54 detection values ​​fall within the reference range. Conversely, the generation unit 410 determines that the user's grip on the electronic pen 5 housing 500 is not ideal if any of the three sensor 54 detection values ​​deviate from the reference range.

[0278] The generation unit 410 controls the operation of the vibrating member 52 to perform vibration if it determines that the way the user is gripping the housing 500 of the electronic pen 5 is not ideal. In other words, in this example, the vibrating member 52 vibrates when the user state information 401 satisfies predetermined conditions.

[0279] The transmitting unit 420 transmits user status information 401 to the electronic device 1 via the pen sensor 13. Furthermore, if the user status information 401 includes a concentration level, the transmitting unit 420 transmits an adjustment value 402 to the electronic device 1 via the pen sensor 13.

[0280] The functional configuration of the pen controller 56C has been described above. Next, the specific processing flow in the pen controller 56C will be explained in detail. Figure 19 is a flowchart illustrating an example of a series of processing steps performed by the pen controller 56C according to the fourth embodiment. Figure 19 describes the process by which the pen controller 56C adjusts drawing parameters according to the user's level of concentration. Note that the content and order of the following steps can be changed as appropriate.

[0281] (Step SP300) The pen controller 56C acquires detection results from multiple sensors 54 using the generation unit 410. Then, the process proceeds to step SP302.

[0282] (Step SP302) The pen controller 56C calculates the user's level of concentration on the drawing task using the generation unit 410. The specific process for calculating the level of concentration is as described above, so its explanation is omitted here. The generation unit 410 of the pen controller 56 stores the calculated level of concentration as user state information 401 in the storage unit 200C. Then, the process moves on to step SP304.

[0283] (Step SP304) The pen controller 56C, using the generation unit 410, determines whether the concentration level of the user status information 401 is above a predetermined standard value. If the determination is positive, the process proceeds to step SP306. Conversely, if the determination is negative, the process proceeds to step SP308.

[0284] (Step SP306) The pen controller 56C expands the range of the adjustment values ​​402 for the drawing parameters using the generation unit 410. Specifically, the generation unit 410 of the pen controller 56C lowers the lower limit of the range that each drawing parameter included in the adjustment value 402 can take. In addition, the generation unit 410 of the pen controller 56C raises the upper limit of the range that each drawing parameter included in the adjustment value 402 can take. The generation unit 410 of the pen controller 56C updates the adjustment values ​​402 stored in the storage unit 200C with the expanded range. Then, the process moves on to step SP310.

[0285] (Step SP308) The pen controller 56C reduces the range of the adjustment values ​​402 for the drawing parameters using the generation unit 410. Specifically, the generation unit 410 of the pen controller 56C raises the lower limit of the range that each drawing parameter included in the adjustment value 402 can take. Also, the generation unit 410 of the pen controller 56C lowers the upper limit of the range that each drawing parameter included in the adjustment value 402 can take. The generation unit 410 of the pen controller 56C updates the adjustment values ​​402 stored in the storage unit 200C with the reduced range. Then, the process moves on to step SP310.

[0286] (Step SP310) The pen controller 56C transmits the adjustment values ​​402 for the drawing parameters to the electronic device 1 via the pen sensor 13 using the transmission unit 420. Then, the sequence of processes shown in Figure 19 is completed.

[0287] <Effects and benefits of the electronic pen 5 according to the fourth embodiment> As described above, the electronic pen 5 according to the fourth embodiment comprises a housing 500 that is held by the user, a plurality of sensors 54 provided on the housing 500, a communication module 561, and a pen controller 56C. The communication module 561 is provided on the housing 500 and communicates with the pen sensor 13. The pen controller 56C has a generation unit 410 that generates user state information 401 indicating the user's state based on a combination of detection results of the plurality of sensors 54, and a transmission unit 420 that transmits the user state information 401 generated by the generation unit 410 to the electronic device 1 via the pen sensor 13.

[0288] With this configuration, the electronic pen 5 generates information indicating the user's status without requiring any additional special equipment. Therefore, the electronic pen 5 can improve user convenience.

[0289] Furthermore, in the electronic pen 5 according to the fourth embodiment, the sensor 54 is a pressure sensor. The user status information 401 indicates the state of the user's grip on the housing 500. The electronic pen 5 also further includes a vibrating member 52 provided on the housing 500, which vibrates when the user status information 401 satisfies predetermined conditions.

[0290] With this configuration, the electronic pen 5 generates information indicating the user's grip on the housing 500 without requiring any additional special equipment. Therefore, the electronic device 1 can further improve user convenience.

[0291] Furthermore, in the electronic pen 5 according to the fourth embodiment, the user state information 401 is a concentration level indicating the degree of the user's concentration on the drawing task performed via the pen sensor 13. The generation unit 410 calculates adjustment values ​​402 for the drawing parameters of a virtual drawing tool used for drawing by the user from the concentration level. The transmission unit 420 transmits the adjustment values ​​402 calculated by the generation unit 410 to the electronic device 1 via the pen sensor 13.

[0292] With this configuration, the electronic pen 5 calculates adjustment values ​​402 for drawing parameters that are appropriate to the user's level of concentration. Therefore, the electronic pen 5 can further improve user convenience.

[0293] In the fourth embodiment, the adjustment value 402 includes an upper and lower limit to the range of values ​​that the drawing parameter can take. The generation unit 410 also determines whether the user's level of concentration is above a certain threshold and changes the upper and lower limits according to the result of that determination.

[0294] With this configuration, the electronic pen 5 will make its drawing performance peaky when the user is focused, and milder when the user is tired and not focused. Conversely, when the user is focused, the electronic pen 5 will milden the performance of drawing parameters such as pen pressure, and when the user is tired and not focused, it will make its drawing performance peaky to equalize the user's drawing ability as fatigue affects it. In other words, the electronic pen 5 can further improve user convenience by calculating the optimal drawing parameter adjustment value 402 according to the user's level of concentration.

[0295] <Functional configuration of the electronic device 1 according to the fourth embodiment> Figure 20 shows an example of the functional configuration of the host processor 15C of the electronic device 1 according to the fourth embodiment. As shown in Figure 20, the host processor 15C includes a storage unit 600C, a state detection unit 810, a vibration control unit 820, and a display control unit 830. Furthermore, functions other than those of the memory unit 600C are realized by the CPU executing programs stored in the memory device of the host processor 15C.

[0296] The storage unit 600C has a functional configuration for storing various data used in various processes executed by the host processor 15C. Specifically, the storage unit 600C stores display content 801, condition data 802, and presentation information 803.

[0297] Display content 801 is content that is displayed in the display area of ​​the display panel 12 when a user is browsing or working on the electronic device 1. Specifically, display content 801 may be, for example, study workbooks, reference books, test sets, quiz collections, or quiz games. Display content 801 includes multiple objects 8011.

[0298] Object 8011 is an object used to indicate questions, riddles, etc., provided in the display content 801. If the display content 801 is a collection of learning problems, then object 8011 is an object that displays each problem.

[0299] Condition data 802 is data indicating predetermined conditions regarding the change in the position of the electronic pen 5 in the state detection unit 810, which will be described later. Condition data 802 is, for example, a condition that the amount of movement of the electronic pen 5 on the pen sensor 13 is less than or equal to a reference distance within a reference time. The reference time and reference distance are predetermined values.

[0300] The display information 803 is information that is displayed on the display content 801 when the position of the electronic pen 5 changes and predetermined conditions are met. The display information 803 is predetermined content for each object 8011. The display information 803 includes, for example, text data indicating a predetermined message. Note that the display information 803 may also be an illustration or a video.

[0301] The state detection unit 810 detects which object 8011 in the display content 801 corresponds to the position of the electronic pen 5 on the pen sensor 13. The state detection unit 810 also determines whether the change in the position of the electronic pen 5 detected by the pen sensor 13 satisfies predetermined conditions. As described above, the predetermined conditions are those indicated by the condition data 802.

[0302] The vibration control unit 820 controls the vibration operation of the vibrating member 52 provided on the electronic pen 5. Furthermore, if the vibrating member HD (see Figure 23) is positioned to overlap the display area of ​​the display panel 12, the vibration control unit 820 controls the vibration operation of the vibrating member HD.

[0303] The display control unit 830 controls the display operation of the display panel 12. Specifically, the display control unit 830 displays the display content 801 on the display panel 12. The display control unit 830 also displays the presentation information 803 associated with the object 8011 detected by the state detection unit 810 on the display panel 12.

[0304] Figure 21 is a flowchart showing an example of a series of processing steps performed by the host processor 15C according to the fourth embodiment. Note that the content and order of the following steps can be changed as appropriate.

[0305] (Step SP400) The host processor 15C displays the display content 801 in the display area of ​​the display panel 12 via the display control unit 830. Then, the process proceeds to step SP402.

[0306] (Step SP402) The host processor 15C, using the state detection unit 810, starts detecting the position of the electronic pen 5 on the pen sensor 13.

[0307] Here, the display content 801 during the processing of steps SP400 and SP402 will be explained with reference to Figure 22A. Figure 22A is a diagram showing an example of the display content 801 displayed on the electronic device 1 according to the fourth embodiment. In Figure 22A, the display panel 12 displays display content 801 indicating a study workbook. Also in Figure 22A, the display content 801 displays three objects 8011 that indicate the "questions" contained in the workbook.

[0308] The three objects 8011 are objects that represent the text objects for "Question 1" to "Question 3," respectively. In Figure 22A, the electronic pen 5 is pointing to the position where the object representing "Question 2" is displayed.

[0309] Returning to Figure 21, the process moves on to step SP404.

[0310] (Step SP404) The host processor 15C uses a state detection unit 810 to determine whether the amount of movement of the electronic pen 5 on the pen sensor 13 is small or not. Specifically, the state detection unit 810 of the host processor 15C determines whether the amount of movement of the electronic pen 5 on the pen sensor 13 is less than or equal to a reference distance within a reference time. If the determination is positive, the process proceeds to step SP406. Conversely, if the determination is negative, the series of processes shown in Figure 21 ends.

[0311] (Step SP406) The host processor 15C, via the display control unit 830, displays presentation information 803 on the display content 801 that is pre-associated with the object 8011 displayed at the position indicated by the electronic pen 5.

[0312] Here, the display content 801 during processing in step SP406 will be explained with reference to Figure 22B. Figure 22B shows the state in which the presentation information 803 is displayed on the display content 801 shown in Figure 22A. As shown in Figure 22B, the display content 801 shows the presentation information 803 overlapping the object 8011, which indicates "Question 2" and is being positioned by the electronic pen 5. In Figure 22B, the presentation information 803 displayed in the display content 801 is an object associated with the object 8011, which indicates "Question 2". The presentation information 803 contains a text message that provides hints about "Question 2".

[0313] Returning to Figure 21, we will continue the explanation of the process in step SP406. The host processor 15C vibrates the vibrating member 52 via the vibration control unit 820. Specifically, the vibration control unit 820 transmits a control signal from the pen sensor 13 to the electronic pen 5 that vibrates the vibrating member 52 of the electronic pen 5 at a predetermined period. Then, the series of processes shown in Figure 21 is completed.

[0314] Here, with reference to Figure 23, the hardware configuration of the electronic device 1 when the vibrating member HD is provided so as to overlap the display area of ​​the display panel 12 of the electronic device 1 will be described. Figure 23 is a diagram showing the hardware configuration of the electronic device 1 when the vibrating member HD is provided so as to overlap the display area.

[0315] As shown in Figure 23, the electronic device 1 is provided with multiple vibrating members HD so as to overlap the display area of ​​the display panel 12. Specifically, the vibrating members HD are provided on the bottom side of the display panel 12 and the pen sensor 13, so as to overlap with the display panel 12 and the pen sensor 13. Also, in Figure 23, the vibrating members HD are provided near the edge of the display panel 12.

[0316] The two vibrating members HD provided on the display panel 12 in this manner cause the entire display panel 12 to function as an audio output device such as a speaker. Specifically, the two vibrating members HD vibrate according to control signals that include information such as sound and voice transmitted from the vibration control unit 820, thereby causing the display panel 12 to function as a speaker.

[0317] Furthermore, the vibration control unit 820 vibrates the two vibrating members HD at predetermined frequencies, thereby causing a specific location on the display panel 12 to vibrate precisely. Specifically, the vibration control unit 820 controls the operation of the two vibrating members HD so that the vibration waves generated from the two vibrating members HD overlap and are amplified at the set location on the display panel 12. Here, the set position is, for example, the position where the electronic pen 5 is pointed on the display panel 12 when the state detection unit 810 determines that a predetermined condition has been met.

[0318] <Effects and Effects of the Electronic Device 1 According to the Fourth Embodiment> As described above, the electronic device 1 according to the fourth embodiment comprises a display panel 12 for displaying an object, a pen sensor 13, a state detection unit 810, and a vibration control unit 820. The pen sensor 13 is provided so as to overlap the display area of ​​the display panel 12 and detects position indication by the electronic pen 5. The state detection unit 810 determines whether the change in the position of the electronic pen 5 detected by the pen sensor 13 satisfies predetermined conditions. When the state detection unit 810 determines that the change in the position of the electronic pen 5 satisfies predetermined conditions, the vibration control unit 820 vibrates a vibration member 52 or HD which is provided so as to overlap the display area or which is provided on the electronic pen 5.

[0319] In this configuration, the electronic device 1 vibrates the vibrating member 52 or HD in response to the user's behavior towards the electronic pen 5 as they hold it. This allows the electronic device 1 to provide feedback to the user through vibration in response to specific user behavior towards the electronic pen 5. Therefore, the electronic device 1 can improve the user experience.

[0320] Furthermore, in the electronic device 1 according to the fourth embodiment, the predetermined condition is that the amount of movement of the electronic pen 5 on the pen sensor 13 is less than or equal to a reference distance within a reference time.

[0321] In this configuration, the electronic device 1 provides feedback to the user through vibration of the vibrating member 52 when the user's fingers holding the electronic pen 5 remain still for a certain period of time. Therefore, the electronic device 1 can inform the user that their movements have stopped, thereby improving user convenience.

[0322] Furthermore, the electronic device 1 according to the fourth embodiment further includes a storage unit 600C that stores display content 801 having a plurality of objects 8011, and a display control unit 830 that displays the display content 801 on a display panel 12. The state detection unit 810 detects which object 8011 in the display content 801 corresponds to the position of the electronic pen 5 on the pen sensor 13. The display control unit 830 displays presentation information 803 associated with the object 8011 detected by the state detection unit 810 on the display panel 12.

[0323] In this configuration, the electronic device 1 displays suggested information 803 (e.g., a hint for the problem) according to the object 8011 when the indicated position of the electronic pen 5 held by the user satisfies a predetermined condition (e.g., stopping movement) on the display content 801 (e.g., a problem set). Therefore, the electronic device 1 can improve the user experience.

[0324] Furthermore, in the electronic device 1 according to the fourth embodiment, the vibrating member 52 is provided on the electronic pen 5. When the position of the electronic pen 5 changes and a predetermined condition is met, the vibration control unit 820 transmits a control signal from the pen sensor 13 to the electronic pen 5 that causes the vibrating member 52 to vibrate at a predetermined period.

[0325] With this configuration, the electronic device 1 vibrates the vibrating member 52 at a predetermined period, thereby preventing the user from failing to sense or recognize the vibration of the electronic pen 5.

[0326] Furthermore, in the electronic device 1 according to the fourth embodiment, multiple vibrating members HD are provided so as to overlap the display area. The vibration control unit 820 controls the operation of the vibrating members HD so as to vibrate the position of the electronic pen 5 detected by the pen sensor 13 on the display panel 12 when a change in the position of the electronic pen 5 satisfies predetermined conditions.

[0327] In this configuration, the electronic device 1 vibrates a predetermined position on the display panel in response to changes in the position of the electronic pen 5 held by the user. As a result, the electronic device 1 provides feedback to the user by vibrating the touched position when the user touches the display panel 12 with the electronic pen 5. In addition, the electronic device 1 may output sound effects or voice effects from the touched position when the user touches the display panel 12 with the electronic pen 5. Therefore, the electronic device 1 can improve the appeal of the display content 801 displayed on the electronic device 1 and enhance the user experience.

[0328] ---Fifth Embodiment--- Next, the fifth embodiment will be described.

[0329] <Hardware configuration of the electronic pen 5D according to the fifth embodiment> Figure 24 is a cross-sectional view showing an example of the hardware configuration of the electronic pen 5D according to the fifth embodiment. This cross-sectional view is shown with the central axis of the electronic pen 5D as the cross-sectional line. As shown in Figure 24 according to the first embodiment, the electronic pen 5D comprises a housing 500D, a pen tip 501D, and a tail plug 502 (not shown). The tail plug 502 (not shown) is the same as in the first embodiment, so its description is omitted.

[0330] The housing 500D is the part of the electronic pen 5D that the user holds. The housing 500D includes an outer casing 5000, a first conductor 570, a second conductor 580, a third conductor GND2, and a pen controller 56.

[0331] The outer casing 5000 is the part that forms the outer casing of the housing 500D. The outer casing 5000 is formed in a cylindrical shape. The inner circumference of the end of the outer casing 5000 on the pen tip 501D side is formed so that the end of the housing 500D of the pen tip 501D can be attached to and detached from it. The inner circumference of the end of the outer casing 5000 on the pen tip 501D side is formed, for example, in the shape of a female screw. Inside the outer casing 5000, a first conductor 570, a second conductor 580, a third conductor GND2, and a pen controller 56 are provided.

[0332] The first conductor 570 is formed as a core that constitutes the central axis inside the outer casing 5000. The first conductor 570 is electrically connected to the first electrode 571 by contacting it when the pen tip 501D is connected to the housing 500D. The first conductor 570 is also electrically connected to the pen controller 56 via a signal line. Thus, the first conductor 570 is responsible for transmitting signals between the first electrode 571 and the pen controller 56. The first conductor 570 has a protrusion at the end facing the pen tip 501D. The protrusion of the first conductor 570 is formed to fit into the protrusion when the pen tip 501D and the housing 500D are connected.

[0333] The second conductor 580 is formed in a cylindrical shape so as to cover the outer circumference of the third conductor GND2. The second conductor 580 is electrically connected to the second electrode 581 by contacting it when the pen tip 501D is connected to the housing 500D. The second conductor 580 is also electrically connected to the pen controller 56 via a signal line. Thus, the second conductor 580 is responsible for transmitting signals between the second electrode 581 and the pen controller 56.

[0334] The third conductor GND2 is provided between the first conductor 570 and the second electrode 581 so as to cover the outer circumference of the first conductor 570 and the inner circumference of the second conductor 580. The third conductor GND2 is also formed in a cylindrical shape. The third conductor GND2 is electrically connected to the ground electrode GND1 by contacting it when the pen tip 501D is connected to the housing 500D. The third conductor GND2 is also electrically connected to the pen controller 56 via a signal line. Thus, the third conductor GND2 plays the role of making the potential of the ground electrode GND1 the same as the potential of the third conductor GND2.

[0335] The pen tip 501D is the part of the electronic pen 5D that provides positional indication to the pen sensor 13. The pen tip 501D has an outer casing 5011, a first electrode 571, a second electrode 581, and a ground electrode GND1.

[0336] The outer casing 5011 is the part that forms the outer casing of the pen tip 501D. The outer casing 5011 has a funnel-shaped portion that becomes smaller in diameter towards the tip of the electronic pen 5D, and a cylindrical portion for connecting to the outer casing 5000 of the housing 500D. The funnel-shaped portion and the cylindrical portion are formed integrally. Inside the funnel-shaped portion of the outer casing 5011, a first electrode 571, a second electrode 581, and a ground electrode GND1 are provided. The outer circumference of the end of the cylindrical portion of the outer casing 5011 on the housing 500D side is formed so that the end of the housing 500D can be detached from it. The outer circumference of the end of the outer casing 5011 on the housing 500D side is formed in a male screw shape that fits, for example, the female screw shape formed on the outer casing 5000 of the housing 500D.

[0337] The first electrode 571 is an electrode formed as a core that constitutes the central axis of the pen tip 501. The first electrode 571 is electrically connected to the first conductor 570 by contacting it when the pen tip 501D is connected to the housing 500D.

[0338] The second electrode 581 is a ring electrode formed in a cylindrical shape so as to cover the outer circumference of the first electrode 571. The second electrode 581 is electrically connected to the second conductor 580 by contacting it when the pen tip 501D is connected to the housing 500D.

[0339] The ground electrode GND1 is formed in a cylindrical shape and is provided between the first electrode 571 and the second electrode 581 so as to cover the outer circumference of the first electrode 571 and the inner circumference of the second electrode 581. The ground electrode GND1 is electrically connected to the third conductor GND2 by contacting it when the pen tip 501D is connected to the housing 500D.

[0340] <Effects and benefits of the electronic pen 5D according to the fifth embodiment> As described above, the electronic pen 5D according to the fifth embodiment comprises a pen tip 501D and a housing 500D. The pen tip 501D has a first electrode 571 and a second electrode 581 that transmit and receive signals with the pen sensor 13. The housing 500D has an outer casing 5000, a first conductor 570, a second conductor 580, and a pen controller 56 provided on the outer casing 5000. The outer casing 5000 is formed in a cylindrical shape and the pen tip 501 is detachable from it. The first conductor 570 is electrically connected to the first electrode 571 when the pen tip 501D is connected to the outer casing 5000. The second conductor 580 is electrically connected to the second electrode 581 when the pen tip 501D is connected to the outer casing 5000. The pen controller 56 is electrically connected to the first conductor 570 and the second conductor 580 and controls the transmission and reception of signals.

[0341] In this configuration, the electronic pen 5D has an outer casing 5000 of the housing 500D that is detachable from the pen tip 501D. This allows the user to use the electronic pen 5D while changing the pen tip 501, which has various appearances, depending on the application or the user's mood. Furthermore, with this configuration, the electronic pen 5D can select a pen tip 501D whose arrangement and shape of the first electrode 571 and the second electrode 581 are suitable for the communication protocol for sending and receiving signals with the pen sensor 13, and replace it with the selected pen tip 501D. Therefore, the 5D electronic pen can improve user convenience and user experience.

[0342] Furthermore, in the electronic pen 5D according to the fifth embodiment, the first electrode 571 is formed as a core that constitutes the central axis of the pen tip 501D. The second electrode 581 is a ring electrode formed in a cylindrical shape so as to cover the outer circumference of the first electrode 571. The first conductor 570 is formed as a core that constitutes the central axis of the outer casing 5000. The second conductor 580 is formed in a cylindrical shape so as to cover the outer circumference of the first conductor 570.

[0343] According to this configuration, the electronic pen 5D can use any shape as the pen tip 501D, as long as the pen tip 501D has a structure in which a core body and a ring electrode are attached to and detached from the outer casing 5000. Therefore, the electronic pen 5D can further improve user convenience.

[0344] Furthermore, in the electronic pen 5D according to the fifth embodiment, the pen tip 501D is formed in a cylindrical shape and further includes a ground electrode GND1 provided between the first electrode 571 and the second electrode 581 so as to cover the outer circumference of the first electrode 571 and the inner circumference of the second electrode 581. The housing 500D further includes a ground electrode GND1 and a third conductor GND2 which is electrically connected to the pen controller 56.

[0345] With this configuration, the electronic pen 5D has a ground electrode GND1 between the first electrode 571 and the second electrode 581, which suppresses electrical influences between the first electrode 571 and the second electrode 581. Therefore, the electronic pen 5D can improve user convenience while improving the transmission and reception performance to and from the pen sensor 13 via the first electrode 571 and the second electrode 581.

[0346] ---Sixth Embodiment--- Next, the sixth embodiment will be described.

[0347] <Hardware configuration of the electronic pen 5E according to the sixth embodiment> Figure 25A is a conceptual diagram showing an example of the hardware configuration of the electronic pen 5E according to the sixth embodiment. This figure is a cross-sectional view taken with the central axis of the electronic pen 5E as the cross-sectional line. Figure 25B is a cross-sectional view of the electronic pen 5E shown in Figure 25A along the line IIXVB-IIXVB.

[0348] As shown in Figures 25A and 25B, the electronic pen 5E comprises a pen tip 501 (not shown), a tail plug 502 (not shown), a housing 500E, a cartridge 900, a circuit board 910, an illumination unit 920, and a light guide path 930. Note that the pen tip 501 and tail plug 502 are the same as in the first embodiment, so their description is omitted.

[0349] The housing 500E is the part of the electronic pen 5E that the user holds, and is formed in a cylindrical shape. The housing 500E has a window portion 940 that transmits light from inside the housing 500E to the outside of the housing 500E.

[0350] The cartridge 900 is formed in a cylindrical shape as the core body that constitutes the central axis inside the housing 500E. The cartridge 900 is installed inside the housing 500E so that the housing 500E can be attached and detached. A flat portion is provided on a part of the surface of the core body of the cartridge 900, and the circuit board 910 is provided on this flat portion.

[0351] The circuit board 910 is a board on which electrical circuits for performing various operations of the electronic pen 5E are provided. In addition to the power supply 51, pen controller 56, and communication module 561 described in the first embodiment, the circuit board 910 is also provided with an illumination unit 920.

[0352] The irradiating unit 920 is a component that emits light in response to an electrical signal transmitted from the circuit board 910. The irradiating unit 920 is mounted on a cartridge and emits light to the input terminal of the light guide path 930. The irradiating unit 920 is, for example, an LED or a semiconductor laser (LD: Laser Diode). The light emitted from the irradiating unit 920 is emitted to the inside of the light guide path 930 and to the outside of the housing 500E through the window portion 940.

[0353] The light guide path 930 is a component that transmits light emitted from the illumination unit 920 to the inside of the window unit 940. The light guide path 930 is installed inside the housing 500E so that the housing 500E can be removed and reinstalled. The input terminal of the light guide path 930 is connected to the illumination unit 920. The output terminal of the light guide path 930 is connected to the window unit 940. A specific example of the structure of the light guide path 930 will be explained later, so its explanation is omitted here.

[0354] <First example of the configuration of the light guide path 931 according to the sixth embodiment> Here, the specific structure of the optical guide 930 will be described based on an embodiment. Figure 26 is a diagram showing a first example of the configuration of the optical guide 931 according to the sixth embodiment. As shown in Figure 26, in the first example, the optical guide 931 is an optical waveguide formed as a flexible cable. Specifically, the optical guide 931 is, for example, an optical fiber cable.

[0355] The light guide path 931 receives the light emitted from the illumination unit 920 via an input terminal and transmits it to an output terminal, from which the light is emitted to the outside of the housing 500E via the window unit 940.

[0356] <Second example of the configuration of the light guide path 932 according to the sixth embodiment> Figure 27A is a diagram showing a second example of the specific configuration of the light guide 932 according to the sixth embodiment. Figure 27B is a cross-sectional view of the light guide 932 shown in Figure 27A along the line IIXVIIB-IIXVIIB. Figure 27C is a cross-sectional view of the light guide 932 shown in Figure 27A along the line IIXVIIC-IIXVIIC.

[0357] As shown in Figures 27A to 27C, in the second example, the light guide path 932 is formed in a plate shape with its longitudinal direction (Y-axis direction) aligned with the pen shaft of the electronic pen 5E. In addition, a slit 9321 is provided on the upper surface (Z-axis direction) side of the light guide path 932 so as to be aligned with its longitudinal direction (Y-axis direction).

[0358] Furthermore, the light guide path 932 has a core portion 9324, a cladding portion 9323, and a covering portion 9322.

[0359] The core portion 9324 and the cladding portion 9323 are formed from a light-transmitting transparent material. The core portion 9324 is located at the innermost part of the light guide path 932. The core portion 9324 is formed in a plate shape with a convex portion. The surface of the core portion 9324 is covered by the cladding portion 9323, except for the portion where the slit 9321 and the input end on the bottom side (opposite the Z-axis direction) are provided. Furthermore, at the slit 9321 and the input end on the bottom side (opposite to the Z-axis direction) of the light guide path 932, the core portion 9324 is exposed to the outside of the light guide path 932.

[0360] The cladding portion 9323 is made of a material with a higher refractive index than the core portion 9324.

[0361] The covering portion 9322 is formed of an opaque material that does not transmit light. The covering portion 9322 is provided so as to cover the cladding portion 9323.

[0362] <Third example of the configuration of the light guide path 933 according to the sixth embodiment> Figure 28A is a diagram showing a third example of the specific configuration of the light guide path 933 according to the sixth embodiment. Figure 28B is a cross-sectional view of the light guide path 933 shown in Figure 28A along the line IIXVIIIB-IIXVIIIB. Figure 28C is a cross-sectional view of the light guide path 933 shown in Figure 28A along the line IIXVIIIC-IIXVIIIC.

[0363] As shown in Figures 28A to 28C, the light guide path 933 is formed in a cylindrical shape. The light guide path 933 is also provided on the cartridge 900 so as to cover the outer circumference of the cartridge 900. In addition, a slit 9331 is provided on the outer circumference of the light guide path 933 so as to follow the circumferential direction.

[0364] The light guide path 933 has a core portion 9334, a cladding portion 9333, and a covering portion 9332. The materials forming the core portion 9334, the cladding portion 9333, and the covering portion 9332 are the same as those for the core portion 9324, the cladding portion 9323, and the covering portion 9322 in the second example, so their description is omitted.

[0365] The core portion 9334 is located at the innermost part of the light guide path 933. The core portion 9334 is formed in a cylindrical shape with a convex portion. The outer and inner circumferences of the core portion 9334 are covered by the cladding portion 9333, except for the slit 9331 on the outer circumference of the light guide path 933 and the portion where the input end of the inner circumference of the light guide path 933 is located. Furthermore, at the slit 9331 and the input terminal in the light guide path 933, the core portion 9334 is exposed to the outside of the light guide path 933.

[0366] The covering portion 9332 is provided so as to cover the cladding portion 9333.

[0367] Although not shown in the figures, the light guide path 931 shown in the first example also has a core portion, a cladding portion, and a covering portion extending outward from the center, similar to the second and third examples.

[0368] In the optical guide paths 931-933 configured as described above, light irradiated at the input terminal is guided to the slit by passing through the core while repeatedly reflecting off the surface of the cladding.

[0369] <Effects and benefits of the electronic pen 5E according to the sixth embodiment> The electronic pen 5E according to the sixth embodiment comprises a housing 500E, a cylindrical cartridge 900, an illumination unit 920, and a light guide path 930. The housing 500E has a window 940 that transmits light from the inside to the outside and is formed in a cylindrical shape. The cartridge 900 is detachable from the housing 500E, is provided inside the housing 500E, and has a circuit board 910. The illumination unit 920 is provided on the cartridge 900 and emits light in accordance with an electrical signal transmitted from the circuit board 910. The light guide path 930 transmits the light emitted from the illumination unit 920 to the inside of the window 940.

[0370] With this configuration, the electronic pen 5E can guide light to the window portion 940 via the light guide path 930, regardless of how the housing 500E or the window portion 940 are formed. Therefore, the electronic pen 5E can illuminate the housing 500E while accommodating various shapes.

[0371] Furthermore, in the electronic pen 5E according to the sixth embodiment, the light guide path 932 has a core portion 9324, a cladding portion 9323, and a covering portion 9322. The cladding portion 9323 is made of a material with a higher refractive index than the core portion 9324 and is provided to cover the core portion 9324. The covering portion 9322 is made of an opaque material and is provided to cover the cladding portion 9323.

[0372] Therefore, the electronic pen 5E can emit light while suppressing light loss in the light guide path 930 and accommodating various shapes of housings 500E.

[0373] Furthermore, in the electronic pen 5E according to the sixth embodiment, the optical guide path 931 is an optical waveguide formed as a flexible cable.

[0374] With this configuration, the electronic pen 5E guides light to the window section 940 using a flexible optical waveguide, allowing it to illuminate various shapes of housings 500E.

[0375] Furthermore, in the electronic pen 5E according to the sixth embodiment, the light guide path 932 is formed in a plate shape with its longitudinal direction aligned with the pen shaft, and a slit 9321 is provided on the outer surface of the housing 500E side so as to be aligned with the pen shaft.

[0376] Therefore, regardless of the position of the window portion 940 in the longitudinal direction of the housing 500E, the light from the illumination portion 920 can be guided to the window portion 940 by the light guide path 930.

[0377] Furthermore, in the electronic pen 5E according to the sixth embodiment, the light guide path 933 is formed in a cylindrical shape and is provided so as to cover the outer circumference of the cartridge 900, and a slit 9331 is provided on the outer circumference so as to follow the circumferential direction.

[0378] Therefore, regardless of the position of the window portion 940 in the circumferential direction of the housing 500E, the light from the illumination portion 920 can be guided to the window portion 940 by the light guide path 930.

[0379] ---Revised Version--- It should be noted that the present invention is not limited to the embodiments described above. That is, any modifications made to the above embodiments by those skilled in the art are also included within the scope of the present invention, as long as they retain the features of the present invention. Furthermore, the elements of the above embodiments and the modifications described later can be combined to the extent that it is technically possible, and any combination thereof is also included within the scope of the present invention, as long as it retains the features of the present invention.

[0380] For example, in the first embodiment, the sensor 54 of the electronic pen 5 was a fingerprint sensor or a camera, but is not limited to these. The sensor 54 can be any sensor that can detect the user's biometric information and can be installed on the electronic pen 5. The sensor 54 may be, for example, an infrared vein sensor. The vein sensor may be installed on the side of the housing 500 as shown in Figure 4A or Figure 4B, or on the end of the tail plug 502 as shown in Figure 4D.

[0381] With this configuration, the electronic pen 5 can detect the user's biometric information using various sensors, not just fingerprint sensors and cameras. Therefore, the electronic pen 5 can improve user convenience.

[0382] In the second embodiment, the electronic device 1 may accept gesture input while the user is performing an operation input to the input device 55 provided on the electronic pen 5. A specific example of the case where the input device 55 is a push-button type side switch or button will be described. The gesture detection unit 710 of the electronic device 1 determines whether or not the input device 55 of the electronic pen 5 is pressed. If the input device 55 is pressed, the gesture detection unit 710 starts detecting gesture operations, including movement or rotation of the electronic pen 5. Conversely, if the input device 55 is not pressed, the gesture detection unit 710 stops detecting gesture operations, including movement or rotation of the electronic pen 5.

[0383] With this configuration, the electronic device 1 detects gesture operations while an operation input is being made to the input device 55, thereby suppressing false detections such as the detection of unintended gesture operations. Therefore, the electronic device 1 can further improve user convenience.

[0384] In the second embodiment, the electronic device 1 may change the report rate according to the driver ID 6032 of the sensor controller 14. The report rate is a value that indicates the number of transmissions per second between various devices in the position detection system 1000. Specifically, the host processor 15A of the electronic device 1 determines the report rate value according to the type and performance of the sensor controller 14 which is pre-associated with the driver ID 6032. The report rate is pre-associated for each type or performance of the sensor controller 14 and stored in the storage unit 600A. In addition, two types of report rates are defined: one between the host processor 15A and the sensor controller 14, and another between the sensor controller 14 and the electronic pen 5.

[0385] With this configuration, the electronic device 1 determines the report rate according to the driver ID 6032, thereby improving the processing efficiency of the electronic device 1.

[0386] In the second embodiment, the electronic device 1 may communicate with the electronic pen 5 using a seamless pairing function. Specifically, the electronic device 1 first transmits and receives various information necessary for Bluetooth® communication by communicating with the electronic pen 5 using the communication module 561 and the pen sensor 13. Subsequently, the electronic device 1 communicates with the electronic pen 5 using a wireless communication device for Bluetooth® communication that is different from the communication module 561.

[0387] With this configuration, the electronic device 1 can perform not only communication using the communication module 561 and the pen sensor 13, but also Bluetooth® communication, thereby further improving user convenience.

[0388] In the second embodiment, the electronic pen 5 may determine which of the multiple electronic devices 1 it has connected to when it is capable of communicating with multiple electronic devices 1. Specifically, the electronic pen 5 obtains a driver ID 6032 when it connects to an electronic device 1 using a wireless communication device for Bluetooth® communication that is different from the communication module 561. Subsequently, the electronic pen 5 identifies the electronic device 1 based on the obtained driver ID 6032.

[0389] With this configuration, the electronic pen 5 can determine the status of its communication connection with the electronic device 1, thereby further improving user convenience.

[0390] In the second embodiment, the electronic device 1 may obtain an electronic pen ID 6031 for identifying the pen from the electronic pen 5 via the pen sensor 13. Furthermore, the electronic device 1 may execute a program to update the firmware of the electronic pen 5 to match the type of electronic pen 5 corresponding to the electronic pen ID 6031. Note that the transmission and reception process between the electronic device 1 and the electronic pen 5 during the firmware update process is performed using a wireless communication device for Bluetooth® communication, rather than a communication module 561.

[0391] In this configuration, electronic device 1 automatically recognizes the type of electronic pen 5 and performs a firmware update to match the electronic pen 5. Therefore, electronic device 1 can further improve user convenience.

[0392] Furthermore, in the second embodiment, the display panel 12 in the electronic device 1 may be a transmissive double-sided display. A transmissive double-sided display is formed of a light-transmitting material and is a double-sided display capable of displaying images, videos, etc., on the front and back surfaces of the housing 500. The electronic device 1 comprises a transmissive double-sided display consisting of two displays and a pen sensor 13 provided between the two displays. Furthermore, the electronic device 1 acquires the electronic pen ID 6031 from each of the two electronic pens 5 via the pen sensor 13. Based on the acquired electronic pen ID 6031 of the electronic pen 5, the electronic device 1 determines which side of the transparent double-sided display, the front or the back, was indicated. In this example, it is assumed that the two electronic pens 5 are used for different purposes, one for indicating the position on the front and the other for indicating the position on the back.

[0393] With this configuration, the electronic device 1 can determine whether the position indication is displayed on the front or back of the transparent double-sided display. Therefore, the electronic device 1 can further improve user convenience.

[0394] In the third embodiment, the light-emitting member 542 may also be a light for illumination. The light-emitting member 542 that functions as a light for illumination includes an LED for illumination as a light-emitting element.

[0395] With this configuration, the electronic pen 5 functions as a light, further improving user convenience.

[0396] In the fourth embodiment, the electronic pen 5 may also have a temperature sensor 541 for measuring the user's body temperature (see Figure 17). The sensor 541, which functions as a temperature sensor, is provided on the pen tip 501 or the tail cap 502. The sensor 541, which functions as a temperature sensor, is used, for example, to measure the user's body temperature. That is, the electronic pen 5 functions as a thermometer by placing the part of the pen tip 501 or tail cap 502 where the sensor 541 is provided, for example, under the user's armpit.

[0397] In this configuration, the electronic pen 5 measures the user's body temperature using a sensor 541 located at the pen tip 501 or the tail cap 502. Therefore, the electronic pen 5 can also function as a thermometer, further improving user convenience.

[0398] Furthermore, in the sixth embodiment, the portion of the light guide path 932 where the core portion 9324 is provided may be hollow. In addition, the cladding portion 9323 of the light guide path 932 may be a reflector made of a material with high light reflectivity. Furthermore, the portion of the light guide path 933 where the core portion 9334 is provided may be hollow. In addition, the cladding portion 9333 of the light guide path 932 may be a reflector made of a material with high light reflectivity.

[0399] With this configuration, the electronic pen 5E is made of materials that are less expensive than the core part 9324 or 9334 and the cladding part 9323 or 0333. Therefore, the electronic pen 5E can emit light while keeping manufacturing costs down and being compatible with various shapes of housings 500E. [Explanation of Symbols]

[0400] 5…Electronic pen, 500…Housing, 54…Sensor, 56A…Pen controller, 561…Communication module, 200A…Storage unit, 210…Authentication unit, 220…Transmitter unit

Claims

1. An electronic pen that provides positional instructions to a pen sensor, A housing held by the user, The housing is provided with a sensor that detects the user's biometric information, A communication module is provided in the aforementioned housing and communicates with the pen sensor, The pen controller, which is located inside the housing, has a storage unit for storing the user's registration information, an authentication unit for authenticating that the user indicated by the biometric information is registered in the registration information by comparing the biometric information detected by the sensor with the registration information, and a transmission unit for transmitting the authentication result from the authentication unit to the pen sensor via the communication module. An electronic pen equipped with [a specific feature].

2. The aforementioned sensor is a fingerprint sensor. The electronic pen according to claim 1, wherein the registration information includes fingerprint information indicating the user's fingerprint.

3. The aforementioned sensor is a camera, The electronic pen according to claim 1, wherein the registration information includes facial image information showing the user's facial image.

4. The aforementioned sensor is a vein sensor, The electronic pen according to claim 1, wherein the registration information includes vein information indicating the user's vein pattern.

5. A receiving unit that receives document information indicating a document that the user has electronically signed from the pen sensor via the communication module, A history registration unit stores the document information received by the receiving unit in the storage unit as signature history information, associating it with information indicating the user authenticated by the authentication unit. The electronic pen according to any one of claims 1 to 4, further comprising the above.

6. A display panel that displays the target to be displayed, A pen sensor is provided so as to overlap the display area of ​​the aforementioned display panel and detects position indication by an electronic pen, A signature receiving unit that receives an electronic signature applied to a document displayed in the display area using the electronic pen via the pen sensor, A signer acquisition unit that acquires signer information indicating the signer of the electronic signature, A storage unit that associates the signer information with document information indicating a document on which the electronic signature has been applied, and stores this as signature history information. Electronic devices equipped with the following features.

7. The electronic device according to claim 6, wherein the signatory information includes first identification information relating to the electronic pen.

8. The electronic device according to claim 6, wherein the signatory information includes authentication information of the user of the electronic pen.

9. The electronic device according to claim 8, wherein the signature receiving unit accepts the electronic signature when the authentication information indicates that the user's authentication was successful, and stops accepting the electronic signature when the authentication information indicates that the user's authentication failed.

10. The system further includes an authentication unit that authenticates the user when the combination of first identification information relating to the electronic pen and second identification information different from the first identification information is a predetermined combination. The electronic device according to claim 8 or 9, wherein the storage unit stores the authentication result by the authentication unit as authentication information.

11. The electronic device according to claim 8 or 9, wherein the authentication information is the result of biometric authentication for the user.

12. An electronic device capable of communicating with a server device that stores information related to an electronic pen, A display panel that displays the target to be displayed, A pen sensor is provided so as to overlap the display area of ​​the display panel and detects the position indication by the electronic pen, A gesture detection unit detects a gesture operation performed by an electronic pen via the pen sensor to specify a designated area that represents a part of a drawing object displayed in the display area, When the gesture detection unit detects the gesture operation, an extraction unit extracts drawing information for the specified area. A transmission unit that transmits the drawing information extracted by the extraction unit to the server device, Electronic devices equipped with the following features.

13. The electronic device according to claim 12, wherein the drawing information includes time-series data of orientation information, including the position, tilt, and pressure of the electronic pen on the pen sensor, and drawing parameters relating to a virtual drawing tool used to draw the drawing object.

14. A receiving unit that receives the drawing information from the server device, An adjustment unit adjusts the drawing parameters of the drawing tool to the drawing parameters indicated by the drawing information received by the receiving unit, The electronic device according to claim 13, further comprising:

15. The electronic device according to claim 12, wherein the drawing information is image data indicating the designated area of ​​the drawing object.

16. A display panel that displays the target to be displayed, A pen sensor is provided so as to overlap the display area of ​​the aforementioned display panel and detects position indication by an electronic pen, A gesture detection unit that detects gesture operations including movement or rotation of the electronic pen, When the gesture detection unit detects a first gesture operation using the electronic pen via the pen sensor to specify a portion of a drawing object displayed in the display area, the extraction unit extracts information that the specified portion represents. Electronic devices equipped with the following features.

17. The electronic device according to claim 16, wherein the extraction unit extracts color information relating to the color within the area of ​​the portion.

18. The electronic device according to claim 17, further comprising an adjustment unit that adjusts the range of the area in accordance with the second gesture operation when the gesture detection unit detects a second gesture operation different from the first gesture operation after the extraction unit has extracted color information within the partial area.

19. The electronic device according to claim 17, further comprising an adjustment unit that adjusts the extracted color according to the third gesture operation when the gesture detection unit detects a third gesture operation different from the first gesture operation after the extraction unit has extracted color information within the region.

20. The aforementioned display panel displays display content including an object that can be operated, The extraction unit extracts image data of the specified object when the first gesture operation specifying the object is detected by the gesture detection unit. The electronic device according to claim 16, further comprising a transmitting unit that transmits image data extracted by the extraction unit to the electronic pen.

21. The display control unit further comprises, which controls the display operation of the display panel such that when the extraction unit extracts the image data, the object moves toward the indicated position of the electronic pen toward the pen sensor on the display area and then disappears. The electronic device according to claim 20, wherein the transmitting unit transmits a control command to the electronic pen to display the object on a display provided on the electronic pen after the display control unit has removed the display of the object from the display area.

22. An electronic pen that provides positional instructions to a pen sensor, The pen tip and, A housing connected to the aforementioned pen tip and held by the user, A rotary input device provided on the pen tip side of the housing, which receives user input via a rotatable rotating member, A communication module is provided in the aforementioned housing and communicates with the pen sensor, A transmission unit transmits a predetermined control command to the pen sensor via the communication module in response to the user's operation input received by the rotation input device. An electronic pen equipped with [a specific feature].

23. The aforementioned rotation input device is a trackball, The electronic pen according to claim 22, wherein the transmitting unit transmits a control command to the pen sensor according to the rotation direction of the trackball.

24. The rotation input device includes a wheel member that rotates along the rotation axis in response to the user's operation input, and a rotation detection member that detects the rotation of the rotation axis. The electronic pen according to claim 22, wherein the transmitting unit transmits a control command to the pen sensor according to the rotation direction of the wheel member.

25. A position detection unit that detects changes in the position of the pen tip using a sensor provided inside the housing, A position calculation unit calculates the position of the pen tip relative to the pen sensor from the change in the position of the pen tip detected by the position detection unit, Furthermore, The electronic pen according to claim 22, wherein the transmitting unit transmits the calculation result of the position calculation unit to an electronic device having the pen sensor by a wireless communication device different from the communication module when the distance between the pen sensor and the pen tip is greater than or equal to a predetermined distance.

26. The electronic pen according to claim 25, wherein the sensor is an inertial measurement unit having a three-axis accelerometer and a three-axis gyroscope.

27. A connecting member is provided in the housing and detachably connects the housing to the electronic device having the pen sensor, A connection detection unit for detecting the connection status of the housing to the electronic device, The electronic pen according to claim 22, wherein the transmitting unit transmits a different control command to the electronic device when the housing is connected to the electronic device, using a different wireless communication device than the communication module, compared to when the housing is detached from the electronic device.

28. The pen tip is provided with a plurality of light-emitting elements, each emitting light of a different color, A light-emitting control unit that causes the light-emitting element to emit light in a color indicated by a control command transmitted from the pen sensor, The electronic pen according to claim 22, further comprising:

29. An electronic pen that provides positional instructions to a pen sensor installed in an electronic device, A housing held by the user, Multiple sensors provided in the housing, A communication module is provided in the aforementioned housing and communicates with the pen sensor, A pen controller having a generation unit that generates user state information indicating the user's state based on a combination of detection results from the plurality of sensors, and a transmission unit that transmits the user state information generated by the generation unit to the electronic device via the pen sensor, An electronic pen equipped with [a specific feature].

30. The aforementioned sensor is a pressure sensor, The user status information indicates the state of the user's grip on the housing. The electronic pen according to claim 29, further comprising a vibrating member provided in the housing, which vibrates when the user status information satisfies predetermined conditions.

31. The user state information is a concentration level indicating the degree of the user's concentration on the drawing task performed via the pen sensor. The generation unit calculates adjustment values ​​for the drawing parameters of the virtual drawing tool used for drawing by the user from the concentration level, The electronic pen according to claim 29, wherein the transmitting unit transmits the adjustment value calculated by the generating unit to the electronic device via the pen sensor.

32. The adjustment value includes the upper and lower limits of the range of values ​​that the drawing parameter can take. The electronic pen according to claim 31, wherein the generating unit determines whether the user's level of concentration is above a certain threshold, and changes the upper and lower limits according to the determination result.

33. A display panel that displays the target to be displayed, A pen sensor is provided so as to overlap the display area of ​​the aforementioned display panel and detects position indication by an electronic pen, A state detection unit that determines whether a change in the position of the electronic pen detected by the pen sensor satisfies predetermined conditions, When the state detection unit determines that the change in the position of the electronic pen satisfies the predetermined conditions, a vibration control unit vibrates a vibrating member that is provided so as to overlap the display area or is provided on the electronic pen, Electronic devices equipped with the following features.

34. The electronic device according to claim 33, wherein the predetermined condition is that the amount of movement of the electronic pen on the pen sensor is less than or equal to a reference distance within a reference time.

35. The system further comprises a storage unit for storing display content having multiple objects, and a display control unit for displaying the display content on the display panel, The state detection unit detects which of the objects in the display content the position of the electronic pen on the pen sensor corresponds to. The electronic device according to claim 34, wherein the display control unit displays presentation information associated with the object detected by the state detection unit on the display panel.

36. The vibrating member is provided in the electronic pen, The electronic device according to claim 34, wherein the vibration control unit transmits a control signal from the pen sensor to the electronic pen to vibrate the vibrating member at a predetermined period when the change in the position of the electronic pen satisfies the predetermined conditions.

37. Multiple vibrating members are provided so as to overlap the display area. The electronic device according to claim 33, wherein the vibration control unit controls the operation of the vibrating member to vibrate the position of the electronic pen detected by the pen sensor on the display panel when the change in the position of the electronic pen satisfies the predetermined conditions.

38. An electronic pen that provides positional instructions to a pen sensor, A pen tip having a first electrode and a second electrode that transmit and receive signals with the pen sensor, A housing having a cylindrical outer casing from which the pen tip can be attached and detached, the housing comprising a first conductor electrically connected to the first electrode when the pen tip is connected to the outer casing, a second conductor electrically connected to the second electrode when the pen tip is connected to the outer casing, and a pen controller electrically connected to the first and second conductors for controlling the transmission and reception of the signal, An electronic pen equipped with [a specific feature].

39. The first electrode is formed as a core that constitutes the central axis of the pen tip, The second electrode is a ring electrode formed in a cylindrical shape so as to cover the outer circumference of the first electrode. The first conductor is formed as a core that constitutes the central axis of the outer casing, The electronic pen according to claim 38, wherein the second conductor is formed in a cylindrical shape so as to cover the outer circumference of the first conductor.

40. The pen tip is formed in a cylindrical shape and further includes a ground electrode provided between the first electrode and the second electrode so as to cover the outer circumference of the first electrode and the inner circumference of the second electrode. The electronic pen according to claim 39, wherein the housing further comprises a third conductor electrically connected to the ground electrode and the pen controller.

41. A cylindrical housing having a window that transmits light from the inside to the outside, The aforementioned housing is detachable, and a cylindrical cartridge having a circuit board is provided inside the housing, The cartridge is provided with an irradiation unit that irradiates light in response to an electrical signal transmitted from the circuit board, A light guide path that transmits light emitted from the irradiation unit to the inside of the window unit, An electronic pen equipped with [a specific feature].

42. The electronic pen according to claim 41, wherein the light guide path comprises a core portion, a cladding portion formed of a material with a higher refractive index than the core portion and provided to cover the core portion, and a covering portion formed of an opaque material and provided to cover the cladding portion.

43. The electronic pen according to claim 42, wherein the optical guide is an optical waveguide formed as a flexible cable. It has been done,

44. The electronic pen according to claim 41 or 42, wherein the light guide path is formed in a plate shape with its longitudinal direction aligned with the pen shaft, and a slit is provided on the outer surface of the housing side so as to be aligned with the pen shaft.

45. The electronic pen according to claim 41 or 42, wherein the light guide path is formed in a cylindrical shape and is provided so as to cover the outer circumference of the cartridge, and a slit is provided on the outer circumference so as to be in the circumferential direction.

Images