Display device, pen input system, method, and program

Abstract

To solve the problem in which there is room for improvement in user authentication methods by electronic pens.SOLUTION: A display device includes: a touch display that accepts input from an electronic pen; a receiving unit that receives first data corresponding to a detection result of biometric information of a user gripping the electronic pen and second data corresponding to a detection result of at least one of acceleration, pen pressure, and angular velocity from the electronic pen; and a control unit. When the first data satisfies a predetermined condition, the control unit executes processing of associating information of the user with a first image input by the electronic pen based on the second data.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present application relates to a display device, a pen input system, a method, and a program. [Background technology]

[0002] BACKGROUND ART Conventionally, there is a technique for authenticating a user by comparing signature data input by an electronic pen with one or more stored reference signature data (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-9452 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, there is room for improvement in the above-described user authentication method. [Means for solving the problem]

[0005] In one embodiment, (1) the display device is characterized by comprising: a touch display that accepts input from an electronic pen; a receiving unit that receives from the electronic pen first data corresponding to the detection results of the biometric information of a user holding the electronic pen and second data corresponding to the detection results of at least one of acceleration, writing pressure, and angular velocity; and a control unit that, when the first data satisfies a predetermined condition, executes a process of linking the user's information to a first image input by the electronic pen based on the second data.

[0006] (2) The display device of (1) above is characterized in that, when the first image is input into an application to which a predetermined authority level is set, if the first data satisfies a predetermined condition but the user's authority does not meet the predetermined authority level, the control unit displays a second image on the touch display indicating that the first image cannot be input without performing a process to link the first image to the user's information.

[0007] (3) The display device of either (1) or (2) above is characterized in that the control unit displays the first image and a third image indicating that the first image is linked to user information on the touch display.

[0008] (4) The display device of (3) above is characterized in that, when the touch display detects an input selecting the first image or the third image, the control unit causes the touch display to display a fourth image showing information about the user.

[0009] (5) Any of the display devices (1) to (4) above is characterized in that, when the touch display detects an operation to edit the first image, the control unit causes the touch display to display a fifth image prompting the input of the first data.

[0010] (6) The display device of (5) above is characterized in that the control unit allows editing of the first image if the first data input after displaying the fifth image satisfies a predetermined condition.

[0011] In one embodiment (7), the system includes an electronic pen and a display device having a touch display that accepts input by the electronic pen, and the electronic pen is The electronic pen has a first sensor that acquires biometric information of the user holding it, at least one second sensor that detects at least one of acceleration, writing pressure, and angular velocity, and a transmitting unit that transmits first data corresponding to the detection result of the first sensor and second data according to the detection result of the at least one second sensor to the display device, and the display device has a receiving unit that receives the first data and the second data, and a control unit, and when the first data satisfies a predetermined condition, the control unit executes a process of linking the user's information to an image input by the electronic pen based on the second data.

[0012] In one embodiment, the method (8) is characterized in that, when first data received by a receiving unit from an electronic pen and corresponding to biometric information of a user acquired by the electronic pen satisfies a predetermined condition, the receiving unit executes a process of linking the user's information to an image input to a touch display by the electronic pen based on second data received by the receiving unit from the electronic pen and corresponding to at least one detection result of acceleration, writing pressure, and angular velocity applied to the electronic pen.

[0013] In one embodiment, (9) the program is characterized in that, when first data received by the receiving unit from the electronic pen and corresponding to the user's biometric information acquired by the electronic pen satisfies a predetermined condition, the program executes a process of linking the user's information to an image input to the touch display by the electronic pen based on second data received by the receiving unit from the electronic pen and corresponding to at least one detection result of acceleration, writing pressure, and angular velocity applied to the electronic pen. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is an external view of a display device according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing the configuration of a display device according to an embodiment. [Figure 3] FIG. 3 is an external view of an electronic pen according to an embodiment. [Figure 4] FIG. 4 is a block diagram showing the configuration of an electronic pen according to an embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of the operation of the display device according to the embodiment. [Figure 6] FIG. 6 is a diagram showing an example of how an image is drawn on a touch display of a display device according to an embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a first image according to an embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a first image according to an embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of the operation of the display device according to the embodiment. [Figure 10] FIG. 10 is a diagram showing a display example of the display device according to an embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of the operation of the display device according to the embodiment. [Figure 12] FIG. 12 is a diagram showing a display example of the display device according to an embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of the operation of the display device according to the embodiment. [Figure 14] FIG. 14 is a diagram showing a display example of the display device according to an embodiment. [Figure 15] FIG. 15 is a diagram illustrating an example of the operation of the display device according to the embodiment. [Figure 16] FIG. 16 is a diagram showing a display example of a display device according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0015] The embodiments will be described with reference to the drawings, in which the same or similar parts are designated by the same or similar reference numerals.

[0016] The display device according to an embodiment may be, for example, a terminal such as a smartphone terminal or a tablet terminal. However, the display device is not limited to such terminals and may be, for example, a personal computer, an electronic whiteboard, or a wearable device such as a head-mounted display.

[0017] 1 is an external view of a display device according to an embodiment of the present invention, and the external appearance of the display device 100 will be described with reference to FIG.

[0018] As shown in FIG. 1, the display device 100 includes a housing 101 and a touch display 110.

[0019] The touch display 110 is provided with its display surface exposed from the housing 101 of the display device 100. The touch display 110 has a touch panel 111 and a display unit 112. The display unit 112 is provided so as to overlap the touch panel 111, and the display area of ​​the display unit 112 overlaps with the touch panel 111. However, instead of the display unit 112 and the touch panel 111 being provided so as to overlap each other, the display unit 112 and the touch panel 111 may be provided as separate units.

[0020] 2 is a block diagram showing the configuration of a display device according to an embodiment, and the functional configuration of the display device 100 will be described with reference to FIG.

[0021] As shown in FIG. 2, the display device 100 includes a touch display 110 (a touch panel 111 and a display unit 112), a communication interface 120, a storage unit 130, and a control unit 140.

[0022] The touch panel 111 detects position information (hereinafter simply referred to as position information of the electronic pen, etc.) indicating the position on the touch panel 111 where an operation is performed by a pointer such as the electronic pen 200 described below, and transmits the detected position information of the electronic pen, etc. to the control unit 140. The detection method of the touch panel 111 may be, for example, a pressure-sensitive method, a capacitance method, or an electromagnetic induction method, but is not limited to these.

[0023] Display unit 112 displays objects such as characters, images, or figures (hereinafter simply referred to as objects) on the screen based on signals input from control unit 140. Control unit 140 can also display objects on display unit 112 based on position information of an electronic pen or the like received from touch panel 111. In other words, display unit 112 can display objects handwritten on touch display 110 with electronic pen 200 or the like. Display unit 112 is configured to have a display panel such as a liquid crystal display (Liquid Crystal Display), an electro-luminescence display (EL display), or a micro electro mechanical system (MEMS) shutter display.

[0024] The communication interface 120 can communicate with other devices via a wireless connection. Wireless communication standards supported by the communication interface 120 include, for example, cellular communication standards such as 2G, 3G, 4G, and 5G, and short-range wireless communication standards. Examples of short-range wireless communication standards include IEEE802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), and NFC (Near Field Communication). Examples of WPAN communication standards include Wireless Field Communication (WPC) and Wireless Personal Area Network (WPAN). An example of a WPAN communication standard is ZigBee (registered trademark). The communication interface 120 may communicate with other devices via a wired connection. When the communication interface 120 is connected via a wire, it may be an interface that complies with a wired communication standard such as Universal Serial Bus (USB).

[0025] The communication interface 120 functions as a receiving unit that receives data from the electronic pen 200 , and transmits the data received from the electronic pen 200 to the control unit 140 .

[0026] The storage unit 130 includes at least one memory that stores the program 131, data, etc. The storage unit 130 is also used as a working area that temporarily stores the processing results of the control unit 140. The storage unit 130 may be configured to include any non-transitory storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage unit 130 may be configured to include multiple types of storage media. The storage unit 130 may be configured to include a combination of a portable storage medium such as a memory card, an optical disk, or a magneto-optical disk, and a storage medium reader. The storage unit 130 may be configured to include a RAM (Random Access Memory). The storage unit 130 may be configured to include a storage device used as a temporary storage area, such as a personal computer (PC) or a personal computer memory (PC). The storage unit 130 may store, for example, biometric information of a user in advance. The biometric information may include, for example, at least one of fingerprint information, a facial image, and voiceprint information. The storage unit 130 may further store user information. The user information may include, for example, at least one of a user ID (an identifier indicating a user), a facial image of the user, the user's name, the user's affiliation, the user's biometric information, and the user's job title. The storage unit 130 may store, for example, information indicating user authority. The information indicating user authority is, for example, information corresponding to the editing authority level of a predetermined application and indicating authority pre-associated with the user (hereinafter also referred to as user authority information).

[0027] The program 131 provides various functions such as a function to perform biometric authentication of a user and a function to associate user information with an object, based on the control of a device constituting the display device 100, for example, the control unit 140.

[0028] The control unit 140 is an arithmetic processing device. Examples of arithmetic processing devices include, but are not limited to, a central processing unit (CPU), a system-on-chip (SoC), a micro control unit (MCU), a field-programmable gate array (FPGA), and a core processor. The control unit 140 also includes a graphics processing unit (GPU), a video RAM (VRAM), etc., and draws various images on the display unit 112. The control unit 140 may be configured with multiple arithmetic processing devices, and various controls may be performed by the cooperation of the multiple arithmetic processing devices.

[0029] The control unit 140 performs overall control of the operation of the display device 100 to realize various functions. The control unit 140 executes various operations based on input detected by the touch panel 111. The control unit 140 may output, in response to the input signal, via the communication interface 120, the display unit 112, etc.

[0030] The control unit 140 executes the control program 131 to realize the functions provided by the control program 131 as processing by the control unit 140.

[0031] The control unit 140 may detect whether the display device 100 is connected to the electronic pen 200 via the communication interface 120 or not.

[0032] The control unit 140 may perform control so that the touch panel 111 can receive position information of the electronic pen or the like when the display device 100 and the electronic pen 200 are connected via the communication interface 120. In other words, the control unit 140 may perform control so that the touch panel 111 does not receive input from the electronic pen 200 until the display device 100 and the electronic pen 200 are connected via the communication interface 120.

[0033] The electronic pen 200 will be described below.

[0034] 3 is an external view of an electronic pen according to an embodiment, and the external appearance of the electronic pen 200 will be described with reference to FIG.

[0035] As shown in FIG. 3, the electronic pen 200 includes a housing 201, a core body 202, and a first sensor 210.

[0036] The housing 201 is cylindrical. The core body 202 is provided at the lower end of the electronic pen 200 (housing 201). The first sensor 210 is provided at the lower end side of the electronic pen 200 (housing 201), but may be provided at an appropriate position, such as at the upper end side. When using the electronic pen 200 to handwrite an object on the touch display 110, the user holds the housing 201, brings the core body 202 into contact with the touch display 110, and moves the electronic pen 200 over the touch display 110 so as to draw the desired object.

[0037] 4 is a block diagram showing the configuration of an electronic pen according to an embodiment, and the functional configuration of the electronic pen 200 will be described with reference to FIG.

[0038] As shown in FIG. 4, the electronic pen 200 includes a first sensor 210, a second sensor 220, a communication interface 230, a storage unit 240, and a control unit 250.

[0039] The first sensor 210 is a biometric sensor. The first sensor 210 acquires biometric information of a user holding the electronic pen 200 and outputs data corresponding to the acquired biometric information of the user to the control unit 250. The first sensor 210 may be, for example, a fingerprint sensor that acquires fingerprint data of the user, a camera that acquires facial image data including at least a part of the user's face, a microphone that acquires voice data of the user, or one or more sensors that combine these sensors. The first sensor 210 can acquire at least one of the above-mentioned fingerprint data, facial image data, and voice data as the acquired biometric information of the user.

[0040] The second sensor 220 is a sensor for estimating the amount of physical change that occurs in the electronic pen 200 when a user uses the electronic pen 200 to handwrite an object on the touch display 110. The second sensor 220 is, for example, an acceleration sensor, an angular velocity sensor, a writing pressure sensor configured to detect the pressure applied to the core body 202, or one or more sensors that combine these sensors. The second sensor 220 transmits the acquired data to the control unit 250.

[0041] The communication interface 230 communicates wirelessly or via a wire. The communication standard supported by the communication interface 230 may be, for example, the cellular communication standard, short-range wireless communication standard, or wired communication standard described for the communication interface 120. The communication interface 230 functions as a transmitter that transmits data acquired by the electronic pen 200 (for example, data acquired by the first sensor 210 and the second sensor 220) to the display device 100.

[0042] The storage unit 240 includes at least one memory that stores programs and data. The storage unit 240 is also used as a work area that temporarily stores processing results of the control unit 250. The storage unit 240 may be configured to include any non-transitory storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage unit 240 may be configured to include multiple types of storage media. The storage unit 240 may be configured to include a storage device used as a temporary storage area such as RAM. The storage unit 240 may store, for example, biometric information of the user in advance. The biometric information includes, for example, at least one of fingerprint information, facial image, and voiceprint information.

[0043] The control unit 250 is a processing unit. Examples of the processing unit include, but are not limited to, a CPU, an SoC, an MCU, an FPGA, or a core processor. The control unit 50 may be configured with a plurality of processing units, and various controls may be executed by the cooperation of the plurality of processing units.

[0044] The control unit 250 may detect whether the electronic pen 200 is connected to the display device 100 via the communication interface 230. When the electronic pen 200 is connected to the display device 100 via the communication interface 230, the control unit 250 may perform control so that the data acquired by the first sensor 210 and the second sensor 220 is transmitted to the display device 100. In other words, the control unit 250 may perform control so that the data acquired by the first sensor 210 and the second sensor 220 is not transmitted to the display device 100 until the electronic pen 200 is connected to the display device 100 via the communication interface 230.

[0045] The control unit 250 may compare the user's biometric information acquired by the first sensor 210 with the user's biometric information stored in advance in the memory unit 240, and transmit the comparison result to the display device 100 via the communication interface 230.

[0046] In one embodiment, the display device includes a touch display that accepts input from an electronic pen, a receiving unit that receives from the electronic pen first data corresponding to the detection results of the biometric information of a user holding the electronic pen and second data corresponding to the detection results of at least one of acceleration, writing pressure, and angular velocity, and a control unit that, if the first data satisfies a predetermined condition, executes a process of linking user information to a first image input by the electronic pen based on the second data.

[0047] Fig. 5 is a diagram showing an example of the operation of the display device according to one embodiment. Fig. 6 is a diagram showing, in time sequence, an example of how an image is drawn on the touch display 110 of the display device 100 in steps S101 to S105 of Fig. 5.

[0048] In this embodiment, the display device 100 and the electronic pen 200 are wirelessly connected via short-range wireless communication. The electronic pen 200 has a fingerprint sensor as the first sensor 210 and an acceleration sensor as the second sensor 220. The display device 100 displays an application screen ((a) in FIG. 6) that supports handwriting operations on the touch display 110. In (a) in FIG. 6, the display device 100 displays a frame 300 on the touch display 110 that indicates an area for accepting an electronic signature. A user can sign by using the electronic pen 200 to perform handwriting operations in the area within the frame 300 on the touch display 110.

[0049] In this embodiment, an application that supports handwriting operations is, for example, an application that supports electronic signatures, such as an electronic contract application, but is not limited to this as long as it is an application that allows input operations using an electronic pen. Furthermore, in this embodiment, a case is described in which characters are drawn on the touch display 110 using the electronic pen 200, but the present disclosure is not limited to this. For example, the display device of the present disclosure can also be applied to a case in which a picture or a work that combines pictures and characters is drawn on the touch display 110 using the electronic pen 200.

[0050] In step S101, the control unit 140 receives the first data (fingerprint data) acquired by the first sensor 210 of the electronic pen 200 via the communication interface 120.

[0051] In step S102, the control unit 140 compares the received first data (fingerprint data) with the user's fingerprint information stored in advance in the storage unit 130, and determines whether the user holding the electronic pen 200 is a legitimate user, thereby authenticating the user. That is, the control unit 140 authenticates the user based on the received first data (fingerprint data).

[0052] In step S102, if the first data (fingerprint data) matches the user's fingerprint information stored in advance in the storage unit 130 (hereinafter also referred to as a case where user authentication is successful), the control unit 140 proceeds to step S103. On the other hand, if the first data (fingerprint data) does not match the user's fingerprint information stored in advance in the storage unit 130 (hereinafter also referred to as a case where user authentication is unsuccessful), the control unit 140 returns to step S101. If user authentication is unsuccessful, the control unit 140 may cause the touch display 110 to display a notification urging the user to authenticate using the first sensor 210.

[0053] The electronic pen 200 (control unit 250) may perform the process of comparing the first data (fingerprint data) acquired by the first sensor 210 with the user's fingerprint information pre-stored in the storage unit 130 instead of the display device 100 (control unit 140). That is, the electronic pen 200 (control unit 250) may perform the process of comparing the first data (fingerprint data) acquired by the first sensor 210 with the user's fingerprint information pre-stored in the storage unit 130, and transmit the comparison result to the display device 100 (control unit 140) via the communication interface 230. In this case, the comparison result is, for example, data indicating whether or not the first data (fingerprint data) matches the user's fingerprint information pre-stored in the storage unit 130. The control unit 140 may then determine whether or not the user authentication has been successful based on the comparison result received from the electronic pen 200 (control unit 250) via the communication interface 120.

[0054] In step S103, the control unit 140 starts acquiring the second data, and the process proceeds to step S104. That is, the control unit 140 requests the electronic pen 200 (control unit 250) to transmit the second data via the communication interface 120. In response to the request, the electronic pen 200 (control unit 250) transmits acceleration data, which is data indicating the acceleration acquired by the second sensor 220 (acceleration sensor), to the display device 100 (control unit 140) via the communication interface 230. The electronic pen 200 (control unit 250) periodically transmits the acceleration data to the display device 100 (control unit 140). The control unit 140 periodically receives the acceleration data from the electronic pen 200 (control unit 250).

[0055] Also, in step S103, control unit 140 starts control to draw an object on display unit 112 based on position information of the electronic pen or the like received from touch panel 111. That is, in step S103, when the user performs an operation to draw a predetermined object on touch display 110 using electronic pen 200 (hereinafter also referred to as a handwriting operation), control unit 140 draws the object on touch display 110 in accordance with the handwriting operation.

[0056] Here, Fig. 6(a) shows the display state of the touch display 110 immediately after executing step S103. Then, after step S103, when the user performs a handwriting operation to sign within the frame 300 of Fig. 6(a) using the electronic pen 200, the control unit 140 draws an image corresponding to the handwriting operation within the frame 300, as shown in Fig. 6(b).

[0057] In step S104, the control unit 140 determines whether the electronic pen 200 has ceased to be used based on the second data (acceleration data). In other words, the control unit 140 refers to the second data (acceleration data) over time and estimates a state in which handwriting operation has ceased to be performed. Specifically, when the control unit 140 determines based on the second data (acceleration data) that the acceleration occurring in the electronic pen 200 is equal to or greater than a predetermined value, the control unit 140 determines that the electronic pen 200 is being used. When the control unit 140 determines based on the second data (acceleration data) that the acceleration occurring in the electronic pen 200 is less than the predetermined value, the control unit 140 determines that the electronic pen 200 has ceased to be used. Here, the control unit 140 determines based on the second data (acceleration data) that a predetermined time has elapsed since the acceleration occurring in the electronic pen 200 became less than the predetermined value. In this case, the control unit 140 may determine that the electronic pen 200 is no longer in use. If the control unit 140 determines that the electronic pen 200 is no longer in use, the process proceeds to step S105. When proceeding to step S105, the control unit 140 may transmit a signal (hereinafter also referred to as a second data transmission stop signal) to the electronic pen 200 (control unit 250) via the communication interface 120 to instruct the electronic pen 200 to stop transmitting the second data (acceleration data). When the electronic pen 200 (control unit 250) receives the second data transmission stop signal from the display device 100, the electronic pen 200 may stop transmitting the second data (acceleration data) to the display device 100.

[0058] The second sensor 220 may use at least one of a writing pressure sensor and an angular velocity sensor instead of or as a supplement to the acceleration sensor.

[0059] Here, the control unit 140 may determine whether the electronic pen 200 is no longer in use as follows.

[0060] Whether the electronic pen 200 is no longer in use can be determined based on, for example, the second data (acceleration data). The acceleration indicated by the second data (acceleration data) indicates a unique pattern of time change corresponding to the movement of the electronic pen 200. Specifically, this acceleration periodically fluctuates over time according to the movement of the electronic pen 200. The storage unit 130 of the display device 100 may store, as a registered pattern, a typical pattern of acceleration corresponding to the state of use of the electronic pen 200 (for example, a state in which the electronic pen 200 is placed on a desk or the like, a state in which the electronic pen 200 is in free fall, or a state in which the user continues to hold the electronic pen 200 without using it). The control unit 140 may determine whether the pattern of time change in acceleration indicated by the second data (acceleration data) (hereinafter also referred to as a detection pattern) indicates a registered pattern of a predetermined state. For example, when the sum of the absolute values ​​of the differences between the detection pattern and the registered pattern at each time point satisfies a predetermined criterion, the control unit 140 determines that the detection pattern indicates the registered pattern. For example, when the detection pattern indicates a registered pattern in which the electronic pen 200 is placed on a desk or the like, the user moves their hand to place the electronic pen 200 on a desk or the like, the electronic pen 200 is falling freely, or the user continues to hold the electronic pen 200 in their hand without using it, the control unit 140 may determine that the electronic pen 200 is no longer in use.

[0061] Here, the display device 100 may be provided with a notification unit such as a vibrator, a speaker, or an LED light. The control unit 140 may notify the user, via the notification unit of the display device 100 or the touch display 110, that it has determined that the electronic pen 200 is being used, from the time when the control unit 140 starts acquiring the second data (step S103) until the time when the control unit 140 determines that the electronic pen 200 is no longer being used (step S104: YES), the electronic pen 200 may be provided with a notification unit such as a vibrator, a speaker, or an LED light. The electronic pen 200 may notify the user, via the notification unit of the electronic pen 200, that it has determined that the electronic pen 200 is being used, from the time when the control unit 140 starts transmitting the second data (step S103) until the time when the control unit 140 determines that the electronic pen 200 is no longer being used (step S104: YES). For example, the electronic pen 200 (control unit 250) may notify the user via the notification unit of the electronic pen 200 that the display device 100 has determined that the electronic pen 200 is being used from the time it receives a signal from the display device 100 requesting the transmission of the second data until it receives a signal from the display device 100 to stop the transmission of the second data.

[0062] In step S105, control unit 140 executes a process of linking the first image, which is an image drawn before determining in step S104 that electronic pen 200 is not being used, with user information. Specifically, control unit 140 stores a management table linking the ID (identifier) ​​of the first image with the user information in storage unit 130 of display device 100. Note that control unit 140 performs the process of linking the first image with the user information by adding the user's information to data indicating the first image. The control unit 140 may execute a process of embedding text data indicating information in the first image. As a process of linking the first image with the user information, the control unit 140 may execute a process of sending a transaction requesting the issuance of an NFT (Non Fungible Token) including the first image and the user information to a blockchain network of an existing NFT issuing company.

[0063] The user information is at least one of the user ID, the user's face image, the user's name, the user's affiliation, the user's biometric information, and the user's job title.

[0064] 6(c) shows the display state of touch display 110 when control unit 140 determines in step S104 that electronic pen 200 is not being used. That is, control unit 140 performs a process of associating user information with image 301 (see FIG. 6(c)) drawn before determining in step S104 that electronic pen 200 is not being used, as the first image. Note that FIG. 7 illustrates only the first image (image 301). Here, control unit 140 may perform a process of associating a part or the entire application screen including image 301 with user information, as the first image, as shown in FIG. 8.

[0065] As described above, when the user authentication is successful, the display device 100 associates the user information with the first image that has been drawn until the second data satisfies the predetermined condition.

[0066] According to such a display device 100, once the user has finished writing the first screen, the user's information can be linked to the first image, which is useful in that the user can link the user's information to the image without having to perform complicated operations.

[0067] In addition, in one embodiment, when a first image is input into an application to which a predetermined authority level is set, if the first data satisfies a predetermined condition but the user's authority does not meet the predetermined authority level, the control unit of the display device may display a second image on the touch display indicating that the first image cannot be input, without performing a process to link the first image to the user's information.

[0068] The second image may be an image that notifies the user that the first image cannot be input, in other words, that the user does not have the authority to input the first image. The second image may be composed of at least one of characters, symbols, illustrations, and photographs.

[0069] FIG. 9 is a diagram illustrating an example of the operation of the display device according to the embodiment.

[0070] In FIG. 9, explanation of steps that overlap with the example of operation in FIG. 5 will be omitted.

[0071] The display device 100 of this embodiment displays the screen of an application that supports the above-mentioned handwriting operation on the touch display 110. The application has an authority level set to permit input via the touch display 110. When the user's authority satisfies the authority level, the application permits input to the screen of the application via the touch display 110.

[0072] In step S106, control unit 140 determines whether the authority of the user authenticated in step S102 satisfies a predetermined authority level. Specifically, control unit 140 refers to the user authority information stored in storage unit 130 and determines whether the authority of the user authenticated in step S102 satisfies the authority level set for the application.

[0073] In step S106, the control unit 140 determines whether the user's authority satisfies the authority level. If it is determined that the user's authority does not meet the authority level in step S106, the process proceeds to step S103. On the other hand, if the control unit 140 determines that the user's authority does not meet the authority level in step S106, the process proceeds to step S107.

[0074] In step S107, control unit 140 causes touch display 110 to display a second image indicating that the first image cannot be input, and ends the process. For example, control unit 140 may cause touch display 110 to display second image 302, as shown in Fig. 10. Specifically, control unit 140 causes touch display 110 to display second image 302, which notifies the user that the first image cannot be input, by superimposing it on at least a part of the area for inputting the first image (the area within frame 300). Note that second image 302 may have a transparency greater than 0, allowing an image located below second image 302 to be seen.

[0075] Furthermore, if it is determined in step S102 that the user's authority does not satisfy a predetermined condition, the control unit 140 may reduce the illuminance of the touch display 110 or stop displaying the screen of the application. If it is determined in step S102 that the user's authority does not satisfy a predetermined condition, the control unit 140 may change the display mode, such as by changing the color of the area within the frame 300. That is, by performing control in this manner, it may be possible to notify the user that they do not have the authority to input the first image.

[0076] As described above, if the authority of a user does not satisfy the authority level set for the application, display device 100 does not accept input from the user. With such display device 100, it is possible to restrict input of the first image by users other than those who have predetermined authority.

[0077] In one embodiment, the display device may display, on the touch display, the first image and a third image indicating that the first image is linked to the user's information.

[0078] The third image may be composed of, for example, at least one of characters, symbols, illustrations, and photographs.

[0079] FIG. 11 is a diagram illustrating an example of the operation of the display device according to the embodiment.

[0080] In step S108, the control unit 140 determines whether or not user information is associated with the image displayed on the touch display 110. If user information is associated with the image displayed on the touch display 110 in step S108, the control unit 140 proceeds to step S109. On the other hand, if user information is not associated with the image displayed on the touch display 110 in step S108, the control unit 140 ends the processing. Note that the control unit 140 may execute the processing of step S108, for example, when a triggering user operation is received via the touch display 110, but may execute the processing at various timings.

[0081] In step S109, the control unit 140 causes the touch display 110 to display a third image indicating that the image is linked to the user's information. For example, as shown in Fig. 12, the control unit 140 causes the third image 303 to be displayed near the image linked to the user's information (i.e., the first image 301). Note that the control unit 140 may display the third image 303 superimposed on the first image 301. The third image 303 may be a frame that surrounds the first image 301.

[0082] In step S109, the control unit 140 changes the display mode of the first image 301. For example, in step S109, the control unit 140 may cause the first image 301 to blink, or may change the color that constitutes the first image 301.

[0083] According to such a display device 100, the user can intuitively understand which of the images displayed on the touch display 110 is linked to the user's information.

[0084] In one embodiment, the display device may cause the touch display to display a fourth image showing user information when the touch display detects an input selecting the first image or the third image.

[0085] The fourth image includes information indicating at least one of the user ID, the user's face image, the user's name, the user's affiliation, the user's biometric information, and the user's job title. The fourth image may be composed of at least one of characters, symbols, illustrations, and photographs.

[0086] FIG. 13 is a diagram illustrating an example of the operation of the display device according to the embodiment.

[0087] In FIG. 13, explanation of steps that overlap with the example of operation in FIG. 11 will be omitted.

[0088] In step S110, if control unit 140 detects an operation to select first image 301 via touch display 110, the process proceeds to step S111. In step S110, if control unit 140 detects an operation to select third image 303 via touch display 110, the process proceeds to step S111. For example, the operation to select first image 301 or third image 303 may be an operation to tap first image 301 or third image 303.

[0089] In step S111, the control unit 140 causes the touch display 110 to display a fourth image 304 indicating information about the user. Specifically, the control unit 140 causes the touch display 110 to display the fourth image 304 near the first image 301 as shown in Fig. 14. Furthermore, the control unit 140 may cause the touch display 110 to display the fourth image 304 so as to be superimposed on at least a part of the first image 301.

[0090] According to such a display device 100, the user can easily obtain information about the user who created the first image 301.

[0091] In one embodiment, when the touch display detects an operation to edit the first image, the display device determines whether or not to allow input of the operation to edit the first image based on the user information.

[0092] Furthermore, when the touch display detects an operation to edit the first image, the display device may cause the touch display to display a fifth image that prompts the user to input the first data.

[0093] Furthermore, the display device permits editing of the first image when the first data input after displaying the fifth image satisfies a predetermined condition.

[0094] The operation of editing the first image includes, for example, at least one of an operation of deleting at least a part of the first image, an operation of copying at least a part of the first image, an operation of changing the display mode of at least a part of the first image (for example, editing to change the color, line thickness, etc.), an operation of downloading the first image, and an operation of adding an image to the first image by handwriting.

[0095] The fifth image prompts the user to input the first data, in other words, prompts the user to input biometric information. The image may be any image that prompts the user to input information, and may be composed of at least one of characters, symbols, illustrations, and photographs, for example.

[0096] 15 is a diagram showing an example of the operation of the display device according to an embodiment. The display device 100 displays the screen shown in FIG.

[0097] In step S112, control unit 140 detects an operation to edit first image 301. Specifically, control unit 140 detects an operation in which the user presses and holds first image 301 on touch display 110 in order to delete a part of first image 301, and proceeds to step S113.

[0098] In step S113, the control unit 140 causes the touch display 110 to display a fifth image 305 prompting the user to input the first data, as shown in FIG. 16, and then the process proceeds to step S114.

[0099] In step S114, the user is prompted by the fifth image 305 to input fingerprint information to the display device 100 using the first sensor 210 of the electronic pen 200. That is, the control unit 140 acquires the first data (fingerprint data) from the electronic pen 200 via the communication interface 120, and proceeds to step S115. The display device 100 may be equipped with a biometric sensor such as a fingerprint sensor. In step S114, the display device 100 may acquire the first data from the biometric sensor equipped in the display device itself.

[0100] In step S115, control unit 140 determines whether the first data (fingerprint data) input in step S112 matches the fingerprint information of the user linked to first image 301. If the input first data (fingerprint data) matches the fingerprint information of the user linked to first image 301 in step S115, control unit 140 proceeds to step S116. On the other hand, if the input first data (fingerprint data) does not match the fingerprint information of the user linked to first image 301 in step S115, control unit 140 returns to step S113. Note that if the input first data (fingerprint data) does not match the fingerprint information of the user linked to first image 301, control unit 140 may execute processing to notify a notification destination (e.g., email address) registered in advance by the user linked to first image 301 that someone else is attempting to edit the first image. The control unit 140 may count the number of times that the input first data (fingerprint data) does not match the fingerprint information of the user linked to the first image 301. When the counted number reaches a predetermined number, the control unit 140 may end the process without returning to S113, and thereafter may prevent the first image 301 from being edited for a predetermined period of time.

[0101] In step S116, control unit 140 permits the user to edit first image 301. Specifically, control unit 140 deletes first image 301. Note that in step S116, control unit 140 may make first image 301 editable, and delete first image 301 in response to a user operation received after step S116.

[0102] In step S116, control unit 140 may cause touch display 110 to display an image indicating that editing of first image 301 is permitted. Also, in step S116, control unit 140 may change the display mode of first image 301. For example, control unit 140 changes the display mode of first image 301 by displaying first image 301 in a manner that causes it to periodically vibrate. For example, control unit 140 changes the display mode of first image 301 by changing the color of first image 301.

[0103] As described above, display device 100 can prevent the first image from being altered, deleted, or used by a third party other than the copyright owner of the first image.

[0104] In this disclosure, descriptions such as "first," "second," "third," "fourth," and "fifth" are identifiers for distinguishing the components. In this disclosure, components distinguished by descriptions such as "first," "second," "third," "fourth," and "fifth" may have their numbers interchanged. For example, the first image and the second image may have their identifiers "first" and "second" interchanged. The identifiers are interchanged simultaneously. The components remain distinguished even after the identifiers are interchanged. Identifiers may be deleted. Components from which identifiers have been deleted are distinguished by their symbols. The identifiers "first," "second," "third," "fourth," and "fifth" in this disclosure should not be used solely to interpret the order of the components or to justify the existence of identifiers with smaller numbers.

[0105] A program may be provided that causes a computer to execute each process performed by the display device 100. The program may be recorded on a computer-readable medium. Using the computer-readable medium, the program can be installed on a computer. Here, the computer-readable medium on which the program is recorded may be a non-transitory recording medium. The non-transitory recording medium is not particularly limited, and may be, for example, a recording medium such as a CD-ROM or a DVD-ROM.

[0106] The above describes one embodiment in detail with reference to the drawings, but the specific configuration is not limited to that described above, and various design changes can be made within the scope that does not deviate from the gist of the invention. [Explanation of symbols]

[0107] 100:Display device 101: Housing 110: Touch display 111: Touch panel 112: Display section 120: Communication interface 130: Storage section 131: Program 140: Control unit 200: Electronic pen 201: Housing 202: Core body 210: First sensor 220: Second sensor 230: Communication interface 240: Storage section 250: Control unit 300: Frame 301: First image 302: Second image 303: Third image 304: 4th image 305: 5th image

Claims

1. a touch display that accepts input from an electronic pen; a receiving unit that receives, from the electronic pen, first data corresponding to a detection result of biometric information of a user holding the electronic pen and second data corresponding to a detection result of at least one of acceleration, writing pressure, and angular velocity; a control unit that executes a process of linking information about the user to a first image input by the electronic pen based on the second data when the first data satisfies a predetermined condition, The control unit causes the touch display to display the first image and a third image indicating that the first image is linked to user information. Display device.

2. The control unit When the first image is input into an application having a predetermined authority level, If the first data satisfies a predetermined condition but the user's authority does not meet the predetermined authority level, The display device according to claim 1 , wherein a second image indicating that the first image cannot be input is displayed on the touch display without performing a process of linking the first image to the user's information.

3. When the touch display detects an input for selecting the first image or the third image, the control unit causes the touch display to display a fourth image showing information about the user. The display device according to claim 1 .

4. The display device according to claim 1 , wherein the control unit causes the touch display to display a fifth image prompting input of the first data when the touch display detects an operation to edit the first image.

5. The display device according to claim 4 , wherein the control unit permits editing of the first image when the first data input after the fifth image is displayed satisfies a predetermined condition.

6. An electronic pen and a display device having a touch display that accepts input from the electronic pen; Equipped with The electronic pen is a first sensor that acquires biometric information of a user holding the electronic pen; at least one second sensor that detects at least one of acceleration, writing pressure, and angular velocity; a transmitter that transmits, to the display device, first data corresponding to a detection result of the first sensor and second data according to a detection result of the at least one second sensor; and The display device includes: a receiving unit that receives the first data and the second data; A control unit; and The control unit If the first data satisfies a predetermined condition, executes a process of linking information about the user to a first image input by the electronic pen based on the second data; The control unit causes the touch display to display the first image and a third image indicating that the first image is linked to information of the user. Pen input system.

7. An information processing method executed by a control unit of a display device having a receiving unit and a touch display, When the first data corresponding to the biometric information of the user acquired by the electronic pen, which is received by the receiving unit from the electronic pen, satisfies a predetermined condition, a process of associating information about the user with a first image input to the touch display by the electronic pen based on second data corresponding to at least one of detection results of acceleration, writing pressure, and angular velocity applied to the electronic pen, the second data being received by the receiving unit from the electronic pen; and displaying, on the touch display, the first image and a third image indicating that the first image is linked to information of the user. Information processing methods.

8. When the first data corresponding to the biometric information of the user acquired by the electronic pen, which is received by the receiving unit from the electronic pen, satisfies a predetermined condition, and a second data corresponding to at least one of the detection results of the acceleration, the writing pressure, and the angular velocity applied to the electronic pen, the second data being received by the receiving unit from the electronic pen. executing a process of linking information about the user to a first image input to the touch display; The first image and a third image indicating that the first image is linked to information of the user are displayed on the touch display. program.

Images