Ink volume calculation method and information processing device

Abstract

This will enable various analyses based on differences in ink usage among the groups. [Solution] An ink quantity calculation method performed by a computer having a processor, wherein the processor acquires one or more ink data which are generated in response to the operation of an electronic pen and include a series of coordinates indicating the position of the electronic pen, groups the one or more ink data into one or more groups based on the information contained in the one or more ink data, calculates the ink quantity corresponding to the one or more ink data for each of the one or more groups, and controls the display of the calculated ink quantity for each group on a display.

Description

Technical Field

[0001] The present invention relates to an ink amount calculation method, an information processing apparatus, and a program.

Background Art

[0002] Computers that receive handwritten input by an electronic pen and output the result as ink data are known. Patent Document 1 discloses an example of this type of computer.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in recent years, the scenes where handwritten input by an electronic pen is utilized have been expanding. For example, in educational sites such as schools, the introduction of electronic pens is progressing. In such a situation, for example, the utilization of electronic pens for the purpose of improving motivation for study or work is desired.

[0005] Therefore, one object of the present invention is to provide an ink amount calculation method, an information processing apparatus, and a program capable of visualizing the amount of study or work.

Means for Solving the Problems

[0006] An ink amount calculation method according to a first aspect of the present invention is an ink amount calculation method executed by a computer having a processor, wherein the processor acquires coordinate information related to stroke data generated in response to an operation of an electronic pen, and calculates an ink amount related to the operation amount of the electronic pen based on the coordinate information.

[0007] A second aspect of the present invention is an ink volume calculation method performed by a computer having a processor, characterized in that the processor extracts coordinate information related to the trajectory of the electronic pen from ink data including information related to the trajectory of the electronic pen, and calculates an ink volume indicating the amount of operation of the electronic pen based on the coordinate information.

[0008] An information processing device according to a first aspect of the present invention is an information processing device having a processor, wherein the processor acquires coordinate information related to stroke data generated in response to the operation of an electronic pen, and calculates an amount of ink related to the amount of operation of the electronic pen based on the coordinate information.

[0009] An information processing device according to a second aspect of the present invention is an information processing device having a processor, wherein the processor extracts coordinate information related to the trajectory of an electronic pen from ink data including information related to the trajectory of an electronic pen, and calculates an amount of ink indicating the amount of operation of the electronic pen based on the coordinate information.

[0010] A program according to the first aspect of the present invention is a program that causes a computer to perform the following processes: extracting coordinate information related to stroke data generated in response to the operation of an electronic pen, and calculating the amount of ink related to the amount of operation of the electronic pen based on the coordinate information.

[0011] A program according to a second aspect of the present invention is a program that causes a computer to perform the following processes: extracting coordinate information related to the trajectory of an electronic pen from ink data containing information related to the trajectory of the electronic pen, and calculating the amount of ink indicating the amount of operation of the electronic pen based on the coordinate information. [Effects of the Invention]

[0012] According to this invention, it becomes possible to visualize the amount of studying or working. [Brief explanation of the drawing]

[0013] [Figure 1] It is a diagram showing the configuration of the ink amount calculation system 1 according to an embodiment of the present invention. [Figure 2] It is a diagram showing the configuration of the user device 2 shown in FIG. 1. [Figure 3] It is a diagram showing the configuration of the server device 3 shown in FIG. 1. [Figure 4] It is a diagram showing the data stored in the ink database 5 shown in FIG. 1. [Figure 5] It is a diagram showing the data structure of the ink data shown in FIG. 4. [Figure 6] It is a diagram showing the data structure of the stroke data shown in FIG. 5. [Figure 7] It is a diagram for explaining a method of calculating the ink amount. [Figure 8] It is a flowchart showing the processing flow of the analysis processing executed by the server device 3 shown in FIG. 1. [Figure 9] It is a diagram showing a specific example 1 of the analysis processing shown in FIG. 8. [Figure 10] It is a diagram showing a specific example 2 of the analysis processing shown in FIG. 8. [Figure 11] It is a flowchart showing an example of the processing flow of the input restriction processing executed by the user device 2 shown in FIG. 1. [Figure 12] It is a flowchart showing another example of the processing flow of the input restriction processing executed by the user device 2 shown in FIG. 1.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0015] FIG. 1 is a diagram showing the configuration of an ink amount calculation system 1 according to an embodiment of the present invention. As shown in the figure, the ink amount calculation system 1 according to the present embodiment includes a plurality of user devices 2, a plurality of server devices 3, a plurality of content databases 4, a plurality of ink databases 5, and a network 6.

[0016] The user device 2 is an information processing device such as a computer that is personally used, such as a tablet computer, a smartphone, or a personal computer, and is configured to receive input by an electronic pen S. The server device 3 is an information processing device such as a computer used by a business operator that provides a service based on the “ink amount” representing the amount of input by the electronic pen S, and is composed of one or more server computers or personal computers.

[0017] The network 6 is typically the Internet and plays a role in mediating communication between computers. Each of the plurality of user devices 2 and server devices 3 shown in FIG. 1 is configured to be able to communicate with each other via this network 6.

[0018] The content database 4 and the ink database 5 are respective relational databases provided in association with individual server devices 3, and their entities are constructed in a storage device 31 (see FIG. 3) described later. The content database 4 serves to store data of content that can be described using the electronic pen S, such as data of a question set having answer fields. The ink database 5 serves to store ink data indicating the input result of the electronic pen S in the user device 2.

[0019] Figure 2 shows the configuration of the user device 2 shown in Figure 1. As shown in the figure, the user device 2 has a configuration in which a host processor 10, a storage device 11, a communication device 12, an input / output device 13, a sensor controller 14, a biosensor 15, a brightness sensor 16, a temperature sensor 17, a camera 18, a microphone 19, and a position sensor 20 are interconnected via a bus 21. The user device 2 also has a sensor 22 for receiving input from the electronic pen S. The sensor 22 is connected to the sensor controller 14.

[0020] The host processor 10 controls various parts of the user device 2 and is a processor that reads and executes various programs stored in the storage device 11. The storage device 11 includes a main memory such as DRAM (Dynamic Random Access Memory) and an auxiliary storage device such as a hard disk, and plays the role of temporarily and permanently storing various programs for running the operating system and various applications of the user device 2, as well as data used by these programs.

[0021] The applications stored in the storage device 11 and executed by the host processor 10 include drawing applications. The drawing applications display content supplied from the server device 3 and receive input from the electronic pen S to the content via the sensor controller 14, and perform processing to draw characters and shapes according to the received content. Specifically, the processing to draw characters and shapes includes the process of generating ink data that shows the input result of the electronic pen S, the process of storing the generated ink data in the storage device 11, the process of rendering the stored ink data and displaying it on the display, and the process of supplying the stored ink data to the server device 3. Details of the ink data will be described later.

[0022] When using the drawing application, the user logs in to the application by entering a pre-assigned user ID and password. When the drawing application supplies ink data to the server device 3, it also supplies the user ID entered during login to the server device 3. As will be explained in detail later with reference to Figure 3, the server device 3 is configured to manage the ink data received from the user device 2 in association with the user ID thus transmitted.

[0023] The storage device 11 also has the role of storing the amount of ink used to input ink data, which indicates the amount of operation of the electronic pen S required for input, in association with the pen ID (described later) of the electronic pen S, for the purpose of input restriction processing described later. The host processor 10 or sensor controller 14 is configured to continuously calculate the amount of ink while input is being made by the electronic pen S and to add it to the amount of ink stored in the storage device 11 in association with the pen ID of the electronic pen S. When the amount of ink stored in the storage device 11 reaches a predetermined value, it is configured to restrict input from the electronic pen S. Details of this series of processes (input restriction processing) will be explained in detail later with reference to Figures 11 and 12.

[0024] The communication device 12 is a device for communicating with external devices using wireless communication methods such as wireless LAN (Local Area Network) and 5th generation mobile communication systems, or wired communication methods such as wired LAN, and transmits and receives data according to the instructions of the host processor 10. The external devices to which the communication device 12 is connected include the network 6 and server device 3 shown in Figure 1.

[0025] The input / output device 13 includes an input device that receives user input operations and supplies them to the host processor 10, and an output device that outputs the processing results of the host processor 10 to the user. The input device comprising the input / output device 13 may include, for example, a keyboard or mouse. The output device comprising the input / output device 13 may include, for example, a display or speakers.

[0026] The sensor controller 14 and sensor 22 are devices that receive input from the electronic pen S and supply it to the host processor 10. The sensor 22 is composed of a plurality of electrodes arranged within the touch surface. The sensor controller 14 is composed of an integrated circuit that has the function of acquiring the position of the electronic pen S within the touch surface and the data transmitted by the electronic pen S by communicating with the electronic pen S via the sensor 22. The communication method between the sensor controller 14 and the electronic pen S is not particularly limited, but for example, an active electrostatic method or an electromagnetic induction method is preferred. The following explanation will continue assuming the use of an active electrostatic method.

[0027] When using the active electrostatic method for communication, the sensor controller 14 transmits an uplink signal via the sensor 22 at regular intervals. The uplink signal notifies the electronic pen S of the timing for transmitting the downlink signal and also transmits commands to control the operation of the electronic pen S. When the electronic pen S receives the uplink signal, it transmits a downlink signal at a timing corresponding to the reception timing. The downlink signal includes a position signal for the sensor controller 14 to detect its own position and a data signal for transmitting data requested by the command. When the sensor controller 14 receives the downlink signal via the sensor 22, it derives the position of the electronic pen S based on the received intensity of the position signal at each of the multiple electrodes constituting the sensor 22, and acquires the data transmitted by the electronic pen S by demodulating the data signal. The sensor controller 14 is configured to supply the acquired position and data to the host processor 10 each time they are acquired. The host processor 10 (specifically, the drawing application) generates, records, renders, etc., ink data based on the supplied position and data.

[0028] Here, the electronic pen S is configured to have a first electrode located at the tip of the pen and a second electrode located closer to the end of the electronic pen S than the tip electrode. The downlink signal described above is transmitted from the first electrode. The second electrode is used to transmit another position signal, for example, with a different frequency from the position signal transmitted from the first electrode. The sensor controller 14 derives the positions of the first electrode and the second electrode by distinguishing and detecting the position signals transmitted from each electrode, and supplies both to the host processor 10. The host processor 10 treats the position of the first electrode as the indicated position of the electronic pen S, while using the position of the second electrode to derive the tilt of the electronic pen S.

[0029] Furthermore, the electronic pen S has a pen ID, which is the identification information of the electronic pen, stored in advance. When the sensor controller 14 starts communication with the electronic pen S, it receives the pen ID from the electronic pen S via the data signal described above and stores it in the storage device 11, thereby establishing pairing with the electronic pen S. The electronic pen S is further configured to have a pressure sensor that detects the pressure applied to the pen tip and a switch that is configured to be operable by the user. The data transmitted by the electronic pen S via the data signal described above includes pressure information indicating the value of the pressure detected by the pressure sensor and switch information indicating the on / off state of the switch.

[0030] The biosensor 15 measures biometric information such as heart rate, body temperature, and posture, and plays a role in acquiring biometric information of the user while using the user device 2. The brightness sensor 16 measures the amount of incident light and plays a role in detecting the brightness of the environment in which the user device 2 is being used. The temperature sensor 17 measures temperature and plays a role in detecting the ambient temperature of the environment in which the user device 2 is being used. The camera 18 is a device that captures images using an optical system and plays a role in capturing photographs or videos of people in front of the user device 2. The microphone 19 is a device that records sound and plays a role in recording sounds occurring in the vicinity of the user device 2. The position sensor 20 is a sensor that measures position using, for example, GPS (Global Positioning System), and plays a role in acquiring the position of the user device 2. The data acquired by these biosensors 15, brightness sensor 16, temperature sensor 17, camera 18, microphone 19, and position sensor 20 are supplied to the host processor 10 in digital format. Furthermore, some or all of the biosensors 15, brightness sensors 16, temperature sensors 17, cameras 18, microphones 19, and position sensors 20 may be configured as separate devices from the user device 2.

[0031] Figure 3 shows the configuration of the server device 3 shown in Figure 1. As shown in the figure, the server device 3 has a configuration in which a CPU (Central Processing Unit) 30, a storage device 31, an input device 32, an output device 33, and a communication device 34 are interconnected via a bus 35.

[0032] The CPU 30 is a processor that controls various parts of the server device 3 and reads and executes various programs stored in the storage device 31. The storage device 31 includes a main memory such as DRAM and an auxiliary storage device such as a hard disk, and plays the role of temporarily and permanently storing various programs for running the operating system and various applications of the server device 3, as well as data used by these programs. The storage device 31 also plays the role of storing the actual contents of the content database 4 and ink database 5 shown in Figure 1.

[0033] The processes executed by the CPU 30 according to the program stored in the storage device 31 include supplying data from the content database 4 to the user device 2 in accordance with a request from the user device 2, storing the ink data supplied by the user device 2 in the ink database 5, and analyzing the ink data in the ink database 5 and outputting the analysis results. The details of the analysis process will be explained later with reference to Figures 8 to 10.

[0034] The input device 32 is a device that receives user input operations and supplies them to the CPU 30, and includes, for example, a keyboard and a mouse. The output device 33 is a device that outputs the processing results of the CPU 30 to the user, and includes, for example, a display and speakers. The communication device 34 is a device for communicating with external devices using wireless communication methods such as wireless LAN and fifth-generation mobile communication systems, or wired communication methods such as wired LAN, and transmits and receives data according to the instructions of the CPU 30. External devices to which the communication device 34 is connected include the network 6 and user device 2 shown in Figure 1.

[0035] Figure 4 shows the data stored in the ink database 5. The ink database 5 is configured to store ink data supplied from the user device 2, associating it with the user ID used when logging into the drawing application that generated the ink data. As shown in Figure 4, the ink database 5 is configured to store multiple ink data associated with a single user ID.

[0036] Figure 5 shows the data structure of ink data. As shown in the figure, ink data consists of a timestamp, stroke data, drawing style data, sensor data, and metadata. The timestamp is time information indicating the time the ink data was generated, and is assigned, for example, by the drawing application. The stroke data is data that shows the trajectory of the electronic pen S from pen down to pen up, and multiple stroke data can be stored within a single ink data.

[0037] Figure 6 shows the data structure of stroke data. As shown in the figure, stroke data consists of a timestamp, scan rate data, and coordinate information consisting of a series of data including a first coordinate, a second coordinate, pressure information, and switch information, respectively. The timestamp is time information indicating the time the stroke data was generated, and is assigned, for example, by a drawing application. The scan rate data is data indicating the frequency of coordinate acquisition, and is assigned, for example, by a drawing application. The first coordinate is data indicating the position of the first electrode as described above, and therefore the coordinate information is data related to the trajectory of the electronic pen S. The second coordinate is data indicating the position of the second electrode as described above. Pressure information and switch information are as described above.

[0038] Returning to Figure 5, the drawing style data defines the style of the lines to be drawn and is provided, for example, by a drawing application. As illustrated in Figure 5, the drawing style data includes pen tip shape data, drawing color data, and so on. The pen tip shape data indicates the shape of the pen tip of the electronic pen S and consists of information indicating the type of pen tip, such as a ballpoint pen, brush, or color marker, and information indicating the thickness of the pen tip. The drawing color data indicates the color of the lines to be drawn. The drawing application renders the ink data according to this drawing style data.

[0039] Sensor data is data acquired by various sensors (including camera 18 and microphone 19) as shown in Figure 2. The drawing application is configured to acquire data from various sensors when generating ink data and to place it within the ink data. Specifically, the contents of the sensor data are as follows: biosensor data is data indicating biological information acquired by biosensor 15, brightness sensor data is data indicating brightness detected by brightness sensor 16, temperature sensor data is data indicating temperature detected by temperature sensor 17, camera data is data indicating a photograph or video taken by camera 18, microphone data is data indicating sound recorded by microphone 19, and position sensor data is data indicating the position acquired by position sensor 20.

[0040] Metadata is additional data about the ink data, and is added, for example, by the drawing application. Metadata includes, as shown in Figure 5, the pen ID, content ID, problem ID, simultaneous viewing content URI (Uniform Resource Identifier), and character recognition results. The pen ID is the identification information of the electronic pen S used to input the ink data, and is set in the ink data based on the information received from the electronic pen S by the sensor controller 14.

[0041] The Content ID is the identifier of the content (stored in the Content Database 4) that the drawing application displayed while the user was inputting with the electronic pen S. The Problem ID is the identifier of one of the problems if the content indicated by the Content ID contains multiple problems.

[0042] Here, it is preferable that the pen ID, content ID, and question ID are stored only once in the ink data. Therefore, if the pen ID, content ID, or question ID changes due to a change in the electronic pen S being used or a change in the question being answered, it is preferable for the drawing application to temporarily terminate the generation of ink data and then start generating new ink data.

[0043] The simultaneous viewing content URI is data that indicates the address of content (such as a video) being played by another specific application within the same user device 2 while the drawing application is generating ink data. The character recognition result is text data obtained as a result of performing a predetermined character recognition process on the stroke data contained in the ink data.

[0044] Returning to Figure 1, User Device 2 and Server Device 3 are configured to have a function to calculate the amount of ink described above based on the ink data having the configuration described above. Specifically, they are configured to extract the coordinate information described above from the ink data and calculate the amount of ink based on the extracted coordinate information. The calculated amount of ink is used in Server Device 3 to perform various analyses (such as analyzing the impact of the study environment on the amount of study and the accuracy rate), and in User Device 2 to limit input by the electronic pen S. Below, we will first explain the method of calculating the amount of ink with reference to Figure 7, then explain the analysis process performed by Server Device 3 with reference to Figures 8 to 10, and finally explain the input restriction process performed by User Device 2 with reference to Figures 11 and 12.

[0045] Figure 7 illustrates the method for calculating the amount of ink. Figures 7(a) and 7(b) show examples of methods for calculating the amount of ink based on coordinate information.

[0046] Figure 7(a) shows an example of calculating the amount of ink based on the number of first coordinates included in the coordinate information. In the figure, each of the series of coordinates 100 that constitute the trajectory of the word "hello" is shown as a white circle. The drawing application renders the ink data by interpolating between these coordinates 100 using a predetermined interpolation curve 101. In the example in Figure 7(a), the stroke data is composed of 88 coordinates 100, so the server device 3 can calculate the amount of ink as 88.

[0047] Here, the server device 3 may also calculate the amount of ink based on the scan rate data described above. That is, even if the number of coordinates 100 that make up the trajectory is the same, the higher the scan rate (i.e., the higher the frequency of coordinate acquisition), the shorter the line drawn as a result of rendering will be. For example, if the scan rate doubles, the rendered line will be half the length. Therefore, the server device 3 can be configured to calculate a smaller amount of ink as the scan rate indicated by the scan rate data increases. In one example, the amount of ink can be calculated by multiplying the number of coordinates 100 by the reciprocal of the scan rate. In this way, it becomes possible to make the amount of ink proportional to the length of the line drawn as a result of rendering.

[0048] Figure 7(b) shows an example of calculating ink volume based on the area of ​​stroke data. When the drawing application draws a line based on stroke data, it is configured to draw with a line width corresponding to the pen pressure. More specifically, as shown in Figure 7(b), a circle 110 with a radius corresponding to the corresponding pen pressure (the number in circle 110 in the figure) is virtually placed at each coordinate, and the line is drawn by filling the area enclosed by two envelope lines 111a and 111b that enclose these circles. Therefore, the server device 3 can calculate the area of ​​the stroke data based on a series of coordinates and pen pressure information that constitute the trajectory, and the calculated area can be used as the ink volume. According to this, the thicker the line width, the greater the ink volume, so it is possible to reproduce the ink consumption of real ink-using pens such as ballpoint pens and color markers based on the ink volume.

[0049] Here, the server device 3 may calculate the area of ​​the stroke data based on the pen tip shape data described above, either in place of or in conjunction with the pen pressure information. As described above, the pen tip shape data includes information indicating the type of pen tip and information indicating the thickness of the pen tip, so it is possible to calculate the area of ​​the stroke data in this way as well.

[0050] Figure 8 is a flowchart showing the processing flow of the analysis process executed by server device 3. Figure 8 outlines the general flow of the analysis process, while Figures 9 and 10, shown later, will explain specific examples of the analysis process.

[0051] As shown in Figure 8, the server device 3 first extracts one or more ink data to be analyzed from the ink database 5 (step S1). Next, the server device 3 extracts various data from each ink data according to the purpose of analysis (step S2), and groups the ink data based on the extracted data (step S3). Then, the server device 3 calculates the ink amount of each ink data using the method described with reference to Figure 7, and further calculates the total ink amount for each group (step S4). After that, the server device 3 calculates other characteristic values ​​for each group as needed (step S5), generates analysis results based on the values ​​calculated up to this point, and outputs them to a display or the like (step S6).

[0052] Figure 9 shows a specific example 1 of the analysis process shown in Figure 8. Specific example 1 compares the amount of ink used (=study time) of a certain junior high school student living in Shibuya Ward (hereinafter, this student's user ID will be referred to as "Featured User ID") with the amount of ink used by all junior high school students living in Shibuya Ward on a monthly basis. Figure 9(a) is a flowchart showing the processing flow of the analysis process for this specific example 1, and Figure 9(b) shows the analysis results output as a result of the processing in Figure 9(a).

[0053] Server device 3 first extracts ink data containing user IDs of junior high school students living in Shibuya Ward from ink database 5 (step S1a). Next, server device 3 extracts timestamps and user IDs from each extracted ink data (step S2a), and groups the ink data based on the extracted timestamps and user IDs (step S3a). Specifically, it forms a first large group with the ink data of the user ID of interest, and a second large group with all the ink data extracted in step S1a. Then, based on the timestamps, it subdivides the ink data within each large group into smaller groups by month.

[0054] Next, the server device 3 calculates the amount of ink for each ink data using the method described with reference to Figure 7, and further calculates the total amount of ink for each group (step S4a). Then, without performing step S5 shown in Figure 8, the server device 3 generates and outputs the analysis results based on the values ​​calculated up to this point (step S6a).

[0055] The line graph 120 in Figure 9(b) shows the monthly total ink usage for the first major group (i.e., the group containing only the ink data of the user ID of interest), and the bar graph 121 shows the average monthly total ink usage for the second major group (i.e., the group containing all the ink data extracted in step S1a). Users who view this graph can understand at a glance whether the junior high school student corresponding to the user ID of interest is studying more than the average junior high school student in the same district. For example, the ink usage in March is higher than the average, suggesting that the student studied well, while the ink usage in other months is lower than the average, suggesting that the student is not studying enough. In particular, the ink usage in February and April is less than half of the average, suggesting the existence of some special circumstances. If the person viewing this graph is the homeroom teacher of the junior high school student corresponding to the user ID of interest, it is thought that they can understand the need for support for the student and provide appropriate support. Also, if the person viewing this graph is the junior high school student corresponding to the user ID of interest, it is thought that they can realize from this graph that they are not studying enough.

[0056] Figure 10 shows a specific example 2 of the analysis process shown in Figure 8. Specific example 2 clarifies the level of brightness under which a junior high school student living in Shibuya Ward studies, and also clarifies the relationship between brightness and the correct answer rate. Figure 10(a) is a flowchart showing the processing flow of the analysis process related to this specific example 1, and Figure 10(b) shows the analysis results output as a result of the processing in Figure 10(a).

[0057] Server device 3 first extracts ink data from ink database 5, including the user ID of a junior high school student living in Shibuya Ward and the content ID of the learning content (step S1b). Next, server device 3 extracts brightness sensor data, content ID, problem ID, and character recognition results from each extracted ink data (step S2b), and groups the ink data based on the extracted brightness sensor data (step S3b). Figure 10(b) shows an example of grouping the data into groups based on brightness indicated by the brightness sensor data: a group of 100 lux or less, a group of 100 to 500 lux, a group of 500 to 900 lux, and a group of 900 lux or more.

[0058] Next, the server device 3 calculates the amount of ink in each ink data using the method described with reference to Figure 7, and further calculates the total amount of ink for each group (step S4b). The server device 3 also calculates the correct answer rate for each group based on the content ID, question ID, and character recognition results (step S5b). Specifically, it determines whether each question ID is correct or incorrect by comparing the correct answer identified from the content ID and question ID with the character recognition results, and calculates the correct answer rate for each group as the characteristic value described above by aggregating the determination results for each ink data. Finally, the server device 3 generates and outputs the analysis results based on the values ​​calculated up to this point (step S6b).

[0059] The bar graph 122 shown in Figure 10(b) shows the total amount of ink used by each group. Users who view this graph can understand at a glance the level of lighting in which a certain junior high school student living in Shibuya Ward is studying. The shaded area 122a within the bar graph 122 represents the number of correct answers, and by checking the proportion of the shaded area 122a to the total, users can understand the relationship between brightness and the correct answer rate. For example, in the example in Figure 10(b), it can be seen that the largest number of junior high school students study under brightness levels of 500-900 lux, and their correct answer rate is also high. On the other hand, it can be seen that a certain number of junior high school students study in dim light below 100 lux or under excessive lighting above 900 lux, and these students have a lower correct answer rate. If a junior high school teacher is looking at this graph, it is thought that they can use this graph to instruct junior high school students to study under appropriate lighting, based on the evidence of correct answer rates.

[0060] The analysis processes performed by the server device 3 have been explained above, including specific examples. However, the ink volume calculation system 1 according to this embodiment can perform a variety of analysis processes other than those described here.

[0061] For example, in the example in Figure 10, by using biosensor data (e.g., heart rate) instead of light sensor data, the analysis results will allow us to understand the physical condition while studying, as well as the relationship between that condition and the accuracy rate. Similarly, in the example in Figure 10, by using humidity sensor data instead of light sensor data, the analysis results will allow us to understand the humidity while studying, as well as the relationship between humidity and the accuracy rate.

[0062] Furthermore, in the example in Figure 10, by using the volume level indicated by microphone data instead of the brightness sensor data, the analysis results make it possible to understand the surrounding noise environment while studying, as well as the relationship between the noise environment and the correct answer rate. In this case, speech recognition processing may be used to determine whether the audio indicated by the microphone data is related to the problem, and the ink data may be grouped according to the result (the proportion of what is said that is related to the problem). This would make it possible to understand, for example, the difference in the correct answer rate depending on whether or not the problem was solved under the guidance of a parent or tutor.

[0063] Furthermore, in the example shown in Figure 10, instead of grouping based on brightness sensor data, it may be possible to determine whether the writer is troubled or not, or whether a parent is accompanying them while they study, based on changes in facial expressions shown by camera data, and then group the data accordingly.

[0064] Furthermore, by using the analysis results obtained by the ink volume calculation system 1 according to this embodiment, it becomes possible to perform various analyses related to studying, such as analyzing strengths and weaknesses, analyzing efficient problem-solving methods, analyzing the correlation between repeated practice and its results, analyzing the amount of ink required to get the correct answer, and analyzing the contribution of each student in group work. In addition to analyses related to studying, it also becomes possible to realize various analyses and services such as analyzing the contribution of multiple creators when collaboratively drawing pictures, analyzing by filtering how much was written on what, providing rewards to those who put in effort (such as being able to use special pen tip shape data), a commission system based on the amount of ink used, and evaluation of work efficiency (such as whether results were achieved with a small amount of ink).

[0065] Figure 11 is a flowchart showing an example of the processing flow of input restriction processing performed by user device 2. Figure 12 is a flowchart showing another example of the processing flow of input restriction processing performed by user device 2. Figure 11 is an example in which input restriction of the electronic pen S is performed by the sensor controller 14 shown in Figure 2, and Figure 12 is an example in which input restriction of the electronic pen S is performed by a drawing application running in the host processor 10. Each of these will be explained below.

[0066] First, looking at Figure 11, the sensor controller 14 first performs communication with the electronic pen S (step S10). This communication includes the transmission of an uplink signal by the sensor controller 14 and the reception of a downlink signal transmitted by the electronic pen S, which received the uplink signal. The sensor controller 14 determines whether or not it has received a downlink signal (step S11), and if it determines that it has not received one, it cancels the pairing if pairing is in progress (step S12), and then returns to step S10.

[0067] Meanwhile, the sensor controller 14, having determined in step S11 that it has received a downlink signal, determines whether or not it is currently pairing with the electronic pen S (step S13). If it determines that it is not currently pairing, it performs pairing with the electronic pen S (step S14). The processing performed in step S14 includes sending an uplink signal instructing the electronic pen S to send a pen ID, and receiving the pen ID sent by the electronic pen S in response to the uplink signal. The sensor controller 14, having received the pen ID, stores it in the storage device 11 and outputs it to the host processor 10 (step S15).

[0068] If step S13 determines that pairing is in progress, and if step S15 is completed, the sensor controller 14 retrieves the ink amount stored in the storage device 11 in association with the pen ID stored in the storage device 11, and determines whether the retrieved ink amount is equal to or greater than a predetermined value (step S16). If it determines that the ink amount is equal to or greater than a predetermined value, it unpairs the device (step S21) and terminates the process. In this case, the user will no longer be able to use the electronic pen S.

[0069] If the sensor controller 14 determines in step S16 that the ink amount is not above a predetermined value, it derives the position of the electronic pen S based on the position signal transmitted by the electronic pen S and acquires the transmitted data of the electronic pen S based on the data signal transmitted by the electronic pen S (step S17). Next, the sensor controller 14 determines whether the electronic pen S is in a pen-down state (the pen tip is in contact with the touch surface) by referring to the pressure information contained in the transmitted data of the electronic pen S (step S18). If it is in a pen-down state, it calculates the ink amount and adds it to the ink amount stored in the storage device 11 in association with the pen ID stored in step S15 (step S19). In this case, it is preferable to calculate the ink amount based on the number of coordinates, as explained with reference to Figure 7(a), for example.

[0070] If it is determined in step S18 that the pen is not in the pen-down state, and if step S19 is completed, the sensor controller 14 outputs the acquired position and data to the host processor 10 (step S20), and returns to step S10. If the electronic pen S is in the pen-down state, the host processor 10 generates ink data based on the position and data supplied by the sensor controller 14. If the electronic pen S is not in the pen-down state, the host processor 10 uses the position supplied by the sensor controller 14 to move the cursor displayed on the display.

[0071] Next, looking at Figure 12, the drawing application first obtains the pen ID of the electronic pen S from the sensor controller 14 or the storage device 11 (step S30). Then, it obtains the amount of ink stored in the storage device 11 in association with the obtained pen ID and determines whether the obtained amount of ink is equal to or greater than a predetermined value (step S31). If it is determined that the amount of ink is equal to or greater than a predetermined value, the drawing application terminates processing without performing the ink data generation process (step S33). In this case, the user will no longer be able to use the electronic pen S.

[0072] If the drawing application determines in step S31 that the ink level is not above a predetermined value, it will acquire the position and transmission data of the electronic pen S from the sensor controller 14 (step S32), and then generate ink data based on the acquired position and data, as explained with reference to Figure 5 (step S33). Note that the data generated in step S33 is usually only a part of the ink data, and the drawing application will complete one complete ink data by repeatedly executing step S33.

[0073] The drawing application that generated the ink data calculates the amount of ink and adds it to the amount of ink stored in the storage device 11, which is associated with the pen ID obtained in step S30 (step S34). In this case, it is preferable to calculate the amount of ink based on the area of ​​the stroke data, as explained with reference to Figure 7(b). Then, the process returns to step S31 and continues.

[0074] The input restriction processing performed by the user device 2 has been explained above with two examples. As described above, the ink amount calculation system 1 according to this embodiment makes it possible to perform input restriction processing for the electronic pen S based on the ink amount using either the sensor controller 14 or the host processor 10.

[0075] As explained above, the ink volume calculation system 1 according to this embodiment calculates the amount of ink used to input ink data, which represents the amount of operation required for the electronic pen S. This makes it possible to visualize the amount of studying or working. Users of the electronic pen S can gain motivation for studying or working by looking at this visualized amount of studying or working. Teachers and supervisors can also use this visualized amount of studying or working to guide students and subordinates. Furthermore, while it was difficult to measure the amount of writing on each page in conventional learning evaluations based on the "number of pages answered," calculating the amount of ink makes it easier to grasp the amount of studying and to get a more accurate representation of the actual amount of studying.

[0076] Furthermore, according to the ink volume calculation system 1 of this embodiment, by analyzing the calculated ink volume with various metadata, it becomes possible to perform a more detailed analysis of the learning volume, for example, by understanding that the learning volume fluctuates depending on the environment. In addition, according to the ink volume calculation system 1 of this embodiment, it is also possible to perform various analyses based on the calculated ink volume and present the results to the user. Moreover, since the total value of the ink volume is known, it becomes possible to charge costs based on the ink volume when selling works generated from ink data to other companies. In other words, it becomes possible to determine the price of a work not only based on the content of the work (evaluation of its expression) but also on the amount of labor invested in the work. This is considered to be particularly effective as a form of success-based compensation when outsourcing at the individual level, such as on CrowdWorks, which has been attracting attention in recent years.

[0077] Furthermore, the ink volume calculation system 1 according to this embodiment allows for limiting input from the electronic pen S according to the amount of ink, making it possible to sell ink separately from the electronic pen S itself, or to flexibly promote the use of the electronic pen S by offering trial periods up to a predetermined amount of ink. In addition, it becomes possible to build a system similar to an analog pen by setting limits on the amount of ink that can be used and prompting the user to purchase more when the ink runs out, or by changing the rate of ink consumption according to the strength of the writing pressure.

[0078] Although preferred embodiments of the present invention have been described above, the present invention is not limited in any way to these embodiments, and it goes without saying that the present invention can be implemented in various forms without departing from its essence.

[0079] For example, the server device 3 may store information about the electronic money or points held by the user, associating it with the user ID, and award electronic money or points according to the amount of ink used. This makes it possible to provide an incentive for the user of the electronic pen S to increase the amount of ink used (i.e., to study or work hard). In the case of a student user, it is preferable that the awarded electronic money or points be usable at stores within the school or nearby.

[0080] Furthermore, although the above embodiment describes an example in which the server device 3 performs the ink quantity analysis processing, the user device 2 may also perform the analysis processing. In this case, the user device 2 may perform the analysis processing based on the ink data it generates.

[0081] Furthermore, in the above embodiment, an example was described in which input by the electronic pen S is uniformly restricted when the ink level reaches a predetermined value. However, input restrictions may also be applied to each piece of content, for example, by allowing the user to solve problems only until the ink level reaches a predetermined value. [Explanation of Symbols]

[0082] 1. Ink volume calculation system 2. User devices 3 Server equipment 4. Content Database 5 Ink Database 6 Network 10 host processors 11 Storage device 12. Communication equipment 13 Input / Output Devices 14 Sensor Controller 15. Biosensors 16. Brightness sensor 17 Temperature sensor 18 Cameras 19 Mike 20 Position Sensors 21 Bus 22 sensors 30 CPU 31 Storage device 32 Input devices 33 Output device 34 Communication equipment 35 bus S Electronic Pen

Claims

1. A method for calculating the amount of ink, which is performed by a computer having a processor, The aforementioned processor, One or more ink data sets are obtained, which are ink data generated in response to the operation of the electronic pen and include a series of coordinates indicating the position of the electronic pen. Based on the information contained in the one or more ink data, the one or more ink data are grouped into one or more groups. For each of the one or more groups, calculate the amount of ink corresponding to the one or more ink data. The display of the calculated ink amount for each group is controlled on the display. A method for calculating ink volume characterized by the following features.

2. The grouping is performed based on the timestamp included in the one or more ink data. The method for calculating the amount of ink according to feature 1.

3. The grouping is performed based on data included in the one or more ink data, which is sensor data detected by the sensor. The method for calculating the amount of ink according to feature 1.

4. The processor restricts input from the electronic pen based on the amount of ink corresponding to the one or more ink data acquired. The method for calculating the amount of ink according to feature 1.

5. The processor awards electronic money or points based on the amount of ink corresponding to the one or more ink data acquired. The method for calculating the amount of ink according to feature 1.

6. The processor calculates the amount of ink based on the number of the series of coordinates. The method for calculating the amount of ink according to feature 1.

7. The aforementioned processor, Obtain scan rate data indicating the scan rate of the aforementioned coordinates, The amount of ink is calculated based on the number of coordinates in the series and the scan rate data. The method for calculating the amount of ink according to feature 6.

8. The aforementioned processor, Pen tip shape data indicating the shape of the pen tip of the aforementioned electronic pen is acquired, The amount of ink is calculated based on the area calculated based on the series of coordinates and the pen tip shape data. The method for calculating the amount of ink according to feature 1.

9. An information processing device having a processor, The aforementioned processor, One or more ink data sets are obtained, which are ink data generated in response to the operation of the electronic pen and include a series of coordinates indicating the position of the electronic pen. Based on the information contained in the one or more ink data, the one or more ink data are grouped into one or more groups. For each of the one or more groups, calculate the amount of ink corresponding to the one or more ink data. The display of the calculated ink amount for each group is controlled on the display. An information processing device characterized by the following:

10. The processor performs the grouping based on the timestamp included in the one or more ink data. The information processing apparatus according to feature 9.

11. The processor performs the grouping based on data included in the one or more ink data, which is sensor data detected by the sensor. The information processing apparatus according to feature 9.

12. The processor restricts input from the electronic pen based on the amount of ink corresponding to the one or more ink data acquired. The information processing apparatus according to feature 9.

13. The processor awards electronic money or points based on the amount of ink corresponding to the one or more ink data acquired. The information processing apparatus according to feature 9.

14. The processor calculates the amount of ink based on the number of the series of coordinates. The information processing apparatus according to feature 9.

15. The aforementioned processor, Obtain scan rate data indicating the scan rate of the aforementioned coordinates, The amount of ink is calculated based on the number of coordinates in the series and the scan rate data. The information processing apparatus according to feature 14.

16. The aforementioned processor, Pen tip shape data indicating the shape of the pen tip of the aforementioned electronic pen is acquired, The amount of ink is calculated based on the area calculated based on the series of coordinates and the pen tip shape data. The information processing apparatus according to feature 9.

Images