Information processing device and information processing method
The device maintains a one-to-one correspondence between paper pages and files by identifying written areas and confirming file operations, addressing the issue of incorrect file associations during standby mode or user oversight.
Patent Information
- Application Number
- JP2022532291
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-06-15
- Filing Date
- 2021-02-24
- Publication Date
- 2024-12-09
- Estimated Expiration
- 2041-02-24
AI Technical Summary
Existing information processing devices fail to maintain a one-to-one correspondence between pages of a paper medium and files storing handwritten data, leading to unintentional recording of handwritten information across multiple files due to standby mode transitions or user oversight, resulting in incorrect file associations.
The device includes a control unit that identifies written and unwritten areas on pages to determine file combination or division, ensuring that handwritten data from the same page is stored in a single file, and optionally confirms file operations with the user.
Prevents handwritten information from being unintentionally recorded in multiple files, maintaining a one-to-one correspondence between paper pages and files, and ensuring accurate file management even during standby mode or user errors.
Smart Images

Figure 0007596381000002 
Figure 0007596381000003 
Figure 0007596381000004
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing apparatus and an information processing method. [Background technology]
[0002] There is known a handwritten data drawing device that allows the handwriting of a user writing characters or pictures on a paper medium such as a report paper to be electronically captured as handwritten data. This type of device generally includes a position detection device such as a digitizer and a stylus having both a function as an indicator and a function as a ballpoint pen. The paper medium is placed on the touch surface of the position detection device. With this configuration, when a user writes characters or pictures on the surface of the paper medium using the ballpoint pen function of the stylus, the position detection device can obtain a series of coordinate data indicating the movement trajectory of the stylus on the touch surface. The series of coordinate data obtained in this manner becomes handwritten data indicating the handwriting of the electronic pen.
[0003] Incidentally, the paper medium used in the handwritten data drawing device may have multiple pages. In this case, the handwritten data drawing device needs to create handwritten data for each page separately. Otherwise, the handwriting written on each of the multiple pages of the paper medium will overlap on one page on the screen. In this regard, Patent Document 1 discloses a technology in which a position detection device is provided with an operation button for switching the file in which the coordinate data is stored to a new file, thereby creating a file of handwritten data for each page. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 6005880 Summary of the Invention [Problem to be solved by the invention]
[0005] Incidentally, some position detection devices are designed to automatically enter a standby mode if no operation is performed for a predetermined period of time (e.g., 15 minutes) in order to save power. In this case, the file in which the coordinate data is being stored is temporarily closed when the device enters the standby mode, and the coordinate data is stored in a new file after the device returns from the standby mode.
[0006] However, with this type of standby processing, even if the user writes on the same page of the paper medium before and after the standby mode, after returning from the standby mode, the coordinate data is stored in a file different from that before the standby mode was entered. In this case, handwritten characters written on the same page of the paper medium are recorded in a state where they are divided into multiple files, which can be mistakenly recognized as if they were written on multiple pages, and therefore improvement was required.
[0007] In addition, according to the technology of Patent Document 1, if the user forgets to press the operation button, the handwritten data written on each of the multiple pages of the paper medium will be accumulated in one file. This also means that the pages of the paper medium and the files no longer correspond one-to-one, and therefore improvement was required.
[0008] SUMMARY OF THE PRESENT EMBODIMENTS It is therefore an object of the present invention to provide an information processing apparatus and an information processing method that can establish a one-to-one correspondence between a page of a paper medium and a file that stores handwritten data. [Means for solving the problem]
[0009] An information processing device according to the present invention includes a memory unit that stores handwritten data generated in response to handwritten input on a sheet-like recording medium as a first file and a second file corresponding to a first and second page, respectively, and a control unit that determines whether to merge the first file and the second file based on a first identification result that identifies an area on the first page where handwritten data is written or an area on the first page where handwritten data is not written based on the handwritten data stored in the first file, and a second identification result that identifies an area on the second page where handwritten data is written or an area on the second page where handwritten data is not written based on the handwritten data stored in the second file, and controls the first file and the second file to be merged if it is determined that they should be merged.
[0010] The information processing method according to the present invention is an information processing method executed by an information processing device having a memory unit that stores handwritten data generated in response to handwritten input on a sheet-like recording medium as a first file and a second file corresponding to a first and second page, respectively, and includes a determination step of determining whether to merge the first file and the second file based on a first identification result that identifies an area on the first page where handwritten data is written or an area on the first page where handwritten data is not written, based on the handwritten data stored in the first file, and a second identification result that identifies an area on the second page where handwritten data is written or an area on the second page where handwritten data is not written, based on the handwritten data stored in the second file, and a control step of controlling the first file and the second file to be merged if it is determined that they should be merged. Effect of the Invention
[0011] According to the present invention, it is possible to prevent handwritten information written on the same page of a paper medium from being unintentionally recorded in multiple files. [Brief description of the drawings]
[0012] [Figure 1] 1 is a diagram showing a position detection device 10 and a tablet terminal 30 according to an embodiment of the present invention. [Diagram 2] 2 is a diagram showing the internal configuration of the position detection device 10 and the tablet terminal 30. FIG. [Diagram 3] FIG. 2 is a diagram showing a detailed configuration of a touch panel 15. [Figure 4] 2 is a diagram showing handwritten data output from a sensor controller 16, a file for storing the handwritten data, and stroke data stored in a memory 34 by a control unit 33. FIG. [Diagram 5] 1(a) and (b) are diagrams showing examples of the filled-in states of pages #1 and #2 according to the first aspect of the present invention, respectively. [Figure 6] FIG. 2 is a flow chart showing file merging processing according to the first aspect of the present invention. [Figure 7] FIG. 13 is a diagram showing an example of a result of drawing, on the touch screen 31, one or more scroll data stored in the file #n according to the second aspect of the present invention. [Figure 8] FIG. [Figure 9] FIG. [Figure 10] 7. Only the characters corresponding to point numbers 1 to 899 among the characters shown in FIG. 7 are drawn superimposed on the page coordinates shown in FIG. [Figure 11] Of the multiple characters shown in FIG. 7, only the characters corresponding to point numbers 900 and after are drawn superimposed on the page coordinates shown in FIG. [Figure 12] FIG. 13 is a schematic diagram showing the relationship between point numbers and page coordinates for one file containing handwriting that spans two pages. [Figure 13] FIG. 11 is a flow chart showing file division processing according to a second aspect of the present invention. [Figure 14] FIG. 11 is a flow chart showing file division processing according to a second aspect of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.
[0014] 1 is a diagram showing a position detection device 10 and a tablet terminal 30 according to an embodiment of the present invention. The position detection device 10 has a built-in capacitive touch panel, and is a device that detects the position of a stylus S on a touch surface 10a shown in the figure by using this touch panel. However, the position detection device 10 may also have a built-in electromagnetic induction touch panel instead of the capacitive touch panel.
[0015] The stylus S is compatible with an active electrostatic method and functions as an indicator for indicating a position on the touch surface 10a, and also functions as a writing implement (e.g., a ballpoint pen) for leaving visible handwriting on the surface of a sheet-like recording medium such as paper. The tablet terminal 30 is an information processing device having a touch screen 31 that supports touch input. The position detection device 10 and the tablet terminal 30 are connected to each other by wireless communication such as Bluetooth (registered trademark) or wired communication such as USB.
[0016] The X direction and the Y direction shown in FIG. 1 correspond to the horizontal direction and the depth direction, respectively, as seen by the user of the position detection device 10. The position detection device 10 has a rectangular shape with one side in the Y direction longer than the other side in the X direction, and as shown in FIG. 1, a rectangular notepad NP, which is a little smaller than the position detection device 10, is mounted on the touch surface 10a as a sheet-like recording medium and is used. As will be described in detail later, when a user writes characters or draws pictures on the surface of the notepad NP using a stylus S as a writing implement, the position detection device 10 detects the trajectory of the stylus S as a series of coordinate data. The tablet terminal 30 acquires the series of coordinate data from the position detection device 10, generates stroke data, and displays it on the touch screen 31. FIG. 1 shows a state in which the character string "MAKING IDEAS" written by the user on the notepad NP is displayed on the touch screen 31 of the tablet terminal 30 by these processes. Although paper is generally used as the sheet-like recording medium, resin or other materials may also be used.
[0017] As shown in FIG. 1, the position detection device 10 is configured to have a power / operation button 11, a power lamp 12, a mount storage section 13, and a stylus fixing section 14. Among these, the power / operation button 11 is a switch for turning on and off the power of the position detection device 10, and is also a switch for accepting a page break instruction from the user. When the power / operation button 11 is continuously pressed for a predetermined time or more (i.e., when pressed for a long time), the position detection device 10 turns on or off the power of the position detection device 10. On the other hand, when the power / operation button 11 is pressed but the pressed state is released before the predetermined time is reached (i.e., when pressed for a short time), the position detection device 10 accepts a page break instruction from the user. Also, the power lamp 12 is a lamp that is turned on when the power of the position detection device 10 is on and is turned off when the power is off.
[0018] Here, a page is a concept corresponding to a block of handwritten data generated in response to handwritten input, or a file including this block of handwritten data. Therefore, handwritten data or a file generated by handwriting input on each page of a sheet-like recording medium consisting of multiple pages is associated with each page. Alternatively, when handwritten data generated by handwriting input on the same page of a sheet-like recording medium is divided into multiple handwritten data or files by standby mode operation or intentional operation by the user, each divided handwritten data or file is associated with a page.
[0019] The mount storage section 13 is an opening configured so that the mount of the notepad NP can be inserted. The user fixes the notepad NP to the position detection device 10 by inserting the mount of the notepad NP into the mount storage section 13. The stylus fixing section 14 is a recess for fixing the stylus S. When the stylus S is not in use, the user fixes the stylus S to the position detection device 10 by fitting the end of the stylus S into the recess of the stylus fixing section 14 with the clip of the stylus S inserted into the mount storage section 13.
[0020] The position detection device 10 is configured to accumulate a series of coordinate data detected sequentially in one file as a basic operation. Therefore, if a user writes on multiple pages while flipping through the notepad NP, one file will contain coordinate data of handwriting on different pages. If the series of coordinate data accumulated in this way is displayed on the touch screen 31 of the tablet terminal 30, the handwriting on multiple pages will be displayed overlapping each other.
[0021] Since this is not practical, the position detection device 10 is configured so that the user can instruct a page break. Specifically, when the user briefly presses the power / operation button 11, the position detection device 10 accepts the page break instruction as described above, and switches the file in which the coordinate data is stored to a new file. This operation creates a file of handwritten data for each page, preventing handwriting on multiple pages from overlapping and being displayed on the touch screen 31 as described above.
[0022] However, in reality, there are cases where the user forgets to briefly press the power / operation button 11. In that case, handwriting on multiple pages will overlap and be displayed on the touch screen 31, so the tablet terminal 30 has a configuration for dividing the file afterwards. This point will be described in detail later as a second aspect of the present invention.
[0023] Furthermore, in order to save power, the position detection device 10 is designed to automatically enter a standby mode if no operation is performed for a predetermined period of time (e.g., 15 minutes). The operation here includes detection of coordinate data of the stylus S. The position detection device 10 that has entered the standby mode is configured to save power consumption by not performing any operation other than detecting the pressing of the power / operation button 11, for example. The position detection device 10 that detects the pressing (long press or short press) of the power / operation button 11 while in the standby mode is configured to return from the standby mode and start operations other than detecting the pressing of the power / operation button 11 that had been stopped.
[0024] Here, the position detection device 10 is configured to close the file in which the coordinate data is being stored when entering the standby mode in order to prevent the file from being destroyed or lost. Also, after returning from the standby mode, a new file is generated and the coordinate data is stored therein. According to such a configuration of the position detection device 10, it is possible to prevent the file from being destroyed or lost, while even if the user writes on the same page of the paper medium before and after the standby mode, the coordinate data is stored in a file different from that before entering the standby mode after returning from the standby mode. In that case, handwritten data written on the same page will be treated as being written on different pages, so the tablet terminal 30 also has a configuration for later combining handwritten data written on the same page into one file. This point will be described in detail later as a first aspect of the present invention.
[0025] 2 is a diagram showing the internal configurations of the position detection device 10 and the tablet terminal 30. As shown in the figure, the position detection device 10 further includes a touch panel 15, a sensor controller 16, a memory 17, and a wireless communication unit 18. Moreover, the tablet terminal 30 includes a touch screen 31 also shown in FIG. 1, as well as a wireless communication unit 32, a control unit 33, and a memory 34.
[0026] The touch panel 15 is a projected capacitive touch panel (PCAP) that supports active electrostatic position detection of the stylus S and capacitive position detection of a finger.
[0027] 3 is a diagram showing a detailed configuration of the touch panel 15. As shown in the figure, the touch panel 15 is configured to have a plurality of linear electrodes 15x, 15y arranged to cover the entire touch surface 10a. The plurality of linear electrodes 15x are linear electrodes extending in the Y direction and arranged at equal intervals in the X direction perpendicular to the Y direction. The plurality of linear electrodes 15y are linear electrodes extending in the X direction and arranged at equal intervals in the Y direction. Each of the plurality of linear electrodes 15x, 15y is connected to the sensor controller 16.
[0028] Returning to Fig. 2, the sensor controller 16 is an integrated circuit that detects the position of the stylus S using the touch panel 15 and also receives data transmitted by the stylus S. The sensor controller 16 also performs processing to detect the position of a finger on the touch surface 10a using the touch panel 15. The position detection of the stylus S is performed by an active electrostatic method, and the position detection of the finger is performed by a capacitive method.
[0029] Detection of the stylus S by the sensor controller 16 will be described with reference to Fig. 3 again. The sensor controller 16 is configured to periodically transmit an uplink signal using all of the linear electrodes 15x (or the linear electrodes 15y) shown in Fig. 3. The uplink signal is a signal that has a role of notifying the stylus S of the transmission timing of the downlink signal and a role of transmitting a command to the stylus S.
[0030] The stylus S that has received the uplink signal transmits a downlink signal at a timing indicated by the uplink signal. When the stylus S has not yet been paired with the sensor controller 16, the downlink signal is composed of an unmodulated burst signal of a predetermined time length. Hereinafter, this burst signal is referred to as a "position signal". On the other hand, when the stylus S is paired with the sensor controller 16, the downlink signal is composed of a position signal of a shorter time length and a data signal. The data signal is a signal modulated by data instructed by a command included in the uplink signal. Examples of data transmitted by the data signal include a writing pressure value indicating the pressure applied to the tip of the stylus S, switch information indicating the on / off state of a button provided on the stylus S, and a pen ID previously stored in the stylus S.
[0031] If the sensor controller 16 is not yet paired with the stylus S, after transmitting the uplink signal, it scans all of the linear electrodes 15x, 15y to attempt to detect the downlink signal transmitted by the stylus S over the entire touch surface 10a (global scan). If the downlink signal is detected by this detection, the sensor controller 16 detects the position of the stylus S based on the reception strength of the downlink signal at each of the linear electrodes 15x, 15y, and performs a predetermined pairing operation with the stylus S. Upon completion of this operation, the sensor controller 16 and the stylus S are in a paired state.
[0032] After transmitting the uplink signal, the sensor controller 16 paired with the stylus S scans only a predetermined number of the linear electrodes 15x, 15y in the vicinity of the last detected position of the stylus S, thereby attempting to detect the position signal transmitted by the stylus S in only a part of the touch surface 10a (local scan). Then, the sensor controller 16 acquires a new position of the stylus S based on the reception strength of the downlink signal at each of the linear electrodes 15x, 15y. Next, the sensor controller 16 receives the data signal transmitted by the stylus S by scanning only one of the linear electrodes 15x, 15y in the vicinity of the last detected position of the stylus S. Then, the sensor controller 16 acquires the data transmitted by the stylus S by demodulating the received data signal.
[0033] Returning to FIG. 2, the memory 17 is a storage unit configured to manage data on a file-by-file basis. The sensor controller 16 is configured to write coordinate data indicating the position of the stylus S detected by the active electrostatic method and data received from the stylus S (hereinafter collectively referred to as "handwritten data") to a file in the memory 17. In this way, a series of handwritten data indicating the user's handwriting is accumulated in the file. The files are stored in the memory 17 in order of generation, such as #1, #2, ...
[0034] 4 is a diagram showing handwritten data output from the sensor controller 16 and a file for storing the handwritten data. The sensor controller 16 in this example is configured to generate handwritten data including coordinate data (X, Y) indicating the position of the stylus S, the pen pressure value P and switch information SW1, SW2 received from the stylus S, and timestamp information indicating the time T at which the position was detected, and output the data to the memory 17. The following description will be continued assuming this example.
[0035] The sensor controller 16 is configured to generate a new file in the memory 17 when the position detection device 10 is powered on, when the position detection device 10 returns from the standby mode, and when a short press of the power / operation button 11 is detected. In Fig. 4, file #1 is a file generated in response to powering on the position detection device 10, file #2 is a file generated in response to return from the standby mode, and file #3 is a file generated in response to detection of a short press of the power / operation button 11. When the sensor controller 16 generates a new file, it changes the output destination of the handwritten data to that file.
[0036] Returning to FIG. 2, the wireless communication unit 18 is a functional unit that retrieves a file stored in the memory 17 and transmits it to the tablet terminal 30. The wireless communication unit 18 may retrieve and transmit a file in response to a transmission instruction from the tablet terminal 30, or in response to a user's operation on an operation means provided in the position detection device 10. In addition, when the position detection device 10 and the tablet terminal 30 approach each other within a distance where communication is possible, the wireless communication unit 18 may be configured to automatically transmit the handwritten data. In addition, the wireless communication unit 18 may transmit the stored handwritten data together with information specifying the page on which the handwritten data is written, each time handwritten data for one coordinate is stored in the memory 17 by the sensor controller 16, instead of in file units. In this way, it becomes possible to display the handwritten data in real time on the touch screen 31 of the tablet terminal 30. In this case, the management of the files is performed on the tablet terminal 30 side.
[0037] Moving on to the tablet terminal 30, the wireless communication unit 32 receives the handwritten data from the position detection device 10 and supplies it to the control unit 33. The control unit 33 generates stroke data, which is vector data for drawing, based on the series of handwritten data supplied from the wireless communication unit 32, and stores it in the memory 34.
[0038] 4 also shows stroke data stored in memory 34 by control unit 33. As shown in the figure, stroke data is data including one or more handwritten data, and control unit 33 is configured to compile one or more stroke data for each file and store them in memory 34. Here, memory 34 is a storage unit configured to manage data on a file-by-file basis, similar to memory 17. The order of files in memory 17 is also maintained in memory 34.
[0039] A method for generating stroke data by the control unit 33 will be described in detail. To generate stroke data from a series of handwritten data, the control unit 33 first determines a boundary between strokes by referring to the pen pressure value P in each handwritten data. That is, a unit of handwritten data with a corresponding pen pressure value P of zero is acquired in a hover state, and therefore does not contribute to the handwriting. Therefore, the control unit 33 excludes such handwritten data from the targets for generating stroke data, and determines a place where the excluded handwritten data is included as a boundary between strokes. Then, one stroke data is generated from a set of one or more handwritten data detected by this boundary.
[0040] When generating stroke data, the control unit 33 refers to the timestamp information of each piece of handwritten data to assign order information to each piece of generated stroke data. As a result, the stroke data in the file stored in the memory 34 are ordered in the order of writing. In the example of FIG. 4, data written as "order n" (n is a natural number) is the order information, and the natural number n indicates the order of writing.
[0041] The control unit 33 is also configured with a function to retrieve files stored in the memory 34, render each stroke data contained therein, and display the results on the touch screen 31, as well as a function to recognize the user's touch operations on the touch screen 31 and perform processing according to the content of the operations.
[0042] In addition to the above functions, the control unit 33 is configured to have a function of combining and dividing files stored in the memory 34. Among these, the function of combining files corresponds to the above-mentioned first aspect of the present invention, and the function of dividing files corresponds to the above-mentioned second aspect of the present invention. Hereinafter, the processing performed by the control unit 33 will be described in detail in the order of the first aspect of the present invention and the second aspect of the present invention. Note that in this embodiment, a case where files storing stroke data (files stored in the memory 34) are combined or divided will be described as an example, but the control unit 33 may combine or divide files storing handwritten data (files stored in the memory 17). In this case, it is preferable that the control unit 33 first copies or creates a file storing handwritten data in the memory 34, and then performs the combining or dividing process on the copied or created file.
[0043] 5(a) and (b) are diagrams showing an example of the writing state of pages #1 and #2 according to the first aspect of the present invention. Pages #1 and #2 correspond to two files #n and #n+1, respectively, among a plurality of files stored in order in memory 34. The English sentences written on pages #1 and #2 were written by the user from top to bottom on one page of a paper medium. However, when the user stopped writing for a while in the middle of writing and the position detection device 10 entered the standby mode, the English sentences are divided into two files in memory 17 and 34 as shown in FIG. 5.
[0044] Here, when writing text on one page of paper medium, the user writes from one end in the Y direction of the page (the end where writing starts) to the other end in the Y direction (the end where writing ends) while starting lines, and within a line, writes from one end in the X direction to the other end in the X direction. Note that the "one end in the Y direction" as the writing start end is the "top end" when the user writes horizontally on the paper medium, and the "left end" when writing vertically. The following explanation will be continued assuming horizontal writing, but the present invention can also be applied to vertical writing.
[0045] Since the user continues writing as described above, if the file is changed in the middle of one page of the paper medium, as illustrated in Fig. 5(a)(b), an area of a predetermined length from the top end of page #2 corresponding to the second file #n+1 becomes a blank area EA, and the bottom end F2y (end) of this blank area EA is located substantially lower (toward the end of writing) than the bottom end E1y (end) of the written area FA in page #1 corresponding to the first file #n. The word "substantially" is added here to take into consideration the case where each line is written with an upward slant to the right as in the example of Fig. 5, or the case where a file is switched within a line. The control unit 33 according to the first aspect of the present invention is configured to determine whether or not files #n and #n+1 can be combined by finding this relationship, and to execute a process of combining files #n and #n+1 according to the result. By this combining process, each handwritten input divided into multiple files is combined again as a series of handwritten input.
[0046] 6 is a flow diagram showing file merging processing according to the first aspect of the present invention. Hereinafter, the processing of the control unit 33 according to the first aspect of the present invention will be specifically described with reference to this flow diagram.
[0047] First, the control unit 33 assigns 1 to the variable n (step S1). Next, the control unit 33 attempts to select two files #n and #n+1 stored in the memory 34 (step S2), and determines whether or not the selection has been successful (step S3). If the control unit 33 is unable to select the files #n and #n+1 here, it ends the file combination process.
[0048] Next, the control unit 33 sets valid areas EZ in pages #1 and #2 corresponding to files #n and #n+1, respectively (step S4). The valid area EZ is an area within a page sandwiched between safe zones SZ provided at the top and bottom of each page, as shown in FIG. 5. The safe zone SZ is an area where the user normally does not write anything. The specific size of each safe zone SZ can be set by the user.
[0049] Next, the control unit 33 acquires a first identification result for identifying an area on page #1 where handwritten data is written or an area where handwritten data is not written, based on the handwritten data stored in the file #n (step S5). The first identification result is preferably generated based on the end information of the handwritten data stored in the file #n (the lower end E1y shown in FIG. 5(a)), and is assumed to be the written area FA described above here. In this case, the written area FA is preferably an area including all stroke data corresponding to the file #n. Specifically, the maximum and minimum values are acquired from the y coordinate (coordinate information) included in the coordinates constituting each stroke data stored in the file #n, and the area sandwiched between a straight line extending in the X direction at a position corresponding to the acquired maximum value and a straight line extending in the X direction at a position corresponding to the acquired minimum value may be detected as the written area FA. In the example of FIG. 5(a), the upper end of the written area FA coincides with the upper end of the valid area EZ, but the upper end of the written area FA does not have to coincide with the upper end of the valid area EZ.
[0050] Next, the control unit 33 obtains a second identification result for identifying an area on page #2 where handwritten data is written or an area where handwritten data is not written, based on the handwritten data stored in file #n+1 (step S6). The second identification result is preferably generated based on the start end information (bottom end F2y shown in FIG. 5(b)) of the handwritten data stored in file #n+1, and here, it is a blank area EA located above (on the writing start end side) as viewed from the written area on page #2, among one or more blank areas included in page #2. Specifically, the written area on page #2 is detected in the same manner as in step S6, and an area on the above side (on the writing start end side) where no stroke data exists may be detected as the blank area EA.
[0051] Subsequently, the control unit 33 determines whether the blank area EA could be detected in step S6 (step S7). If it is determined that the blank area could not be detected, n is incremented by 1 (step S12), and the process returns to step S2. If there is no blank area above the filled area of page #2, file #n+1 should not be a target for merging with file #n. Therefore, by performing step S7, the processing when the files are not merged can be speeded up.
[0052] When it is determined in step S7 that the blank area could be detected, the control unit 33 executes steps S8 to S11 shown below, and based on the arrangement relationship of the areas where the handwritten data is entered or the areas where the handwritten data is not entered on each of page #1 and page #2, in other words, based on the first identification result and the second identification result, determines whether to merge files #n and #n+1.
[0053] Specifically, the control unit 33 first obtains the lower end E1y of the filled area FA detected in step S5 (step S8), and at the same time obtains the lower end F2y of the blank area EA detected in step S6 (step S9). Then, based on the obtained lower ends E1y and F2y, the control unit 33 determines whether to merge files #n and #n+1 (step S10). Specifically, the determination in step S10 is made by determining whether F2y is smaller than E1y + 10 (F2y < E1y + 10). The number "10" used in this determination is merely an example, and for example, a predetermined value set by user settings may be used.
[0054] F2y being smaller than E1y+10 means that the bottom end of the blank area EA detected in step S6 is substantially located below the bottom end of the written area FA detected in step S5. This means that there is a high possibility that the written area FA detected in step S5 can be placed in the blank area EA detected in step S6, so if the control unit 33 determines that F2y is smaller in step S10, it performs a process of combining file #n+1 with file #n (step S11). This combining can be performed by, specifically, moving all stroke data in file #n+1 to the end of file #n. In step S11, the control unit 33 also performs a process of incrementing the numbers of files #n+2 and after by 1. On the other hand, if it is determined that F2y is not smaller in step S10, the control unit 33 increments n by 1 without combining the files (step S12) and returns the process to step S2.
[0055] After executing step S11, the control unit 33 returns the process to step S2 without incrementing n. This makes it possible to appropriately combine files even if the standby mode is entered multiple times while writing on one page of the paper medium.
[0056] As described above, according to the function of the tablet terminal 30 relating to the first aspect of the present invention, multiple files storing the results of entries made on the same page of a paper medium can be combined into a single file, so that even if the one-to-one correspondence between the pages of the paper medium and the files is no longer established because the position detection device 10 has entered standby mode, it is possible to establish a one-to-one correspondence between the pages of the paper medium and the files that store handwritten data.
[0057] Next, FIG. 7 is a diagram showing an example of the result of drawing one or more scroll data stored in the file #n according to the second aspect of the present invention on the touch screen 31. The user writes the English sentence shown in FIG. 5(a) on one page of the paper medium, then turns the page and writes the English sentence shown in FIG. 5(b) on another page of the paper medium, but forgets to briefly press the power / operation button 11 when turning the page, and as a result, stroke data corresponding to each of the two pages is accumulated in one file #n. As a result, the handwriting on the two pages of the paper medium is displayed overlapping on one page #1 on the touch screen 31.
[0058] 8 and 9 are diagrams showing point numbers and page coordinates, respectively. The control unit 33 is configured to use the point numbers and page coordinates to execute the process according to the second aspect of the present invention.
[0059] The point number is additional information based on the number of strokes corresponding to the handwritten input, and here, it is a number indicating the serial number of each point indicating one or more stroke data included in one file. Fig. 8 shows an example in which point numbers are assigned to the end points of stroke data and points curved with a curvature of a predetermined value or more. However, the points to which point numbers should be assigned are not limited to these, and may be, for example, control points used when drawing stroke data (such as control points of a Catmull-Rom curve), or points (coordinate data) included in each of one or more handwritten data used by the control unit 33 to generate stroke data.
[0060] The page coordinates are numbers indicating the serial numbers of each cell obtained by dividing a page into a grid, and are assigned to each cell so that the numbers increase in the direction in which the character string is written, as shown in Figure 9. Figure 9 shows an example of dividing a page into 425 cells.
[0061] Fig. 10 is a diagram showing only the characters corresponding to point numbers 1 to 899 among the characters shown in Fig. 7, superimposed on the page coordinates shown in Fig. 9. Fig. 11 is a diagram showing only the characters corresponding to point numbers 900 and onward among the characters shown in Fig. 7, superimposed on the page coordinates shown in Fig. 9. As can be understood from these diagrams, assuming that the user writes text on a page in the above-mentioned writing manner (i.e., writing from one end of the page in the Y direction to the other end in the Y direction while starting a new line, and writing from one end of the X direction to the other end in the line), when handwriting on two pages is displayed on the touch screen 31 overlapping, the corresponding page coordinates will decrease significantly as the writing page is switched.
[0062] FIG. 12 is a diagram showing a relationship between point numbers and page coordinates for one file including handwriting on two pages. As shown in the figure, the point numbers (1 to 902 in FIG. 12) corresponding to the handwriting on the first page can be roughly approximated linearly, while the point numbers (903 to 904 in FIG. 12) corresponding to the handwriting on the second page are plotted at a position significantly deviated from the straight line of this approximation. Therefore, the control unit 33 according to the second aspect of the present invention is configured to obtain a correlation coefficient between the point numbers and the page coordinates, determine whether a page has been turned based on the obtained correlation coefficient, and execute a file division process according to the result. That is, in order to avoid recording the handwritten input as one file when it should be divided into multiple handwritten data corresponding to each page and stored as multiple files, the file division process is executed by taking into consideration, for example, the above-mentioned additional information corresponding to the page turning.
[0063] 13 and 14 are flow diagrams showing a file division process according to the second aspect of the present invention. Hereinafter, the process of the control unit 33 according to the second aspect of the present invention will be specifically described with reference to these flow diagrams.
[0064] First, the control unit 33 acquires a file #n to be processed (step S20). Next, the control unit 33 calculates a total of N points P i The control unit 33 then determines a point number (i=1 to N) (step S21). The variable i is the point number described above. The control unit 33 then assigns 1 to the variable i and 0 to the variable MPC (step S22). The variable MPC is the point number P that is a candidate for moving to another file in the process described below. i This is a variable that stores the number of
[0065] Next, the control unit 33 detects the point P i Page coordinate C of i (step S23), and the correlation coefficient r of point P1 is derived by the following formula (1) (step S24). PP is the sum of squared deviations obtained by equation (2), and S CC is the sum of squared deviations obtained by equation (3), and S PC is the sum of the deviation products obtained by equation (4). is points P1~P i is the average value of <c>is page coordinate C1~C i is the average value.
[0066]
number
[0067] Next, the control unit 33 controls the points P1 to P i It is determined whether the number of points (=i) exceeds 20% of the total number of points N (i / N>0.2) (step S25). If not, it is determined whether the correlation coefficient r derived in step S14 is smaller than 0.9 (step S26), and if it is determined to be smaller, the file division process is terminated. This makes it possible to terminate the file division process when the relationship between the point numbers and the page coordinates clearly does not satisfy the relationship exemplified in FIG. 12, such as when what is written on the page is not a sentence but a drawing, and it is not appropriate to apply the second aspect of the present invention. Note that if the variable i is too small (for example, i / N<0.1), it is possible that the value of the correlation coefficient r derived in step S14 is not stable, so the determination result in step S26 may be forcibly set to negative.
[0068] If it is determined in step S26 that the correlation coefficient r is not less than 0.9, the control unit 33 increments the variable i by 1 (step S29) and determines whether the variable i is greater than N (step S30). If the variable i is greater than N, the control unit 33 ends the file division process. In this case, the file is not divided. On the other hand, if the variable i is not greater than N, the process returns to step S23 and continues.
[0069] If the control unit 33 determines in step S25 that i / N is greater than 0.2, it then determines whether the correlation coefficient r derived in step S14 is less than 0.9 (step S26). If it is determined that the correlation coefficient r is not less than 0.9, it clears the migration candidate collection and assigns 0 to the variable MPC (step S28). The migration candidate collection is the collection of points P i As will be described later, the point P i The accumulation of is conditional on the correlation coefficient r being less than 0.9, but the subsequent point P i If the correlation coefficient r becomes 0.9 or more, the number of points P i is likely to be an outlier that should be ignored. i After executing step S28, the control unit 33 proceeds to step S29 and continues the process.
[0070] If it is determined in step S26 that the correlation coefficient r is smaller than 0.9, the control unit 33 sets the point P i is put into the movement candidate collection (step S31), and the variable MPC is incremented by 1 (step S32). Then, the point P i It is determined whether the number of points (=MPC) is less than 10% of the total number of points N (MPC / N<0.1) (step S33). If it is determined that the number is less than 10%, the control unit 33 proceeds to step S29 in FIG. 13 to continue the process.
[0071] On the other hand, if the control unit 33 determines in step S33 that the difference is not less than 10%, the point P i+1 All subsequent points are placed in the migration candidate collection (step S34), and a user confirmation screen is displayed (step S35). This user confirmation screen is for confirming with the user whether or not it is OK to divide the file. The user confirmation screen displays one or more points P i It is preferable to arrange information that enables the user to distinguish the stroke data. After displaying the user confirmation screen, the control unit 33 judges the result of the user's confirmation on this screen (step S36).
[0072] If it is determined in step S36 that the user has approved the file division, the control unit 33 transfers one or more points P i The stroke data is moved to the new file (step S37), and the file division process is terminated. As a result, the file is divided before and after the user turns the page. If it is determined in step S36 that the user has denied the file division, the control unit 33 terminates the file division process without executing step S37.
[0073] As described above, according to the functions of the tablet terminal 30 relating to the second aspect of the present invention, a single file that stores the results of entries made on multiple pages of paper can be divided into individual pages. Therefore, even if the user forgets to press the power / operation button 11 and the one-to-one correspondence between the pages of the paper medium and the files is no longer established, it is possible to establish a one-to-one correspondence between the pages of the paper medium and the files that store the handwritten data.
[0074] Furthermore, since confirmation is requested from the user in steps S35 and S36, it is possible to prevent the tablet terminal 30 from automatically dividing the file inappropriately. This is particularly effective when the user's handwriting contains a mixture of text and figures.
[0075] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and it goes without saying that the present invention can be embodied in various forms without departing from the spirit of the present invention.
[0076] For example, in the above embodiment, the tablet terminal 30 having both the first and second aspects of the present invention has been described, but the tablet terminal 30 may have only one of the aspects.
[0077] In relation to the first aspect of the present invention, when entering the sleep mode, the control unit 33 may store predetermined tag information in the memory 17. In this way, the control unit 33 can recognize that entry into the sleep mode occurred in the middle of writing by referring to the tag information when returning from the sleep mode, so that it is possible to ensure the continuity of a series of handwritten data written on one page of the paper medium.
[0078] Furthermore, the tablet terminal 30 may not execute steps S25 and S26 of the process shown in Fig. 13, and may always transition from step S24 to step S27. Similarly, the tablet terminal 30 may not execute steps S35 and S36 of the process shown in Fig. 14, and may always transition from step S34 to step S37.
[0079] Furthermore, before step S11 in Fig. 6, a user confirmation process similar to steps S35 and S36 in Fig. 14 may be executed. This can prevent the tablet terminal 30 from automatically performing inappropriate file combination. [Explanation of symbols]
[0080] 10 Position detection device 10a Touch Surface 11 Power / operation button 12 Power light 13 Mount storage section 14 Stylus fixing part 15 Touch Panel 15x,15y linear electrode 16 Sensor Controller 17,34 Memory 18 Wireless Communication Section 30 Tablet devices 31 Touchscreen 32 Wireless Communication Section 33 Control Unit C i Page coordinates E1y Bottom edge of filled-in area EZ Effective Area F2y Bottom edge of blank area MPC Point P that is a candidate for moving to a separate file i Variable to store the number of NP Notepad P Pen pressure value P i point r correlation coefficient S stylus SW1, SW2 switch information SZ Safe Zone< / c>
Claims
1. a storage unit that stores handwritten data generated in response to handwritten input on a sheet-like recording medium as a first file and a second file corresponding to first and second consecutive pages, respectively; detecting a first written area on the first page, the first area being an area where handwritten data is written, based on the handwritten data stored in the first file; detecting a second written area on the second page, the second area being an area where handwritten data is written, based on the handwritten data stored in the second file; obtaining a blank area on the writing start side of the second written area, the blank area being an area in the second page where no handwritten data exists; determining whether to combine the first file and the second file based on an arrangement relationship between the first written area and the blank area; a control unit that combines the first file and the second file when it is determined that the files should be combined; An information processing device comprising:
2. The control unit is Detecting the first written area based on end information of the handwritten data stored in the first file; detecting the second written area based on start information of the handwritten data stored in the second file; The information processing device according to claim 1 .
3. the end information and the start information include coordinate information generated in response to handwritten input on a sheet-like recording medium; The information processing device according to claim 2 .
4. the control unit combines the first file and the second file based on the end information and the start information, thereby generating handwritten data corresponding to handwritten input on a sheet-like recording medium. The information processing device according to claim 2 .
5. the control unit is configured to be able to acquire additional information corresponding to the handwritten input strokes in the first file, and performs a process of dividing the first file by taking into consideration the additional information. The information processing device according to claim 1 .
6. the additional information is information based on the number of strokes corresponding to the handwritten input. The information processing device according to claim 5 .
7. An information processing method executed by an information processing device having a storage unit that stores handwritten data generated in response to a handwritten input on a sheet-like recording medium as a first file and a second file corresponding to first and second consecutive pages, respectively, comprising: detecting a first written area on the first page, the first area being an area where handwritten data is written, based on the handwritten data stored in the first file; detecting a second written area on the second page, the second area being an area where handwritten data is written, based on the handwritten data stored in the second file; obtaining a blank area on the writing start side of the second written area, the blank area being an area in the second page where no handwritten data exists; a determination step of determining whether or not to combine the first file and the second file based on a layout relationship between the first written area and the blank area; a control step of combining the first file and the second file when it is determined that the files are to be combined; An information processing method comprising:
8. The determining step includes: Detecting the first written area based on end information of the handwritten data stored in the first file; detecting the second written area based on start information of the handwritten data stored in the second file; The information processing method according to claim 7.
9. The end information and the start information include coordinate information generated in response to handwritten input on a sheet-shaped recording medium. The information processing method according to claim 8.
10. the control step combines the first file and the second file based on the end information and the start information, thereby generating handwritten data corresponding to handwritten input on a sheet-like recording medium. The information processing method according to claim 8.
11. the information processing device is configured to be able to acquire additional information corresponding to the handwritten input strokes in the first file, and performs a process of dividing the first file by taking into consideration the additional information; The information processing method according to claim 7.
12. the additional information is information based on the number of strokes corresponding to the handwritten input. The information processing method according to claim 11.
Citation Information
Patent Citations
Device for producing hydrogenated amorphous silicon
JP1985005880A
Method and system for information management
JP2002132943A
Information processing apparatus, information processing system, information processing program and information processing method
JP2012014216A
Methods and apparatus for automatic page break detection
US20060031764A1
