Information processing device, display method and program

Abstract

To easily generate a plurality of electronic tags for an electronic file including a plurality of pages.SOLUTION: An information processing device (2, 3) comprises a control part (200, 300) that, when generating electronic sticky notes displaying print images of a selected electronic file (6), generates a plurality of electronic sticky notes (701 to 703) corresponding to the number of pages when it is determined that the electronic file is to be printed over a plurality of pages.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a display method, and a program. [Background technology]

[0002] As a method for supporting the creation of materials consisting of multiple slides using an information processing device such as a personal computer, a method is known in which multiple slide objects arranged on a work field are added or removed from a slide flow in response to a drag operation (see, for example, Patent Document 1). Slide objects correspond to slides of text, handwritten objects, images, audio, video, web pages, etc. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-182649 Summary of the Invention [Problem to be solved by the invention]

[0004] When a multi-page electronic file is turned into a sticky note using the information processing device described above, only electronic sticky notes that are summary images (thumbnails) of specific pages among the multiple pages are generated. In other words, even when generating electronic sticky notes from an electronic file that is printed on multiple pages, there is a problem in that only specific pages are generated as electronic sticky notes.

[0005] In view of the above problems, one of the objects of the present invention is to make it possible to easily generate multiple electronic sticky notes for a multi-page electronic file. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present invention includes a control unit that, when generating an electronic sticky note displaying a print image of a selected electronic file, generates multiple electronic sticky notes according to the number of pages if it determines that the electronic file will be printed across multiple pages. [Effects of the Invention]

[0007] According to the above aspect, it is possible to easily generate a plurality of electronic sticky notes for an electronic file of a plurality of pages. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a learning system according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of the functional configuration of a user terminal. [Figure 3] FIG. 10 is a diagram illustrating an example of an operation of a user terminal. [Figure 4] 10 is a flowchart illustrating an example of a note function process. [Figure 5] 10 is a flowchart illustrating an example of a file sticky note process according to an embodiment. [Figure 6] 6A to 6D are diagrams illustrating a specific example of processing for creating sticky notes from an electronic file with a print layout of multiple pages. [Figure 7] 7A to 7D are diagrams illustrating display examples of electronic sticky notes. [Figure 8] 8A and 8B are diagrams illustrating an example of how to use an electronic sticky note. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The alphabet following a number in the illustrated reference symbols is intended to identify multiple components to which that number is assigned. In the following description of this specification, the alphabet following the number will be used only when referring to a specific component among multiple components to which the same number is assigned. In other words, when a "user terminal 3" is mentioned, the user terminal may be any of the three user terminals 3A to 3C in FIG. 1 or other user terminals not shown, and when a "user terminal 3A" is mentioned, the user terminal refers only to the user terminal to which the symbol 3A in FIG. 1 is assigned.

[0010] The learning system 1 illustrated in FIG. 1 includes a Web system 2 and a user terminal 3. The number of user terminals 3 is not limited to three. Users of the user terminals 3 include users who use the learning system 1 to study, such as children, pupils, and students, and users who support the study, such as teachers. Each of the Web system 2 and the user terminals 3 can be connected to a communication network 4 wirelessly or via a wired connection, and each of the user terminals 3 can communicate with the Web system 2 via the communication network 4.

[0011] The Web system 2 is a system that uses a communication network 4 to provide various functions related to user learning, and includes a control unit 200, a memory unit 201, and a communication unit 204 as illustrated in FIG. 1. The Web system 2 may include other functional blocks not shown, such as an input unit and a display unit. The Web system 2 may be configured with a single server or multiple servers. For example, the Web system 2 may be configured with a Web server, an application server, and a database server. The term "server" in this specification may be read as "computer."

[0012] The control unit 200 controls the operation of the Web system 2. For example, the control unit 200 performs processing in response to an HTTP request from the user terminal 3, generates a screen in response to the results of the processing, and transmits it to the user terminal 3. The processing in response to the HTTP request includes processing for generating electronic sticky notes while the note function is being executed. The functions of the control unit 200 are provided by one or more processors that execute an OS program and various programs related to providing the note function, etc. The processor may include a CPU.

[0013] The storage unit 201 has an application data storage area 210 that stores applications provided to users via the communication network 4 and a user data storage area 211 that stores user data. The application data storage area 210 stores a first application 220 that provides a note function, a second application 221 that provides mathematical tools, a third application 222 that provides dictionary content, and the like. The note function may be a function that enables recording of learning content and collected information using electronic sticky notes, etc., as described below, and distribution and submission of assignments. The mathematical tools are tools that provide various mathematical functions such as calculation, graph drawing, and statistical processing. The dictionary content includes content such as an English-Japanese dictionary, a Japanese-English dictionary, and a Japanese dictionary. The user data storage area 211 stores various data associated with users who can use the functions of the Web system 2 for each user. For example, user data 230A stores data such as the user ID, login password, and learning history of the user of the user terminal 3A, and user data 230B stores data such as the user ID, login password, and learning history of the user of the user terminal 3B. The storage device that provides the functions of the storage unit 201 includes a ROM and RAM as a main storage device, and an auxiliary storage device such as an HDD. The functions of the storage unit 201 may be provided by a portable recording medium such as an optical disk, a storage device with a USB terminal, or a card-type storage device. The communication unit 204 connects the Web system 2 to the communication network 4 and communicates with external devices via the communication network 4. The functions of the communication unit 204 are provided by a communication device that communicates with nodes (communication equipment) of the communication network 4 in accordance with a well-known communication standard.

[0014] The user terminal 3 is an information processing device used by a user for learning, and includes a control unit 300, a storage unit 301, an input unit 302, a display unit 303, and a communication unit 304 as illustrated in Fig. 2. The user terminal 3 may include other functional blocks not shown, such as an imaging unit, a sound collection unit, and a sound emission unit. The information processing device serving as the user terminal 3 may be a personal computer or a smartphone equipped with a communication function.

[0015] The control unit 300 controls the operation of the user terminal 3. For example, the control unit 300 executes a web browser to send an HTTP request to the web system 2 and displays and outputs a display screen according to the HTTP response received from the web system 2. The control unit 300 may execute a program such as a script included in the HTTP response. The functions of the control unit 300 are provided by one or more processors that execute an OS program and a web browser 310 program for using the note function, etc. The processor may include a CPU.

[0016] The memory unit 301 stores a program for the web browser 310. Storage devices that provide the functions of the memory unit 301 include ROM and RAM as main storage devices and auxiliary storage devices such as HDDs. The functions of the memory unit 301 may be provided by portable recording media such as optical discs, storage devices with USB terminals, and card-type storage devices. The input unit 302 accepts input of various information related to the operation (operation) of the user terminal 3. The display unit 303 displays various information related to the operation (operation) of the user terminal 3. The function of the display unit 303 is provided by a display device such as a dot-matrix liquid crystal display. The function of the input unit 302 is provided by an input device such as a position detection device (digitizer), keyboard, or mouse that is superimposed on the display area of ​​the display device (display unit 303). The communication unit 304 connects the user terminal 3 to a communication network 4 and communicates with external devices via the communication network 4. The function of the communication unit 304 is provided by a communication device that communicates with nodes (communication devices) of the communication network 4 according to a well-known communication standard.

[0017] A user of the user terminal 3 can study using functions provided by the Web system 2 by connecting the user terminal 3 to the Web system 2. The user terminal 3 is connected to the Web system 2 when the user ID and password transmitted to the Web system 2 are authenticated by the Web system 2. A menu screen 320, as illustrated in FIG. 3, is displayed on the user terminal 3 connected to the Web system 2. The menu screen 320 is configured to allow the user to select items available for study. For example, when a user operation to select the character string 321 "notebook" is detected, the first application 220 providing the note function is executed, and the display on the user terminal 3 switches from the menu screen 320 to a note screen 330. The note screen 330 has an icon (object) 332 for generating an electronic sticky note and a work area 331 on which the generated electronic sticky note 333 is displayed. The electronic sticky note 333 can be written with text, handwritten characters, figures, etc., and can be repositioned within the work area 331 or associated (linked) with other electronic sticky notes. Selecting the "Text" icon 332A generates an electronic sticky note 333 with a plain background, and selecting the "Camera" icon 332B generates an electronic sticky note with, for example, an image captured by a camera included in the user terminal 3 as the background. Selecting the "File" icon 332C generates an electronic sticky note with a print image captured from the electronic file to be made into a sticky note as the background. By switching the display screen, the electronic sticky note generated by selecting the "File" icon 332C allows the user to view the entire print layout of the electronic file that has been made into a sticky note.

[0018] The user terminal 3 on which the note screen 330 is displayed performs, for example, the note function processing shown in Fig. 3. When the control unit 300 of the user terminal 3 that has started the note function processing determines that a user operation has been detected (step S1; YES), data related to the user operation is transmitted to the control unit 200 of the Web system 2 via the communication unit 304, the communication network 4, and the communication unit 204, and determines whether the user operation is an operation to terminate the note function processing (step S2; YES). When it is determined that the user operation is an operation to terminate the note function processing (step S2; YES), the control unit 300 transmits an HTTP request to the control unit 200 of the Web system 2 to terminate the note function. When the note function processing is terminated, the display on the display unit 303 switches from the note screen 330 to the menu screen 320.

[0019] If the control unit 300 determines that the detected operation is not an operation to terminate the note function processing (step S2; NO), it determines whether the detected operation is an operation to select file sticky note creation (step S3). The term "file sticky note creation" in this specification refers to generating an electronic sticky note that allows editing, viewing, etc. of an electronic file, and may be, for example, an operation to select the "file" icon 332C on the note screen 330 in FIG. 3. If the control unit 300 determines that the detected operation is not an operation to select file sticky note creation (step S3; NO), it performs a process corresponding to the detected operation other than file sticky note creation (step S5). Step S5 may include, for example, a process of sending an HTTP request corresponding to the detected operation to the control unit 200 of the Web system 2 and a process of displaying a screen corresponding to the HTTP response received from the control unit 200. Step S5 may also be a process of writing text, handwritten characters, figures, etc. on the generated electronic sticky note 333.

[0020] If it is determined that the operation is to select sticky file (step S3; YES), the control unit 300 performs a sticky file process (step S4). As the sticky file process in step S4, the control unit 300 performs, for example, the process shown in Fig. 5. Note that in the following description, the process of each step shown in Fig. 5 will be described as being performed solely by the user terminal 3, but the process of one or more steps will be performed by the user terminal 3 and the Web system 2.

[0021] When the control unit 300 of the user terminal 3 that has started the sticky file process determines that a user operation has been detected (step S400; YES), it determines whether the detected user operation is an operation to end the sticky file process (step S401). If it is determined that the detected user operation is an operation to end the sticky file process (step S401; YES), the control unit 300 ends the sticky file process. If it is determined that the detected operation is not an operation to end the sticky file process (step S401; NO), the control unit 300 then determines whether the detected operation is an operation to select a file of a specific format (step S402). A file of a specific format may be, for example, a file whose extension matches the extension of a file format registered in the table 500 of FIG. 6A. If it is determined that the detected operation is not an operation to select a file of a specific format (step S402; NO), the control unit 300 performs processing according to the detected operation (step S403), and then performs the determination of step S400. If it is determined that the operation is to select a file of a specific format (step S402; YES), the control unit 300 acquires the number of pages of the print layout data of the selected file (step S404). The number of pages of the print layout data may be, for example, layout data 611 when document data 601 in an electronic file 6 called "material.pdf" as shown in FIG. 6B is printed on a printer. The number of pages of the print layout data is described, for example, in the property 602 of the electronic file 6.

[0022] After step S404, the control unit 300 determines whether the acquired number of pages is two or more, i.e., whether the number of pages is multiple pages (step S405). If the number of pages is not two or more (step S405; NO), the control unit 300 acquires link data for the selected file, captures a print image, and generates one electronic sticky note (step S406). Then, the control unit 300 displays and outputs the generated electronic sticky note (step S407), and ends the file sticky note creation process. The link data acquired in step S406 may be information indicating the location where the selected file is stored. Also, in step S406, the control unit 300 captures, for example, an entire page of print layout data for the selected file, or a print image within a predetermined range of one page, and generates an electronic sticky note with the captured print image displayed as a summary image (thumbnail) in the background. Also, the electronic sticky note generated in step S406 may be switchable between an editing screen on which text, etc., can be written and a viewing screen on which the print layout of the electronic file can be viewed, as will be described later with reference to FIGS. 8A and 8B.

[0023] If the number of pages is two or more (step S405; YES), the control unit 300 then determines whether the number of pages is equal to or less than the upper limit N (step S408). The upper limit N can be set individually for each file format, as shown in table 500 of FIG. 6A, for example, or it may be a common value for all file formats. Furthermore, the upper limit N is not limited to the values ​​exemplified in table 500 of FIG. 6A. If it is determined that the number of pages is equal to or less than the upper limit N (step S408; YES), the control unit 300 acquires link data of the file, captures print images of all pages, and generates electronic sticky notes in the same number as the number of pages (step S409). If it is determined that the number of pages is not equal to or less than the upper limit N (step S408; NO), the control unit 300 acquires link data of the file, captures print images for N pages, and generates N electronic sticky notes (step S410). When the upper limit value N is 10, the page range to be captured in step S410 may be, for example, page 1 through page 10 as shown in table 500 of FIG. 6A, but is not limited to a specific page range. The page range may be changeable by user operation. Furthermore, the page range to capture the print image may be individually set for each file format, as shown in table 500 of FIG. 6A. For example, table 500 of FIG. 6A sets the number of electronic sticky notes to be generated for PDF files (i.e., 10 pages, i.e., 10 electronic sticky notes), for document format files such as Word files (i.e., 8 pages, i.e., 8 electronic sticky notes), and for spreadsheet format files such as Excel (registered trademark) files (i.e., 4 pages, i.e., 4 electronic sticky notes). In actual operation, the number of electronic sticky notes that can be generated for each file format is set based on the actual usage, such as, for example, for spreadsheet format files, it is desirable to be able to view the entire display content as a summary image (i.e., if the file is divided into too many pages, there is no opportunity to view the electronic sticky notes). However, the setting can be changed as appropriate, or the same value may be used for all file formats. In steps S409 and S410, the control unit 300 generates a plurality of electronic sticky notes each having a different print image to be displayed as a summary image in the background.After step S409 or S410, the control unit 300 number and link the generated electronic sticky notes according to the page order (step S411). In step S411, the control unit 300 performs numbering managed by sticky note groups and sticky note numbers as shown in table 501 in FIG. 7A, for example, and links based on the file link data. The sticky note numbers are assigned based on the page order of the thumbnails (summary images) of the electronic sticky notes. After step S411, the control unit 300 displays and outputs the generated electronic sticky notes in an overlapping state (step S412), and ends the file sticky note creation process.

[0024] For example, if the upper limit N when turning the electronic file 6 with three print pages shown in FIG. 6B into a sticky is 10, the control unit 300 generates three electronic sticky notes 701-703 with different thumbnails as shown in FIG. 6C in step S409. The generated three electronic sticky notes 701-703 have, for example, a print image captured from the print layout displayed as the background, allowing text, handwritten characters, figures, and the like to be written on the print image by layer compositing. After generating the electronic sticky notes, the control unit 300 numberes and links the generated three electronic sticky notes 701-703 as shown in table 501 of FIG. 7A (step S410). Next, the control unit 300 displays a group of electronic sticky notes 700 in which the three electronic sticky notes 701-703 are stacked in the order of the thumbnail pages, as shown in FIGS. 6D and 7B (step S411). The electronic sticky note group 700 is displayed with the electronic sticky note of the thumbnail with the larger page number superimposed on the back side. When the electronic sticky note group 700 is displayed, an object 710 that expands and displays the multiple electronic sticky notes displayed superimposed on each other is displayed in a position adjacent to the electronic sticky note group 700. In addition, when the electronic sticky note group 700 is displayed, a menu 720 that enables processing such as editing of the electronic sticky notes included in the electronic sticky note group 700 is displayed in a position adjacent to the electronic sticky note group 700.

[0025] In this way, in the learning system 1 according to the embodiment, when an electronic file with multiple pages of print layout data is tagged, multiple electronic tags that display different pages as thumbnails (backgrounds) can be generated in a single operation. The generated multiple electronic tags are numbered and linked using a table 501, for example, as illustrated in FIG. 7A. Therefore, when an operation of pressing an object 710 (see FIG. 7B) adjacent to an electronic tag group 700 in which multiple electronic tags are displayed overlapping each other is detected, the electronic tags 701-703 are displayed in the order of thumbnail pages without overlapping each other, as illustrated in FIG. 7C, and adjacent electronic tags are linked by association objects 731 and 732, such as arrows. Therefore, even when other electronic tags are displayed in the work area 331 (see FIG. 3) of the notebook screen 330, the electronic tags 701-703 for the same electronic file can be easily identified. Therefore, the interaction process between the user and the control unit 200 of the Web system 2 and the control unit 300 of the user terminal 3 can reliably assist the user in performing a technical task (the process of generating electronic sticky notes from a file having multiple pages).

[0026] Furthermore, when an operation to select one of the expanded and displayed electronic sticky notes 701-703 is detected, a menu 720 that enables editing or other processing of the selected electronic sticky note 702 is displayed adjacent to the electronic sticky note 702, as illustrated in FIG. 7D. This allows the user to easily identify the electronic sticky note that is the target of editing or other processing. When the user presses the "Edit" portion of the menu 720 illustrated in FIG. 7D, an editing screen 350 that enables editing or other processing of the second page, as illustrated in FIG. 8A, is displayed on the display unit 303 of the user terminal 3. The editing screen 350 includes a menu area 351 that enables the user to select whether to write text, handwritten characters, or objects, and an editing area 352 that displays a print image of the second page of the electronic file. A switch 353 for switching between the editing screen 350 and the viewer screen is displayed in the menu area 351. By switching the switch 353, the display on the display unit 303 switches from the editing screen 350 to the electronic file viewing screen 360 illustrated in FIG. 8B. All pages of the electronic file, including pages that are thumbnails, can be viewed on the viewing screen 360. At this time, by specifying and associating electronic files as link destinations for multiple electronic sticky notes, the entire electronic file can be viewed from any of the multiple electronic sticky notes. Also, a sticky note button 361 is provided on the viewing screen 360, and when the sticky note button 361 is pressed, a new electronic sticky note can be generated with the page that is displayed as a thumbnail.

[0027] In a conventional electronic sticky note generation process, for example, multiple electronic sticky notes are generated while changing the displayed page on the viewing screen 360 illustrated in FIG. 8B, and then the multiple electronic sticky notes are linked in page order. This requires a lot of time and effort to generate multiple electronic sticky notes with different thumbnail pages. In contrast, the file sticky note generation process according to the above-described embodiment can automatically generate multiple electronic sticky notes with different thumbnail pages with a single operation. That is, the electronic sticky note generation process according to the above-described embodiment can easily generate multiple electronic sticky notes for an electronic file with a multi-page print layout, for example. Note that the electronic files that are the targets of the processing from step S404 onward illustrated in FIG. 5 are not limited to the combination of files with extensions exemplified in table 500 in FIG. 6A. For example, the electronic files that are the targets of the processing from step S404 onward may only be files with a .pdf extension. Furthermore, files with extensions other than those exemplified in table 500 may also be the targets of the processing from step S404 onward.

[0028] Furthermore, for example, by setting an upper limit value N when generating multiple electronic sticky notes for an electronic file with a multi-page print layout, it is possible to suppress an increase in processing load and storage space pressure caused by an excessive number of electronic sticky notes generated in a single operation. The upper limit value N is not limited to a specific value such as N=10 as exemplified in this specification. The upper limit value N may be a fixed value or a value settable by the user. Furthermore, the page range to be captured when the number of pages in the print layout of the electronic file exceeds the upper limit value N is not limited to the range including the first page as exemplified. The page range to be captured may be fixed or settable by the user. Furthermore, in the electronic sticky note generation process according to the above-described embodiment, a new electronic sticky note can be generated from the viewing screen of the generated electronic sticky note. Therefore, after generating multiple electronic sticky notes for an electronic file with a multi-page print layout, it is possible to generate additional electronic sticky notes for desired pages.

[0029] The above-described embodiment is a specific example shown to facilitate understanding of the invention, and the present invention is not limited to the above-described embodiment. Various modifications and changes can be made to the information processing device, display method, and program without departing from the scope of the claims. [Explanation of symbols]

[0030] 3...user terminal, 6...electronic file, 200...control unit, 331...work area, 700...electronic sticky note group, 701 to 703...electronic sticky notes

Claims

1. a control unit that generates a plurality of electronic sticky notes corresponding to the number of pages when determining that the electronic file is to be printed across a plurality of pages when generating an electronic sticky note displaying a print image of the selected electronic file; An information processing device comprising:

2. The information processing apparatus according to claim 1 , wherein when the number of pages of the electronic file exceeds an upper limit, the control unit generates electronic sticky notes in the same number as the upper limit.

3. the upper limit is set according to the file format of the electronic file, The information processing device according to claim 2 , wherein when the number of pages of the electronic file exceeds an upper limit, the control unit generates electronic sticky notes in the same number as the upper limit, in accordance with the file format.

4. The information processing apparatus according to claim 2 , wherein the control unit generates a plurality of electronic sticky notes displaying print images of pages from the first page of the electronic file to a page specified by the upper limit value.

5. 2. The information processing device according to claim 1, wherein the control unit associates the generated electronic sticky notes so that they are arranged in the page order of the print image displayed on each electronic sticky note, and further generates a predetermined association object for connecting adjacent electronic sticky notes in page order based on the association, which is displayed when the multiple electronic sticky notes are displayed so that they do not overlap each other.

6. The information processing apparatus according to claim 1 , wherein the control unit associates the electronic file with the plurality of electronic sticky notes as link destinations.

7. The information processing device A process for generating a plurality of electronic sticky notes corresponding to the number of pages when determining that the electronic file is to be printed across multiple pages when generating an electronic sticky note displaying a print image of the selected electronic file. The display method to perform.

8. In the information processing device, A process for generating an electronic sticky note displaying a print image of a selected electronic file, and if it is determined that the electronic file is to be printed across multiple pages, generating multiple electronic sticky notes according to the number of pages. A program that executes the following.

Images