Program, information processing apparatus, and information processing method

Abstract

To reduce an operation load when a user manually performs an operation for delivering data resulting from image data to an application.SOLUTION: The present invention provides a program 13 for causing an information processing device 3 in which an application 12 is installed to function as an acquisition unit 21 that acquires data resulting from image data from an external device 4, a screen control unit 26 that displays a display component related to the data acquired by the acquisition unit, and an operation reception unit 23 that receives a data transfer operation of the display component with respect to a screen displayed by the application.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a program, an information processing device, and an information processing method. [Background technology]

[0002] Scanner apps that control scanner devices are known. Scanner apps installed on information processing devices acquire data resulting from image data from the scanner device. Users can use this data in various application software (hereinafter simply referred to as applications or apps). For example, users may share data resulting from image data acquired by the scanner app with various locations using a remote conferencing app or manage it using a digital note app.

[0003] There is known a technology for sharing various types of data among a plurality of applications (see, for example, Patent Document 1). Patent Document 1 discloses a technology for extracting a compatible application corresponding to the execution characteristics of scan processing from among a plurality of applications, displaying identification information for identifying the compatible application on a display unit, and sharing image information with an output destination application whose selection has been accepted via an API (Application Programming Interface). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2019-185795 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with conventional technology, the user is required to manually transfer image data to an application, which places a heavy burden on the user. In other words, if the application to which the scanner app is linked has an API or the like and the scanner app can link with the application by calling the API, the scanner app can transfer data resulting from the image data (hereinafter simply referred to as image data) to the application without user intervention.

[0006] On the other hand, if a user wants to use image data in an application that does not expose integration functions such as APIs, the user must use a drag-and-drop function provided by the OS (Operating System) to transfer the image data to the application using the following procedure. 1. The user sets in the scanner app a folder for the scanner device to output image data. 2. The scanner device reads the document, and the scanner app saves the image data in the folder specified in step 1. 3. The user operates the file management software provided by the OS to open the folder specified in 1. 4. The user searches the opened folder for the image data output by the scanner device. 5. The user drags and drops the image data into the application. 6. The user deletes image data that is no longer needed from the folder.

[0007] As described above, the process of transferring image data to an application is complicated and can lead to mistakes such as mistaking image data, sending the wrong image data, or deleting the wrong image data.

[0008] In view of the above-mentioned problems, the present invention provides a technique for reducing the operational load when a user manually performs an operation to transfer data resulting from image data to an application. [Means for solving the problem]

[0009] In view of the above problems, the present invention provides a program for causing an information processing device on which an application is installed to function as an acquisition unit that acquires data resulting from image data from an external device, a screen control unit that displays display components related to the data acquired by the acquisition unit, and an operation reception unit that accepts data transfer operations of the display components to the screen displayed by the application. [Effects of the Invention]

[0010] This reduces the operational burden when a user manually transfers data resulting from image data to an application. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 2 is a diagram illustrating processing or operations performed by an information processing device and operations performed by a user. [Figure 2] FIG. 1 is a diagram illustrating an example of the overall configuration of a scanner system. [Figure 3] FIG. 1 illustrates a hardware configuration of an example of an information processing device. [Figure 4] 1 is an example of a functional block diagram illustrating functions of a scanner device and an information processing device, divided into blocks. [Figure 5] FIG. 10 is a diagram illustrating an example of a scan setting screen. [Figure 6] FIG. 10 is a diagram illustrating an example of a collaboration support screen. [Figure 7] 10 is a sequence diagram illustrating an example of a process in which a scanner system scans a document and an information processing apparatus displays a collaboration support screen. [Figure 8] 10 is a flowchart illustrating an example of a process in which an information processing device displays a collaboration support screen and transfers image data to a collaboration destination application in response to a data transfer operation. [Figure 9] 10A and 10B are diagrams illustrating an example of a cooperation support screen and a screen of a cooperation destination application displayed by an information processing device. [Figure 10] FIG. 10 is a diagram showing an example of a screen display during drag and drop. [Figure 11] FIG. 10 is a diagram showing an example of a screen display when drag and drop is completed. [Figure 12] FIG. 10 is a diagram illustrating an example of a collaboration destination selection screen displayed by a scanner application. [Figure 13] 10 is a flowchart illustrating an example of a process in which the information processing apparatus displays a collaboration support screen after a preview display and transfers image data to a collaboration destination application in response to a data transfer operation. [Figure 14] 10A to 10C are diagrams illustrating transitions of screens displayed by the information processing device when displaying a collaboration support screen. [Figure 15] 1 is an example of a functional block diagram illustrating functions of a scanner device and an information processing device, divided into blocks. [Figure 16] 10 is a flowchart illustrating an example of a process in which an information processing device displays a collaboration support screen and transfers image data to a collaboration destination application in response to a data transfer operation. [Figure 17] 10 is a flowchart illustrating an example of a process in which an information processing device displays a collaboration support screen and transfers image data to a collaboration destination application in response to a data transfer operation. [Figure 18] FIG. 10 is a diagram showing a display position of a screen of a linked application as an embodiment. [Figure 19] FIG. 10 is a diagram showing a display position of a screen of a linked application as an embodiment. [Figure 20] 10 is a flowchart illustrating an example of a process performed by a screen control unit to adjust the display position of a collaboration assistance screen. DETAILED DESCRIPTION OF THE INVENTION

[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An information processing device and an information processing method performed by the information processing device will be described below as an example of an embodiment of the present invention with reference to the accompanying drawings.

[0013] <Outline of processing or operation> 1 is a diagram illustrating the processing or operation performed by an information processing device and the operation performed by a user in this embodiment. The information processing device is capable of communicating with a scanner device, and has a scanner application installed therein that controls the scanner device. The information processing device also has an application (hereinafter referred to as a "linked application") installed therein that can utilize data resulting from image data created by the scanner application (hereinafter simply referred to as "image data").

[0014] When the scanner application causes the scanner device to scan a document, the scanner application obtains a file containing image data from the scanner device. The scanner application saves the file in a temporary folder and automatically displays the collaboration support screen 11. The collaboration support screen 11 displays a file icon 222 representing the file saved in the temporary folder. The user drags and drops the file icon 222 displayed on the collaboration support screen 11 onto the screen 15 of the collaboration destination application to which the user wishes to transfer the image data.

[0015] This allows the user to use the image data in linked application 12. How the user uses the image data in linked application 12 varies depending on linked application 12, but for example, in the case of a linked application that holds a video conference, image data can be shared among each location.

[0016] In this way, the scanner application 13 of this embodiment automatically displays the collaboration support screen 11 including the file icon 222 when a scan is performed, eliminating the need for the user to set an arbitrary folder in the scanner application 13 or open this folder. The user simply passes the displayed file icon 222 to the collaboration destination application 12. Therefore, the scanner application 13 can reduce operational errors such as file mix-ups, erroneous sending, and erroneous deletion. It also helps to eliminate the problem of not knowing how to collaborate.

[0017] <Terminology> A data transfer operation is an operation of transferring image data to the linked application 12. Examples of the data transfer operation include drag and drop, copy and paste, or cut and paste of a file. The data transfer operation may be any other operation as long as it can transfer image data to the linked application 12. Drag and drop, copy and paste, or cut and paste may be referred to as a "data transfer operation." Furthermore, when the user operates a touch panel instead of a mouse, an operation equivalent to drag and drop, copy and paste, or cut and paste on the touch panel is a "data transfer operation."

[0018] The external device is a device that creates image data, such as a scanner device 4, a smartphone, or a digital camera.

[0019] Data derived from image data may be any data created based on image data, such as the image data itself, a file containing image data, text data obtained by character recognition of image data, or a file containing text data.

[0020] Display components are elements of a graphical user interface (GUI), such as icons, pictures, figures, images, and text.

[0021] [First embodiment] <System configuration example> Next, an example of the configuration of the scanner system 1 will be described with reference to Fig. 2. Fig. 2 is a diagram illustrating an example of the overall configuration of the scanner system 1. As shown in Fig. 2, the scanner system 1 includes an information processing device 3 and scanner devices 4A and 4B, which are capable of communicating with each other via a network 7. In this embodiment, any one of the scanner devices 4A and 4B will be referred to as "scanner device 4."

[0022] The network 7 may be, for example, a LAN in a user's home or company. The network 7 may be configured using wireless communication such as Wi-Fi. The network 7 may also include a WAN, a Virtual Private Network (VPN), or a Wide Area Ethernet (registered trademark).

[0023] The information processing device 3 may be directly connected to the scanner device 4 in a one-to-one wired manner via a USB cable or the like. Even in the case of one-to-one connection, the information processing device 3 and the scanner device 4 may communicate wirelessly. Known communication methods for this purpose include Wi-Fi Direct and Bluetooth (registered trademark).

[0024] The information processing device 3 may be a general-purpose information processing device. A scanner application that controls the scanner device 4 is installed in the information processing device 3. Various linked applications 12 are also installed in the information processing device 3. Some of these linked applications 12 have a function to link with the scanner application using an API or the like, while others do not. For applications that have a linking function, the scanner application calls the API to transfer image data to the linked application. For linked applications 12 that do not have a linking function, the scanner application provides the user with a function to assist in data transfer. It is assumed that the linked applications 12 support data transfer using a data transfer operation.

[0025] The scanner application may have a function of performing character recognition on image data of a document included in a file received from the scanner device 4. The information processing device 3 may transmit image data to a server device via the network 7.

[0026] Specifically, the information processing device 3 may be any device or equipment with a communication function, such as a PC (Personal Computer), a smartphone, or a tablet PC. Additionally, the information processing device 3 may be any device or equipment that can execute a scanner application and a linked application.

[0027] The scanner device 4 is an optical reading device that reads an original and transmits the generated image data to the information processing device 3. In this embodiment, the scanner device 4 scans various documents as examples of input documents.

[0028] The scanner device 4 may also be a device called an MFP (Multifunction Peripheral) or a multifunction device, which may have a printer function, a copy function, a facsimile function, etc. in addition to a scanner function.

[0029] In addition, in FIG. 2, the scanner device 4 and the information processing device 3 are separate devices, but the scanner device 4 and the information processing device 3 may be integrated into one device (such as an MFP).

[0030] The scanner device 4 may be a smartphone or a digital camera. A file containing image data captured by the smartphone or digital camera may be transmitted via the network 7 or may be stored on a removable storage medium. When the user inserts the storage medium into the information processing device 3, the information processing device 3 can acquire the file.

[0031] <Hardware configuration example> Next, the hardware configuration of the information processing device 3 according to this embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the hardware configuration of the information processing device 3 according to this embodiment. As shown in Fig. 3, the information processing device 3 is constructed by a computer 500, and includes a CPU 501, a ROM 502, a RAM 503, an HD (Hard Disk) 504, an HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F (Interface) 508, a network I / F 509, a bus line 510, a keyboard 511, a pointing device 512, an optical drive 514, and a media I / F 516.

[0032] Of these, the CPU 501 controls the overall operation of the computer 500. The ROM 502 stores programs, such as an IPL, used to drive the CPU 501. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data, such as programs. The HDD controller 505 controls the reading and writing of various data from and to the HD 504 under the control of the CPU 501. The display 506 displays various information, such as a cursor, menus, windows, characters, or images. The external device connection I / F 508 is an interface for connecting various external devices. In this case, external devices include, for example, a USB (Universal Serial Bus) memory or a printer. The network I / F 509 is an interface for data communication using the network 7. The bus line 510 is an address bus, a data bus, or the like, for electrically connecting the components, such as the CPU 501, shown in FIG. 3.

[0033] The keyboard 511 is a type of input means having multiple keys used to input characters, numbers, various instructions, etc. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The optical drive 514 controls reading and writing of various data from an optical storage medium 513, which is an example of a removable storage medium. The optical storage medium 513 may be a CD, DVD, Blu-Ray (registered trademark), etc. The media I / F 516 controls reading and writing (storing) of data from a storage medium 515, such as a flash memory.

[0034] <About the function> Next, the functions of the information processing device 3 will be described in detail with reference to Fig. 4. Fig. 4 is a functional block diagram that explains the functions of the scanner device 4 and the information processing device 3 by dividing them into blocks.

[0035] <<Scanner device>> The scanner device 4 has a communication unit 41 and a reading unit 42. The reading unit 42 uses an ADF (Automatic Document Feeder) function to feed documents one by one, and generates image data with a predetermined resolution and gradation by scanning the document surface with a line sensor. The ADF function is not necessary, and the scanner device 4 may read the document surface placed by the user on a transparent glass plate.

[0036] The reading unit 42 creates a file in a predetermined format containing image data. The predetermined format may be, for example, PDF or JPEG. Alternatively, the file format may be any format, such as PNG, TIFF, or HTML. The predetermined format may also be a format specific to the scanner device 4 and the scanner application 13. When a document contains multiple pages, the reading unit 42 creates one file per page of the document in the default setting. In the case of combined scanning, where the default setting is changed, multiple pages are included in one file. These settings are referred to as "settings that separate the output file into multiple files." In contrast, in the case of a "setting to combine files," multiple files containing one or more pages are combined into one file. The reading unit 42 may combine multiple pages into one file, or the scanner application 13 may combine the pages.

[0037] In addition, in this embodiment, for convenience of explanation, it is assumed that the reading unit 42 creates a file, but the conversion from image data to a file may be performed by the scanner application 13. For example, the scanner device 4 may transmit image data that is not in a file format to the information processing device 3, and the scanner application 13 may convert the image data into a file.

[0038] The communication unit 41 communicates with the information processing device 3 using a communication protocol such as SNMP (Simple Network Management Protocol) or via a dedicated line such as a USB cable. The communication unit 41 transmits the file generated by the reading unit 42 to the information processing device 3.

[0039] <<Information processing equipment>> The information processing device 3 includes an acquisition unit 21, a display control unit 22, an operation reception unit 23, a storage unit 24, an integration unit 25, a screen control unit 26, a deletion unit 27, a startup request unit 28, and an OS collaboration unit 30. Each of these units included in the information processing device 3 is a function or means realized by the CPU 501 of the information processing device 3 executing program instructions. This program may be, for example, a scanner application 13 dedicated to the scanner device 4 or a general-purpose scanner application 13. The scanner application 13 may also be a web application. A web application refers to software or its mechanism that operates through cooperation between a program written in a programming language (e.g., JavaScript (registered trademark)) that runs on a web browser and a program on a web server, and that is executed on the browser. A native application is a program installed on the information processing device 3, and in this embodiment, is a program that can communicate with the scanner device 4.

[0040] The acquisition unit 21 acquires files from the scanner device 4 by communicating with the scanner device 4 via the network 7 or a USB cable, etc. The acquisition unit 21 can also send control signals such as reading conditions and reading start signals to the scanner device 4. Note that a TWAIN (Tool Without An Interesting Name) driver or a proprietary driver may be installed in the information processing device 3. Note that TWAIN is a standard that defines technical specifications for controlling an input device such as an image scanner from a scanner application running on a computer to capture image data.

[0041] The display control unit 22 controls the screen of the scanner application 13. The display control unit 22 displays a setting screen in response to a user operation, or displays image data included in a file transmitted from the scanner device 4.

[0042] The operation reception unit 23 receives operations for the scanner application 13. As one of these operations, the operation reception unit 23 receives a "data transfer operation" for transferring image data to the linked application 12. The data transfer operation may be a drag and drop, copy and paste, or cut and paste. The data transfer operation may be any other operation that can transfer image data to the linked application 12. Note that the data transfer operation is not a function of the scanner application 13 alone, but an operation that utilizes a function of the OS. This is because it is difficult for the scanner application 13 to control the linked application 12, which is the data transfer destination.

[0043] Although the cooperation destination application 12 does not have a cooperation function that mainly uses an API or the like, the user can also perform data transfer operations with the cooperation destination application 12 that has a cooperation function.

[0044] The saving unit 24 saves the files acquired by the acquiring unit 21 in a predetermined temporary folder (an example of a saving area). When the acquiring unit 21 receives a notification that scanning of all pages has been completed, the acquiring unit 21 may save multiple files in the temporary folder, or may save each file acquired by the acquiring unit 21 in the temporary folder.

[0045] If the document contains multiple pages, the user can set the scanner app 13 to either "combine files" or "split the output file into multiple files" before scanning. If the output file is set to be split into multiple files, the user will need to perform data transfer operations for each file. Therefore, when the integration unit 25 receives a notification from the scanner device 4 that scanning of all pages has been completed, it combines the multiple files into a single file. The multiple files created for each page are saved separately. The integration unit 25 may further compress the combined file into a ZIP file or similar. This allows the scanner app 13 to reduce the processing load incurred during data transfer operations.

[0046] The screen control unit 26 displays the collaboration assistance screen 11 on the display 506. The collaboration assistance screen 11 is one of the windows generated by the scanner application 13. The collaboration assistance screen 11 may or may not overlap the screen of the scanner application 13. Details of the collaboration assistance screen 11 will be described with reference to FIG. 6.

[0047] The deletion unit 27 detects that the user has closed the collaboration support screen 11 and deletes the files stored in the temporary folder. This prevents files from accumulating in the temporary folder and taking up space on the HD 504 or the like.

[0048] When the link destination application 12 is not running, the start request unit 28 requests the link destination application 12 to be started via the OS link unit 30. By starting the link destination application 12, the user can transfer image data to the link destination application 12. If the image data can be received even when the link destination application 12 is not running, the start request unit 28 does not need to start the link destination application 12.

[0049] The OS interaction unit 30 is a function that interacts with the OS 14. The OS interaction unit 30 requests the OS 14 to perform processing on the interaction destination application 12 via the OS 14. The OS interaction unit 30 can obtain, for example, information from the OS 14 regarding whether the interaction destination application 12 is running, whether the interaction support screen 11 is being displayed, or information regarding the display position and size of the interaction destination application 12.

[0050] < <os>> The OS 14 has a transfer processing unit 51 and a file information linking unit 52. The transfer processing unit 51 performs data transfer processing based on a user's data transfer operation received by the operation receiving unit 23. The data transfer processing includes displaying an icon during movement in response to a user's operation, identifying a file, identifying a link destination application 12, and identifying the content of the data transfer processing (drag & drop, copy & paste, or cut & paste).

[0051] The file information linking unit 52 transfers the image data identified by the transfer processing unit 51 to the link destination application 12. Therefore, in this embodiment, the image data can be transferred to the link destination application 12 by using the function of the OS without using an API or the like.

[0052] <Scanner app screen> First, a method for setting the scanner application 13 to support the operation of transferring data to the linked application 12 will be described with reference to Fig. 5. Fig. 5 shows a scan setting screen 200. The scan setting screen 200 has a reading setting field 201 and a linked application setting field 202. The reading setting field 201 is a field where the user can set reading conditions such as color / grayscale, reading surface, image quality, document orientation, file format, and file name.

[0053] The link destination application setting field 202 can display a pull-down menu 212, which displays options for link destination applications 12. The options in FIG. 5 are "Drag a file to link destination application A" 205, "Drag a file to link destination application B" 206, "Drag a file to link destination application C" 207, and "Drag a file to link destination application D" 208. These options for link destination applications 12 are set in advance by the user. Link destination applications A to D are applications that do not have public APIs and therefore are difficult to link functions with via APIs, but that support data transfer via data transfer operations. The number of link destination applications A to D (four in the figure) is merely an example.

[0054] The reason why there are options such as link destination applications A to D according to the link destination application 12 is that the information processing device 3 starts the link destination application 12. In other words, if the user selects in advance the link destination application 12 in which he or she wants to utilize the image data after scanning, the link destination application 12 can be started automatically.

[0055] The pull-down menu 212 also displays options for apps that support API-based function collaboration. The apps that support API-based function collaboration are "App A" 203 and "App B" 204. These app options are set in advance by the user. Apps A and B have public APIs, so when the user selects one, the scanner app 13 can transfer image data to the app without performing any data transfer operations.

[0056] Furthermore, "Save by dragging" 209 is an option that the user selects when there is no need to transfer image data to the linked application 12 or an application that supports functional collaboration via API. When "Save by dragging" 209 is selected, the scanner application 13 displays the collaboration support screen 11 after scanning, but does not perform any control related to the linked application 12, such as launching the linked application. A user who does not want the linked application 12 to launch automatically can select "Save by dragging" 209 to prevent the linked application from launching.

[0057] Furthermore, by pressing "Add and Delete" 210, the user can add or delete linked applications 12 or applications that publish APIs to a pull-down menu 212. In the case of an application that publishes an API, the user can also configure settings related to the API.

[0058] In FIG. 5, "Quick Menu" 211 is currently set in the link destination application setting field 202. The "Quick Menu" 211 is not a setting by the user to set a link destination application or an application that exposes an API before scanning, but a setting to display a link destination selection screen (see FIG. 12) after scanning. On the link destination selection screen, the user can select a link destination application or an application that supports functional collaboration via API after scanning. Therefore, when "Quick Menu" 211 is selected, the link destination selection screen is displayed first. In this way, only one of the link destination application or "Quick Menu" 211 can be set in the link destination application setting field 202. By the user accepting the "Quick Menu" 211 instead of the link destination application 12, the link destination selection screen can be displayed after scanning. Furthermore, there is no inconsistency between the link destination application selected in the link destination application setting field 202 and the link destination application selected after the "Quick Menu" 211 is displayed (after scanning). Details of the link destination selection screen will be described in the second embodiment.

[0059] 6 shows an example of the collaboration support screen 11. The collaboration support screen 11 is, for example, a window generated by the OS 14. The collaboration support screen 11 may be a pop-up screen or the like displayed by the scanner application 13.

[0060] The collaboration support screen 11 has a message 221 , a file icon 222 , a data display button 223 , an image diagram 224 , and a completion button 225 .

[0061] The message 221 is a written message encouraging the drag and drop of the file icon 222, such as "You can link scanned data by dragging and dropping the following icon into linked application A." Note that "drag and drop" may be "copy and paste" or "cut and paste," or may be two or more of "drag and drop," "copy and paste," and "cut and paste."

[0062] The file icon 222 is an icon representing a file saved in a temporary folder. The file icon 222 is displayed in a framed area.

[0063] The data display button 223 is a button for displaying the contents (image data) of the file.

[0064] The image 224 is an illustration that visually guides the user on how to use the collaboration support screen 11.

[0065] The done button 225 is a button for the user to close the collaboration support screen 11. The user can also close the collaboration support screen 11 by clicking the cross mark 226 in the upper right corner.

[0066] By checking the cooperation support screen 11, the user can understand that image data can be transferred to cooperation destination application A by dragging and dropping the file icon 222 onto cooperation destination application A.

[0067] <Action or Processing> Next, a flow of cooperation support by the scanner system 1 will be described with reference to Fig. 7. Fig. 7 is a sequence diagram illustrating a process in which the scanner system 1 scans an original and the information processing device 3 displays the cooperation support screen 11.

[0068] S1: The user operates the information processing device 3 to input a scan execution operation to the scanner application 13. The operation acceptance unit 23 accepts this operation.

[0069] S2: The acquisition unit 21 transmits a command to start scanning to the scanner device 4 in response to this operation.

[0070] S3: When the communication unit 41 of the scanner device 4 receives the command to start scanning, the reading unit 42 starts scanning the document.

[0071] S4: The reading unit 42 creates a file containing image data each time a page is read, and the communication unit 41 sequentially transmits the file to the information processing device 3. This file may be an image file such as a JPEG file, or a PDF file. The scanner device 4 may also perform character recognition, and the file transmitted by the scanner device 4 is not limited to image data. In this way, the scanner device 4 transmits "data resulting from image data" to the information processing device 3.

[0072] S5: Furthermore, when all the documents have been scanned, the reading unit 42 detects, for example, "no document" and transmits a scan completion notification to the information processing device 3. In the case of reading one page at a time, when scanning one page is completed, the reading unit 42 transmits a scan completion notification to the information processing device 3. S6: The acquisition unit 21 of the information processing device 3 receives the scan completion notification. As a result, the screen control unit 26 executes the collaboration assistance process. Details of step S6 will be described with reference to FIG. 8. In this embodiment, the screen control unit 26 displays the collaboration assistance screen 11 after the scanner application 13 receives the scan completion notification, but the collaboration assistance screen 11 may also be displayed during scanning. However, since the file being scanned exists in a temporary folder, the user cannot perform data transfer operations until the file is moved to the temporary folder prepared for the collaboration assistance screen 11.

[0073] The acquisition unit 21 may acquire a file containing image data from a memory card attached to the information processing device 3, instead of acquiring image data from the scanner device 4. Furthermore, when the information processing device 3 communicates with a device that has files, such as a smartphone or a digital camera, the acquisition unit 21 may receive the file from the smartphone or the digital camera.

[0074] The collaboration support process in step S6 will be described with reference to Fig. 8. Fig. 8 is a flowchart illustrating the process in which the information processing device 3 displays the collaboration support screen 11 and transfers image data to a collaboration destination application in response to a data transfer operation.

[0075] When scanning starts, the screen control unit 26 starts the display process of the collaboration support screen 11 (S11). When scanning is performed, one or more files are saved in a temporary folder. The temporary folder is a folder where the scanner application 13 saves working files.

[0076] First, the storage unit 24 stores the file in a temporary folder (S12). The temporary folder is a folder for storing files that are displayed as file icons 222 on the collaboration support screen 11. The reason for moving the file from the temporary folder to the temporary folder is that the temporary folder is a folder for the scanner application 13, and it is not desirable for the user to operate it directly. However, the file may remain stored in the temporary folder.

[0077] The storage unit 24 determines whether or not the output file is set to be divided into multiple files (S13). If the determination in step S13 is Yes, the process proceeds to step S14, and if No, the process proceeds to step S15.

[0078] In step S14, the merging unit 25 combines the multiple files saved in the temporary folder into one file (S14). This eliminates the need for the user to repeatedly perform data transfer operations. The process of merging into one file is performed after scanning of all pages is complete.

[0079] Next, the screen control unit 26 displays the collaboration assistance screen 11 (S15). The screen control unit 26 requests the OS 14 via the OS collaboration unit 30 to display a window in which a message 221, a file icon 222, a data display button 223, an image diagram 224, and a completion button 225 are arranged. Note that the screen control unit 26 can display the collaboration assistance screen 11 after step S2 in Fig. 7 (however, data transfer operations cannot be performed until the files are integrated into one file).

[0080] The display control unit 22 may display a preview of the contents of the file before displaying the collaboration assistance screen 11. In this case, the screen control unit 26 may display the collaboration assistance screen 11 when the user inputs that they have confirmed the preview display (for example, by pressing the OK button). The display control unit 22 may display the preview in parallel with or after displaying the collaboration assistance screen 11.

[0081] Furthermore, the activation request unit 28 determines whether the link destination application 12 set by the user in the link destination application setting field 202 on the scan setting screen 200 is running (S16). The activation request unit 28 requests the OS interaction unit 30 to inquire whether the link destination application 12 is running. In response to the request from the activation request unit 28, the OS interaction unit 30 inquires of the OS whether the link destination application 12 is running, along with information identifying the link destination application 12.

[0082] In this embodiment, the data transfer operation is premised on the fact that the linked application 12 is running. However, if image data can be received when the linked application 12 is not running, the start-up request unit 28 does not need to start the linked application 12.

[0083] If the determination in step S16 is Yes, the process proceeds to step S17, and if the determination is No, the process proceeds to step S18.

[0084] In step S17, the launch request unit 28 displays the link destination application 12 in the foreground (S17). The launch request unit 28 acquires the window handle of the link destination application 12 and requests the OS link unit 30 to display the link destination application 12 in the foreground. In response to the request from the launch request unit 28, the OS link unit 30 requests the OS 14 to display the link destination application 12 in the foreground together with the window handle of the link destination application 12. Note that displaying in the foreground refers to an active window that is currently being used, and refers to a window that accepts keyboard or mouse operations by the user.

[0085] Note that the launch request unit 28 may not display the link-destination application 12 in the foreground, or may highlight the link-destination application 12 in addition to displaying it in the foreground. For example, the launch request unit 28 requests the OS link unit 30 to blink the window frame of the link-destination application 12, increase the brightness, or the like.

[0086] In step S18, the launch request unit 28 launches the link-destination application 12 (S18). The launch request unit 28 requests the OS link unit 30 to launch the link-destination application 12. In response to the request from the launch request unit 28, the OS link unit 30 requests the OS 14 to launch the link-destination application 12 together with information identifying the link-destination application 12 (there is no window handle because the application is not yet launched). Note that the order of execution of the processes of step S18 and step S15 may be reversed, or they may be executed in parallel.

[0087] As a result, the collaboration assistance screen 11 and the screen 15 of the collaboration destination application 12 are displayed on the entire screen of the information processing device 3. The user drags and drops (copy and paste or cut and paste) the file icon 222 displayed on the collaboration assistance screen 11 onto the screen of the collaboration destination application 12. The transfer processing unit 51 identifies the file in the temporary folder when the operation acceptance unit 23 accepts a click on the file icon 222. When the dragging starts, the transfer processing unit 51 displays an illustration of the file icon moving in accordance with the mouse cursor. The transfer processing unit 51 identifies the collaboration destination application 12 when the operation acceptance unit 23 accepts the dropping of the file icon 222. The transfer processing unit 51 also determines that the operation acceptance unit 23 has accepted the drag and drop operation.

[0088] The transfer processing unit 51 requests the file information linking unit 52 to transfer data by specifying the file storage location and the link destination application 12. The file information linking unit 52 transfers the file (image data) in the temporary folder to the link destination application 12 (S19). Transferring the image data means notifying the link destination application 12 of information that identifies the file (image data) and making the file the subject of predetermined processing.

[0089] When the user has completed the data transfer operation, he or she presses the completion button 225 on the collaboration assistance screen 11. The operation acceptance unit 23 accepts the pressing of the completion button 225, and the screen control unit 26 closes the collaboration assistance screen 11 (S20).

[0090] When the screen control unit 26 closes the collaboration assistance screen 11, the deletion unit 27 deletes the files stored in the temporary folder (S21). Details of the process of detecting that the collaboration assistance screen 11 has been closed will be described in the third embodiment.

[0091] In this way, the user can transfer the image data to the linked application 12. Because the file icon 222 is displayed on the link support screen 11, there is no need to search for the file containing the image data, and operational errors such as mistaking files, sending the wrong files, or deleting the wrong files can be reduced.

[0092] In step S20, the user presses the Finish button 225, but the user may forget to press the Finish button 225. In this case, the deletion unit 27 cannot delete the files in the temporary folder, and when the user performs the next scan, multiple files will remain saved in the temporary folder. In this case, the following methods can be considered for displaying the collaboration support screen 11. The screen control unit 26 manages the identification information (file name, file ID, timestamp, etc.) of the files that the storage unit 24 has saved in the temporary folder, and therefore identifies the last scanned file from the temporary folder and displays the file icon 222 of this file on the collaboration support screen 11. The screen control unit 26 displays the file icons 222 for all files stored in the temporary folder on the collaboration assistance screen 11. That is, the collaboration assistance screen 11 is displayed for each file stored in the temporary folder.

[0093] Therefore, the screen control unit 26 displays at least the file icon 222 of the file that was last scanned on the collaboration assistance screen 11.

[0094] <Screen example> 9 shows an example of the collaboration assistance screen 11 and the screen 15 of the collaboration destination application displayed by the information processing device 3. Since the collaboration destination application 12 is running, the user can, for example, drag and drop the file icon 222 on the collaboration assistance screen 11 onto the screen 15 of the collaboration destination application 12.

[0095] 10 shows an example of a screen display during drag-and-drop. Since drag-and-drop is in progress, the mouse cursor 232 and the moving file icon 231 are displayed. Note that the file icon 222 on the collaboration assistance screen 11 remains unchanged. This is due to the OS specifications. When drag-and-drop has started, the screen control unit 26 may display the file icon 222 on the collaboration assistance screen 11 in a different manner than before the start of drag-and-drop. A different manner may be, for example, lowering the brightness or changing the color.

[0096] FIG. 11 shows an example of a screen display when drag and drop is completed. Since the link destination application 12 has received the image data, a file icon 233 is displayed in the chat field 234. In this way, the user can easily transfer image data to a link destination application 12 that does not support API-based functional linkage. In an application in which the file destination is different for each conference, such as a video conferencing application, setting up the API is not easy even if the API is publicly available. The scanner application 13 of this embodiment can achieve the same effect for applications with publicly available APIs.

[0097] <Major Effects> In the information processing device 3 of this embodiment, when a scan is performed, the collaboration support screen 11 including the file icon 222 is automatically displayed, eliminating the need for the user to set an arbitrary folder in the scanner application 13 or open this folder. The user can transfer image data to the collaboration destination application 12 with a simple operation of dragging and dropping the file icon 222 displayed on the collaboration support screen 11 onto the collaboration destination application 12 that uses the image data. This allows the scanner application 13 to reduce operational errors such as mistaking image data, sending the wrong image data, or deleting the wrong image data. It also helps to eliminate the problem of not knowing how to collaborate.

[0098] [Second embodiment] In the first embodiment, the user sets the cooperation destination application 12 before scanning, but in this embodiment, a scanner application 13 will be described in which the user can set the cooperation destination application 12 after scanning.

[0099] In this embodiment, the hardware configuration diagram of FIG. 3 and the functional block diagram of FIG. 4 described in the first embodiment can be used.

[0100] <Post-scan settings> First, a screen on which the user selects the link-destination application 12 after scanning will be described with reference to Fig. 12. Fig. 12 shows a link-destination selection screen 240 displayed by the scanner application 13. The link-destination selection screen 240 is a screen on which the user selects the link-destination application 12 and the folder in which to save the file after scanning.

[0101] The recommendation section 301 displays selection buttons 301a and 301b relating to folders or apps that the user has used in the past or frequently uses.

[0102] The "Save to computer" field 302 displays destination folder selection buttons 302b to 302d, which are selected when saving a file to a computer (information processing device 3). When the user selects one of the destination folder selection buttons 302b to 302d, the file created by the last scan is saved in the selected folder.

[0103] Additionally, a dedicated app selection button 302a is displayed in the "Save to computer" field 302. The dedicated app is an app that works in conjunction with the scanner app 13 and is used for displaying files, etc. In other words, when the dedicated app selection button 302a is selected, the dedicated app starts up (if it is not already running), and the dedicated app can display the file created by the last scan.

[0104] In the "Check scan results and link" field 303, after the preview is displayed, selection buttons 303b to 303d for the link destination application to which the image data is to be transferred are displayed. For example, when the user presses one of the selection buttons 303b to 303d, the scanner application 13 displays a preview. For example, when the user ends the preview display, the link support screen 11 is displayed. The scanner application 13 launches the link destination application 12 in accordance with the selected selection button 303b to 303d.

[0105] Also, a selection button 303a for "Save to folder" is displayed in the "Check scan results and link" field 303. The selection button 303a for "Save to folder" is a selection button for saving the file in a folder rather than in the link destination application 12 after the scanner application 13 displays a preview. If the user does not want to transfer the image data to the link destination application 12, the user selects the selection button 303a for "Save to file." The destination folder can be set in advance by the user or can be set when the selection button 303a is pressed.

[0106] The link destination selection screen 240 also has a selection button for applications that can link functions via API. When the user presses this selection button, a preview of the last scanned file is displayed, and then the scanner application 13 can call the API and transfer the file to the selected application.

[0107] <Action or Processing> 13 is a flowchart illustrating a process in which the information processing device 3 displays the collaboration support screen 11 after the preview display, and transfers image data to the collaboration destination application 12 in response to a data transfer operation. Note that the explanation of FIG. 13 may mainly focus on differences from FIG. 8. In this embodiment, it is assumed that the quick menu 211 is set in the collaboration destination application setting field 202 on the scan setting screen 200.

[0108] When scanning is started, the display control unit 22 automatically displays the collaboration destination selection screen 240 shown in Fig. 12 (S31). In addition to being displayed automatically, the collaboration destination selection screen 240 may also be displayed when the user performs some kind of display operation. The collaboration destination selection screen 240 may also be displayed after scanning is completed. The collaboration destination selection screen 240 can be displayed after scanning is started in step S2 of Fig. 7.

[0109] The operation reception unit 23 determines whether or not a selection button for the link-destination application 12 has been pressed on the link-destination selection screen 240 (S32). That is, the operation reception unit 23 determines whether or not any of the selection buttons 303b to 303d displayed in the "Check scan results and link field" 303 has been pressed.

[0110] If the determination in step S32 is Yes, the process proceeds to step S33; if the determination is No, the process according to the button pressed by the user is performed, and the process in Fig. 13 ends. If the selection button 303a is pressed in the case of No in step S32, the file created by the last scan is automatically saved in a folder after the preview is displayed as described above. If one of the selection buttons 302a to 302d displayed in the "Save to computer" field 302 is pressed, the file is either transferred to a dedicated app without displaying a preview, or automatically saved in a folder.

[0111] In step S33, the scanner application 13 displays a preview of the file saved in the temporary folder (S33). The preview display may be displayed after the display of the collaboration support screen 11. The preview display may be displayed in parallel with the display of the collaboration support screen 11.

[0112] The subsequent processing may be the same as in Fig. 8. Therefore, the selection of the cooperation target application 12 triggers the display of the cooperation support screen 11.

[0113] <Screen example> The transition of screens displayed by the information processing device 3 in this embodiment will be described with reference to Fig. 14. Fig. 14 is a diagram illustrating the transition of screens displayed by the information processing device 3 when displaying the collaboration support screen 11. First, after scanning starts, the display control unit 22 displays the collaboration destination selection screen 240 of Fig. 12. Here, it is assumed that the user presses one of the selection buttons 303b to 303d for the collaboration destination application 12 displayed in the "Check scan results and collaboration field" 303.

[0114] As a result, the display control unit 22 displays a preview 250 of the last scanned file. The user can check the preview 250 and determine whether to transfer the file to the link-destination application 12. If the file is to be transferred to the link-destination application 12, the user presses the OK button 251, and if the file is not to be transferred, the user presses the cancel button 252. Here, it is assumed that the OK button 251 is pressed.

[0115] Pressing the OK button 251 causes the screen control unit 26 to display the collaboration assistance screen 11. The screen control unit 26 may display the collaboration assistance screen 11 before the preview display. Furthermore, if the collaboration destination application 12 is not running, the start request unit 28 starts the collaboration destination application 12. Therefore, the collaboration assistance screen 11 and the screen 15 of the collaboration destination application 12 are displayed in the same manner as in FIG. 9. Thereafter, the screen transitions as shown in FIGS. 10 and 11 in the same manner as in the first embodiment.

[0116] <Major Effects> According to this embodiment, in addition to the effects of the first embodiment, the user can select the linked application 12 after checking the preview, and then transfer the image data.

[0117] [Third embodiment] In the third embodiment, a process of detecting that the user has manually closed the collaboration destination selection screen 240 and deleting files in the temporary folder will be described in detail.

[0118] <About the function> 15 is a functional block diagram for explaining the functions of the scanner device 4 and the information processing device 3 in separate blocks. The functions of the scanner device may be the same as those in FIG.

[0119] <<Information processing equipment>> The information processing device 3 newly includes a detection unit 29. The detection unit 29 detects, via the OS collaboration unit 30, that the user has closed the collaboration support screen 11. When the screen control unit 26 displays the collaboration support screen 11, the window handle of the collaboration support screen 11 is obtained. The detection unit 29 can specify this window handle and obtain the state of the collaboration support screen 11 via the OS collaboration unit 30.

[0120] < <os>> The OS now includes a window management unit 53. The window management unit 53 manages whether a window exists and, if so, the display position of the window.

[0121] <Action or Processing> 16 is a flowchart illustrating a process in which the information processing device 3 displays the collaboration assistance screen 11 and transfers image data to the collaboration destination application 12 in response to a data transfer operation. Note that the explanation of FIG. 16 may mainly focus on the differences from FIG. 8. The processes of steps S51 to S59 are the same as those of FIG. 8.

[0122] In step S60, the detection unit 29 determines whether the operation reception unit 23 has received an operation to close the collaboration assistance screen 11 and whether the collaboration assistance screen 11 has been closed (S60). After displaying the collaboration assistance screen 11, the detection unit 29 requests the OS collaboration unit 30 to inquire whether the collaboration assistance screen 11 has been closed. The OS collaboration unit 30 specifies the window handle of the collaboration assistance screen 11 and acquires the state of the collaboration assistance screen 11 from the OS. For example, the detection unit 29 can detect that the collaboration assistance screen 11 has been closed based on a response that the collaboration assistance screen 11 does not exist.

[0123] If the determination in step S60 is Yes, the process proceeds to step S61; if the determination in step S60 is No, the determination in step S60 is repeated. However, if the detection unit 29 does not detect that the collaboration assistance screen 11 has been closed even after a certain period of time has passed, it may be determined that the user did not close the collaboration assistance screen 11. In this case, the process in FIG. 16 ends with the collaboration assistance screen 11 still displayed.

[0124] In step S61, since the collaboration assistance screen 11 is closed, the deletion unit 27 deletes the files in the temporary folder (S61).

[0125] Note that FIG. 16 shows the same processing as FIG. 8 of the first embodiment, but also in FIG. 13 of the second embodiment, the detection unit 29 can detect that the collaboration assistance screen 11 has been closed.

[0126] <Major Effects> According to this embodiment, in addition to the effects of the first and second embodiments, it is possible to detect that the user has closed the collaboration support screen 11 and delete the files in the temporary folder.

[0127] [Fourth embodiment] In this embodiment, the scanner application 13 detects that the transfer of data to the cooperation destination application 12 has been completed and automatically closes the cooperation assistance screen 11.

[0128] <About the function> In this embodiment, the functional block diagram of Fig. 15 described in the third embodiment can be used. However, the function of the detection unit 29 is different from that in the third embodiment.

[0129] <<Information processing equipment>> The detection unit 29 of this embodiment detects that the file information linking unit 52 has handed over image data to the link-destination application 12 via the OS linking unit 30. Alternatively, the detection unit 29 may monitor a folder from which the link-destination application 12 receives image data and detect that the image data has been received.

[0130] < <os>> The window management unit 53 of this embodiment detects that a file has been dragged and dropped onto the window of the cooperation destination application 12.

[0131] <Action or Processing> 17 is a flowchart illustrating the process in which the information processing device 3 displays the collaboration assistance screen 11 and transfers image data to a collaboration destination application in response to a data transfer operation. Note that the explanation of FIG. 17 may mainly focus on the differences from FIG. 8. The processes of steps S71 to S79 ​​are the same as those of FIG. 8.

[0132] In step S80, the detection unit 29 determines whether the cooperation destination application 12 has received image data (S80). Two methods of determination will be described.

[0133] (i) After displaying the collaboration support screen 11, the detection unit 29 specifies a file and requests the OS collaboration unit 30 to inquire whether the file information collaboration unit 52 has handed over the file to the collaboration destination application 12. The OS collaboration unit 30 specifies a file and inquires of the OS 14 whether the file information collaboration unit 52 has handed over image data to the collaboration destination application 12. For example, the detection unit 29 can detect that the file has been handed over to the collaboration destination application 12 based on a response from the file information collaboration unit 52 that the data transfer was successful.

[0134] (ii) After displaying the collaboration support screen 11, the detection unit 29 monitors the folder in which the collaboration destination application 12 receives image data and detects that the image data has been received. Since the file name in which the image data is stored is known, it determines whether a file with this file name has been added to the folder.

[0135] If the determination in step S80 is Yes, the process proceeds to step S81; if the determination in step S80 is No, the determination in step S80 is repeated. However, if the detection unit 29 does not detect that the cooperation destination application 12 has received the image data after a certain period of time has elapsed, it may be determined that the user has not performed a data transfer operation. In this case, the process in FIG. 17 ends with the cooperation assistance screen 11 still displayed.

[0136] In step S81, since it is detected that the cooperation destination application 12 has received the image data, the screen control unit 26 closes the cooperation assistance screen 11. That is, the screen control unit 26 requests the OS 14 via the OS cooperation unit 30 to close the cooperation assistance screen 11.

[0137] Then, since the collaboration assistance screen 11 is closed, the deletion unit 27 deletes the file in the temporary folder (S82). Closing of the collaboration assistance screen 11 can be detected in the same way as in step S60 of FIG.

[0138] Note that FIG. 17 shows the same processing as FIG. 8 of the first embodiment, but in FIG. 13 of the second embodiment as well, the detection unit 29 can detect that the cooperation destination application 12 has received image data.

[0139] <Major Effects> In addition to the effects of the first and second embodiments, this embodiment can detect that the linkage destination application 12 has received image data, close the linkage support screen 11, and delete the files in the temporary folder. Therefore, even if the user forgets to close the linkage support screen 11, the linkage support screen 11 can be closed and the files in the temporary folder can be deleted. Furthermore, it is possible to prevent a large number of files from accumulating in the temporary folder and causing a strain on the capacity of the HD 504.

[0140] [Fifth embodiment] In this embodiment, a scanner application 13 that adjusts the display position of the cooperation assistance screen 11 so that it does not overlap with the cooperation destination application 12 will be described.

[0141] In this embodiment, the functional block diagram of FIG. 15 described in the third embodiment can be used.

[0142] If the link destination application 12 is already running, the link assistance screen 11 may overlap with the screen 15 of the link destination application 12. If the link destination application 12 is not already running, the screen 15 of the started link destination application may overlap with the link assistance screen 11. Even if the link assistance screen 11 and the screen 15 of the link destination application overlap, data transfer operations are possible, but the user may be confused by the operation. Therefore, in this embodiment, the scanner application 13 adjusts the display position of the link assistance screen 11 so that it does not overlap with the screen 15 of the link destination application 12.

[0143] <If the linked app is already running> The screen control unit 26 obtains the display position of the linked application 12 from the OS 14 via the OS linkage unit 30. Since the OS 14 manages the display position of each window, the screen control unit 26 can obtain the display position of the screen 15 of the linked application 12 by specifying the window handle.

[0144] FIG. 18 is a diagram showing the display position of the screen 15 of the cooperation destination application on the entire screen 260 of the information processing device 3. The upper left corner of the entire screen 260 is set as the origin (0,0), and the coordinates of the entire screen 260 are defined by the x-axis and y-axis shown in the figure. The screen control unit 26 can acquire the display position (x1, y1) (x2, y2) of the screen 15 of the cooperation destination application 12. The screen control unit 26 can also acquire the number of vertical pixels P and the number of horizontal pixels Q of the entire screen 260 from the OS 14. The screen control unit 26 determines whether the space on the left or right side of the cooperation destination application 12 is larger based on the display position, and determines to display the cooperation assistance screen 11 in the larger space. In FIG. 18(a), the space on the left side of the cooperation destination application 12 is larger.

[0145] 18(b), the screen control unit 26 displays the collaboration assistance screen 11 on the left side of the screen 15 of the collaboration destination application 12. The screen control unit 26 determines the position in the x direction so that the center of the collaboration assistance screen 11 is at 1 / 2×x1 (the center of the left space) in the x direction. Note that the position in the up-down direction may be, for example, the center of the entire screen 260, or may be at the same height as the screen 15 of the collaboration destination application 12.

[0146] As shown in Fig. 19, there may be cases where there is not enough space on the entire screen 260. Fig. 19(a) is a diagram showing the display position of the screen 15 of the cooperation destination application 12 when there is not enough space on the entire screen 260 of the information processing device 3. The screen control unit 26 determines whether the larger space is equal to or larger than a threshold. The threshold may be the width of the cooperation assistance screen 11. If the larger space is equal to or larger than the threshold, the cooperation assistance screen 11 is displayed as shown in Fig. 18.

[0147] If the larger space is not equal to or larger than the threshold, the screen control unit 26 displays the collaboration support screen 11 at the right or left end of the larger space on the entire screen. In FIG. 19(a), the left side space of the screen 15 of the collaboration target application 12 is larger.

[0148] 19(b), the screen control unit 26 displays the collaboration assistance screen 11 at the left edge of the entire screen 260. This minimizes the area where the collaboration assistance screen 11 and the screen 15 of the collaboration destination application 12 overlap. Because the area of ​​the screen 15 of the collaboration destination application 12 that does not overlap with the collaboration assistance screen 11 is larger, the user can easily drag and drop the file icon 222.

[0149] When the screen 15 of the linked application 12 is displayed in full screen, the screen control unit 26 may display the image in any location such as the center of the entire screen 260 (the center of at least one of the left and right, top and bottom).

[0150] <If the linked app is not running> If the link destination application 12 is not running, the launch request unit 28 launches the link destination application 12. Either the launch of the link destination application 12 or the display of the link assistance screen 11 may occur first, but if the link destination application 12 is launched first, the same processing as when the link destination application 12 is already launched is performed. If the link assistance screen 11 is displayed first, the screen control unit 26 determines whether the two overlap after the link destination application is launched, and if they overlap, the same processing as when the link destination application 12 is already launched is performed. If the link assistance screen 11 is displayed first, the link assistance screen 11 will be moved, so it is preferable to launch the link destination application 12 before displaying the link assistance screen 11.

[0151] <Action or Processing> 20 is a flowchart illustrating the process performed by the screen control unit 26 to adjust the display position of the collaboration assistance screen 11. The process in FIG. 20 is executed when the screen control unit 26 displays the collaboration assistance screen 11 in the first to fourth embodiments.

[0152] First, the screen control unit 26 determines whether the link-destination application 12 has been started (S91). This determination method may be the same as that of S16 in Fig. 8. If the determination in step S91 is Yes, the process proceeds to step S93, and if the determination is No, the process proceeds to step S92.

[0153] In step S92, the screen control unit 26 waits until the cooperation destination application 12 is started (S92).

[0154] When the linked application 12 is started (Yes in S92) or has already been started (Yes in S91), the screen control unit 26 adjusts the display position of the linked support screen 11 so that it does not overlap with the screen 15 of the linked application 12 or so that the overlap is minimized (S93).

[0155] <Major Effects> The scanner application 13 of this embodiment adjusts the display position of the collaboration support screen 11 so that it does not overlap with the collaboration destination application 12, or adjusts the display position of the collaboration support screen 11 so that the overlap is minimized, making it easy for the user to perform data transfer operations.

[0156] [Other application examples] The best mode for carrying out the present invention has been described above using examples, but the present invention is not limited to these examples in any way, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention.

[0157] For example, the configuration example in FIG. 4 and the like is divided according to main functions to make it easier to understand the processing by the information processing device 3. The method of dividing the processing units and their names do not limit the present invention. The processing by the information processing device 3 can be divided into even more processing units depending on the processing content. Also, it can be divided so that one processing unit includes even more processes.

[0158] Furthermore, each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to perform each of the above-described functions.

[0159] Embodiments of the present invention provide significant improvements in computer power and functionality. These improvements allow users to utilize computers that provide more efficient and robust interaction with tables, which are ways of storing and presenting information in information processing devices. Furthermore, embodiments of the present invention provide a better user experience through the use of more efficient, powerful, and robust user interfaces. Such user interfaces provide better interaction between humans and machines. [Explanation of symbols]

[0160] 1 Scanner System 3. Information processing equipment 4. Scanner device< / os> < / os> < / os>

Claims

1. The information processing device on which the application is installed an acquisition unit that acquires data resulting from the image data from an external device; a screen control unit that displays display components related to the data acquired by the acquisition unit; an operation receiving unit that receives an operation for transferring data of the display component to the screen displayed by the application; A program to function as a

2. the screen control unit displays the display component when the acquisition unit acquires the data. The program according to claim 1.

3. after requesting the external device to start reading the document, the operation accepting unit accepts a selection of the application; The information processing device When the acquisition unit acquires the data and the application is not running, the acquisition unit functions as a start request unit that starts the application. The program according to claim 2.

4. the screen control unit displays the display component when the acquisition unit acquires the data and the operation acceptance unit accepts the selection of the application. The program according to claim 1.

5. When the acquisition unit acquires the data and the operation acceptance unit accepts the selection of the application, if the application is not running, the acquisition unit functions as a start request unit that starts the application. The program according to claim 4.

6. The information processing device causing the screen control unit to function as a display control unit that displays a preview of the data before or after the screen control unit displays the display component; The program according to claim 4.

7. If the application is already running, the start request unit displays the application in the foreground of the entire screen displayed by the information processing device. The program according to claim 3 or 5.

8. the screen control unit displays the display component in a region surrounded by a frame; The information processing device a storage unit that stores the data acquired by the acquisition unit in a predetermined storage area; When it is detected that an operation to close the area surrounded by the frame has been performed, the device functions as a deletion unit that deletes the data stored in the predetermined storage area. The program according to claim 1.

9. If an operation to close the area surrounded by the frame is not performed and the deletion unit does not delete the data stored in the predetermined storage area, and therefore a plurality of the data exists in the predetermined storage area, the screen control unit displays the display component related to at least the data last acquired by the acquisition unit. The program according to claim 8.

10. the screen control unit displays the display component in a region surrounded by a frame; The information processing device a detection unit that detects that the application has received the data; When the detection unit detects that the application has received the data, the screen control unit closes the area surrounded by the frame. The program according to claim 1.

11. The information processing device a storage unit that stores the data acquired by the acquisition unit in a predetermined storage area; When the detection unit detects that the application has received the data, the detection unit functions as a deletion unit that deletes the data stored in the predetermined storage area. The program according to claim 10.

12. The information processing device When the acquisition unit acquires a plurality of pieces of data from an external source, the acquisition unit functions as an integration unit that integrates the plurality of pieces of data into one piece of data; the screen control unit displays the display components related to the integrated data. The program according to claim 1.

13. the screen control unit displays, together with the display component, a message prompting an operation to transfer the display component on a screen displayed by the application. The program according to claim 1.

14. The operation of transferring the display component is drag and drop, copy and paste, or cut and paste. The program according to claim 13.

15. the screen control unit acquires a display position of a screen displayed by the application, and displays the display component at a position that does not overlap with the screen displayed by the application. The program according to claim 1.

16. a setting for accepting a selection of the application after the acquisition unit acquires the data from the external device, before the acquisition unit acquires the data from the external device, the operation acceptance unit accepts the selection of the application on a screen that accepts the selection of the application instead of the application to be selected; The program according to claim 4.

17. An information processing device in which an application is installed, an acquisition unit that acquires data resulting from the image data from an external device; a screen control unit that displays display components related to the data acquired by the acquisition unit; an operation receiving unit that receives an operation for transferring data of the display component to a screen displayed by the application; An information processing device having the above.

18. An information processing method performed by an information processing device in which an application is installed, An acquisition unit acquires data resulting from the image data from an external device. a screen control unit displays a display component related to the data acquired by the acquisition unit; an operation receiving unit receiving an operation for transferring data of the display component to a screen displayed by the application; An information processing method that performs the above.

Images