Information processing system, determination device, and program

Abstract

To efficiently unpack an information processing device and to prevent a user from forgetting to remove a fixing device.SOLUTION: An information processing system 100 includes an imaging unit 132 that captures an image of a fixing device 8 that has been removed from an information processing device 1 or a movable portion 44 to which the fixing device 8 has been attached, an image analysis unit 115 that analyzes the image captured by the imaging unit 132 and determines whether the fixing device 8 has been removed from the movable portion 44, and a determination unit 116 that determines whether all fixing devices 8 that had been attached to the information processing device 1 have been removed from the information processing device 1 on the basis of the analysis results by the image analysis unit 115.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing system, a determination device, a determination method, and a program, and more particularly to a technique for determining whether a fixing device has been properly removed from a movable part before starting up an information processing device in which a movable part is fixed by the fixing device. [Background technology]

[0002] Information processing devices such as MFPs (Multifunction Peripherals) include a scanner unit and a printer unit. The scanner unit and printer unit have various moving parts. For example, the scanner unit includes a reading head that is arranged along the main scanning direction of the document. The scanner unit reads the image on the document by moving the reading head in a sub-scanning direction that is perpendicular to the main scanning direction. The printer unit also includes moving parts such as a transport roller that transports paper, a rotating photosensitive drum, an intermediate transfer belt, and a toner bottle.

[0003] When an information processing device is shipped from a factory, its moving parts are fixed with fixing devices such as adhesive tape or resin molded parts. Fixing the moving parts with fixing devices prevents the moving parts from being damaged by vibrations during transportation. When the information processing device is delivered to the installation site, it is unpacked and the fixing devices are removed. Once all fixing devices attached to the information processing device have been properly removed, the information processing device is ready for normal operation.

[0004] However, sometimes the fixing device is forgotten to be removed during unpacking. If the information processing device is started up normally with the fixing device still attached to the movable part, the movable part may be damaged during initial operation.

[0005] In the past, it has been proposed to operate an information processing device in an unpacking mode to prevent forgetting to remove fixtures (see, for example, Patent Document 1). In the unpacking mode, a video or other guidance is displayed to the user to guide the user through the procedure for removing the fixtures. When the user instructs the user to proceed with the procedure, the information processing device drives the moving parts to an extent that will not damage them, and determines whether the fixtures have been removed. Therefore, the user can remove all of the fixtures from the information processing device by removing the fixtures one by one according to the guidance. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-145958 Summary of the Invention [Problem to be solved by the invention]

[0007] However, with the above-mentioned conventional technology, the user must remove the multiple fasteners one by one in order while checking the guidance, which takes time to check the guidance and makes it difficult to proceed with the unpacking work efficiently.

[0008] Furthermore, even if guidance is displayed, the user may not always properly remove the fixing device, and there is still a possibility that the user may forget to remove it. In the prior art, the moving part is driven to a degree that will not damage it in order to check whether the fixing part has been forgotten to be removed. In order to achieve a configuration that can drive the moving part to a degree that will not damage it, as in the prior art, it is necessary to provide play so that the moving part can move a certain amount while the fixed part is fixed. However, if play is provided while the moving part is fixed, there is a problem that the moving part will vibrate during transportation, which may damage the moving part.

[0009] Therefore, it is preferable that the movable part is fixed by a fixture so that there is no play. In this case, the information processing device cannot drive the movable part to an extent that will not damage it, because it checks whether the fixture has been removed.

[0010] The present invention aims to provide an information processing system, a determination device, a determination method, and a program that can solve the above problems. That is, the present invention aims to enable efficient unpacking of an information processing device and to prevent forgetting to remove fixing devices. [Means for solving the problem]

[0011] In order to achieve the above object, the invention of claim 1 is an information processing system comprising: a photographing unit that photographs an image of a fixing device that has been removed from an information processing device or a movable part to which the fixing device was attached; an image analysis unit that analyzes the image photographed by the photographing unit and determines whether the fixing device has been removed from the movable part; and a determination unit that determines whether all fixing devices that were attached to the information processing device have been removed from the information processing device based on the analysis result by the image analysis unit.

[0012] The invention of claim 2 is characterized in that, in the information processing system of claim 1, it further comprises a command unit that outputs a command to the information processing device to allow the movable part to be driven when the judgment unit determines that all of the fixing devices have been removed from the information processing device.

[0013] The invention of claim 3 is the information processing system of claim 1 or 2, wherein when the determination unit determines that all of the fixing devices have not been removed from the information processing device, it identifies fixing devices that have not been removed from the information processing device and notifies the user of the identified fixing devices.

[0014] The invention of claim 4 is the information processing system of claim 3, further comprising a guidance output unit that outputs guidance showing the procedure for removing the fixing device identified by the determination unit when the fixing device identified by the determination unit is notified to the user.

[0015] The invention according to claim 5 is the information processing system according to claim 3, characterized in that the photographing unit is mounted on a mobile terminal different from the information processing device.

[0016] The invention of claim 6 is characterized in that, in the information processing system of claim 5, the image analysis unit is mounted on a server on the cloud, acquires images captured by the photographing unit of the mobile terminal, and analyzes the images.

[0017] The invention of claim 7 is characterized in that, in the information processing system of claim 5, the image analysis unit is mounted on the information processing device, acquires images captured by the photographing unit of the mobile terminal, and analyzes the images.

[0018] The invention of claim 8 is the information processing system of claim 3, characterized in that the image analysis unit requests the user to take a new photograph if it is impossible to determine whether the fixing device has been removed from the movable part based on the image taken by the photographing unit.

[0019] The invention of claim 9 is the information processing system of claim 3, wherein the image analysis unit determines whether each of the plurality of fixing devices has been properly removed when the plurality of fixing devices are captured in an image captured by the photographing unit.

[0020] The invention of claim 10 is the information processing system of claim 3, characterized in that the image analysis unit performs artificial intelligence analysis on the fixing device or the movable part that appears in the image taken by the photographing unit, and determines whether the fixing device has been properly removed from the movable part.

[0021] The invention of claim 11 is the information processing system of claim 2, characterized in that the image analysis unit, the judgment unit, and the command unit are mounted on a server on the cloud.

[0022] The invention according to claim 12 is the information processing system according to claim 2, characterized in that the command unit is installed in the information processing device.

[0023] The invention of claim 13 is the information processing system of claim 2, wherein the information processing device has an unpacking mode that prohibits the driving of the moving part and a normal start-up mode that permits the driving of the moving part, and is configured to transition from the unpacking mode to the normal start-up mode based on the drive permission command output from the command unit.

[0024] The invention of claim 14 is the information processing system of claim 4, further comprising an image sending unit that sends an image captured by the photographing unit to a predetermined external device when it is determined that the fixing device identified by the determination unit has not been removed from the information processing device after the guidance is output by the guidance output unit.

[0025] The invention of claim 15 is a determination device capable of communicating with a mobile terminal equipped with a photographing unit, comprising: an image analysis unit that, when an image of a fixing device that has been removed from an information processing device or a movable part to which the fixing device was attached is taken by the photographing unit of the mobile terminal, acquires the image from the mobile terminal, analyzes the image, and determines whether the fixing device has been removed from the movable part; and a determination unit that determines whether all fixing devices that were attached to the information processing device have been removed from the information processing device based on the analysis result by the image analysis unit.

[0026] The invention of claim 16 is a program executed on a computer capable of communicating with a mobile terminal equipped with a photographing unit, the program causing the computer to execute the following steps: when an image of a fixing device detached from an information processing device or a movable part to which the fixing device was attached is photographed by the photographing unit of the mobile terminal, the computer acquires the image from the mobile terminal, analyzes the image, and determines whether the fixing device has been detached from the movable part; and the computer determines whether all fixing devices attached to the information processing device have been detached from the information processing device based on the analysis result of the image analysis step. [Effects of the Invention]

[0027] According to the present invention, it is possible to efficiently unpack an information processing device and to prevent a user from forgetting to remove a fixing device. [Brief explanation of the drawings]

[0028] [Figure 1] FIG. 1 is a diagram illustrating an external configuration of an information processing apparatus. [Figure 2] FIG. 1 is a diagram illustrating an internal configuration of an information processing device. [Figure 3] FIG. 10 is a diagram illustrating an example of an information processing device when an unpacking operation is performed. [Figure 4] 1 is a diagram illustrating a schematic configuration of an information processing system according to a first embodiment. [Figure 5] 1 is a block diagram showing a main functional configuration of an information processing system according to a first embodiment. [Figure 6] FIG. 10 is a diagram showing an example of an image taken by a user during unpacking work. [Figure 7] 10 is a flowchart illustrating an example of a processing procedure performed in the mobile terminal. [Figure 8] 10 is a flowchart illustrating an example of a processing procedure performed in a server. [Figure 9] FIG. 10 is a block diagram showing the main functional configuration of an information processing system according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0029] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. Elements common to the embodiments described below are designated by the same reference numerals, and redundant description thereof will be omitted.

[0030] (First embodiment) 1 is a diagram showing the external configuration of an information processing device 1 according to the present invention. The information processing device 1 is configured as an MFP, and has multiple functions such as a scan function, a print function, and a copy function.

[0031] The information processing device 1 has a scanner unit 2 on top of the device body. The scanner unit 2 has a document reading unit 2a and an automatic document transport unit 2b. The document reading unit 2a optically reads the image of a document set by a user and generates image data. The automatic document transport unit 2b automatically transports documents set by the user on a document setting tray 2c one by one to a reading position by the document reading unit 2a and discharges them onto a document discharge tray 2d.

[0032] The information processing device 1 has a printer unit 3 at the bottom of the device body. The printer unit 3 has an image forming unit 3a and a paper feed conveying unit 3b. The paper feed conveying unit 3b feeds and automatically conveys sheets of printing media such as printing paper one by one. The image forming unit 3a forms an image on the sheet as the sheet automatically conveyed by the paper feed conveying unit 3b passes a predetermined position. The printer unit 3 ejects the sheet with the image formed onto an ejection tray 3c provided above the printer unit 3.

[0033] The information processing device 1 also has an operation panel 5 on the front side of the device body. The operation panel 5 is a user interface when the user uses the information processing device 1. Therefore, the operation panel 5 has a display unit that displays various information to the user and an operation unit that accepts operations by the user.

[0034] 2 is a diagram showing the internal configuration of the information processing device 1. The automatic document transport unit 2b has a pickup roller 11 and a transport roller 12. The pickup roller 11 picks up the topmost document in a stack of documents placed on the document placement tray 2c and sends it downstream along a transport path. The transport roller 12 transports the document sent by the pickup roller 11 along a predetermined transport path. The pickup roller 11 and the transport roller 12 are both movable parts driven by a motor (not shown).

[0035] The document reading unit 2a includes a reading head 15 equipped with a light source 16 and a mirror 17. The reading head 15 is movable in the X direction shown in FIG. 2. For example, when a document is set on the document tray 2c of the automatic document feeder 2b, the document reading unit 2a moves the reading head 15 to a predetermined position below the slit glass 13. When a document automatically fed by the automatic document feeder 2b passes above the slit glass 13, the reading head 15 turns on the light source 16 to illuminate the document surface. Light reflected from the document surface is reflected by a mirror 17 and then by two mirrors 18, 18 provided at predetermined positions in the document reading unit 2a. The light reflected by the two mirrors 18, 18 enters a lens 19 and forms an image on a light receiving element 20 such as a CCD (Charge Coupled Device). The light receiving element 20 photoelectrically converts the light formed by the lens 19 to read the image of the document. Furthermore, when an original is set on the platen glass 14, the original reading unit 2a reads the image of the entire original by moving the reading head 15 in the X direction below the platen glass 14. The reading head 15 is a movable part that is driven in the X direction by a motor (not shown).

[0036] The paper feed conveying unit 3b has multiple paper feed trays 21 that can store multiple sheets 9. Each paper feed tray 21 is provided with a pickup roller 22 and a paper feed roller 23. The pickup roller 22 sends out the uppermost sheet 9 of the multiple sheets 9 stored in the paper feed tray 21 toward a conveying path 24. The paper feed roller 23 separates the first sheet 9 sent out by the pickup roller 22 from the second and subsequent sheets 9, and supplies only the first sheet 9 to the conveying path 24. In addition, the conveying path 24 for the sheet 9 is provided with a timing roller 25, a secondary transfer roller 26, and a fixing unit 27. The pickup roller 22, paper feed roller 23, timing roller 25, secondary transfer roller 26, and fixing unit 27 are movable parts driven by a motor (not shown).

[0037] The image forming section 3a has a plurality of image forming units 30Y, 30M, 30C, and 30K, each for a different color: yellow (Y), magenta (M), cyan (C), and black (K). The image forming section 3a also has an intermediate transfer belt 34 onto which the toner images of each color are primarily transferred by the image forming units 30Y, 30M, 30C, and 30K. The intermediate transfer belt 34 is an endless belt stretched between a drive roller 32 and a driven roller 33, and moves circulating between the drive roller 32 and the driven roller 33.

[0038] The image forming units 30Y, 30M, 30C, and 30K share a common configuration, differing only in the color of the toner they use. Image forming unit 30Y will be described below. Image forming unit 30Y has a cylindrical photoconductor drum 35 located below an intermediate transfer belt 34. A charging unit 36, an exposure unit 37, and a developing unit 38 are arranged around the photoconductor drum 35. The charging unit 36 is a roller that charges the surface of the rotating photoconductor drum 35 to a predetermined charge. The exposure unit 37 exposes the surface of the photoconductor drum 35, which has been charged to a predetermined charge, to light, forming an electrostatic latent image on the surface of the photoconductor drum 35. The developing unit 38 applies a developer containing toner and carrier to the surface of the photoconductor drum 35, thereby developing the electrostatic latent image with toner. Image forming unit 30Y has a primary transfer roller 39 located opposite the photoconductor drum 35 across the intermediate transfer belt 34. The primary transfer roller 39 primarily transfers the toner image formed on the surface of the photosensitive drum 35 by the developing unit 38 onto the intermediate transfer belt 34. The other image forming units 30M, 30C, and 30K have the same configuration.

[0039] Each image forming unit 30Y, 30M, 30C, and 30K performs primary transfer of a toner image of each color onto the intermediate transfer belt 34, superimposing the toner images of each color. Therefore, a color image in which the toner images of each color are superimposed is formed on the intermediate transfer belt 34. When the intermediate transfer belt 34 passes the position of the secondary transfer roller 26, the color image is secondarily transferred onto the surface of the sheet 9 being conveyed by the paper feed conveyance unit 3b. The image secondarily transferred onto the sheet 9 is fixed to the sheet 9 by passing through the fixing unit 27.

[0040] The image forming section 3a also includes toner bottles 31Y, 31M, 31C, and 31K of the respective colors. The image forming section 3a rotates the toner bottles 31Y, 31M, 31C, and 31K, respectively, to supply the toner filled in each toner bottle 31Y, 31M, 31C, and 31K to the developing section 38 of each image forming unit 30Y, 30M, 30C, and 30K.

[0041] The intermediate transfer belt 34, the image forming units 30Y, 30M, 30C, and 30K, and the toner bottles 31Y, 31M, 31C, and 31K are movable parts that are driven by motors (not shown).

[0042] As described above, the information processing device 1 is provided with a plurality of moving parts. When the information processing device 1 is shipped from the factory, a fixing device is attached to each of the plurality of moving parts to fix the moving parts so that the moving parts do not move. This prevents the moving parts from being damaged during transportation of the information processing device 1.

[0043] When the information processing device 1 is delivered to the installation site, unpacking is performed. The unpacking is a process for preparing the information processing device 1 for use at the installation site. Therefore, during the unpacking, all of the fasteners attached to the multiple movable parts of the information processing device 1 are removed. FIG. 3 illustrates an example of the information processing device 1 during unpacking. As shown in FIG. 3, during the unpacking of the information processing device 1, the opening and closing doors 4a, 4b, and 4c provided on the information processing device 1 are opened, and all of the fasteners securing the movable parts are removed. The unpacking is often performed by a service technician dispatched by the manufacturer. However, due to a labor shortage and other factors, it is expected that users will increasingly perform the unpacking themselves. When a service technician performs the unpacking, they have received prior training and can remove all of the fasteners from the information processing device 1. However, when a user performs the unpacking themselves, they may forget to remove the fasteners, even if they follow the instruction manual. Therefore, the information processing system 100 of this embodiment allows the user to efficiently unpack the information processing device 1 and also makes it possible to prevent the user from forgetting to remove the fixing device.

[0044] Fig. 4 is a diagram showing a schematic configuration of an information processing system 100 in the first embodiment. This information processing system 100 supports the unpacking of an information processing device 1 installed at an installation site 101 such as an office. In addition to the information processing device 1, the information processing system 100 shown in Fig. 4 also includes servers 110 and 120 installed on a cloud 102 such as the Internet, and a mobile terminal 130 carried by a user who unpacks the information processing device 1 at the installation site 101.

[0045] The mobile terminal 130 is configured, for example, by a smartphone or a tablet terminal. An application for assisting the user in unpacking the information processing device 1 is pre-installed on the mobile terminal 130. By starting the application, the mobile terminal 130 cooperates with the server 110 and the server 120 to assist the user in unpacking. Note that while FIG. 4 illustrates the server 110 and the server 120 as separate servers, this is not a limitation. For example, the server 110 and the server 120 may be configured as a single server.

[0046] Server 110 is a server computer. Server 110 includes a non-volatile storage unit 111 such as a hard disk drive. Storage unit 111 stores an image database 112. Image database 112 stores, for each model of information processing device 1, images of fixtures to be attached to the movable part, images of the movable part with the fixtures attached, images of the movable part with the fixtures removed, and the like. Note that the images of the movable part are not necessarily limited to images showing the movable part, and may be images showing the location where the fixtures are attached.

[0047] During the unpacking process, the user removes one by one the fasteners attached to each of the multiple movable parts of the information processing device 1. After removing a fastener from the information processing device 1, the user launches an application on the mobile terminal 130 and takes an image of the fastener removed from the information processing device 1 or the movable part to which the fastener was attached. The image taken at this time may be either a still image or a moving image. When the application takes an image using the imaging function of the mobile terminal 130, it transmits the captured image to the server 110 that has been registered in advance.

[0048] The server 110 is a determination device capable of communicating with a mobile terminal 130 having a photographing function. When the server 110 acquires a photographed image from the mobile terminal 130, it performs image analysis to identify the fasteners or movable parts shown in the image. At this time, the server 110 can accurately identify the fasteners or movable parts shown in the photographed image by referring to the image database 112 and searching for an image that most closely resembles an image registered in the image database 112. After identifying the fasteners or movable parts shown in the photographed image, the server 110 determines whether the fasteners have been properly removed from the movable parts based on the photographed image. The server 110 also determines whether all of the multiple fasteners attached to the information processing device 1 have been removed from the information processing device 1. If all of the fasteners have not been removed from the information processing device 1, the server 110 notifies the mobile terminal 130 of the fasteners that have not been removed from the information processing device 1. The mobile terminal 130 then informs the user of the fasteners that have not been removed from the information processing device 1. Therefore, the user can properly remove all of the fasteners attached to the information processing device 1 from the information processing device 1 during unpacking.

[0049] FIG. 5 is a block diagram showing the main functional configuration of the information processing system 100. The mobile terminal 130 includes a control unit 131, an image capturing unit 132, a communication unit 133, and a display unit 134. The control unit 131 is configured by a hardware processor of the mobile terminal 130 and controls the image capturing unit 132, the communication unit 133, and the display unit 134. The above-mentioned applications are launched by the control unit 131. The image capturing unit 132 is configured by a camera and captures still images or moving images. The communication unit 133 is a communication interface for wireless communication. For example, the communication unit 133 can connect to a wireless communication relay device and access a local network or the Internet via the relay device. The communication unit 133 can also perform short-range wireless communication such as Bluetooth (registered trademark). The display unit 134 is configured by, for example, a color liquid crystal display and displays various images.

[0050] The information processing device 1 includes a mode switching unit 41, a control unit 42, a communication unit 43, and a movable unit 44. The mode switching unit 41 switches the operation mode of the information processing device 1 using the control unit 42. The operation mode of the information processing device 1 is initially set to unpacking mode when shipped from the factory. The unpacking mode is an operation mode that prohibits the driving of the movable unit. When the information processing device 1 is powered on for the first time after shipping from the factory, the mode switching unit 41 starts up the information processing device 1 in unpacking mode. In the unpacking mode, when the mode switching unit 41 receives a command to permit the driving of the movable unit, it transitions the operation mode from unpacking mode to normal startup mode. The normal startup mode is an operation mode that permits the driving of the movable unit.

[0051] The control unit 42 includes a hardware processor and controls the operation of each unit of the information processing device 1. When the information processing device 1 is activated in the unpacking mode, the control unit 42 does not drive the movable unit 44. In contrast, when the information processing device 1 is activated in the normal startup mode, the control unit 42 drives the movable unit 44 mounted on the information processing device 1. For example, when the information processing device 1 transitions from the unpacking mode to the normal startup mode, the control unit 42 drives the movable unit 44 to perform an initial operation. This initial operation enables the information processing device 1 to execute jobs such as a scan job, a print job, or a copy job. The movable unit 44 includes the reading head 15 of the scanner unit 2 and the photosensitive drum 35 of the printer unit 3. The information processing device 1 is equipped with multiple movable units 44a, 44b, and 44c as the movable unit 44. The control unit 42 controls the execution of a job designated by a user by individually driving each of the multiple movable units 44a, 44b, and 44c.

[0052] The communication unit 43 is a communication interface for communicating with an external device. For example, the communication unit 43 is configured with a network interface card (NIC) or the like, and connects the information processing device 1 to a network such as a LAN (Local Area Network). The communication unit 43 may also have a function for performing short-range wireless communication such as Bluetooth (registered trademark).

[0053] The server 110 includes a communication unit 113 and is capable of communicating with both the mobile terminal 130 and the information processing device 1. The server 110 also includes a hardware processor. The server 110 functions as an image acquisition unit 114, an image analysis unit 115, a determination unit 116, an instruction unit 117, a guidance output unit 118, and an image transmission unit 119 by executing a predetermined program in the hardware processor.

[0054] The image acquisition unit 114 acquires images captured by the mobile terminal 130. FIG. 6 is a diagram showing examples of images captured by a user during unpacking. As shown in FIG. 6(a), the user may use the mobile terminal 130 to capture an image of the movable part 44 from which the fasteners have been removed. In this case, the user does not need to capture an image that shows the movable part 44 as it is. In other words, the user may capture an image of the location where the fasteners for fixing the movable part 44 were attached.

[0055] 6(b), the user may use the mobile terminal 130 to capture an image of the fixing device 8 removed from the information processing device 1. Fixing devices 8 include adhesive tape 8a, rod-shaped body 8b, string-shaped body 8c, screw 8d, and resin-molded product 8e. For example, if multiple adhesive tapes 8a are attached to the information processing device 1, the multiple adhesive tapes 8a each have different colors or sizes (width, etc.). Therefore, the color, size, etc. of the adhesive tape 8a can be identified by image analysis, thereby identifying the location on the information processing device 1 from which the tape was removed. The same applies to the rod-shaped body 8b, string-shaped body 8c, screw 8d, and resin-molded product 8e. In other words, the rod-shaped body 8b, string-shaped body 8c, screw 8d, and resin-molded product 8e each have a unique shape that allows identification of the location on the information processing device 1 from which they were attached. The user may use the mobile terminal 130 to capture an image of each fixing device 8 each time the user removes a fixing device 8 from the information processing device 1. Furthermore, the user may remove multiple fixtures 8 from the information processing device 1 and then photograph the multiple fixtures 8 simultaneously.

[0056] Image analysis unit 115 analyzes the image captured as described above and determines whether or not the fixing device 8 has been properly removed from movable part 44. For example, if one fixing device 8 is captured in the captured image, image analysis unit 115 refers to image database 112 to identify that fixing device 8 and further identifies movable part 44 to which the identified fixing device 8 was attached. At this time, image analysis unit 115 performs artificial intelligence analysis (AI analysis) of the captured image. Through this AI analysis, image analysis unit 115 can identify a fixing device that matches the angle of the fixing device 8 captured in the captured image, even if the angle differs from the angle of the fixing device registered in image database 112. Then, if one fixing device 8 is captured in the captured image, image analysis unit 115 determines that the fixing device 8 has been properly removed from information processing device 1.

[0057] Furthermore, if multiple fixing devices 8 are captured in a captured image, image analysis unit 115 refers to image database 112 and identifies each of the multiple fixing devices 8. Image analysis unit 115 then identifies the movable part 44 to which each fixing device 8 was attached, and determines whether each fixing device 8 has been properly removed from its respective movable part 44. In other words, image analysis unit 115 can determine at once from a single captured image that multiple fixing devices 8 have been removed from information processing device 1.

[0058] Furthermore, when an image of the movable part 44 is taken by the user, the image analysis unit 115 analyzes the taken image, and if the fixing device 8 is visible in the taken image, it determines that the fixing device 8 has not been removed from the information processing device 1. In this case, the image analysis unit 115 also performs an artificial intelligence analysis of the taken image. Through this artificial intelligence analysis, the image analysis unit 115 can identify the matching movable part even if the angle of the movable part 44 shown in the taken image differs from the angle of the movable part whose image is registered in the image database 112.

[0059] If image analysis unit 115 determines, as a result of the image analysis, that fixing device 8 has not been removed from movable unit 44, it notifies mobile terminal 130 of the determination result. Mobile terminal 130 then notifies the user that fixing device 8 has not been removed based on the notification. The notification to the user is performed, for example, by displaying a notification screen on display unit 134. Mobile terminal 130 may also notify the user by outputting audio.

[0060] Furthermore, if image analysis unit 115 cannot correctly determine whether fixing device 8 has been detached from movable unit 44 based on the captured image, it notifies mobile terminal 130 to re-take an image. Based on the notification, mobile terminal 130 notifies the user that re-taking an image is necessary, and requests that the user take a new image.

[0061] Based on the determination result of image analysis unit 115, determination unit 116 determines whether or not all of the fixing devices 8 attached to information processing device 1 at the time of shipment from the factory have been removed from information processing device 1. When determination unit 116 determines that all of the fixing devices 8 have been removed, it causes command unit 117 to function.

[0062] The command unit 117 outputs a drive permission command for the movable unit 44 to the information processing device 1. That is, the command unit 117 outputs the drive permission command when the determination unit 116 determines that all of the fixing devices have been removed from the information processing device 1. The command unit 117 may directly output the drive permission command to the information processing device 1. However, when the information processing device 1 is unpacked, the information processing device 1 may not be powered on. In that case, the command unit 117 cannot output the drive permission command to the information processing device 1. Therefore, the command unit 117 may output the drive permission command to the mobile terminal 130. In this case, the command unit 117 instructs the mobile terminal 130 to output the drive permission command when the information processing device 1 is started up in the unpacking mode.

[0063] Furthermore, when determination unit 116 determines that all of the fixtures 8 have not been removed from information processing device 1, it identifies the fixtures 8 that have not been removed from information processing device 1. Then, determination unit 116 notifies mobile terminal 130 that the identified fixtures 8 have not been removed. Based on the notification, mobile terminal 130 notifies the user of the fixtures 8 that have not been removed from information processing device 1. Furthermore, when determination unit 116 identifies the fixtures 8 that have not been removed from information processing device 1, it causes guidance output unit 118 to function.

[0064] When mobile device 130 is notified of a fixing device 8 identified by determination unit 116, guidance output unit 118 outputs guidance to mobile device 130 that indicates the procedure for removing fixing device 8 identified by determination unit 116. The guidance may be, for example, guidance in the form of a moving image or guidance in the form of audio. Mobile device 130 guides the user through the procedure for removing fixing device 8 based on the guidance output from guidance output unit 118.

[0065] Furthermore, even when the captured image acquired from mobile terminal 130 is analyzed after guidance output unit 118 has output guidance, determination unit 116 may still determine that fixing device 8 has not been removed. In this case, determination unit 116 causes image transmission unit 119 to function.

[0066] The image transmission unit 119 transmits the captured images acquired from the mobile terminal 130 to the server 120. The server 120 is capable of communicating with an information terminal 140 of an operator who assists the unpacking work. The server 120 transmits the captured images acquired from the image transmission unit 119 to the information terminal 140, which is an external device. This allows the operator to check the captured images and remotely assist the user in the unpacking work.

[0067] Next, a description will be given of the operation of the information processing system 100. The operation of the information processing system 100 is mainly divided into the operation of the mobile terminal 130 and the operation of the server 110. Therefore, the operation of the mobile terminal 130 will be first described.

[0068] 7 is a flowchart showing an example of a processing procedure performed in mobile terminal 130. This processing is performed by the hardware processor of control unit 131 executing a predetermined program. When mobile terminal 130 starts this processing, it launches an application for assisting the user in unpacking (step S10). When the application is launched, mobile terminal 130 connects to server 110 and establishes communication with server 110 (step S11).

[0069] When the mobile terminal 130 establishes a state in which it can communicate with the server 110, it accepts input of identification information of the information processing device 1 on which the unpacking work will be performed (step S12). The identification information is, for example, the serial number of the information processing device 1, and is information that can identify the model of the information processing device 1. For example, the mobile terminal 130 accepts an input operation of the identification information by the user. The mobile terminal 130 can also input the identification information by reading code information such as a QR code (registered trademark) assigned to the information processing device 1. When the mobile terminal 130 accepts input of the identification information, it transmits the identification information to the server 110 (step S13). This allows the server 110 to identify the information processing device 1 on which the unpacking work will be performed.

[0070] Thereafter, the mobile terminal 130 determines whether or not a photographing instruction from the user has been detected (step S14). If a photographing instruction has been detected (YES in step S14), the mobile terminal 130 drives the photographing unit 132 to photograph an image (step S15). For example, the user photographs an image of the movable part 44 to which the fixture 8 was attached in the information processing device 1 as shown in FIG. 6(a), or of the fixture 8 that has been removed from the information processing device 1 as shown in FIG. 6(b). After photographing an image, the mobile terminal 130 transmits the photographed image to the server 110 (step S16). Note that if a photographing instruction from the user has not been detected (NO in step S14), the mobile terminal 130 skips the processes of steps S15 and S16.

[0071] Mobile terminal 130 determines whether or not it has received information from server 110 (step S17). If it has received information from server 110 (YES in step S17), mobile terminal 130 performs processing such as displaying the information received from server 110, and notifies the user of the information received from server 110 (step S18). For example, if it receives a determination result as to whether or not fixing device 8 has been properly removed, mobile terminal 130 notifies the user of the determination result made by server 110. Furthermore, if it receives guidance indicating the procedure for removing fixing device 8, mobile terminal 130 notifies the user of the procedure for removing fixing device 8 based on the guidance.

[0072] Next, the mobile terminal 130 determines whether the unpacking work has been completed (step S19). For example, when the server 110 notifies the mobile terminal 130 that the unpacking work has been completed, the mobile terminal 130 determines that the unpacking work has been completed. If the unpacking work has not been completed (NO in step S19), the processing by the mobile terminal 130 returns to step S14. The mobile terminal 130 then repeatedly executes the processing from step S14 onwards. Furthermore, when the unpacking work has been completed (YES in step S19), the mobile terminal 130 ends the running state of the application.

[0073] Next, the operation of server 110 functioning as a determination device will be described. FIG. 8 is a flowchart showing an example of a processing procedure performed by server 110. This processing is performed by a hardware processor of server 110 executing a predetermined program. Server 110 connects to mobile terminal 130 based on a connection request from mobile terminal 130, and establishes a communication state with mobile terminal 130 (step S20). After establishing a communication state with mobile terminal 130, server 110 receives identification information from mobile terminal 130 (step S21). Based on the identification information, server 110 identifies information processing device 1 for which unpacking work will be performed (step S22). After identifying information processing device 1, server 110 extracts information about all fasteners 8 attached to the identified information processing device 1, and creates a fastener list (step S23).

[0074] Next, the server 110 acquires an image captured by the mobile terminal 130 (step S24). Upon acquiring the captured image, the server 110 performs image analysis (step S25). The server 110 then determines whether the fixture 8 shown in the captured image has been properly removed from the information processing device 1 (step S26). If the server 110 determines that the fixture 8 has been properly removed from the information processing device 1 (YES in step S26), it updates the fixture list (step S27). For example, the server 110 deletes the fixture 8 that has been removed from the information processing device 1 from the fixture list and updates the fixture list.

[0075] After updating the fixture list, the server 110 determines whether all fixtures 8 have been removed from the information processing device 1 (step S28). If it determines that all fixtures 8 have been removed (YES in step S28), the server 110 outputs a drive permission command to the information processing device 1 (step S29). This drive permission command may be sent directly to the information processing device 1 or may be sent to the mobile terminal 130. When the mobile terminal 130 receives the drive permission command from the server 110, it transmits the drive permission command to the information processing device 1 using short-range wireless communication with the information processing device 1. Therefore, even if network information has not been set, the information processing device 1 can receive the drive permission command via the mobile terminal 130 and can transition from the unpacking mode to the normal startup mode. After outputting the drive permission command, the server 110 notifies the mobile terminal 130 that the unpacking operation is complete (step S30).

[0076] On the other hand, if all fixtures 8 have not been removed from the information processing device 1 (NO in step S28), server 110 refers to the fixture list and identifies fixtures 8 that have not been removed from the information processing device 1 (step S31). Then, server 110 notifies mobile terminal 130 of the identified fixtures 8 (step S32). This notifies the user of fixtures 8 that have not been removed from the information processing device 1, thereby preventing the user from forgetting to remove the fixtures 8. Furthermore, in addition to notifying mobile terminal 130 of fixtures 8 that have not been removed from the information processing device 1, server 110 outputs guidance to mobile terminal 130 that shows the procedure for removing fixtures 8 from the information processing device 1 (step S33). This allows the user to proceed with the task of removing fixtures 8 based on the guidance output from mobile terminal 130. Thereafter, the processing by server 110 returns to step S24.

[0077] Furthermore, if it is determined in step S26 as a result of image analysis that fixing device 8 has not been removed from movable part 44 (NO in step S26), server 110 notifies mobile terminal 130 that fixing device 8 has not been removed (step S34). After notifying mobile terminal 130, server 110 determines whether guidance has been output (step S35). If fixing device 8 has still not been removed despite the output of guidance, it is considered that the user does not understand how to remove fixing device 8. Therefore, if guidance has been output (YES in step S35), server 110 transmits the captured image acquired in step S24 to server 120 (step S36). At this time, server 110 preferably adds identification information of information processing device 1 to the captured image before transmitting it.

[0078] When the server 120 acquires the captured image, it transmits the captured image to the operator's information terminal 140. This allows the operator to check the captured image on his / her own information terminal 140 and understand the work performed by the user. Furthermore, if the identification information of the information processing device 1 is added to the captured image, the operator can identify the model of the information processing device 1 that is being unpacked. This allows the operator to remotely and appropriately instruct the user on how to remove the fixing device 8.

[0079] If server 110 is unable to determine in step S26 based on the captured image whether fixing device 8 has been removed from movable part 44, it suspends the determination process and asks the user to retake an image. In this case, server 110 performs image analysis again based on the image recaptured by the user, and repeats the determination in step S26.

[0080] As described above, the information processing system 100 of this embodiment includes the photographing unit 132, the image analysis unit 115, and the determination unit 116. The photographing unit 132 photographs an image of the fixing device 8 removed from the information processing device 1 or the movable part 44 to which the fixing device 8 was attached. The image analysis unit 115 analyzes the image photographed by the photographing unit 132 and determines whether the fixing device 8 has been properly removed from the movable part 44. The determination unit 116 determines whether all fixing devices 8 attached to the information processing device 1 have been properly removed from the information processing device 1, based on the analysis result by the image analysis unit 115. That is, the information processing system 100 of this embodiment determines whether the fixing devices 8 have been properly removed from the information processing device 1, based on the image photographed by the photographing unit 132. This allows the user to efficiently unpack the information processing device 1. Furthermore, the information processing system 100 of this embodiment determines whether all fixing devices 8 have been properly removed from the information processing device 1. This prevents the user from forgetting to remove the fixing devices 8 during unpacking.

[0081] (Second embodiment) Next, a second embodiment of the present invention will be described. In the first embodiment, an example was described in which the server 110 analyzes a captured image and determines whether or not the fixing device 8 attached to the information processing device 1 has been properly removed. In this embodiment, an example will be described in which the functions of the server 110 described in the first embodiment are installed in the information processing device 1.

[0082] 9 is a block diagram showing the main functional configuration of the information processing system 100 in the second embodiment. The mobile terminal 130 in this embodiment has the same configuration as in the first embodiment. When the mobile terminal 130 captures an image, it transmits the captured image to the information processing device 1. When the information processing device 1 is unpacked, the network information of the information processing device 1 may not be set. Therefore, the mobile terminal 130 transmits the captured image to the information processing device 1 using short-range wireless communication or the like.

[0083] The information processing device 1 of this embodiment functions as a determination device capable of communicating with a mobile terminal 130 having a photographing function. When unpacking work is performed, the information processing device 1 is activated in an unpacking mode. In the unpacking mode, the communication unit 43 is capable of communicating with the mobile terminal 130 via short-range wireless communication or the like.

[0084] The information processing device 1 has an unpacking work support unit 45 that functions in unpacking mode. The unpacking work support unit 45 functions when the hardware processor of the control unit 42 executes a predetermined program. This unpacking work support unit 45 has the same functions as the server 110 in the first embodiment. That is, the unpacking work support unit 45 has an image acquisition unit 114, an image analysis unit 115, a determination unit 116, a command unit, a guidance output unit 118, and an image transmission unit 119. The information processing device 1 also has an image database 112.

[0085] Such an information processing device 1 can perform the same operations as the server 110 in the first embodiment while communicating one-to-one with the mobile terminal 130. That is, the information processing device 1 determines whether the fixing devices 8 have been properly removed from the information processing device 1 based on an image captured by the mobile terminal 130. The information processing device 1 also determines whether all fixing devices 8 have been appropriately removed from the information processing device 1. Therefore, the information processing system 100 of this embodiment achieves the same effects as the first embodiment.

[0086] When notifying the user of the results of image analysis or judgment, the information processing device 1 may display those results on the display unit of the operation panel 5. Using the operation panel 5 to notify the user has the advantage of reducing the processing load on the mobile terminal 130.

[0087] (Variation) Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications are possible.

[0088] For example, in the above embodiment, an example has been described in which the photographing unit 132 of the mobile terminal 130 photographs images of the fixture 8 and the movable unit 44. However, this is not limited to this. For example, after the fixture 8 attached to the scanner unit 2 of the information processing device 1 is properly removed, the scanner unit 2 may be used as the photographing unit 132. However, in this case, a separate sensor must be provided to detect that the fixture 8 attached to the scanner unit 2 has been properly removed, which increases the cost of the information processing device 1. For this reason, it is preferable that the photographing unit 132 be provided in a device different from the information processing device 1.

[0089] Furthermore, in the above embodiment, an example has been described in which guidance is output when determination unit 116 determines that all of the fixing devices 8 have not been removed. However, the timing for outputting guidance is not limited to the timing when determination unit 116 determines that all of the fixing devices 8 have not been removed. For example, when image analysis unit 115 determines that a fixing device 8 shown in a captured image has not been removed from movable unit 44, guidance output unit 118 may output guidance that shows the procedure for removing that fixing device 8 from movable unit 44.

[0090] In the first embodiment, an example has been described in which server 110 includes command unit 117 and outputs a drive permission command to information processing device 1. However, this is not limited to this. That is, command unit 117 in the first embodiment may be provided in information processing device 1. In this case, when determination unit 116 of server 110 determines that all of fixing devices 8 have been removed from information processing device 1, command unit 117 issues a drive permission command within information processing device 1 and permits driving of movable unit 44.

[0091] In the above embodiment, an MFP having multiple functions such as a scanning function, a printing function, and a copying function has been exemplified as the information processing device 1. However, the information processing device 1 is not necessarily limited to an MFP. For example, the information processing device 1 may be a dedicated printer or a dedicated scanner. Furthermore, the information processing device 1 may be a device that does not have a scanning function or a printing function. In other words, the information processing device 1 may be any device that has a movable part 44 that is driven in a normal operating state. [Explanation of symbols]

[0092] 1. Information processing equipment 8 Fixtures 44 Moving parts 100 Information Processing Systems 110 Server 112 Image Database 114 Image acquisition unit 115 Image Analysis Unit 116 Judgment section 117 Command section 118 Guidance output section 119 Image transmission unit 120 servers 130 Mobile Devices 132 Photography Department 140 Information terminal

Claims

1. an image capturing unit that captures an image of a fixture removed from the information processing device or a movable part to which the fixture was attached; an image analysis unit that analyzes the image captured by the imaging unit and determines whether the fixing device has been detached from the movable unit; a determination unit that determines whether or not all of the fixing devices attached to the information processing device have been removed from the information processing device based on the analysis result by the image analysis unit; An information processing system comprising:

2. a command unit that outputs a command to the information processing device to permit driving of the movable unit when the determination unit determines that all of the fixing devices have been removed from the information processing device; 2. The information processing system according to claim 1, further comprising:

3. The information processing system according to claim 1 or 2, characterized in that, when the determination unit determines that all of the fixing devices have not been removed from the information processing device, it identifies fixing devices that have not been removed from the information processing device and notifies the user of the identified fixing devices.

4. a guidance output unit that outputs guidance indicating a procedure for removing the fixing device identified by the determination unit when the fixing device identified by the determination unit is notified to the user; 4. The information processing system according to claim 3, further comprising:

5. 4. The information processing system according to claim 3, wherein the photographing unit is installed in a mobile terminal different from the information processing device.

6. The information processing system according to claim 5, wherein the image analysis unit is installed in a server on a cloud, acquires images taken by the image capture unit of the mobile terminal, and analyzes the images.

7. 6. The information processing system according to claim 5, wherein the image analysis unit is installed in the information processing device, acquires an image taken by the image taking unit of the mobile terminal, and analyzes the image.

8. The information processing system according to claim 3, wherein the image analysis unit requests a user to take a new photograph if it is impossible to determine whether the fixing device has been removed from the movable part based on the image taken by the photographing unit.

9. The information processing system according to claim 3, wherein, when a plurality of fixing devices are captured in the image captured by the imaging unit, the image analysis unit determines whether each of the plurality of fixing devices has been properly removed.

10. The information processing system according to claim 3, wherein the image analysis unit performs artificial intelligence analysis on the fixing device or the movable part that appears in the image taken by the photographing unit, and determines whether the fixing device has been properly removed from the movable part.

11. The information processing system according to claim 2 , wherein the image analysis unit, the determination unit, and the command unit are installed on a server on a cloud.

12. 3. The information processing system according to claim 2, wherein the command unit is installed in the information processing device.

13. The information processing system according to claim 2, characterized in that the information processing device has an unpacking mode that prohibits driving of the movable part and a normal startup mode that permits driving of the movable part, and transitions from the unpacking mode to the normal startup mode based on the drive permission command output from the command unit.

14. an image transmission unit that transmits the image captured by the imaging unit to a predetermined external device when it is determined that the fixing tool identified by the determination unit has not been removed from the information processing device after the guidance output unit has output the guidance; 5. The information processing system according to claim 4, further comprising:

15. A determination device capable of communicating with a mobile terminal equipped with a photographing unit, an image analysis unit that, when an image of a fixing device that has been detached from an information processing device or a movable part to which the fixing device was attached is taken by the photographing unit of the portable terminal, acquires the image from the portable terminal, analyzes the image, and determines whether the fixing device has been detached from the movable part; a determination unit that determines whether or not all of the fixing devices attached to the information processing device have been removed from the information processing device based on the analysis result by the image analysis unit; A determination device comprising:

16. A program executed on a computer capable of communicating with a mobile terminal having a photographing unit, the program including: an image analysis step of, when an image of a fixing device that has been detached from an information processing device or a movable part to which the fixing device was attached is taken by the photographing unit of the portable terminal, acquiring the image from the portable terminal and analyzing the image to determine whether the fixing device has been detached from the movable part; a determining step of determining whether or not all of the fixing devices attached to the information processing device have been removed from the information processing device based on the analysis result of the image analyzing step; A program characterized by executing the following.

Images