Information processing device, information processing method, and information processing program

Abstract

This information processing device is provided with at least one processor that: acquires at least one of a color-developing member image obtained by capturing an image of a color-developing member that develops color in a density distribution corresponding to the applied energy, and an additional image related to the color-developing member image; and determining whether the acquired image is the color developing member image or the attached image.

Description

Technical Field

[0001] The present invention relates to an information processing device, an information processing method and an information processing program. Background Art

[0002] Conventionally, it is known to use a color developing component that develops color according to energy when energy (such as pressure, heat, and ultraviolet rays) is applied to measure energy. As such a color developing component, for example, there is Prescale (pressure-sensitive film) (registered trademark) (manufactured by FUJIFILM Corporation) that can obtain a color density corresponding to the applied pressure.

[0003] For example, International Publication No. 2021 / 235364 discloses that a pressure measuring sheet (e.g., Prescale) is placed on a calibration sheet and photographed, and the density, size, distortion, and shape of the photographed image are corrected based on the calibration sheet included in the photographed image, and the density value of the pressure measuring sheet included in the corrected image is converted into a pressure value. Also, International Publication No. 2022 / 059342 discloses that an image signal of a photographed image photographed by a sensor having multiple spectral sensitivities (e.g., R sensitivity, G sensitivity, and B sensitivity) is obtained by a measuring sheet that is colored at a density corresponding to external energy, and the surface distribution of the external energy applied to the measuring sheet is derived based on the ratio of the signals of each spectral sensitivity. Summary of the invention

[0004] Technical issues to be solved by the invention

[0005] However, when photographing a color developing component, it is desirable to be able to photograph and record other images related to the color developing component, such as an image containing an identifier (e.g., a barcode and a QR code) indicating identification information of the color developing component and a photograph of the photographic environment in which the color developing component is photographed. For such an image, unlike an image of a color developing component, energy derivation processing is not required, but on the other hand, it is desirable to perform parsing processing on the identifier. Therefore, in the past, the user could input the attributes of the image, and the processor performed processing corresponding to the input attributes. In recent years, it is desirable to have a technology that can further improve convenience when being able to photograph images containing color developing components and other images in this way.

[0006] The present invention provides an information processing device, an information processing method and an information processing program capable of improving usability.

[0007] Means for solving technical problems

[0008] The first embodiment of the present invention is an information processing device comprising at least one processor, which performs the following processing: acquiring a color developing component image obtained by photographing a color developing component that develops color with a concentration distribution corresponding to an applied energy and at least one of an accompanying image related to the color developing component image; and determining whether the acquired image is a color developing component image or an accompanying image.

[0009] A second aspect of the present invention is that in the above-mentioned first aspect, the processor may execute a preset process based on a determination result of the acquired image.

[0010] In the third mode of the present invention, in the above-mentioned second mode, when it is determined that the acquired image is a color developing component image, the processor can use characteristic data that pre-sets the relationship between the energy applied to the color developing component and the color of the color developing component contained in the color developing component image, and derive the energy applied to the color developing component based on the color developing component image.

[0011] According to a fourth aspect of the present invention, in the third aspect, the processor may evaluate the derived energy based on preset reference information.

[0012] According to a fifth aspect of the present invention, in any one of the second to fourth aspects, when the acquired image is determined to be an attached image, the processor may determine whether the attached image includes at least one of a character string and an identifier.

[0013] A sixth aspect of the present invention is that in the fifth aspect, when it is determined that the acquired image is an attached image including at least one of a character string and an identifier, the processor may analyze at least one of the character string and the identifier included in the attached image.

[0014] The seventh embodiment of the present invention is an information processing method, which includes the following processing: acquiring a color developing component image obtained by photographing a color developing component that develops color with a concentration distribution corresponding to the applied energy and at least one of the accompanying images related to the color developing component image; and determining whether the acquired image is a color developing component image or an accompanying image.

[0015] The eighth embodiment of the present invention is an information processing program for causing a computer to perform the following processing: acquiring a color developing component image obtained by photographing a color developing component that develops color with a concentration distribution corresponding to the energy applied and at least one of an accompanying image related to the color developing component image; and determining whether the acquired image is a color developing component image or an accompanying image.

[0016] Effects of the Invention

[0017] According to the above aspects, the information processing device, information processing method, and information processing program of the present invention can improve usability. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a diagram showing an example of a schematic configuration of an information processing system.

[0019] Figure 2 It is a schematic diagram showing the photographing state of the color developing component image.

[0020] Figure 3 This is a diagram showing an example of a color developing component and a calibration component.

[0021] Figure 4 This is a diagram showing an example of a photography instruction.

[0022] Figure 5 This is a block diagram showing an example of the hardware configuration of a terminal device and a server device.

[0023] Figure 6 This is a diagram showing an example of characteristic data.

[0024] Figure 7 This is a block diagram showing an example of the functional configuration of a terminal device and a server device.

[0025] Figure 8 This is a diagram showing an example of a screen displayed on a display.

[0026] Fig. 9 This is a diagram showing an example of a screen displayed on a display.

[0027] Fig.10 This is a flowchart showing an example of information processing by a terminal device.

[0028] Fig.11 This is a flowchart showing an example of information processing by the server device.

[0029] Fig.12 A diagram for explaining a combined image. DETAILED DESCRIPTION

[0030] Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings. Figure 1 The configuration of the information processing system 1 of the present invention will be described. Figure 1 1 is a diagram showing a schematic structure of an information processing system 1. The information processing system 1 includes a terminal device 10, a server device 12, and a database 6. The terminal device 10 and the server device 12 are connected to each other via a wired or wireless network so as to be able to communicate with each other. The terminal device 10 is an example of the information processing device and the first information processing device of the present invention, and the server device 12 is an example of the second information processing device and the external device of the present invention.

[0031] The information processing system 1 is a system for measuring energy using a color developing component 90, which develops color with a concentration distribution corresponding to the applied energy when energy (such as pressure, heat, and ultraviolet rays) is applied. Specifically, the terminal device 10 acquires an image of the color developing component 90 after energy is applied, and derives the energy applied to the color developing component 90 from the image.

[0032] The image acquired by the terminal device 10 is sent to the server device 12, and is stored in the database 6 through the server device 12. In addition, the connection method between the server device 12 and the database 6 is not particularly limited, and for example, it can be a method of connection through a data bus, or a method of connection through a network such as NAS (Network Attached Storage) and SAN (Storage Area Network).

[0033] As the color developing component 90, for example, Prescale (registered trademark) (manufactured by FUJIFILM Corporation) can be used, which can obtain a color development concentration corresponding to the applied pressure. Prescale is a component in which a color developer including microcapsules containing a colorless dye and the color developer is applied to a sheet-like support. When pressure is applied to the Prescale, the microcapsules are destroyed and the colorless dye is adsorbed on the color developer and develops color. In addition, the color developer contains a variety of microcapsules of different sizes and strengths, so the color development concentration varies depending on the amount of microcapsules destroyed by the applied pressure. Therefore, by observing the color development concentration, the size of the pressure applied to the Prescale and the pressure distribution can be measured.

[0034] Furthermore, for example, as the color developing member 90 , a Thermoscale (product name) (manufactured by FUJIFILM Corporation) that develops color based on heat, a UV scale (product name) (manufactured by FUJIFILM Corporation) that develops color based on the amount of ultraviolet light, or the like can be applied.

[0035] In the information processing system 1, if Figure 2 As shown, in a state where the color developing component 90 is placed on the calibration component 80, the user uses the camera 40 (refer to Figure 5) to take a picture. Thus, the terminal device 10 obtains the color component image 50 including the calibration component 80 and the color component 90. In this way, when the user takes a picture, the color component image 50 may be affected by the characteristics of the camera 40, the lighting conditions (such as illuminance and color temperature) in the environment where the picture is taken, the shooting angle and the shooting distance, etc. That is, the color component image 50 may have deviations in distortion, tilt, size, shadow and color, etc. The calibration component 80 is a component for correcting these influences in the color component image 50.

[0036] Figure 3 FIG. 8 shows the imaged surface 80S of the calibration member 80 on which the color developing member 90 is placed. The calibration member 80 is a member formed in a sheet or plate shape by a support body composed of, for example, paper and resin. Figure 3 As shown, the imaged surface 80S includes a plurality of color blocks 83, four patterns 86A to 86D, a central area 88, and a frame 89 surrounding the outer edge of the central area 88. The color blocks 83 may have different colors, and there may be two or more color blocks 83 of the same color.

[0037] The plurality of color blocks 83 are blocks for calibrating the color of the color developing component 90 in the color developing component image 50. The four graphics 86A to 86D are graphics for indicating the range that should be included in the viewing angle when the user photographs the calibration component 80 and the color developing component 90. The frame 89 is used to correct the shape of the color developing component image 50, such as distortion, tilt, and size.

[0038] Furthermore, in the information processing system 1, photography is performed according to the photography command. Specifically, a photography command is created in at least one of the terminal device 10 and the server device 12, and the photography command is shared between the terminal device 10 and the server device 12. The user confirms the photography command displayed on the display 24A of the terminal device 10, and the color developing component 90 is photographed according to the photography command (refer to Figure 8 ).

[0039] The photographing instruction includes items related to the supplementary information about the color developing component image 50. The supplementary information may include, for example, information related to at least one of the inspection object using the color developing component 90, the type of the color developing component 90, the type of energy applied to the color developing component 90, the photographing environment of the color developing component 90, and the photographer of the color developing component 90. The type of the color developing component 90 includes, for example, types corresponding to the types of energy that can be measured such as Prescale, Thermoscale, and UV scale, and varieties of Prescale such as low pressure, medium pressure, and high pressure. The type of energy includes, for example, types such as pressure, heat, and ultraviolet rays, and the instantaneous pressure (the magnitude of the instantaneous pressure) and the continuous pressure (the time integral of the magnitude of the continuously applied pressure) in the pressure. The photographing environment includes, for example, the room temperature, humidity, and light source (illuminance and color temperature, etc.) in the environment where the color developing component 90 is photographed.

[0040] Furthermore, for example, the supplementary information may include information related to at least one of the energy applied to the color developing component 90 derived from the color developing component image 50 and the evaluation of the energy. In the terminal device 10, various indices such as the maximum value, the average value, and the area of ​​the color developing region are derived with respect to the energy applied to the color developing component 90 (details will be described later). Therefore, the photographing instruction may include items of indices related to the energy to be stored in the database 6. Furthermore, in the terminal device 10, an evaluation based on reference information pre-set regarding the energy is performed (details will be described later). Therefore, the photographing instruction may include reference information for evaluation.

[0041] Figure 4 An example of a photography instruction is shown in FIG. Figure 4 The photographic instructions shown include items related to the inspection object using the color developing component 90, the type of color developing component 90, the type of energy applied to the color developing component 90 ("pressure type"), an indicator related to the energy derived from the color developing component image 50 ("inspection item 1"), and benchmark information for evaluating the indicator ("base value").

[0042] The terminal device 10 and the server device 12 are described in detail below. Figure 5 , an example of the hardware structure of the terminal device 10 and the server device 12 is described. Figure 5As shown, the terminal device 10 includes a CPU (Central Processing Unit) 21A, a non-volatile storage unit 22A, and a memory 23A as a temporary storage area. In addition, the terminal device 10 includes a display 24A such as a liquid crystal display, an input unit 25A, a network I / F (Interface) 26A, and a camera 40. The CPU 21A, the storage unit 22A, the memory 23A, the display 24A, the input unit 25A, the network I / F 26A, and the camera 40 are connected via a bus 28A such as a system bus and a control bus so that various information can be received from each other.

[0043] The storage unit 22A is implemented by a storage medium such as a HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory. The storage unit 22A stores an information processing program 27A and characteristic data 18 in the terminal device 10. The CPU 21A reads the information processing program 27A from the storage unit 22A, expands it to the memory 23A, and executes the expanded information processing program 27A. The CPU 21A is an example of the first processor and a processor of the present invention.

[0044] The input unit 25A is used to receive user operations, such as a touch panel, button, keyboard, and mouse. The network I / F 26A performs wired or wireless communication with the server device 12 and other external devices (not shown). The camera 40 has sensors with multiple spectral sensitivities that are different from each other. Under the control of the CPU 21A, the sensor captures the subject and outputs its image signal. As the terminal device 10, for example, a smartphone, tablet terminal, portable terminal, and personal computer with a camera function can be appropriately applied.

[0045] like Figure 5 As shown, the server device 12 includes a CPU 21B, a nonvolatile storage unit 22B, and a memory 23B as a temporary storage area. In addition, the server device 12 includes a display 24B such as a liquid crystal display, an input unit 25B, and a network I / F 26B. The CPU 21B, the storage unit 22B, the memory 23B, the display 24B, the input unit 25B, and the network I / F 26B are connected via a bus 28B such as a system bus and a control bus so that various information can be received from each other.

[0046] The storage unit 22B is implemented by a storage medium such as a HDD, an SSD, or a flash memory. The storage unit 22B stores an information processing program 27B in the server device 12. The CPU 21B reads the information processing program 27B from the storage unit 22B, expands it to the memory 23B, and executes the expanded information processing program 27B. The CPU 21B is an example of a second processor of the present invention.

[0047] The input unit 25B is used to receive user operations, such as a touch panel, button, keyboard, and mouse. The network I / F 26B performs wired or wireless communication with the terminal device 10, the database 6, and other external devices (not shown). As the server device 12, for example, a device in which a software program that provides the function of a database management system (DBMS) is installed on a general-purpose computer can be appropriately used.

[0048] Figure 6 An example of the characteristic data 18 is shown in FIG. The characteristic data 18 is data in which the relationship between the energy applied to the color developing member 90 and the color of the color developing member 90 included in the color developing member image 50 is set in advance. Figure 6 In FIG. 5 , pressure is shown as an example of energy. Also, as values ​​indicating the color of the color developing member 90 in the color developing member image 50 , R (red) value, G (green) value, and B (blue) value in the RGB color system are shown.

[0049] Next, refer to Figure 7 , an example of the functional structure of the terminal device 10 and the server device 12 is described. Figure 4 The method of acquiring multiple color developing component images 50 is described below based on the photography instruction.

[0050] First, the functions of the terminal device 10 are described. Figure 7 As shown, the terminal device 10 includes an acquisition unit 30, a determination unit 31, a correction unit 32, a derivation unit 33, an evaluation unit 34, and a control unit 35. When the CPU 21A executes the information processing program 27A, the CPU 21A functions as each functional unit of the acquisition unit 30, the determination unit 31, the correction unit 32, the derivation unit 33, the evaluation unit 34, and the control unit 35.

[0051] Figure 8 FIG. 2 shows an example of a screen D1 displayed on the display 24A by the control unit 35 when the color developing unit 90 starts photographing. Figure 8 As shown, the control unit 35 displays the photography instruction on the screen D1. The user who confirms the photography instruction on the screen D1 selects the "continuous photography start" button 94. When the "continuous photography start" button 94 is selected, the control unit 35 activates the camera 40, and the user starts photography by the color developing unit 90 of the camera 40 according to the photography instruction.

[0052] The acquisition unit 30 acquires a plurality of color developing member images 50 obtained by photographing the color developing member 90 with the camera 40. As described above, the color developing member image 50 may include the calibration member 80 including the color patch 83 for calibrating the color of the color developing member 90.

[0053] In addition, at least one of the plurality of color component images 50 may include a color patch 83 for calibrating the color of the color component 90, and a part of the plurality of color component images 50 may not include the color patch 83. This is because the color patch 83 included in at least one of the plurality of color component images 50 may be used for other color component images 50 depending on the photographing device and the photographing environment. That is, the user photographs at least one of the plurality of color component images 90 set in the photographing instruction together with the calibration component 80, and photographs the other color component 90 alone without including the calibration component 80.

[0054] Furthermore, the acquisition unit 30 may acquire an accompanying image related to the color developing component image 50. The accompanying image may be, for example, an image including at least one of a character string and an identifier (e.g., a barcode and a two-dimensional code) related to the inspection of the color developing component 90. For example, the acquisition unit 30 may acquire, as an accompanying image, an image including a two-dimensional code indicating identification information, type, and inspection items of the color developing component 90, identification information and type of the inspection object using the color developing component 90, and identification information of the inspector. Furthermore, for example, the accompanying image may be an image accompanying the inspection and photography of the color developing component 90, such as a photograph of the inspection object, a photograph of the photography environment of the color developing component image 50, and a photograph of the face of the inspector.

[0055] The determination unit 31 determines whether the image acquired by the acquisition unit 30 is a color component image 50 or an attached image. Furthermore, when the determination unit 31 determines that the image acquired by the acquisition unit 30 is an attached image, it further determines whether the attached image contains at least one of a character string and an identifier. That is, the determination unit 31 determines whether it is a color component image 50, an attached image containing various information such as identification information, or an attached image not containing various information. Specifically, Figure 8 As shown in the screen D1 of FIG. 1 , the determination unit 31 can receive the selection of the type of the captured image and determine which of the selected types of images the image acquired by the acquisition unit 30 corresponds to. As a method for determining the type of the image, for example, a known method such as pattern matching can be appropriately applied.

[0056] Each functional unit performs a preset process based on the determination result of the determination unit 31. For example, in the case of an accompanying image that is determined to contain at least one of a character string and an identifier, the determination unit 31 can analyze at least one of the character string and the identifier contained in the accompanying image. For example, in the case of an accompanying image containing a two-dimensional code representing identification information of the color developing component 90, the determination unit 31 can analyze the two-dimensional code to obtain the identification information of the color developing component 90. And, for example, in the case of an accompanying image containing a handwritten or printed character string, the determination unit 31 can analyze the character string using a known optical character recognition technology to obtain text data. The information analyzed from these accompanying images can be used as the accompanying information of the color developing component image 50.

[0057] Next, the processing of each functional unit when the image acquired by the acquisition unit 30 is determined as the color developing component image 50 by the determination unit 31 will be described. The acquisition unit 30 acquires the characteristic data 18 (refer to Figure 6 ).

[0058] The correction unit 32 corrects at least one of the distortion, tilt, size, shadow, and color of the color component image 50. Thus, the correction is performed for the effects of the characteristics of the camera 40, the lighting conditions (e.g., illuminance and color temperature) in the environment where the photography is performed, the photography angle, and the photography distance, etc., which can be generated in the color component image 50 when the user takes the photo.

[0059] For example, the correction unit 32 may extract the frame 89 from the color component image 50, and correct the distortion, tilt, and size of the color component image 50 based on the shape of the extracted frame 89. As a method for extracting the frame 89, a known method using edge extraction processing in an image can be appropriately applied. Figure 3 As shown, when the frame 89 is a rectangle, the correction unit 32 performs projection transformation and projection transformation so that the four corners of the frame 89 extracted from the color component image 50 are 90 degrees respectively, thereby correcting the shape of the color component image 50, such as distortion, tilt, and size.

[0060] Furthermore, for example, the correction unit 32 may perform shading correction on the color component image 50. Shading is a deviation in brightness generated on the color component image 50 due to a decrease in the amount of peripheral light caused by the optical system of the camera 40 and a deviation in the illuminance distribution in the lighting environment in which the image is taken. As a method for shading correction, a known method can be appropriately applied.

[0061] Furthermore, for example, the correction unit 32 can calibrate the color of the color component 90 included in the color component image 50 using the color block 83 included in the color component image 50. This is because the color of the color component 90 is affected by the characteristics of the camera 40 and the lighting conditions in the environment in which the image is taken. As a calibration method, a known method can be appropriately applied. For example, for each color block 83 included in the calibration component 80, a reference color is stored in the storage unit 22A in advance, and the correction unit 32 can adjust the color of the color component image 50 so that the color of each color block 83 included in the color component image 50 is consistent with the respective reference color.

[0062] Furthermore, as described above, sometimes at least one of the plurality of color component images 50 includes the color patch 83, and some of the plurality of color component images 50 do not include the color patch 83. In this case, the correction unit 32 may calibrate the color of the color component 90 included in each of the plurality of color component images 50 using the color patch 83 included in at least one of the color component images 50. Specifically, it is preferred that when the color component image 50 includes the color patch 83, the correction unit 32 calibrates the color of the color component 90 using the color patch 83, and when the color component image 50 does not include the color patch 83, the correction unit 32 calibrates the color of the color component 90 using the color patch 83 included in the other color component images 50.

[0063] That is, the correction unit 32 can perform the same calibration on the color component image 50 not including the color patch 83 as on the color component image 50 including the color patch 83. On the other hand, for the color component image 50 including the color patch 83, it is preferable to perform calibration using the color patch 83 included in the image instead of using other images.

[0064] In addition, as described above, the calibration component 80 may include two or more color patches 83 of the same color. For example, due to the characteristics of the camera 40, the lighting conditions in the environment in which the photographing is performed, the photographing angle, the photographing distance, and the like, there may be a situation where two or more color patches 83 originally formed with the same color appear in different colors on the color development component image 50. Therefore, for example, the correction unit 32 may adjust the color of the color development component image 50 so that the average color of the color patches 83 formed with the same color in the color development component image 50 is consistent with the reference color. And, for example, the correction unit 32 may adjust the color of the color development component image 50 so that the color of the color patches 83 formed with the same color in the color development component image 50 that is closest to the reference color is consistent with the reference color.

[0065] Furthermore, the calibration unit 32 may use a part of the plurality of color patches 83 included in the color developing component image 50 for calibration. Furthermore, for example, the calibration unit 32 may make the color patches 83 used for calibration different according to the type of the color developing component 90. For example, Prescale, which is an example of the color developing component 90, is manufactured in a plurality of varieties with different measurable pressure ranges, such as for low pressure, medium pressure, and high pressure. Furthermore, for example, as described above, as the color developing component 90, Thermoscale, UV scale, etc. may also be used in addition to Prescale.

[0066] Therefore, the correction unit 32 can use a part of the color patches 83 that are preset according to the type of the color component 90 included in the color component image 50 to perform calibration. The correspondence between the type of the color component 90 and the color patch 83 used for calibration can be pre-stored in the storage unit 22A, for example. The type of the color component 90 included in the color component image 50 can be input by the user via the input unit 25A, for example (see Fig. 9 ), an identification code indicating the type of the color developing component 90 may be marked on the color developing component 90, and the correction unit 32 may be determined by reading the identification code.

[0067] The deriving unit 33 uses the characteristic data 18 acquired by the acquiring unit 30 and derives the energy applied to the color developing component 90 based on each of the plurality of color developing component images 50. Specifically, the deriving unit 33 derives the energy based on the color developing component image 50 after at least one of distortion, tilt, size, shadow, and color is corrected by the correcting unit 32. In addition, the characteristic data 18 may be prepared in advance according to the type of the color developing component 90 (for example, for low pressure, medium pressure, and high pressure), and stored in the storage unit 22A. In this case, the deriving unit 33 may derive the energy using the characteristic data 18 corresponding to the type of the color developing component 90 included in the color developing component image 50.

[0068] Furthermore, the deriving unit 33 can derive various indices related to the energy applied to the color developing component 90. The various indices include, for example, energy distribution obtained by deriving energy according to pixels of the area where the color developing component 90 develops color (hereinafter referred to as the "color developing area") and representative values ​​such as the maximum value, minimum value, average value, and central value of the energy of the color developing area. Furthermore, for example, the area of ​​the color developing area, the ratio of the area within the range where the energy is pre-set in the color developing area, the uniformity of the energy of the color developing area, and the load of the color developing area (the product of the area of ​​the color developing area and the average value of the energy). Furthermore, for example, the matching degree and deviation degree with the benchmark when the color developing degree (i.e., energy and energy distribution) of the color developing component 90 is pre-set.

[0069] The evaluation unit 34 evaluates the energy derived by the derivation unit 33 based on the preset reference information. The reference information is, for example, a threshold value related to the matching degree and deviation degree of the color development degree (energy and energy distribution) of the color development component 90 from the preset limit sample, and the upper limit value and lower limit value of various indicators related to energy. The evaluation unit 34 can evaluate whether the energy derived by the derivation unit 33 meets the reference. In addition, the evaluation unit 34 can receive the designation of a part of the area to be evaluated in the area of ​​the color development component 90 in the color development component image 50, and evaluate the part of the area. The reference information can be included in the photography instruction, or can be pre-stored in the storage unit 22A.

[0070] Furthermore, the evaluation unit 34 may perform a comprehensive evaluation based on the evaluation results of each energy derived by the deriving unit 33. For example, the evaluation unit 34 may evaluate whether the overall image is qualified based on whether the proportion of the plurality of color developing component images 50 evaluated as qualified among the plurality of color developing component images 50 acquired according to the imaging instruction exceeds a preset threshold.

[0071] It is preferable that the processing of each functional unit related to the plurality of color component images 50 is performed by a predetermined number of processing units. That is, it is preferable that the processing based on the acquisition unit 30, the determination unit 31, the correction unit 32, the derivation unit 33 and the evaluation unit 34 is not repeated for each color component image 50, but that two or more color component images 50 are collected to perform each processing (so-called batch processing). In particular, it is preferable that the processing is performed by a predetermined number of processing units for the processing of acquiring (photographing) a plurality of color component images 50, the processing of deriving the energy applied to the color component 90 based on each of the plurality of color component images 50, and the processing of evaluating the energy based on the predetermined reference information for each of the energies. For example, it is preferable that after acquiring (photographing) five color component images 50, the five color component images 50 are transferred to the energy derivation processing together.

[0072] The control unit 35 performs control to display the color developing component image 50 , the energy derived by the deriving unit 33 , and the evaluation result by the evaluating unit 34 on the display 24A. Fig. 9 2 shows an example of a screen D2 displayed on the display 24A by the control unit 35. The screen D2 displays an image of a portion of the color developing member 90 in the color developing member image 50, various indices related to energy derived from the color developing member 90, and evaluation results.

[0073] As shown in screen D2, the control unit 35 can perform control to extract a portion of the color developing component 90 from the color developing component image 50 and display it on the display 24A. In addition, the control unit 35 can use an image after at least one of the distortion, tilt, size, shadow and color is corrected by the correction unit 32 as the color developing component image 50 displayed on the display 24A. The "pressurized area" in screen D2 refers to the area of ​​the above-mentioned color developing area. The "average pressure" refers to the average value of the energy of the above-mentioned color developing area. The "load" refers to the product of the pressurized area and the average pressure. The "uniformity of pressure value" refers to the uniformity of the pressure value of the color developing area.

[0074] Furthermore, the control unit 35 can receive input of supplementary information related to the color developing component image 50. In the screen D2, as an example of supplementary information related to the color developing component image 50, the type of the color developing component 90, the type of pressure, the room temperature, the humidity, and the light source are displayed, and a pull-down menu 92 for receiving these inputs is displayed. The type of pressure is, for example, an instantaneous pressure indicating the magnitude of the pressure applied to the Prescale instantaneously and a continuous pressure indicating the time integral of the magnitude of the pressure applied to the Prescale continuously. The light source is, for example, a standard light source D65 and auxiliary light sources D50, D55, and D75 specified in JIS Z 8720:2012. Furthermore, for example, as supplementary information, identification information of the calibration component 80, the color developing component 90, the user who applies energy to the color developing component 90, the user who photographs the color developing component 90, the user's evaluation result of energy, and various inspection conditions can be used.

[0075] Then, the control unit 35 transmits the color component image 50 to the server device 12 via the network I / F 26A. Specifically, the control unit 35 transmits at least one of the color component image 50 before correction by the correction unit 32, the color component image 50 after correction, and the image of the portion of the color component 90 extracted from the color component image 50 to the server device 12.

[0076] Furthermore, the control unit 35 may send the accompanying information of the color component image 50 to the server device 12. As described above, the accompanying information includes the energy derived by the deriving unit 33, the result of the evaluation by the evaluation unit 34, the accompanying image acquired by the acquisition unit 30, the information parsed by the determination unit 31 from the character string and identifier contained in the accompanying image, and the information received as input. The control unit 35 may send information about the items specified in the photographing instruction in these accompanying information. In other words, the control unit 35 may exclude the items in the accompanying information that are not specified in the photographing instruction from the objects to be sent to the server device 12. For example, even if the minimum value of energy is derived by the deriving unit 33, the control unit 35 may not send the minimum value of energy to the server device 12 as long as there is no item related to the minimum value of energy in the photographing instruction.

[0077] Next, the functions of the server device 12 are described. Figure 7 As shown, the server device 12 includes a control unit 60 and a determination unit 62. When the CPU 21B executes the information processing program 27B, the CPU 21B functions as each functional unit of the control unit 60 and the determination unit 62.

[0078] The control unit 60 stores the color component image 50 and the accompanying information received from the terminal device 10 via the network I / F 26B in the database 6. Furthermore, the control unit 35 stores the plurality of color component images 50 and the accompanying information included in one imaging command as a set of data in the database 6. That is, the control unit 60 stores the energy derived from each of the plurality of color component images 50 as a set of data in the database 6.

[0079] The determination unit 62 determines whether the color developing component image 50 stored in the database 6 satisfies a preset condition. Specifically, the determination unit 62 can determine whether the color developing component image 50 stored in the database 6 complies with a preset imaging command.

[0080] For example, suppose that due to temporary communication failure, the transmission of various data such as the color component images 50 from the terminal device 10 to the server device 12 cannot be properly performed. Therefore, the determination unit 62 can determine whether the number of color component images 50 set in the photographing instruction is consistent with the number of color component images 50 stored in the database 6. For example, when the photographing instruction includes an instruction for 30 copies, the determination unit 62 can determine whether 30 copies of color component images 50 are stored in the database 6.

[0081] Furthermore, for example, even if the number of items is correct, the user does not perform the inspection according to the photographing instruction. Therefore, the determination unit 62 can determine whether the items related to the additional information set in the photographing instruction and the additional information of the color component image 50 stored in the database 6 are consistent. Figure 4 In the photographing instruction, the No. 1 "pressure roller A" should be inspected by the "high pressure" color developing component 90, but it is mistakenly inspected by the "low pressure" color developing component 90, and is also stored in the database 6. In this case, the determination unit 62 can determine that the photographing instruction is inconsistent with the supplementary information stored in the database 6. And, for example, Figure 4 In the photography instruction, the "pressure area" of "pressure roller A" No.1 should be "150mm 2 Below", but it is exported as "200mm" by inspection 2 ", and is also stored in the database 6. In this case, the determination unit 62 can determine that the photography instruction is inconsistent with the accompanying information stored in the database 6.

[0082] When the determination unit 62 determines that the color component image 50 stored in the database 6 does not satisfy the preset condition, the control unit 60 may request the terminal device 10 to resend the color component image 50. When the control unit 35 of the terminal device 10 receives the resending request from the server device 12, the color component image 50 may be resent to the server device 12.

[0083] Furthermore, when the determination unit 62 determines that the color component image 50 stored in the database 6 does not satisfy the preset condition, the control unit 60 may notify the terminal device 10 of the intention. When the control unit 35 of the terminal device 10 receives a notification from the server device 12 indicating that the color component image 50 stored in the database 6 does not satisfy the preset condition, the user may be notified of the intention. In addition, the notification mechanism is not particularly limited, and for example, the notification may be displayed on the display 24A or by sound.

[0084] Furthermore, when the determination unit 62 determines that the color component image 50 stored in the database 6 satisfies the preset condition, the control unit 60 may notify the terminal device 10 of the intention. After the control unit 35 of the terminal device 10 transmits the color component image 50 to the server device 12, before a preset period (for example, one month) has passed, the color component image 50 may be stored in the storage unit 22A to cope with a request for retransmission. On the other hand, when receiving a notification from the server device 12 that the color component image 50 stored in the database 6 satisfies the preset condition, the color component image 50 of which the notification is received may be deleted from the storage unit 22A before the preset period has passed.

[0085] Next, refer to Fig.10 , the function of the terminal device 10 is described. In the terminal device 10, the CPU 21A executes the information processing program 27A to execute Fig.10 The first information processing is shown. The first information processing is executed when the user issues an instruction to start the execution via the input unit 25A, for example.

[0086] In step S10, the control unit 35 causes the display 24A to display the photographing instruction. In step S12, the acquisition unit 30 acquires the image photographed by the camera 40. Here, as candidates for the image acquired by the acquisition unit 30, there can be cited the color component image 50 photographed according to the photographing instruction displayed in step S10 and the accompanying image related to the color component image 50. In addition, among the accompanying images, there can also be cited images that include or do not include a character string and / or an identifier representing the accompanying information. In step S14, the determination unit 31 determines whether the image acquired in step S12 is the color component image 50 or the accompanying image.

[0087] In step S14, when it is determined that the image is the color component image 50 ("Yes" in step S14), the process moves to step S16. In step S16, the acquisition unit 30 acquires the characteristic data 18 from the storage unit 22A. In step S18, the correction unit 32 corrects at least one of the distortion, tilt, size, shadow, and color of the color component image 50 acquired in step S12. In step S20, the derivation unit 33 uses the characteristic data 18 acquired in step S16 and derives the energy applied to the color component 90 based on the color component image 50 corrected in step S18. In step S22, the evaluation unit 34 evaluates the energy derived in step S20 based on the preset reference information.

[0088] On the other hand, in step S14, when it is determined that it is not the color component image 50 but an accompanying image ("No" in step S14), the process proceeds to step S30. In step S30, the determination unit 31 determines whether the accompanying image acquired in step S12 includes at least one of a character string and an identifier. When it is determined that the accompanying image includes at least one of a character string and an identifier ("Yes" in step S30), the process proceeds to step S32, and the determination unit 31 analyzes at least one of the character string and the identifier contained in the accompanying image.

[0089] After step S22, after step S32, and in step S30, when it is determined that the attached image does not include any of the character string and the identifier ("No" in step S30), the process moves to step S40. In step S40, the control unit 35 controls the display 24A to display the color component image 50 corrected in step S18 and the attached information of the color component image 50. Here, the attached information includes at least one of the energy derived in step S20, the result of the evaluation in step S22, the attached image, and at least one of the character string and the identifier included in the attached image analyzed in step S32. In step S42, the control unit 35 sends the color component image 50 and the attached information to the server device 12, and ends the first information processing.

[0090] Next, refer to Fig.11 , the role of the server device 12 is described. In the server device 12, the CPU 21B executes the information processing program 27B to execute Fig.11 The second information processing shown is started when, for example, the color developing component image is received from the terminal device 10.

[0091] In step S50, the control unit 60 stores the color component image 50 and the accompanying information received from the terminal device 10 in the database 6. In step S52, the determination unit 62 determines whether the color component image 50 and the accompanying information stored in the database 6 in step S10 satisfy a preset condition. If it is determined that the condition is satisfied, the second information processing is terminated.

[0092] On the other hand, if it is determined in step S52 that the condition is not satisfied, the process moves to step S54. In step S54, the control unit 60 may request the terminal device 10 to resend the color component image 50 and the accompanying information. Furthermore, the control unit 60 may notify the terminal device 10 that the color component image 50 and the accompanying information stored in the database 6 do not satisfy the preset condition. When step S54 is completed, the second information processing ends.

[0093] As described above, the information processing system 1 according to one embodiment of the present invention includes a first information processing device (terminal device 10) having at least one first processor and a second information processing device (server device 12) having at least one second processor. The first processor acquires a color component image 50 obtained by photographing a color component 90 that develops color with a concentration distribution corresponding to the applied energy, and sends the color component image 50 to the second information processing device. The second processor stores the color component image 50 received from the first information processing device in the database 6. The first processor or the second processor determines whether the color component image 50 stored in the database 6 satisfies a preset condition.

[0094] That is, according to the information processing system 1 involved in the above-mentioned aspect, when various data such as the color developing component image 50 captured by the terminal device 10 are collected in the server device 12, it can be determined whether the data to be collected in the server device 12 is appropriately collected. Therefore, various data acquired in the terminal device 10 can be appropriately collected in the server device 12, and usability can be improved.

[0095] Furthermore, an information processing device (terminal device 10) involved in one embodiment of the present invention includes at least one processor, which performs the following processing: obtaining a coloring component image 50 obtained by taking a plurality of photos of a coloring component 90 that is colored with a concentration distribution corresponding to the energy applied; and using characteristic data 18 that pre-sets the relationship between the energy applied to the coloring component 90 and the color of the coloring component 90 contained in the coloring component image 50, and deriving the energy applied to the coloring component 90 based on each of the plurality of coloring component images 50.

[0096] That is, the information processing device (terminal device 10) according to the above aspect can derive energy for each of the plurality of color developing member images 50. Therefore, when a plurality of examinations are performed continuously, imaging and energy derivation can be performed smoothly, and usability can be improved.

[0097] Furthermore, an information processing device (terminal device 10) involved in one embodiment of the present invention includes at least one processor, and the processor performs the following processing: acquiring a color developing component image 50 obtained by photographing a color developing component 90 that develops color with a concentration distribution corresponding to the applied energy and at least one of the accompanying images related to the color developing component image 50; and determining whether the acquired image is the color developing component image 50 or the accompanying image.

[0098] That is, according to the information processing device (terminal device 10) involved in the above-mentioned aspect, it is possible to save the user's effort in distinguishing whether it is the color component image 50 or the type of the attached image or the input image. Furthermore, even if the color component image 50 and the attached image are not distinguished during shooting, the image type can be distinguished later. Therefore, usability can be improved.

[0099] In addition, in the above exemplary embodiment, the server device 12 may have a part of the functions of the terminal device 10. For example, instead of the terminal device 10, the server device 12 may perform the function of the derivation unit 33 (deriving the energy based on the color component image 50). Similarly, the terminal device 10 may have a part of the functions of the server device 12. For example, instead of the server device 12, the terminal device 10 may perform the function of the determination unit 62 (determining whether the color component image 50 stored in the database 6 satisfies a preset condition).

[0100] Furthermore, in the above exemplary embodiment, the terminal device 10 is Figure 4 Although the method of acquiring a plurality of color developing component images 50 by a photography instruction has been described, the present invention is not limited thereto. For example, the technology according to the present exemplary embodiment can also be applied to a method of acquiring at least one color developing component image 50.

[0101] Furthermore, as the plurality of color developing component images 50 in the above exemplary embodiment, the following may also be applied: Fig.12 The image shown is obtained by dividing one color developing member 90 into a plurality of regions and capturing the divided regions. Fig.12 This is a diagram showing a color developing component 90 divided into four regions 90A to 90D. As a situation suitable for such division, for example, a color developing component 90 is assumed to be so large that it is difficult to take a picture at once in the camera 40 of the photographing terminal device 10 (smartphone).

[0102] Furthermore, in this case, the acquisition unit 30 may combine the plurality of color developing component images 50 obtained by photographing the plurality of regions 90A to 90D to generate one combined image. Furthermore, the derivation unit 33 may derive the energy applied to the color developing component 90 based on the combined image. Furthermore, in this case, the derivation unit 33 may derive the distribution of the energy applied to the color developing component 90 based on the combined image, and generate a two-dimensional graph (e.g., a heat map) showing the distribution of the energy. Furthermore, the evaluation unit 34 may evaluate the energy derived from the combined image based on pre-set reference information.

[0103] Furthermore, in each of the above exemplary embodiments, the correction unit 32 performs shading correction on the color component image 50 and the derivation unit 33 derives energy based on the color component image 50 after shading correction, but the present invention is not limited thereto. For example, International Publication No. 2022 / 059342 discloses that the uneven surface distribution of the concentration value in the image is eliminated by using the ratio of the signal of each spectral sensitivity of the image without performing shading correction. The derivation unit 33 can derive the ratio of the signal of each spectral sensitivity of the color component image 50 using the technology described in International Publication No. 2022 / 059342, and derive energy based on the ratio. In this case, the correction unit 32 may not perform shading correction on the color component image 50.

[0104] Furthermore, in the above-mentioned exemplary embodiments, the camera 40 provided in the terminal device 10 is used as the photographing device for the color component image 50, but the invention is not limited thereto. For example, an external digital camera or scanner of the terminal device 10 may be used as the photographing device. In this case, the terminal device 10 may not be provided with the camera 40.

[0105] Furthermore, in the above-described exemplary embodiments, the calibration component 80 is photographed together with the color developing component 90 in order to correct at least one of the distortion, tilt, size, shadow, and color of the color developing component image 50, but the present invention is not limited thereto. For example, when a scanner is used as the photographing device, it is possible to suppress deviations in the distortion, tilt, size, shadow, and color of the color developing component image 50. In this case, only the color developing component 90 may be photographed without photographing the calibration component 80. In this case, the function of the correction unit 32 may be omitted.

[0106] Furthermore, in each of the above exemplary embodiments, various processors as shown below can be used as the hardware configuration of the processing unit (processing unit) that performs various processes, such as the acquisition unit 30, the determination unit 31, the correction unit 32, the derivation unit 33, the evaluation unit 34, and the control unit 35, as well as the control unit 60 and the determination unit 62. The various processors described above include, in addition to the CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units as described above, processors such as FPGA (Field Programmable Gate Array) whose circuit configuration can be changed after manufacturing, programmable logic devices (PLD), ASIC (Application Specific Integrated Circuit), and other processors having a circuit configuration specially designed to perform specific processing, i.e., dedicated circuits.

[0107] One processing unit may be composed of one of these various processors, or a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA). Furthermore, multiple processing units may be composed of one processor.

[0108] As an example of a plurality of processing units being constituted by one processor, there is a first method in which one processor is constituted by a combination of one or more CPUs and software, such as a computer represented by a client or server, and the processor functions as a plurality of processing units. There is a second method in which a processor is used that realizes the functions of the entire system including a plurality of processing units by one IC (Integrated Circuit) chip, such as a system on chip (SoC) represented by the like. In this way, various processing units are constituted by one or more of the above-mentioned various processors as a hardware structure.

[0109] Furthermore, as the hardware configuration of these various processors, more specifically, a circuit (circuitry) formed by combining circuit elements such as semiconductor elements can be used.

[0110] Furthermore, in the above exemplary embodiment, the information processing program 27A is pre-stored (installed) in the storage unit 22A, and the information processing program 27B is pre-stored in the storage unit 22B, but the present invention is not limited to this. The information processing program 27A and / or 27B can also be provided by recording on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), and a USB (Universal Serial Bus) memory. Furthermore, the information processing program 2727A and / or 27B can also be provided by downloading from an external device via a network. In addition, the technology of the present invention also relates to a storage medium that non-temporarily stores the information processing program in addition to the information processing program.

[0111] The technology of the present invention can also appropriately combine the above-mentioned illustrative implementation examples and embodiments. The above-mentioned records and illustrated contents are detailed descriptions of the parts involved in the technology of the present invention, which are only examples of the technology of the present invention. For example, the descriptions related to the above-mentioned structure, function, action and effect are descriptions related to an example of the structure, function, action and effect of the parts involved in the technology of the present invention. Therefore, without departing from the scope of the main purpose of the technology of the present invention, it is of course possible to delete unnecessary parts or add or replace new elements to the above-mentioned records and illustrated contents.

[0112] The entire contents of the invention of Japanese Patent Application No. 2022-093298 filed on June 8, 2022 are incorporated herein by reference. All documents, patent applications, and technical standards described in this specification are incorporated herein by reference to the same extent as if each document, patent application, and technical standard were specifically and individually described as being incorporated by reference.

Claims

1. An information processing device comprising at least one processor, The processor performs the following processing: acquiring at least one of an image of a color developing member obtained by photographing a color developing member that develops color with a concentration distribution corresponding to the applied energy and an accompanying image related to the color developing member image; and It is determined whether the acquired image is the color developing member image or the attached image.

2. The information processing device according to claim 1, wherein: The processor executes a preset process according to a determination result of the acquired image.

3. The information processing device according to claim 2, wherein: When it is determined that the acquired image is the color developing member image, The processor uses characteristic data in which a relationship between energy applied to the color developing member and a color of the color developing member included in the color developing member image is preset, and derives the energy applied to the color developing member based on the color developing member image.

4. The information processing device according to claim 3, wherein: The processor evaluates the derived energy according to preset reference information.

5. The information processing device according to claim 2, wherein: When it is determined that the acquired image is the supplementary image, The processor determines whether the attached image includes at least one of a character string and an identifier.

6. The information processing device according to claim 5, wherein: When it is determined that the acquired image is the attached image including at least one of a character string and an identifier, The processor parses at least one of the character string and the identifier included in the attached image.

7. An information processing method, comprising the following processing: acquiring at least one of an image of a color developing member obtained by photographing a color developing member that develops color with a concentration distribution corresponding to the applied energy and an accompanying image related to the color developing member image; and It is determined whether the acquired image is the color developing member image or the attached image.

8. An information processing program for causing a computer to execute the following processing: acquiring at least one of an image of a color developing member obtained by photographing a color developing member that develops color with a concentration distribution corresponding to the applied energy and an accompanying image related to the color developing member image; and It is determined whether the acquired image is the color developing member image or the attached image.

Images