Information processing device, information processing method, and information processing program

Abstract

The information processing device acquires a first energy distribution measured by a first measurement means capable of measuring an integrated value of an energy amount after completion of application of energy to an object, and acquires time series data of a second energy distribution measured by a second measurement means. The second measurement means is capable of measuring the amount of energy at a plurality of time points in a period from the start of application of energy to the object to the end of application of energy to the object, and performs a predetermined process using the first energy distribution and the time sequence data.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and an information processing program. Background Art

[0002] Conventionally, various techniques for measuring energy (such as pressure, heat, and ultraviolet rays) applied to a surface have been known.

[0003] First, a technique for measuring the amount of energy using a coloring member that colors according to the amount of energy when energy is applied is known. As such a coloring member, for example, Prescale (registered trademark) (manufactured by FUJIFILM Corporation) that can obtain a coloring density corresponding to the applied pressure is available. For example, International Publication No. 2021 / 235364 discloses the following: A pressure measurement sheet (such as Prescale) is arranged on a calibration sheet and photographed, the density, size, distortion, and shape of the photographed image are corrected based on the calibration sheet included in the photographed image, and the density value of the pressure measurement sheet included in the corrected image is converted into a pressure value.

[0004] Second, a sensor device that outputs an electrical signal corresponding to pressure or the like through a sensor element that detects pressure or the like is known. For example, Japanese Unexamined Patent Application Publication No. 2020-123119 discloses a sensor device including: a sensing unit arranged on a base material and including a sensor element that detects at least one of pressure and temperature; and a storage unit that stores calibration data of the sensor element. Summary of the Invention

[0005] Technical Problem to be Solved by the Invention

[0006] An object of the present invention is to provide an information processing apparatus, an information processing method, and an information processing program that can effectively utilize information on the amount of energy applied to an object.

[0007] Means for Solving the Technical Problem

[0008] The information processing apparatus according to the first aspect is an information processing apparatus including at least one processor, and the processor performs the following processing: obtaining a first energy distribution measured by a first measurement component that can measure an accumulated value of the amount of energy applied to an object after the energy application to the object is completed; obtaining time-series data of a second energy distribution measured by a second measurement component that can measure the amount of energy at a plurality of time points during the period from the start of energy application to the object to the end of energy application to the object; and performing predetermined processing using the first energy distribution and the time-series data.

[0009] Advantageous Effects of the Invention

[0010] According to the present invention, information on the amount of energy applied to an object can be effectively utilized. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 FIG. is a block diagram showing an example of the schematic configuration of an information processing system.

[0012] Figure 2 FIG. is a diagram showing an example of the schematic configuration of a tactile sensor.

[0013] Figure 3 FIG. is a block diagram showing an example of the hardware configuration of an information processing device.

[0014] Figure 4 FIG. is a diagram showing an example of characteristic data.

[0015] Figure 5 FIG. is a diagram showing an example of an input profile.

[0016] Figure 6 FIG. is a block diagram showing an example of the functional configuration of an information processing device.

[0017] Figure 7 FIG. is a diagram for explaining the correction process of the pressure distribution.

[0018] Figure 8 FIG. is a diagram for explaining the derivation process of a new input profile.

[0019] Figure 9 FIG. is a diagram for explaining the derivation process of a new input profile.

[0020] Figure 10 FIG. is a diagram showing an example of a display screen of the time-series data of the pressure distribution.

[0021] Figure 11 FIG. is a flowchart showing an example of the pressure measurement process.

[0022] Figure 12 FIG. is a diagram for explaining the correction process of the pressure distribution.

[0023] Figure 13 FIG. is a diagram showing an example of a display screen of the time-series data of the pressure distribution. DETAILED DESCRIPTION OF THE INVENTION

[0024] Hereinafter, a mode example for implementing the technology of the present invention will be described in detail with reference to the drawings. In the present embodiment, an example in which pressure is applied as the energy applied to an object will be described. Examples of the object to be pressurized include plate-shaped metals and semiconductor wafers.

[0025] First, refer to Figure 1The structure of the information processing system 1 according to this embodiment will be described. As Figure 1 shown, the information processing system 1 includes an information processing device 10 and a tactile sensor 80. As an example of the information processing device 10, a portable computer such as a smartphone or a tablet terminal can be cited. In addition, the information processing device 10 may be a stationary computer.

[0026] The tactile sensor 80 is an example of a sensor device that outputs an electric signal corresponding to the applied pressure. Figure 2 is a diagram showing a schematic structure of the tactile sensor 80. The tactile sensor 80 includes a plurality of first electrodes 82 extending in a first direction, a plurality of second electrodes 84 extending in a second direction intersecting the first direction, and a connector 86. The plurality of first electrodes 82 and the plurality of second electrodes 84 are arranged on a sheet-like substrate (not shown). And, pressure-sensitive members (not shown) are laminated on the plurality of first electrodes 82 and the plurality of second electrodes 84 to cover each of the first electrodes 82 and the plurality of second electrodes 84.

[0027] As Figure 2 shown, the plurality of first electrodes 82 and the plurality of second electrodes 84 are arranged in a lattice pattern in a top view and overlap at the positions of the intersections of the lattice. The first electrode 82 and the second electrode 84 overlapping at each intersection constitute a sensor element for detecting the pressure applied to the position of the intersection. Specifically, when pressure is applied to the tactile sensor 80, the contact state between the first electrode 82 and the second electrode 84 at the position where the pressure is applied changes, and the resistance value changes. Therefore, by measuring the resistance value of each sensor element, the pressure applied to each sensor element can be detected. That is, the tactile sensor 80 includes a plurality of sensor elements that respectively detect the applied pressure, and detects the pressure distribution through the plurality of sensor elements.

[0028] The plurality of first electrodes 82 and the plurality of second electrodes 84 are respectively connected to the connector 86. The connector 86 and the information processing device 10 are connected to each other by wired or wireless communication. The connector 86 sequentially applies a voltage to the first electrode 82 and the second electrode 84, thereby measuring the resistance value of each sensor element, and sending an electric signal corresponding to the resistance value to the information processing device 10.

[0029] As described above, in this embodiment, an example in which the piezoresistive method is applied to the tactile sensor 80 has been described, but the method for measuring the pressure of the tactile sensor 80 is not limited to the piezoresistive method. The method for measuring the pressure of the tactile sensor 80 may be any one of the electrostatic capacitance method, the pressure-sensitive fiber and the pressure-sensitive rubber method, or a combination of a plurality of methods including the piezoresistive method, the electrostatic capacitance method, the pressure-sensitive fiber and the pressure-sensitive rubber method.

[0030] The information processing system 1 measures the amount of energy using a color-developing component 90 that develops color with a concentration distribution corresponding to the amount of applied energy (pressure in this embodiment). Specifically, the information processing device 10 uses a camera 40 (refer to Figure 3 ) to photograph the color-developing component 90 in a state where color is developed by applying energy, and derives the amount of energy applied to the color-developing component 90 from the captured image.

[0031] As the color-developing component 90, for example, Prescale (registered trademark) (manufactured by FUJIFILM Corporation), which can obtain a color-developing concentration corresponding to the applied pressure, can be applied. Prescale is formed by coating a color former and a developer containing microcapsules with a colorless dye on a sheet-like support. When pressure is applied to Prescale, the microcapsules are broken, and the colorless dye is adsorbed onto the developer and develops color. Moreover, since the color former contains a variety of microcapsules with different sizes and strengths, the amount of microcapsules broken according to the applied pressure is different, and the color-developing concentration is also different. Therefore, by observing the color-developing concentration, the magnitude and pressure distribution of the pressure applied to Prescale can be measured.

[0032] The degree of penetration of the color former into the developer is affected not only by the pressure value but also by the length of the period during which the pressure is applied. That is, the color-developing concentration of the color-developing component 90 is the cumulative value of the applied pressure. The color-developing component 90 is an example of the first measuring component according to the invention technology that can measure the cumulative value of the amount of energy after the application of energy to the object is completed.

[0033] On the other hand, the tactile sensor 80 can continuously output an electric signal corresponding to the applied pressure. That is, the tactile sensor 80 can measure the pressure values at multiple points during the period from the start of applying pressure to the object to the end of the application (hereinafter referred to as the "pressurization period"). The tactile sensor 80 is an example of the second measuring component according to the invention technology that can measure the amount of energy at multiple points during the period from the start of applying energy to the object to the end of applying energy to the object.

[0034] For example, the object, the tactile sensor 80, and the color-developing component 90 are stacked and arranged. Thus, the pressure applied to the object is measured by the tactile sensor 80 and the color-developing component 90. That is, the same pressure is applied to the tactile sensor 80 and the color-developing component 90.

[0035] Moreover, in this embodiment, the resolution of the color-developing component 90 is higher than the surface resolution of the tactile sensor 80. The resolution of the color-developing component 90 and the surface resolution of the tactile sensor 80 are represented by the minimum area capable of measuring pressure. For example, assume that the color-developing component 90 can measure the pressure applied to 0.125 mm 2The pressure of the area point, and the tactile sensor 80 can measure the pressure applied to a 1 mm 2 area point. In this case, at one point where the tactile sensor 80 can measure pressure, the color-developing component 90 can measure the pressure at eight points. That is, in the present embodiment, the color-developing component 90 can measure a denser pressure distribution than the tactile sensor 80.

[0036] Next, refer to Figure 3 to describe the hardware structure of the information processing apparatus 10 according to the present embodiment. As Figure 3 shown, the information processing apparatus 10 includes a CPU (Central Processing Unit), a central processing unit) 20, a memory 21 as a temporary storage area, and a non-volatile storage unit 22. In addition, the information processing apparatus 10 includes a display 23 such as a liquid crystal display, an input device 24 such as a keyboard and a mouse, a network I / F (InterFace: interface) 25 connected to a network, and a camera 40. The CPU 20, the memory 21, the storage unit 22, the display 23, the input device 24, the network I / F 25, and the camera 40 are connected to a bus 27. The CPU 20 is an example of a processor.

[0037] The storage unit 22 is implemented by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. An information processing program 30 is stored in the storage unit 22 as a storage medium. After reading the information processing program 30 from the storage unit 22, the CPU 20 expands it to the memory 21 and executes the expanded information processing program 30.

[0038] In addition, feature data 32 and feature data 34 are stored in the storage unit 22. Figure 4 shows an example of the feature data 32. The feature data 32 is data in which the relationship between the amount of energy applied to the color-developing component 90 (in this embodiment, the pressure value) and the concentration of the color-developing component 90 included in the image obtained by photographing the color-developing component 90 is preset. As the amount of energy, for example, a physical quantity corresponding to the energy that can be measured using the color-developing component 90, such as a pressure value, can be appropriately applied. In addition, in Figure 4 the pressure value is proportional to the concentration value, but the relationship between the pressure value and the concentration value is not necessarily limited to a proportional relationship.

[0039] The feature data 34 is also data in which the relationship between the amount of energy applied to the tactile sensor 80 and the value of the signal level representing the electrical signal output from the tactile sensor 80 is preset, similarly to the feature data 32.

[0040] Furthermore, the storage unit 22 stores an input profile 36. The input profile 36 is input to a pressurizing device that applies pressure to an object. The pressurizing device applies pressure to the object according to the input profile 36. For example, Figure 5 As shown in FIG. 1 , the input profile 36 according to the present embodiment is time series data of the pressure value applied to the object. Figure 5 In the example of FIG. 3 , an input profile 36 is shown, which linearly increases the pressure value from 0 to N from the time point t1 when pressurization starts to the time point t2, maintains the pressure value at N from the time point t2 to the time point t3, and linearly decreases the pressure value from N to 0 from the time point t3 to the time point t4 when pressurization ends. The input profile 36 can also be called the time series data of the target pressure value.

[0041] The camera 40 includes an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, etc. The camera 40 images the color developing member 90 and outputs image data obtained by the imaging to the CPU 20 .

[0042] As described above, the tactile sensor 80 can measure pressure distribution at multiple points during the pressurization period, that is, time series data of pressure distribution. However, in the tactile sensor 80, accurate pressure distribution may not be obtained due to sensitivity variations and hysteresis characteristics of each sensor element.

[0043] On the other hand, the color member 90 can measure the pressure distribution with higher accuracy than the touch sensor 80. However, the color member 90 can measure the cumulative data of the pressure distribution after the pressure application to the object is completed, but cannot measure the time series data of the pressure distribution.

[0044] Therefore, the information processing device 10 according to the present embodiment performs processing using the time series data of the pressure distribution measured by the touch sensor 80 and the pressure distribution measured by the color developing member 90 .

[0045] Next, refer to Figure 6 The functional structure of the information processing device 10 according to this embodiment will be described. Figure 6 As shown, the information processing device 10 includes a photography control unit 50, an acquisition unit 52, a first derivation unit 54, a second derivation unit 56, a generation unit 58, a third derivation unit 60, and a display control unit 62. The photography control unit 50, the acquisition unit 52, the first derivation unit 54, the second derivation unit 56, the generation unit 58, the third derivation unit 60, and the display control unit 62 are functioned by the CPU 20 executing the information processing program 30.

[0046] The photographing control unit 50 controls the camera 40 to read the color-developing member 90, that is, photograph the color-developing member 90. The method of reading the color-developing member 90 by the camera 40 is a non-contact method in which the camera 40 reads the color-developing member 90 without contacting the color-developing member 90. Additionally, a scanner can be used instead of the camera 40. In this case, the photographing control unit 50 controls the scanner to read the color-developing member 90. The method of reading the color-developing member 90 by the scanner is a contact method in which the scanner reads the color-developing member 90 in a state where the mounting surface of the scanner is in contact with the color-developing member 90.

[0047] In the present embodiment, the photographing control unit 50 controls the camera 40 to read the color density of the color-developing member 90. Additionally, the photographing control unit 50 can control the camera 40 to read the hue of the color-developing member 90, or can control the camera 40 to read both the color density and the hue of the color-developing member 90.

[0048] The acquisition unit 52 acquires an image obtained by photographing the color-developing member 90 under the control of the photographing control unit 50 by the camera 40 (hereinafter, referred to as "color-developing member image"). This color-developing member image is an image of a density distribution corresponding to the cumulative value of the pressure applied during the pressurization period.

[0049] Moreover, the acquisition unit 52 acquires the electric signals output from the tactile sensor 80 at a plurality of time points during the pressurization period. That is, the acquisition unit 52 acquires the time-series data of the pressure distribution measured by the tactile sensor 80.

[0050] The first derivation unit 54 uses the feature data 32 and derives the pressure distribution applied to the color-developing member 90 based on the color-developing member image acquired by the acquisition unit 52. Specifically, the first derivation unit 54 converts the density value into a pressure value for each pixel of the color-developing member image using the feature data 32, thereby deriving the pressure distribution. Hereinafter, the pressure distribution obtained using this color-developing member 90 is referred to as "first pressure distribution".

[0051] The second derivation unit 56 converts the numerical value representing the signal level of the electric signal acquired by the acquisition unit 52 into a pressure value using the feature data 34. The second derivation unit 56 performs this conversion on the electric signals detected by each sensor element at each of a plurality of time points during the pressurization period. Thereby, the second derivation unit 56 derives the pressure distribution. Hereinafter, the pressure distribution obtained using this tactile sensor 80 is referred to as "second pressure distribution". Since this second pressure distribution is derived at a plurality of time points during the pressurization period, it becomes time-series data.

[0052] The generation unit 58 generates time-series data of one pressure distribution (hereinafter referred to as "the third pressure distribution") using the time-series data of the first pressure distribution and the second pressure distribution. The process of generating this time-series data is an example of a predetermined process performed using the time-series data of the first pressure distribution and the second pressure distribution.

[0053] Specifically, the generation unit 58 derives the cumulative value of the second pressure distribution by accumulating the time-series data of the second pressure distribution. Next, the generation unit 58 generates the time-series data of the third pressure distribution by correcting the second pressure distribution at each time point of the time-series data of the second pressure distribution according to the relationship between the derived cumulative value of the second pressure distribution and the first pressure distribution.

[0054] More specifically, after aligning the cumulative value of the second pressure distribution and the cumulative value of the first pressure distribution, the generation unit 58 calculates a correction coefficient at the same coordinate by dividing the pressure value of the first pressure distribution by the cumulative value of the second pressure distribution. The coordinate mentioned here refers to the coordinate when representing the first pressure distribution and the second pressure distribution in a rectangular coordinate system on a plane. The generation unit 58 calculates this correction coefficient for each coordinate. Then, the generation unit 58 corrects the pressure value of the second pressure distribution by multiplying the pressure value of each coordinate of the second pressure distribution at each time point of the time-series data of the second pressure distribution by the correction coefficient calculated for that coordinate. Through this correction, the time-series data of the third pressure distribution is generated. Since the time-series data of the third pressure distribution is corrected using the first pressure distribution with higher accuracy than the second pressure distribution, it has higher accuracy than the time-series data of the second pressure distribution.

[0055] In addition, as described above, the resolution of the coloring component 90 is higher than the surface resolution of the tactile sensor 80. Therefore, as an example, as Figure 7 shown, even at positions with the same coordinates as the second pressure distribution, the first pressure distribution sometimes includes pressure values at multiple positions. In the Figure 7 example, p1 represents the pressure value at a certain coordinate of the second pressure distribution, and p2 to p5 represent the pressure values of the first pressure distribution at the same coordinate as this coordinate. That is, Figure 7 in the example, an example where the resolution of the coloring component 90 is 4 times the surface resolution of the tactile sensor 80 is shown. In this case, when calculating the above correction coefficient, the generation unit 58 can use the average value of the pressure values at the above multiple positions for the first pressure distribution.

[0056] Further, the generation unit 58 may also calculate the above correction coefficient using the pressure values of the first pressure distribution. In this case, for the pressure value at one position of the second pressure distribution, the generation unit 58 calculates the correction coefficient for each of the multiple positions obtained by dividing this position. In this case, for the pressure value at one position of the second pressure distribution, the generation unit 58 corrects the pressure value of the second pressure distribution by multiplying the correction coefficient for each of the multiple positions obtained by dividing this position. In this case, the surface resolution of the tactile sensor 80 is corrected to match the resolution of the coloring member 90.

[0057] Moreover, the electrical signals output from the respective sensor elements of the tactile sensor 80 may deviate depending on which position on the detection surface of the pressure applied to each sensor element. Hereinafter, this deviation will be referred to as "surface deviation". The generation unit 58 estimates which position on the above detection surface the pressure is applied based on the deviation of the pressure values of the multiple positions of the first pressure distribution corresponding to one position of the second pressure distribution, and corrects the pressure values of the first pressure distribution according to the estimation result. For example, the generation unit 58 corrects the pressure value of the first pressure distribution to the pressure value when it is assumed that the pressure is applied to the center position of the above detection surface. Thereby, the surface deviation of the applied pressure is corrected.

[0058] The third derivation unit 60 derives a new input profile that makes the time-series data of the third pressure distribution close to the input profile 36 based on the difference between the time-series data of the third pressure distribution and the input profile 36. Refer to Figure 8 and Figure 9 A specific example of the derivation process of the new input profile based on the third derivation unit 60 will be described. Figure 8 The solid line in Figure 9 represents the time-series data of the third pressure distribution, and the dashed line represents the input profile 36.

[0059] As Figure 8 shown, the input profile 36 is time-series data of pressure values, where the time-series data of pressure values gradually increases the pressure value, maintains the pressure value after reaching a specific pressure value, and then gradually decreases the pressure value. In the time-series data of the third pressure distribution derived when applying pressure to the object according to this input profile 36, the pressure value rises at a moment earlier than the input profile 36, the peak value of the pressure value is greater than the above specific pressure value, and the moment when the pressure value decreases is earlier than the input profile 36.

[0060] In this case, as an example, as Figure 9As shown, the third derivation unit 60 derives an input profile that has the same timing of starting to increase the pressure value and the same specific pressure value as the input profile 36, and delays the timing of reaching the specific pressure value, as a new input profile. Thus, it is considered that in the time-series data of the third pressure distribution, the peak value of the pressure value becomes smaller and the timing of the pressure value reaching the peak is delayed. In addition, in this case, for example, the third derivation unit 60 can derive an input profile that sets the specific pressure value to a pressure value smaller than the input profile 36 and sets the period of maintaining the specific pressure value to a period longer than the input profile 36, as a new input profile.

[0061] The display control unit 62 performs control to display the time-series data of the third pressure distribution generated by the generation unit 58 on the display 23. Specifically, as Figure 10 shown, the display control unit 62 performs control to display the third pressure distribution at each time point of the time-series data of the third pressure distribution generated by the generation unit 58 on the display 23 as a three-dimensional graph. Figure 10 An example of a three-dimensional graph showing the third pressure distribution in time series from left to right is shown.

[0062] In addition, as Figure 10 shown by the solid-line rectangle, the display control unit 62 can perform control to display the time-series data of the third pressure distribution at a specific position on the display 23 as a two-dimensional graph. The specific position in this case can be specified by the user. And, as Figure 10 shown by the dashed line in the two-dimensional graph, the display control unit 62 can further perform control to display the input profile 36 on the display 23. And the display control unit 62 can perform control to display the new input profile derived by the third derivation unit 60 on the display 23.

[0063] Next, the operation of the information processing apparatus 10 according to the present embodiment will be described with reference to Figure 11 The pressure measurement process shown in is executed by the CPU 20 executing the information processing program 30. For example, when an execution start instruction is input by the user via the input device 24, etc., the pressure measurement process shown in Figure 11 is executed. Figure 11 shown is executed.

[0064] In Figure 11In step S10, acquisition unit 52 acquires the electrical signal output from tactile sensor 80. In step S12, acquisition unit 52 determines whether the pressurization period has ended. When this determination is negative, the process returns to step S10, and when it is positive, the process proceeds to step S14. Additionally, the method for determining the end of the pressurization period by acquisition unit 52 is not particularly limited. For example, acquisition unit 52 may determine that the pressurization period has ended at the moment when a certain period of time has elapsed since the start of pressurization, or it may be when the period during which the numerical value representing the signal level of the electrical signal output from tactile sensor 80 is approximately zero continues for a certain period. By repeatedly executing step S10, electrical signals output from tactile sensor 80 at multiple points in time during the pressurization period are acquired.

[0065] In step S14, photographing control unit 50 controls camera 40 to photograph color-developing member 90. In step S16, acquisition unit 52 acquires from camera 40 the color-developing member image obtained by photographing color-developing member 90 through the control in step S14. In step S18, first derivation unit 54 uses feature data 32 to derive the first pressure distribution applied to color-developing member 90 based on the color-developing member image acquired in step S16.

[0066] In step S20, second derivation unit 56 derives the second pressure distribution by converting the numerical value representing the signal level of the electrical signal acquired in step S10 into a pressure value using feature data 34. Second derivation unit 56 performs this second pressure distribution derivation process on the electrical signals output from tactile sensor 80 at multiple points in time.

[0067] In step S22, generation unit 58 uses the time-series data of the first pressure distribution derived in step S18 and the second pressure distribution derived in step S20 to generate the time-series data of the third pressure distribution. In step S24, third derivation unit 60 derives a new input profile that makes the time-series data of the third pressure distribution close to input profile 36 based on the difference between the time-series data of the third pressure distribution generated in step S22 and input profile 36.

[0068] In step S26, display control unit 62 performs control to display the time-series data of the third pressure distribution generated in step S22 on display 23. When the process of step S26 ends, the pressure measurement process ends.

[0069] As described above, according to the present embodiment, information on the amount of energy applied to the object can be effectively utilized.

[0070] In addition, in the above-described embodiment, a case where a tactile sensor is applied to a sensor device that outputs an electric signal corresponding to the applied pressure has been described, but the present invention is not limited thereto. For example, as the sensor device, a configuration in which a load cell, a strain gauge, or a force sensor is applied may be adopted. Further, as the sensor device, a configuration in which two or more of a load cell, a strain gauge, a force sensor, and a tactile sensor are applied may be adopted.

[0071] In the above-described embodiment, a case where pressure is applied as the energy applied to the object has been described, but the present invention is not limited thereto. For example, heat or ultraviolet rays may be applied as the energy applied to the object. When heat is applied as the energy applied to the object, as the coloring component 90, Thermoscale (product name) (manufactured by FUJIFILM Corporation) that colors according to heat can be used. In this case, as the sensor device, a temperature sensor that outputs an electric signal corresponding to the level of the temperature can be used. When ultraviolet rays are applied as the energy applied to the object, as the coloring component 90, UV SCALE (product name) (manufactured by FUJIFILM Corporation) that colors according to the amount of ultraviolet light can be used. In this case, as the sensor device, an ultraviolet sensor that outputs an electric signal corresponding to the amount of ultraviolet rays can be used.

[0072] In the above-described embodiment, a configuration in which a plurality of energy amounts of pressure, heat, and ultraviolet rays are measured may be adopted.

[0073] In the above-described embodiment, a case where the generation unit 58 generates the time-series data of the third pressure distribution by correcting each time point of the time-series data of the second pressure distribution based on the relationship between the cumulative value of the second pressure distribution and the first pressure distribution has been described, but the present invention is not limited thereto. For example, a configuration may be adopted in which the generation unit 58 corrects the first pressure distribution using each time point of the time-series data of the second pressure distribution of the second pressure distribution, thereby generating the time-series data of the third pressure distribution.

[0074] Specifically, the generation unit 58 generates the time-series data of the third pressure distribution by correcting the pressure value of the first pressure distribution based on the relative change degree of the pressure value of each time point of the time-series data of the second pressure distribution. Here, as a specific example, an example in which the third pressure distribution is generated at three time points, i.e., the start time point t1, the intermediate time point t2, and the end time point t3 during the pressurization period, will be described. As an example, as Figure 12As shown, the pressure values at specific positions of the second pressure distribution are constant at t1, t2, and t3, i.e., relatively unchanged. In this case, the pressure value at the same position of the first pressure distribution is N, that is, the pressure value at the end point t3 is N. As described above, this N is the cumulative value of the pressure values during the pressurization period. Therefore, in this case, the generation unit 58 can derive that the pressure value applied to any of t1, t2, and t3 is N / 3 at any point in time. In this way, the generation unit 58 can generate the time-series data of the third pressure distribution.

[0075] Moreover, in the above-described embodiment, as an example, as Figure 13 shown, the display control unit 62 can perform control to display the time-series data of the first pressure distribution and the second pressure distribution on the display 23. In Figure 13 the example of, the upper part shows the time-series data of the second pressure distribution, and the lower part shows the first pressure distribution ( Figure 13 the hair color component image in the example of). The control to display the time-series data of the first pressure distribution and the second pressure distribution on the display 23 in this case is an example of a predetermined process performed using the time-series data of the first pressure distribution and the second pressure distribution.

[0076] Moreover, in the above-described embodiment, the display control unit 62 can perform an abnormality determination process using the time-series data of the third pressure distribution. When it is determined that there is an abnormality, a warning is notified by performing control to display a warning message on the display 23. In this case, for example, the display control unit 62 can determine whether there is an abnormality based on whether the deviation amount between the time-series data of the third pressure distribution and the input profile 36 is equal to or greater than a threshold value. And, for example, the display control unit 62 can determine whether there is an abnormality based on whether the deviation amount between the time-series data of the third pressure distribution and a reference value is equal to or greater than a threshold value. The reference value in this case can be a value determined as the product specification value of the hair color component 90, or a statistical value of past measured values. And, in this case, the display control unit 62 can perform the abnormality determination using the time-series data of the second pressure distribution instead of the time-series data of the third pressure distribution.

[0077] Also, in the above-described embodiments, for example, as the hardware structure of a processing unit that executes various processes like each functional unit of the information processing apparatus 10, various processors shown below can be used. As described above, among the various processors, in addition to a general-purpose processor, i.e., a CPU, that executes software (program) and functions as various processing units, there are also processors such as FPGA (Field Programmable Gate Array) whose circuit structure can be changed after manufacturing, i.e., programmable logic devices (PLDs), processors with a circuit structure specifically designed to execute specific processes such as ASIC (Application Specific Integrated Circuit), i.e., dedicated circuits, etc.

[0078] One processing unit can be constituted by one of these various processors, or can be constituted by a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA). Also, multiple processing units can be constituted by one processor.

[0079] As an example of constituting multiple processing units by one processor, first, there is the following method: represented by computers such as a client and a server, a combination of one or more CPUs and software constitutes one processor, and this processor functions as multiple processing units. Second, there is the following method: represented by a System on Chip (SoC), etc., a processor that uses one IC (Integrated Circuit) chip to implement the functions of the entire system including multiple processing units is used. Thus, various processing units are constituted by using one or more of the above-described various processors as the hardware structure.

[0080] In addition, as the hardware structure of these various processors, more specifically, circuitry formed by combining circuit elements such as semiconductor elements can be used.

[0081] Further, in the above-described embodiment, the method of pre-storing (installing) the information processing program 30 in the storage unit 22 has been described, but it is not limited thereto. The information processing program 30 may also be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. Further, the information processing program 30 may be configured to be downloaded from an external device via a network.

[0082] The entire disclosure of Japanese Patent Application No. 2022-188553, filed on November 25, 2022, is incorporated herein by reference. Further, all documents, patent applications, and technical standards described in this specification are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually indicated to be incorporated by reference.

Claims

1. An information processing apparatus, comprising at least one processor, wherein the processor performs the following processing: obtaining a first energy distribution measured by a first measurement component, the first measurement component being capable of measuring an accumulated value of the amount of energy applied to an object after the application of energy to the object is completed; obtaining time-series data of a second energy distribution measured by a second measurement component, the second measurement component being capable of measuring the amount of energy at a plurality of time points during the period from the start to the end of the application of energy to the object; and performing a predetermined process using the first energy distribution and the time-series data.

2. The information processing apparatus according to claim 1, wherein the energy is at least one of pressure, heat, and ultraviolet light.

3. The information processing apparatus according to claim 1, wherein the first measurement component is a coloring component that colors with a concentration distribution corresponding to the amount of energy applied.

4. The information processing apparatus according to claim 3, wherein the processor performs the following processing: obtaining the first energy distribution by performing control to read the first measurement component in a contact or non-contact manner.

5. The information processing apparatus according to claim 4, wherein the processor performs the following processing: performing control to read at least one of the color concentration and hue of the first measurement component.

6. The information processing apparatus according to claim 1, wherein the second measurement component is a sensor device that outputs an electric signal corresponding to the amount of energy applied.

7. The information processing apparatus according to claim 6, wherein the sensor device is at least one of a force sensor, a strain gauge, a force sensor, and a tactile sensor.

8. The information processing apparatus according to claim 7, wherein the sensor device includes the tactile sensor, and the tactile sensor measures the amount of energy by at least one of a piezoresistive method, a capacitance method, a pressure-sensitive fiber, and a pressure-sensitive rubber method.

9. The information processing apparatus according to claim 8, wherein the first measurement component is a coloring component that colors with a concentration distribution corresponding to the amount of energy applied, and the resolution of the coloring component is higher than the surface resolution of the tactile sensor.

10. The information processing apparatus according to claim 1, wherein the processor performs the following processing: generating time-series data of one energy distribution as the predetermined process using the first energy distribution and the time-series data.

11. The information processing apparatus according to claim 10, wherein the processor performs the following processing: generating the time-series data of one energy distribution by correcting the second energy distribution at each time point of the time-series data according to the relationship between the accumulated value of the time-series data and the first energy distribution.

12. The information processing apparatus according to claim 10, wherein the processor performs the following processing: Generate the time-series data of the first energy distribution by correcting the second energy distribution at at least one time point in the time-series data according to the relationship between the cumulative value of the time-series data and the first energy distribution.

13. The information processing apparatus according to claim 11, wherein the processor performs the following processing: Correct at least one of the energy amount, surface resolution, and surface deviation of the applied energy of the second energy distribution.

14. The information processing apparatus according to claim 10, wherein the processor performs the following processing: Use the second energy distribution at each time point of the time-series data to correct the first energy distribution, thereby generating the time-series data of the first energy distribution.

15. The information processing apparatus according to claim 10, wherein the processor performs the following processing: Use the second energy distribution at at least one time point in the time-series data to correct the first energy distribution, thereby generating the time-series data of the first energy distribution.

16. The information processing apparatus according to claim 1, wherein the processor performs the following processing: Perform control to display the first energy distribution and the time-series data on a display as the predetermined processing.

17. The information processing apparatus according to claim 10, wherein the processor performs the following processing: Perform control to display the time-series data of the first energy distribution on a display.

18. The information processing apparatus according to claim 17, wherein the processor further performs the following processing: Perform control to display an input profile for an energy application device that applies energy on the display.

19. The information processing apparatus according to claim 18, wherein the processor performs the following processing: Derive a new input profile that makes the time-series data close to the input profile based on the difference between the time-series data and the input profile.

20. The information processing apparatus according to claim 10, wherein the processor performs the following processing: Perform an abnormality determination process using the time-series data of the first energy distribution; When it is determined that there is an abnormality, notify a warning.

21. An information processing method, wherein a processor included in an information processing apparatus performs the following processing: Obtain a first energy distribution measured by a first measuring component that can measure the cumulative value of the energy amount applied to an object after the energy application to the object is completed; Obtain time-series data of a second energy distribution measured by a second measuring component that can measure the energy amount at a plurality of time points during the period from the start of energy application to the object to the end of energy application to the object; and Perform a predetermined process using the first energy distribution and the time-series data.

22. An information processing program for causing a processor included in an information processing apparatus to perform the following processing: Obtain a first energy distribution measured by a first measuring component that can measure the cumulative value of the energy amount applied to an object after the energy application to the object is completed; Obtain time-series data of the second energy distribution measured by the second measurement component, where the second measurement component is capable of measuring the amount of energy at a plurality of time points during the period from the start of applying energy to the object to the end of applying energy to the object; and Perform a predetermined process using the first energy distribution and the time-series data.

Images