Method and device for automatic grading of used terminals

The automated grading method for used mobile terminals uses AI to analyze high-precision imaging data from multiple angles, addressing the subjective and variable nature of manual grading by enhancing inspection accuracy and consistency in evaluating surface scratches.

WO2025017766A1PCT designated stage expired Publication Date: 2025-01-23CDR ECO-MOVEMENT INC
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/026000
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-14
Publication Date
2025-01-23

AI Technical Summary

Technical Problem

The conventional commercialization process of used mobile terminals relies heavily on manual grading, which is subjective and prone to variations in efficiency and accuracy due to differences in worker experience, particularly in visual inspections that require judgment of minute scratches on the terminal's surface.

Method used

An automated grading method using AI that captures high-precision imaging data of used terminals' surfaces, including scratches, by moving the terminals on a conveyor belt and irradiating them with illumination light from diagonally above, allowing digital cameras to take images from multiple angles, and processing these images to determine the grade based on reference data.

Benefits of technology

This method significantly improves inspection accuracy by providing clear imaging data and objective grading, reducing human error and variability, and enabling the automatic determination of scratch grades on used terminals.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023026000_23012025_PF_FP_ABST
    Figure JP2023026000_23012025_PF_FP_ABST
Patent Text Reader

Abstract

[Problem] To dramatically improve the accuracy of visual inspection of used terminals to be commercialized by adopting a completely novel form of inspection, and contribute to automatic grading of terminals to be recycled on the basis of highly accurate inspection data obtained by the new form of inspection. [Solution] A terminal T is moved in a plane, the front surface or back surface of the moving terminal T is irradiated with illuminating light 3b proceeding forward from obliquely behind and above said terminal T, and the illuminated part of the terminal T is imaged by a camera 3c pointing backward from obliquely in front and above the terminal T, imaging data of the imaged terminal T is compared to multiple types of standard grade data classified by grade and stored in a database of a server 8, the grade (rank) of the standard grade data to which the imaging data is assessed to belong is determined as the grade of the imaging data, and a determination result is outputted.
Need to check novelty before this filing date? Find Prior Art

Description

Method and device for automatically grading used terminals

[0001] The present invention relates to a method and device for automatically grading (hereinafter also referred to as grading or ranking) used mobile terminals such as smartphones (hereinafter referred to as used terminals or terminals) as new products using AI (artificial intelligence) based on image data from visual inspections of each terminal performed in the process of refurbishing and commercializing used mobile terminals such as smartphones and other products.

[0002] Conventionally, terminals purchased as second-hand goods have been refurbished and commercialized, and technologies that are thought to be useful for the commercialization of second-hand terminals have been proposed in Patent Documents 1 to 3. However, none of the proposed documents relate to automatic grading of second-hand terminals.

[0003] Incidentally, an overview of the traditional manual commercialization process for used terminals is shown in Figure 5. Used terminals to be commercialized are "stored" in order to be put into the commercialization process, and terminals that are judged to be unmerchantable are removed, and the remaining terminals are placed in "receiving." All terminals placed in "receiving" are then sent to the next "erasing process" to erase any remaining data and then to the inspection process where "functional inspection" and "visual inspection" are carried out.

[0004] "Functional inspection" and "visual inspection" are carried out as inspection processes to grade the devices based on the inspection results so that they can be made into refurbished products that will be graded in the next "grading" process. Devices classified based on the grading results and other criteria are stored on "stock shelves" to await orders from buyers, and when orders are received from multiple buyers (orderers), each device is individually packaged and "packaged" according to the order details for each orderer, and each package is "sealed" before being "shipped."

[0005] In the conventional commercialization process shown in Figure 5, each process is connected by a belt conveyor BC, and each process base is equipped with a workbench, temporary storage shelves, tools, etc., and at least one worker is assigned to carry out each process.

[0006] As mentioned above, in the conventional commercialization process of used devices, most of the steps were done manually by workers, which meant that there was a drawback in that work efficiency, work results, and work precision were prone to variations due to differences in experience and ability among workers. In particular, grading based on visual inspection, although there were some standards, was based on subjective judgment based on the experience and intuition of the worker, which meant that the judgment process took time and the grades judged varied.

[0007] Regarding the above-mentioned problems, the inventors of the present invention have previously proposed an invention in Japanese Patent Application No. 2022-203406 that enables inspection processes including visual inspection to be performed automatically without manual intervention.

[0008] The proposed invention is a technology that can automatically perform both functional and visual inspections of terminals without manual intervention, and grading is also a technology that automatically determines the grading based on the inspection data. This largely solves the problems of traditional manual grading, but issues remain.

[0009] Special Publication No. 2022-539909 Publication Patent No. 5820464 Publication Patent No. 4171453 Publication

[0010] One of the objectives of the present invention is to provide a method that employs a new imaging format to significantly improve inspection accuracy in the appearance inspection of used terminals to be commercialized, and to automatically use AI to grade reproduced terminals based on the highly accurate imaging data obtained by the new imaging format.

[0011] The quality of the appearance of a used terminal is judged by whether or not there are scratches (scratches, concave, convex, etc.) on the surface (liquid crystal display surface), back surface, outer periphery, or outer corners of the terminal's casing (housing), and if there are scratches, their extent (deep or shallow, high or low, etc.). However, even if a used terminal appears clean at first glance, many have minute scratches (scuffs), so there is a need for technology that can clearly and distinctly capture even minute scratches. Therefore, one of the objectives of the present invention is to capture clear image data of even minute scratches.

[0012] The configuration of the present invention that can solve the above problem involves moving a terminal within a plane, irradiating the outer surface (front or back) of the moving terminal with illumination light from diagonally above the rear of the terminal toward the front in the direction of movement of the terminal, and taking multiple images of the terminal's proof area with a camera (hereinafter referred to as a digital camera or D-camera) facing diagonally above the front of the terminal toward the rear in the direction of movement, and processing the image data to form scratch data of the terminal, which is then referenced to multiple types of standard grade data classified by grade and stored in a database on a server, and the grade (rank) of the standard grade data to which it is determined that the scratch data belongs is determined to be the grade of the terminal, and the determination result is output.

[0013] In the present invention, when the terminal to be moved is moved on a conveyor belt with the front or back side facing up, the above-mentioned illumination light is irradiated and an image is taken with the D camera, and then the terminal is turned over and moved with the back or front side facing up, and the same illumination light is irradiated and an image is taken with the D camera as above, thereby obtaining image data of both sides of the terminal.

[0014] As an example of a specific imaging configuration, a single conveyor is arranged to run in one direction in a horizontal position, and an imaging data forming unit (hereinafter referred to as the first imaging data forming unit) on the front (or back) side of the terminal in the direction of travel of the conveyor is configured by placing a light source for illumination and a digital camera for imaging in a dark box-like space.

[0015] The imaging data forming section on the rear (or front) side of the terminal (hereinafter referred to as the second imaging data forming section) is arranged on the front side in the running direction of the conveyor and has the same configuration as the first imaging data forming section.

[0016] Between the first and second image data forming units, a flipping mechanism is provided on the conveyor to flip over terminals being transported on the conveyor. The flipping mechanism, for example, is comprised of a motor-driven grip with lifting and rotating functions that grabs and raises a terminal in a horizontal position as it moves along, rotates the terminal held at its top dead center 180 degrees, and then lowers it to release it from the conveyor. The grips are available in air-operated suction cup types and mechanically configured grippers.

[0017] The light source of illumination light and the digital camera constituting the first imaging data forming unit and the second imaging data forming unit of the present invention may have an adjustment function that allows the vertical position and tilt angle to be changed arbitrarily. The adjustment and setting of the position and angle are automatically adjusted or set based on data on the size and thickness of the terminal obtained by imaging the terminal with another digital camera as it starts to move.

[0018] The mechanism for automatically adjusting the position and angle is substantially the same for both the light source and the D-camera. For example, it is composed of a linear motion mechanism that uses a motor as the drive source and uses a rack and pinion mechanism or a feed screw mechanism to perform linear motion such as raising and lowering of the object (light source or camera), and a rotation mechanism that changes the set angle of the object (light source and camera), and the linear motion and rotational motion are driven and controlled by the control unit of the motor being rotationally controlled based on a control signal supplied from the control unit of the server.

[0019] In the above description, image data of the front and back surfaces of the terminal are formed in time series by a first image data forming unit and a second image data forming unit arranged in series on a single conveyor. In the present invention, however, the first image data and the second image data may be formed and acquired simultaneously. This point will be described below.

[0020] Examples of the configuration for simultaneously forming and acquiring the first imaging data and the second imaging data include the following.

[0021] First, two conveyors for transporting terminals are prepared, and the two conveyors are arranged as a first conveyor and a second conveyor separated by a gap less than the length of one terminal in the running direction. Next, an upper dark box-like space and a lower dark box-like space are formed above and below the first and second conveyors, respectively, sandwiching the gap between them. An illumination light source and an imaging camera are placed in each of the upper and lower dark box-like spaces, as described above. As a result, the upper dark box-like space is configured as a first imaging data forming unit, and the lower dark box space is configured as a second imaging data forming unit. With this configuration, the first imaging data and the second imaging data can be simultaneously generated and acquired in the first imaging data forming unit and the second imaging data forming unit, which are arranged vertically across the gap between the first and second conveyors. This configuration eliminates the need for a terminal flipping mechanism.

[0022] The mechanism for simultaneously forming and acquiring the first and second image data can be further developed to a configuration that utilizes a mirror to acquire image data of the side of the terminal, as will be described below.

[0023] A mirror or half mirror inclined at approximately 45 degrees with respect to the horizontal plane (conveyor running surface) facing the left and right sides of the terminal being moved is placed on the left and right sides of the gap set between the first and second conveyors in the direction of travel, and a mirror image of the side of the terminal is projected onto the mirror.The side of the terminal projected on the mirror is then photographed by the D camera of the first imaging data forming unit, thereby obtaining imaging data of the left and right sides of the terminal (hereinafter referred to as third imaging data).

[0024] In this invention, illumination light with an inclined optical axis is irradiated onto the moving terminal, multiple images of the illuminated and moving terminal are taken with a digital camera (D-camera), these are processed to obtain image data, the obtained image data is referenced to multiple types of standard grade data for each grade held in a database, the grade of the terminal that provided the obtained image data is determined, and this determination data is output, so that the grade of the terminal in terms of scratches can be automatically determined using AI based on this determination data.

[0025] 4 is a schematic side view illustrating the basic configuration of a terminal imaging data formation unit in the automatic grading system of the present invention. FIG. 5 is a schematic side view of an imaging data formation unit that includes a terminal information formation unit installed in front of the imaging data formation unit of FIG. 1 to acquire data related to the size and thickness of the terminal. FIG. 6 is a schematic side view of an imaging data formation unit that is configured to simultaneously generate and acquire imaging data of the front and back surfaces of a terminal. FIG. 7 is a schematic cross-sectional front view illustrating an example configuration in which a mirror is used in the imaging data formation unit of FIG. 4 to acquire an image of the side surface of the terminal. FIG. 8 is a process diagram illustrating a conventional manual process for commercializing used terminals.

[0026] An example of a system capable of implementing the automatic grading method of the present invention will be described with reference to FIGS.

[0027] In Figure 1, reference numeral 1 denotes a belt conveyor (hereinafter referred to as conveyor 1) that carries terminals T and travels at a speed of approximately 4 m / min. This conveyor 1 is mounted on frames 2A and 2B at the front and rear of its travel direction (the length direction of the conveyor 1). Incidentally, the conveyor 1 in Figure 1 is formed of a flexible transport belt approximately 2 m long and 300 to 450 mm wide, but the conveyor 1 is not limited to a configuration consisting of a belt with the above numerical values ​​and frames 2A and 2B that support this belt. In this specification, the near side of the travel direction of the conveyor 1 is referred to as the rear (or rear), the far side as the front (or front), the upper side in the vertical direction perpendicular to the top surface of the conveyor 1 as the upper side (or top), and the lower side as the lower side (or bottom).

[0028] 3 is a first imaging data forming unit formed on the front side (rear) of the conveyor 1 in the running direction, and 4 is a second imaging data forming unit formed on the back side (forward) of the conveyor 1 in the running direction and has the same configuration as the first imaging data forming unit.

[0029] Since the first imaging data forming unit 3 and the second imaging data forming unit 4 have the same configuration, the following will be an explanation of the first imaging data forming unit 3, but the only difference between the second imaging data forming unit 4 and the first imaging data forming unit 3 is that the symbols for the same components are different.

[0030] The first imaging data forming unit 3 is located on the front (rear) side of the conveyor 1, supported by two vertical frames 2A, 2A at the front and rear, and is configured in a dark box-like area 3a (hereinafter also referred to as the dark box area 3a) by a lighting device 3b and a digital camera 3C (hereinafter also referred to as the D camera 3c) positioned diagonally above and in front of and behind the terminal T placed on the conveyor 1.

[0031] Specifically, the lighting device 3b is positioned so that it can irradiate the terminal T in the dark box area 3a with illumination light from illumination light sources (hereinafter also referred to as light sources) arranged in a planar manner such as LEDs from diagonally above and behind the terminal T. On the other hand, the D camera 3c is positioned so that its objective lens is directed toward the terminal T from diagonally above and in front of the terminal T to be illuminated.

[0032] The positioning of the lighting device 3b and the D camera 3c is adapted to accommodate differences in the size and thickness of the terminal T depending on the type of terminal T (differences in model and manufacturer, etc.), so some lighting devices (not shown) are configured to be able to displace and position the lighting device 3b and the D camera 3c in the upward and downward directions, and to change and position the tilt angle of the illumination optical axis and the optical axis of the camera optical system. This will be described later.

[0033] The second imaging data forming unit 4 has the same configuration as the first imaging data forming unit 3 described above, and is equipped with a dark box area 4a arranged on the front frames 2B, 2B, and an illumination device 4b and a D camera 4c arranged inside this dark box area 4a in the same manner as the illumination device 3b and D camera 3c.

[0034] In the apparatus of the present invention shown in FIG. 1, a reversing mechanism 5 for reversing the end T on the conveyor 1 is disposed between the rear frame 2A and the front frame 2B with respect to the conveyor 1.

[0035] The reversing mechanism 5 holds the terminal T on the conveyor 1 with suction cups, rises, places it on a temporary table at the top dead center and releases it, rotates the placed terminal T by 180 degrees, then holds it again with the suction cups and descends, placing the held terminal T on the conveyor 1. The reversing mechanism 5 is composed of a terminal holder 5a, an elevator 5b having the holder 5a, a temporary table 5c that temporarily places the raised terminal and reverses it, and a drive mechanism unit with a motor or the like.

[0036] As an example, the terminal holder 5a is preferably a suction cup type, but may also be a mechanically configured one that grips and releases the terminal T using pneumatic or electromagnetic gripping means. The elevator 5b that raises and lowers the terminal holder 5a is configured with a linear motion mechanism such as an air cylinder mechanism, a feed screw mechanism, or a rack and pinion mechanism. The terminal holder 5a and the elevator 5b are controlled by a third control unit 63 provided in the control unit server 6.

[0037] The first imaging data forming unit 4 and the second imaging data forming unit 4 are controlled by the first and second control units 61 and 62 of the control unit server 6, and send imaging data (first imaging data and second imaging data) processed from multiple images of the front and back of the terminal T taken by the two D cameras 3c and 4c to the control unit server 6.

[0038] That is, the control unit server 6 includes a first control unit 61 that controls the operation of the lighting device 3b and D camera 3c of the first imaging data forming unit 3 that captures images of the front side (of scratches) of the terminal T, and a second control unit 62 that controls the operation of the lighting device 4b and D camera 4c of the second imaging data forming unit 4 that captures images of the back side (of scratches) of the terminal T.

[0039] Furthermore, the first control unit 61 and the second control unit 62 have the following functions: When a terminal T is being transported on the conveyor 1 from the input side to the output side through the first image data forming unit 3 and the second image data forming unit 4, a terminal detection sensor (not shown) provided on the frame 2A on the front side of the first image data forming unit 3 detects the moving terminal T, and generates a trigger signal t 1 to the first control unit 61. Next, when a terminal detection sensor (not shown) provided on the frame 2B on the front side of the second imaging data formation unit 4 captures the moving terminal T, it outputs a trigger signal t2 to the second control unit 62.

[0040] Trigger signal t 1 When the signal is input, the first control unit 61 activates the lighting device 3b and the D camera 3c of the first image data forming unit 3. When the moving terminal T leaves the angle of view of the D camera 3c, a terminal detection sensor (not shown) provided on the front frame 2A detects the approaching terminal T and outputs an end signal e 1to the first control unit 61, and stops the operation of the lighting device 3b and the D camera 3c.

[0041] After the terminal T has been imaged by the first imaging data forming unit 3, it is transported as is and detected by the terminal detection sensor provided on the front frame 2A. This detection signal is the same as the end signal e1, but is sent to the third control unit 63 as a trigger signal t3. Upon receiving the trigger signal t3, the third control unit 63 controls the reversing mechanism 5 to reverse the terminal T. When the reversed terminal T enters the second imaging data forming unit 4, a trigger signal t2 is generated by a terminal detection sensor (not shown) provided on the frame 2B on the front side of the second imaging data forming unit 4. The end signal e2 is generated when the terminal detection sensor (not shown) provided on the front frame 2B detects the moving terminal T and is supplied to the second control unit 62. The action of the trigger signal t2 and the end signal e2 on the second control unit 62 is the same as that of the first control unit 61 described above. The first control unit 61 and the second control unit 62 analyze and process the imaging data acquired by the two imaging data forming units 3 and 4, and form data necessary for automatic grading judgment regarding scratches on the front and back surfaces of the terminal T (hereinafter, for convenience of explanation, referred to as "scratch data").

[0042] In the first imaging data forming unit 3 and the second imaging data forming unit 4, the imaging data of the front side of the terminal T and the imaging data of the back side of the terminal T taken by the respective D cameras 3c and 4c are processed by the first control unit 61 and the second control unit 2, respectively, and stored in databases 7A and 7B as scratch data regarding the front side and scratch data regarding the back side of the terminal T linked to the terminal T.

[0043] Regarding scratches on the front and back of the terminal T, the scratch data obtained by processing the image data of the front and back of the terminal T stored in the databases 7A and 7B is sent to a grading server 8 where it is graded (ranked) using AI.

[0044] An example of the AI-based grading process in the grading server 8 is as follows. The grading server 8 uses AI to grade the scratch data on the front and back surfaces of the terminal T and determine the grade of the terminal T. To do this, the scratch data on the front and back surfaces of the terminal T is first referenced to standard data on "cracks" to determine whether the terminal has a "crack" or not. Terminals T determined to have cracks are then assigned a rank of D, while terminals T determined to have no cracks are assigned a rank of A, B, or C based on multiple pre-generated standard data based on the degree (size and amount) of scratches (including dents). In this example, a rank A is defined as no scratches or extremely minor scratches. For this determination, the data that serves as the basis for the A to D rank determination is stored in the database 8a as standard grade data, which is learned by the AI. Damage to the terminal T that is more severe than a crack is visually inspected by an inspector and ranked D-. Incidentally, image data of cracks can be acquired with a probability of nearly 100% by adjusting the lighting 3b, 4b and cameras 3c, 4c of the first and second image data forming units 3, 4. In the present invention, the number of grade ranks and the content of the data that serves as the basis for determining each grade to be learned can both be set arbitrarily, and the above embodiment is one example.

[0045] As described above, the defect data obtained by processing the image data of the front and back surfaces of the terminal T from the databases 7A and 7B of the control unit server 6 is sent to the arithmetic processing unit 8b of the grading server 8. The arithmetic processing unit 8b judges the grade (rank) of the terminal T by sequentially referring to the received defect data against multiple types of standard grade data generated by AI in the database 8a. This judgment signal is output from the output unit 8c as ranking data (grading data). The output judgment signal is displayed on the display unit 8d as the grade (rank) of the terminal T. FIG. 1 schematically shows an example in which three levels, A, B, and C, are displayed on the display unit 8d as the grade of the terminal T.

[0046] The flaw data obtained by processing the image data of terminal T, which has been processed to determine the grade and rank it, can be added to the standard grade data of the same rank in database 8a. When the flaw data of each grade formed and determined from actual image data is added to the standard grade data, the amount of data for each grade increases, improving the accuracy of the determination. In the above explanation, the control server 6 and the grading server 8 are described as separate servers, but it is also possible to configure a single server computer to handle the roles and functions of both servers 6 and 8.

[0047] Next, we will explain another example of the device of the present invention shown in Figure 2. In the grading process based on the visual inspection of used terminals, there are two types: visual inspection of a single model and grading based on the results, and visual inspection of terminals T containing a mixture of different models and grading based on the results.

[0048] The embodiment of the device of the present invention described above with reference to Figure 1 was primarily concerned with visual inspection of a single model and grading based on the inspection results, but Figure 2 shows an overview of a device for performing visual inspection and grading when different models are mixed. The device in Figure 1 can also be applied to different models as long as they are of similar size. In this respect, the device in Figure 2 is not affected by the size of the terminal T.

[0049] In the device of Fig. 2, the first image data forming unit 3, the second image data forming unit 4, and the reversing mechanism 5 have the same configuration as the device of Fig. 1, but differ from the device of Fig. 1 in that the conveyor 1 is longer and a third camera is specially provided. First, the conveyor 1 is longer at the rear end in the running direction than the conveyor 1 of Fig. 1. Then, in the longer rear portion, a third digital camera 9 (also called D camera 9) is specially arranged to capture images of the size (length and width in the feed direction) and thickness (height in the vertical direction perpendicular to the running surface of the conveyor 1) of the terminals T placed on the conveyor 1.

[0050] The specially installed D camera 9 is disposed on a frame (not shown) that supports the conveyor 1, captures an image of the terminal T moving almost directly below the camera 9, and sends the captured image data to the fourth control unit 64 of the control server 6. The fourth control unit 64 calculates the size and thickness of the terminal T from the captured image data, and outputs signals to the first and second control units 61, 62 to adjust the height positions of the lighting device and the camera and the tilt angle of the optical axis of the lighting and the camera for the lighting device 3b and D camera 3c of the first imaging data forming unit 3 and the lighting device 4b and D camera 4c of the second imaging data forming unit 4, respectively. The adjustments of the positions and tilt angles are controlled by the first and second control units 61, 62.

[0051] The position and tilt angle adjusted and set as described above are released and return to the original position and angle when the terminal T leaves the second image data forming unit 4 (moves out of the angle of view of the D camera 4c). It goes without saying that the device in Figure 2 can also handle and process a single model. In the case of a single model, the D camera 9 system should be turned off.

[0052] FIG. 3 is a side view showing an outline of a third embodiment of the device of the present invention, in which the first image data forming unit 3 and the second image data forming unit 4 are arranged so as to sandwich the gap Gs between two conveyors 1A and 1B arranged in series with the gap Gs between them from above and below.

[0053] In FIG. 3, conveyors 1A and 1B are arranged in series with a gap Gs between them, and are supported by frames 2A and 2B. The conveyors are arranged so that they run from left to right in FIG. 3 with a terminal T placed on the top surface.

[0054] The gap Gs formed between the two conveyors 1A and 1B is set to a width (in the running direction) that corresponds to approximately the entire length of the terminal T. Then, as an example, rail-shaped support members (not shown) are arranged to support the side edges (left and right side edges in the running direction) of the terminal T from below so that the terminal T carried on the conveyor 1A can transfer from the conveyor 1A to the conveyor 1B without falling through the gap Gs.

[0055] Above and below the conveyors 1A and 1B, which are arranged with the gap Gs between them, a first image data forming unit 3 and a second image data forming unit 4, which are dark box-like spaces, are supported by frames 2A and 2B.

[0056] As in the previous embodiment, the first imaging data forming unit 3 and the second imaging data forming unit 4 are provided with lighting devices 3b and 4b that irradiate the front and back surfaces of the terminal T with illumination light, and D cameras 3c and 4c that capture images of the illuminated surfaces.

[0057] 3, the first image data forming unit 3 and the second image data forming unit 4 differ from those described with reference to FIGS. 1 and 2 in that the data forming units 3 and 4 are arranged above and below each other with a gap Gs formed by two conveyors 1A and 1B therebetween, and that two mirrors 10 and 11 are provided at symmetrical inclination angles diagonally downward on the left and right sides of the gap Gs, as shown in FIG. 3. In FIG. 3, the mirrors 10 and 11 are arranged in the second image data forming unit 4.

[0058] By arranging the mirrors 10 and 11, the image of the side of the terminal T reflected in the mirrors 10 and 11 can be captured by turning the head of the D camera 3c to position it (see FIG. 4). That is, in the example of FIG. 3, the D camera 3c of the first imaging data forming unit 3 can obtain imaging data of three sides in total: the front surface of the terminal T and both the left and right sides of the terminal T.

[0059] The two mirrors 10 and 11 are arranged in the second image data forming unit 4, but in the present invention they can also be arranged on the side of the first image data forming unit 3 in a symmetrical orientation with respect to the conveyors 1A and 1B.

[0060] In this case, both side surfaces of the terminal T are imaged by the D camera 4c of the second imaging data forming unit 4. Note that imaging of both side surfaces of the terminal T is performed as the next step after imaging of the front and back surfaces of the terminal T is completed.

[0061] As described above, the device of the third embodiment of the present invention can simultaneously image scratches on the front and back of the terminal T, and by arranging mirrors 10 and 11, can also image scratches on the side of the terminal T, which is effective in improving the accuracy of appearance inspection.

[0062] As described above, the present invention is a device for inspecting the condition of scratches on the front and back of a used terminal by irradiating a moving terminal with illumination light whose optical axis is tilted, taking multiple images of the illuminated terminal with a digital camera (D-camera), processing these images to obtain image data, and automatically grading the terminal for scratches by referencing the acquired image data with multiple types of model data held in a database and determining the terminal grade that resulted from the acquired image data.Furthermore, the scratch data for which the grade has been determined can be added to the stored standard grade data, further improving the accuracy of grading.

[0063] REFERENCE SIGNS LIST 1 Conveyor 2A, 2B Frame 3 First imaging data formation unit 3a Dark box area 3b Lighting device 3c Digital camera (D camera) 4 Second imaging data formation unit 4a Dark box area 4b Lighting device 4c Digital camera (D camera) 5 Reversing mechanism 6 Server 61 First control unit 62 Second control unit 63 Third control unit 7A, 7B Database 8 Grading server 8a Database 8b Arithmetic processing unit 8c Output unit 8d Display unit

Claims

1. A method for grading used terminals, comprising the steps of: moving a terminal within a plane; illuminating light is shone from an upper rearward angle toward the front of the terminal as it moves; capturing an image of the illuminated portion of the terminal with a camera facing diagonally rearward from an upper frontward angle of the terminal; processing the captured image to form image data of the terminal; referring to multiple types of standard grade data classified by grade and stored in a server database; determining the grade (rank) of the standard grade data to which the captured image data is determined to belong as the grade of the captured image data; and outputting the determination result.

2. The grading method of claim 1, wherein the terminal being moved is moved on a conveyer belt with the front or back side facing up, the illumination light is irradiated and an image is captured by the camera, and then the terminal is flipped over and moved with the back or front side facing up, and another illumination light is irradiated and an image is captured by another camera, thereby obtaining image data for both the front and back sides of the terminal.

3. An imaging data acquisition device for use in the grading method of claim 2, in which a single conveyor is arranged to run in one direction in a horizontal position, and a lighting device (hereinafter referred to as the light source) and an imaging camera are arranged in a dark box-like space on the front side of the conveyor in the running direction, with a section for forming imaging data of the front or back side of the terminal as the first imaging data forming section, and a light source and camera of the same type as those in the first imaging data forming section are arranged on the front side of the conveyor in the running direction, with a section for forming imaging data of the front or back side of the terminal as the second imaging data forming section.

4. The image data acquisition device of claim 3, further comprising an inversion mechanism between the first image data formation section and the second image data formation section for inverting the terminal being transported on the conveyor.

5. The inversion mechanism of claim 4 is an imaging data acquisition device as claimed in claim 4, which is constituted by a grip having a lifting and rotating function driven by a motor that grasps a moving terminal in a horizontal position and rotates the grasped terminal 180 degrees on a horizontal plane.

6. An imaging data acquisition device as claimed in claim 3 or 4, wherein the light source of illumination light and the camera constituting the first imaging data formation unit and the second imaging data formation unit are each provided with an adjustment function that enables their vertical position and inclination angle to be changed arbitrarily.

7. The mechanism for adjusting and setting the position and angle of the light source and camera in claim 6 is an imaging data acquisition device in which the terminal placed on the conveyor and starting to move is imaged by another camera installed at the start position of the movement, and adjustments and settings are made based on data on the size and thickness of the terminal obtained from the image data.

8. The mechanism for adjusting and setting the position and angle of the light source and camera in claim 6 is an imaging data acquisition device as claimed in claim 7, which is composed of a linear motion mechanism that uses a motor as a drive source and raises and lowers the light source and camera using a rack and pinion mechanism, a feed screw mechanism or a cylinder mechanism to position them, and a rotation mechanism that changes the set angle of the light source and camera to position them.

9. An imaging data acquisition device as claimed in claim 3, in which, instead of a single conveyor for transporting terminals, two conveyors are provided as a first conveyor and a second conveyor which are arranged in series with a gap therebetween that is less than the length of the terminal in the direction of travel, and a first imaging data formation unit is arranged above the gap between the first and second conveyors, and a second imaging data formation unit is arranged below the gap, and when the terminal passes through the gap, the first imaging data formation unit and the second imaging data formation unit are operated simultaneously to simultaneously acquire the first imaging data and the second imaging data.

10. The imaging data acquisition device of claim 9, which simultaneously acquires first imaging data and second imaging data, comprises mirrors, inclined at an angle of approximately 45 degrees with respect to the horizontal plane, disposed on the left and right sides of the gap set between the first and second conveyors, facing the left and right sides of the terminal being moved, reflecting the side of the moving terminal onto the mirrors, and capturing a mirror image of the side of the terminal reflected on the mirrors with a camera of the first imaging data formation unit, thereby acquiring imaging data of the left and right sides of the terminal.

Citation Information

Patent Citations

  • Old and useless cell -phone automatic classification equipment

    CN205701488U

  • Surface defect inspecting method and device

    JP2002082060A

  • Work inspection device

    JP2015049213A

  • Carrier device, method for carrying, and inspection system

    JP2018205197A

  • Information processing device

    JP2021043967A