IMAGE PROCESSING-BASED PROCESSING GUIDANCE SYSTEM AND METHOD

Abstract

This invention relates to an image processing-based process guidance system and method that can be used in automotive services, white goods repair, small household appliance repair, electronic device repair, industrial machine maintenance, medical device technical service, maintenance and repair applications, technical service applications, disassembly and assembly operations, and technical applications for training purposes. Its features include a mobile device (1) that is directed to the disassembly area and obtains image data during the disassembly process, an image acquisition unit (2) that receives the said image data, a disassembly tracking module (3) that monitors the disassembly process through the image data and tracks the parts and / or fasteners disassembled by the user on a process basis, a part identification module (4) that distinguishes the disassembled parts from each other and associates them with the relevant process step, and a disassembly sequence record (5) that records the disassembly stage for each disassembled part.It includes a location relationship record (6) which records the area from which each disassembled part was removed and / or the location where it was left; a disassembly data model (7) which creates structured data for the disassembly process by associating part information, disassembly sequence information and location information; a reverse assembly guidance module (8) which processes the said disassembly data model in reverse order during the assembly phase and creates a reverse assembly guidance for the user; and a user interface (9) which presents the created reverse assembly guidance to the user.

Description

1 TARIFF 5 IMAGE PROCESSING-BASED PROCESSING GUIDANCE SYSTEM AND METHOD Technological Field: 10 This invention is based on a device, machine, mechanical assembly or electronic equipment. Monitoring of disassembly and assembly processes through sequential image data. identification of disassembled parts and fasteners, disassembly sequence, source Session-specific disassembly data 15 associated with location and drop location information. the saving in the structure and the reassembly process flow from that data structure with an image processing-based process guidance system and method for its creation It is related. State of the Art: 20 Within the scope of maintenance, repair, troubleshooting, parts replacement or technical service operations. disassembly of a device, machine, mechanical assembly or electronic equipment then reassembly, especially with numerous parts, screws, washers, covers, cables, sockets This is a process that requires attention in systems containing fasteners such as these. 25 In known techniques, this process is mostly avoided in order to eliminate the complications that occur. Manual solutions are being used. Users are taking photos during the dismantling process. recording video, physically arranging the pieces in a specific order, connecting placing the elements in separate boxes, labeling them, or taking notes on which He is trying to remember where the part was taken from and at what stage it was disassembled. 30 In more professional applications, service manuals, parts diagrams, and maintenance and repair guides are used. The documentation and technical guidelines provided by the manufacturer are used. In these known methods, the information generated during the disassembly process is mostly in raw form. is stored. For example, a photograph or video recording provides visual data regarding the dismantling process. 35 In addition to storing the parts, the order in which the disassembled parts were removed and from which area they were detached are also noted. 2 which fasteners it is associated with or what kind of operational relationship it has with other parts 5 transforming the information it contains into automatically structured technical data. It does not bring it. Therefore, even if the user has recorded images, Selecting the correct moment from among the relevant images during the assembly phase, and the disassembly sequence. It has to interpret and re-establish the relationship between the parts. Another In other words, the visual recordings do not technically analyze the process itself, only 10 It stores it for later interpretation. Manual methods such as labeling, part separation, and note-taking are directly dependent on the user. It depends on attention, discipline, and the level of care shown during the process. Disassembly During this process, each piece should be labeled, noting which area it was removed from, or 15 Separate classification of similar fasteners, especially under time pressure This creates additional workload in maintenance and repair applications. One step from the user. in case of incomplete recording, incorrect labeling of a part, or omission of notes Data integrity is compromised during the assembly phase; part mix-ups and fastener confusion occur. forgetting, using the wrong kind of screws, or incorrectly remembering the disassembly sequence 20 Problems such as these may arise. This situation not only increases the processing time, also leads to the need for repeated disassembly and reassembly due to incorrect assembly, and part damage. It can also lead to risks. More corporate information such as service manuals, assembly diagrams, and manufacturer documentation 25 The sources mostly describe the ideal or standard disassembly and assembly procedure of the device. This shows. However, these resources do not actually indicate that a particular user... the actual disassembly process it carried out and the sequence and position that emerged during this process and it does not take into account part relationships. In other words, the process described in the manuals. The flow may not always exactly match the disassembly sequence followed by the user in the application. 30 Especially those whose structure has changed due to previous interventions and who have a different service history, Part placement changed in the field or removed in a specific order by the user. In these systems, standard technical documents do not represent the actual disassembly data. It fails to provide adequate guidance during the assembly phase. 35 3 In conclusion, the fundamental technical problem in known techniques is that during disassembly, 5 consecutive steps are required. The inability to automatically detect the particle separation events observed in the images, during the disassembly session of parts with the same or similar visual characteristics indistinguishable from each other and the order in which each part was removed, the source region from which it was taken and the temporary location information where it was left cannot be linked under the same track record. Therefore, in current systems, 10 of the disassembly process actually performed by the user An automated and session-specific back-assembly flow cannot be generated. The investigations revealed that a company registered under the name Exelis Inc. offers a product called "Augmented reality." "System and method for displaying the device's maintenance and operating instructions" Patent number US9324229B2, titled "A task-related 15-point patent for a user," belongs to Siemens and describes... Patent application number WO2017171649A1, titled "Methods of Information Provision," by Magic Leap's EP3869468A1 focuses on augmented reality and visual object recognition. Patent family number US11263818B2; registered in the name of the US Department of Navy and titled “Multiple” "Modal procedural routing content creation and transformation methods and systems" The patent numbered US12499630B2, titled “Disassembly support method and 20 Note the patent application numbered EP4693226A1 entitled "Disassembly Support Mechanism". It is drawing. These documents generally involve displaying maintenance instructions using augmented reality. presenting the user with the steps of the process, monitoring the task status, creating procedures, or 25 Approaches such as providing disassembly support are included. The invention is based on a pre-prepared Unlike presenting a standard maintenance or assembly procedure to the user, The disassembly process actually performed by the user was captured from sequential camera footage. The system monitors the segment separation events that occur within the image sequence. determining; each separated part is assigned a part identity specific to the session, in the disassembly sequence, 30 It is associated with information about the source region from which it was extracted and the temporary location where it was left. Thus, the back-assembly orientation is derived from a predefined overall task model. No, from the part-sequence-position records created during the relevant disassembly session. It is produced. 35 Description of the invention: 4 An invention is a device, machine, mechanical apparatus or electronic equipment. By monitoring the disassembly process via camera footage, the dismantling was carried out. the information generated during this process is converted into a technical data structure that can be used during the assembly phase. It provides a significant advantage in terms of conversion. The system, image acquisition Object detection, object tracking, image 10 on sequential images obtained from the unit. by performing feature matching and location change analysis between the dismantled areas It identifies the parts and fasteners. It's a machine learning-based object. If a classification model is used, the candidate part in the image is added to the model. Regions are given as input; part class and classification reliability are given as model output. value is obtained. Thus, the disassembly process is recorded only as a passive visual record. 15 It is not hidden, it can be recalled during assembly, it is interpreted and associated. It is converted into transaction data. The purpose of the invention is to analyze each separation event detected from successive images. The same event 20 includes part ID, temporal sequence, origin location, and drop location data. by combining them under a record, the disassembly process is processed by the machine as data. The goal is to enable the conversion of the created data structure back into its original form. By processing it in this stage, the part placement sequence and target that will be presented to the user The aim is to automatically determine the placement location. The user... When disassembling the system, which part is at which stage, from which area, and which connection? 25 also note, label, or memorize that it was removed along with its components Without needing to be manually operated, the system processes this data automatically. This allows for assembly. In this phase, the user is provided with not only a general visual archive but also their own dismantling work. A structured transaction history derived from the transaction is presented. The structure involves converting disassembly data into a functional technical reference for assembly. 30 It provides. The invention enables guidance during assembly using reverse process logic. by helping to put the parts back in the correct order and in the correct position. This is the case. Using the data obtained during disassembly, 35 steps are taken during the assembly phase. the user is shown which part should be reinstalled in which order, and which part is relevant to which system. 5 The following can be displayed: Part ID, chronological sequence, source location, and drop location. Linking information under the same event log; having the same visual characteristics matching fasteners with different source locations, during disassembly the preservation of the resulting part-position relationship despite camera movement and assembly During this process, the selected part is verified against the target position via the image. 10 This technical structure ensures that the wrong part is placed in the wrong connection point. and reduces the risk of skipping an assembly step. Thus, the process sequence user resulting from forgetting or mixing up similar parts The aim is to reduce errors. Another advantage provided by the invention is taking photos, watching videos, taking notes, and assembling parts. and reduces the need for additional user actions such as manual labeling. The user also needs to take lengthy notes, produce numerous images, or during the disassembly process. The system classifies the parts via camera, without requiring manual classification. The process it follows is technically handled. This is especially true for maintenance and repair 20 It provides benefits in terms of time management in processes; it distracts the user's attention to secondary issues. This allows users to proceed directly to the technical application rather than through the registration process. Also, rewatching past videos from beginning to end or taking numerous photos This also eliminates the need to search for the correct stage in between. The invention eliminates the technical and economic disadvantages that may arise from incorrect assembly. It also contributes to reducing the risk of parts being installed incorrectly, such as using similar screws. mixing things up, forgetting some fasteners, or incorrectly reversing the disassembly sequence. Situations such as turning it over may require disassembling the device again, damaging the parts, This may cause the malfunction to persist or require additional service intervention. 30 The invention involves the systematic processing of disassembly data and data during assembly. Providing feedback to the user helps reduce such errors; accordingly this involves the need for repeated disassembly and reassembly, the risk of part damage, and maintenance and repair. It provides a technical benefit in terms of reducing costs. 35 6 The invention also allows users with limited technical knowledge to feedback in a more controlled manner. It supports assembly. The disassembly data is processed by the system. the processing and assembly phases are presented to the user in a step-by-step manner, not only Not for specialist service personnel, but for different individuals who need support during the maintenance and repair process. It also creates ease of application for user groups. This feature makes the invention suitable for the automotive sector. services, white goods and small household appliance repair, electronic device repair, industrial 10 such as machine maintenance, medical device technical service, and technical applications for training purposes. This supports its use in numerous sectors, especially multi-part mechanics. and in operations requiring the disassembly and reassembly of electronic systems, the user Converting specific disassembly data into assembly support offers a significant practical benefit. It constitutes. 15 Within the scope of this invention, sequential images are not only stored in video file format; By analyzing the changes between the images, a part can be separated from the main assembly. The moment of operation is determined. Upon detection of the separation event, the relevant part is treated. A session-specific piece identifier is assigned, and that identifier includes the event's timestamp, 20 disassembly sequence, the source area from which the part was removed, and the position where it was left after disassembly. It is associated with. Thus, the raw image sequence shows each physical disassembly event. This data structure is converted into structured track records representing the track. Thanks to this, the system provides real data obtained from the disassembly process carried out by the user themselves. It can redirect data rollback based on transaction data. Additionally, the system has 25 If needed, existing technical information resources, maintenance and repair databases or additional resources. Its structure, which can be supported by explanatory information systems, will allow for more detailed assembly in the future. This lays the groundwork for advanced applications that will provide guidance and decision support. Innovation in terms of image processing, artificial intelligence, machine learning, maintenance and repair. It is located at the intersection of engineering, mechatronics, electronics and mechanical systems fields. 30 The field offers a feasible and scalable technical solution. Explaining the Figures: The invention will be described by referring to the attached figures, so that the features of the invention are listed in section 35. It will be understood and appreciated more clearly, but the purpose of this invention is this obvious 7 It is not about limiting it with regulations. On the contrary, the invention is defined by the accompanying claims in 5 all alternatives, modifications, and options that could be included within the defined area The aim is to cover their equivalences. The details shown are only for the present invention. It is shown to illustrate the preferred arrangements and both the methods shaping, as well as the rules and conceptual features of the invention, in the most useful way. It should be understood that they are presented to provide an easily understandable definition. In these drawings; 10 Figure 1 shows a schematic view of the system. Illustrations that will help understand this invention are shown in the attached image. They are numbered and listed below with their names. 15 Explanation of References: 1. Mobile device 2. Image acquisition unit 20 3. Disassembly Tracking Module 4. Part identification 5. Disassembly sequence record 6. Location relationship record 7. Disassembly data model 25 8. Reverse mounting orientation module 9. User interface Description of the Invention: The invention is a device that is directed towards the disassembly area and acquires image data during the disassembly process. mobile device (1), image acquisition unit (2) that receives the image data in question, image By monitoring the disassembly process via data, the system can identify the parts and / or connections removed by the user. a disassembly tracking module (3) that tracks the elements on a process basis, disassembled parts A part identification system that distinguishes between parts and associates them with the relevant processing step. 35 module (4) is a disassembly sequence that records the disassembly stage for each disassembled part. 8 record (5) the area from which each disassembled part was removed and / or the location where it was left 5 a location relationship record (6), part information, disassembly sequence information and location a disassembly process that creates structured data about the disassembly operation by associating its information. data model (7), reverse operation of the disassembly data model in question during assembly phase A reverse assembly that processes information sequentially and creates a reverse assembly guide for the user. 10 presents the routing module (8) and the generated back assembly routing to the user It includes a user interface (9). The invention generates sequential image data during the disassembly process by being directed towards the disassembly area. It has an image acquisition unit (2). The invention is a screw that is removed via image data, Identify the cover, cable, socket, washer, or connector and locate the identified part in the relevant 15 to the disassembly tracking module (3) which matches the disassembly step and part identification It has module (4). The invention relates to the disassembly sequence of each disassembled part and the region from which it was removed and / or The dismantling sequence record (5) records the position where it was left and the position relationship 20 has the record (6). The invention records part ID, disassembly sequence, and location information of disassembled parts in the same file. It has a disassembled data model (7) which stores data by relating it under its structure. The invention reverses the disassembly sequence in the disassembly data model, resulting in 25 steps for the assembly phase. It has a reverse assembly orientation module (8) that creates a part placement sequence. is happening. The invention provides visual and / or functional information about part details, process sequence, and position during reassembly. It has a user interface (9) that presents in written form. 30 The invention relates to the image data obtained from the image acquisition unit (2) of a mobile device (1). at least one processor in operation and disassembly tracking module (3), part identification module (4), disassembly sequence record (5), position relationship record (6), disassembly data model (7) It contains at least one memory module. The processor executes program instructions stored in memory. 35 capturing image frames, detecting the separation event, identifying the part. 9 5. Determining, associating location information, and reassembly process flow. It performs the creation processes. It also includes a reverse assembly orientation module. processor-based software that enables data exchange between (8) and user interface (9) It includes architecture. The invention is the identification of disassembled parts by the part identification module (4). by matching the disassembly sequence record (5) and position relationship record (6) to the disassembly data model. (7) has a disassembly tracking module (3) that transmits. The invention is an image processing-based process routing method, accessible via a mobile device (1). The image data of the dismantling area is taken with the image acquisition unit (2), the acquired image 15 Monitoring the disassembly process via the data using the disassembly tracking module (3), the disassembled Identification of parts with part identification module (4), each disassembled Recording the disassembly stage of the part with the disassembly sequence record (5), each disassembled (6) Recording with disassembled part information, disassembly sequence information and location information disassembly 20 The disassembly data in question is associated within the data model (7) during the assembly phase. the reverse assembly orientation module (8) of the model according to the reverse operation sequence processing and reassembly guidance is provided to the user via the user interface (9) The submission process includes the following steps. The invention describes the removal of screws, caps, cables, sockets, washers, or connectors via image data. by identifying the component and matching the identified part with the relevant disassembly step. It includes the steps for creating the track recording. The invention relates to the release position of the disassembled part and the cessation of the part's movement at point 30. its location is determined and recorded via image data, and the part in question By associating the disassembly sequence with the position information, the disassembly data model (7) It includes the steps for its creation. The invention is based on the reverse sequence of operations during the assembly phase of the disassembly data model (7) 5 the step of processing and determining which part will be reassembled in which order It includes. The invention provides the user with part information, process sequence, and relevant location during reassembly. This includes the step of displaying the information via the user interface (9). 10 Detailed Description of the Invention: Within the scope of the invention, the system is a mobile device with camera and processor infrastructure (1) 15 as an image processing-based process routing architecture that works on it It is designed. The mobile device (1) is placed in the area where the user performs the disassembly operation. The system is directed to and capable of capturing, analyzing, recording, and editing images. It serves as the main hardware platform on which the routing and presentation processes are carried out. is doing. During the disassembly process, the mobile device (1) is located on or with the mobile device (1). The connected working image acquisition unit (2) obtains image data of the disassembly area. Each image frame has a time signature indicating the time the image was obtained. disassembly with a stamp and a session ID indicating the relevant disassembly session. The images from the same disassembly session are transferred to the tracking module (3). Thus, the images from the same disassembly session are transferred to the tracking module (3). The image acquisition unit (2) is processed while maintaining temporal integrity. It captures the operations it performs during dismantling in the form of sequential image data, and this It transfers the image data to the relevant software components in the system. At this stage... image data, disassembled parts, fasteners and operation movements It is used as the primary data source for monitoring purposes. 30 Image data received by the image acquisition unit (2) is transferred to the disassembly tracking module (3) It is processed by the disassembly tracking module (3), sequential image in terms of time. by comparing the squares, the changes in object position and movement in the disassembly area. It determines. The module separates a part from the source area on the main assembly, 35 transported by the user or by means of a tool and to another location in the disassembly area 11 The release stages are followed within the same process event. The part's source 5 Upon determining that he / she left the area, a timestamp and sequential information were created for the relevant event. A transaction number is generated. This module outlines the disassembly process in sequential steps. It enables monitoring and records of each disassembly movement by the system. It allows for evaluation in a way that can be created. Disassembly tracking module (3) shows the starting position of a part on the main assembly. It compares the current position in successive images. The beginning of the piece. the visual overlap with the region falling below a predetermined threshold value and if the image region of the part moves away from the source region, the part separates. The event is being created. The separation event is distinguished from temporary hand or tool movements. 15 In order to achieve this, the condition in question must continue in multiple consecutive image frames. It is being checked to ensure it does not. Parts detected during disassembly are identified by the part identification module (4). shape, size, color, edge, texture and / or distinguishing visual features within the image 20 They are distinguished by analyzing them based on their characteristics. The module is the designated part. by utilizing its properties, the part is classified within a part class and disassembly session. It associates a part with a unique identity. It belongs to the same part class. If there is more than one fastening element, a separate one for each fastening element. A session ID is being created; this ID includes the source location of the relevant piece and 25 It is preserved with disassembly sequence information. Part identification module (4), screw, as separate part records of covers, cables, sockets, washers or similar fasteners It enables identification and the detected part to be removed using the relevant disassembly step. It connects the parts that are disassembled within the same disassembly session. This ensures that transactions are monitored on a case-by-case basis without interference. 30 The tracked part is temporarily blocked by the user's hand, tool, or other object. If covered, the last known position, direction of movement, and visual characteristics of the piece The recording is preserved. The current image is obtained upon re-viewing the piece. The specifications were compared with the last recorded part specifications and the estimated location of part 35. 12 It is being rematched with the same session ID. The matching confidence value is set to 5. If the threshold value is not met, the system requests user authentication. Disassembly sequence for each part defined by the part identification module (4) A record (5) is created for each part separation event, the time when the event occurred. showing the timestamp and the sequential process 10 of the related event within the same disassembly session. It records the number. Multiple parts within the same processing stage. If disassembled, the parts in question fall under a common processing group. They are linked and their temporal order within the group is also preserved. This record This ensures that the sequence of steps in the disassembly process is preserved and then during the assembly phase. The sequential data is obtained, which will serve as the basis for creating the reverse sequence of operations. 15 The system also creates a position relationship record (6) for each disassembled part. Position relationship record (6), before the separation event of each part on the main assembly the source region where it was located and the release region where it was placed after the separation event It records. The source region is 20, determined on the reference image of the main system. image coordinates, semantic region information and / or detected on the main mechanism It is represented by relative position information defined according to reference points. The release zone is where the movement of the part ceases and it remains stationary for a specific period of time. It is determined through the image region where it remained. This recording shows the disassembly of the part. The location information associated with the source location in the area after dismantling is the same as 25 This ensures that the relevant part is kept within the context of the process. Thus, during the assembly phase... Data regarding the region to which they will be relocated is being preserved. Position or viewing angle during disassembly of the image acquisition unit (2) If it changes, the common reference points of the main setup in the successive images are 30. Reference points identified among the images are matched to determine this. Image coordinates are converted to a common reference system and the source of the parts Their positions are recorded according to this common reference system. Thus, the camera Image coordinate changes resulting from movement, part-source position It does not cause the relationship to deteriorate. 35 13 Disassembly tracking module (3), part identification module (4) identified 5 by matching the disassembled parts with the disassembly sequence record (5) and position relationship record (6) It transfers the data to the disassembly data model (7). The disassembly data model (7) transfers each disassembled For the part, at least; disassembly session ID, session-specific part ID, part class, Timestamp of the part separation event, sequential process number, source location, release date. It creates a segment event log that includes the location and segment image recording areas. 10 Fasteners removed along with a part, upper-lower component relationship with main part registration. This model is assembled and stored within the same process group. (Disassembly process) transforming the scattered visual and operational information generated during the process into a structured data structure. It transforms. In the disassembly data model (7), each part record contains the identity of the relevant part, disassembly The sequence is associated with information about the region from which it was extracted and / or the location where it was left. This In this way, the disassembly process is not only saved as a visual record, but also includes the parts, sequence, and position. A record structure is created in which a technical data relationship is established between the pieces of information. The subject structure forms the basis for creating the reverse process flow to be used during the assembly phase. It constitutes. When the assembly phase begins, the reverse assembly guidance module (8) disassembly data It processes the model (7). The reverse assembly orientation module (8) processes the disassembly data model. (7) The parts found are sorted in reverse order of the incident records and the parts are 25 a back-assembly process flow by checking the parent-child component relationships between them It consists of a module that must be attached before a part can be reinstalled. in identifying components or fasteners; directly reversing the sequence of parts In cases where the part relationships are incompatible, assembly priority is given to the part relationships in question. It is arranged according to... During this process, the order in which each part is put back is determined. 30 is determined and the recorded location information for the relevant part is used in the reassembly guidance. It is used. The generated back-assembly guidance is given to the user via the user interface (9). is presented and current 35 obtained from the image acquisition unit (2) during assembly. images with part and weld location records in the disassembly data model 14 The part selected by the user is compared with the redirected part ID. and the relevant assembly if the region where it is placed matches the registered source location. The step is marked as completed; if a match is not found, the user interface... This generates a warning for the wrong part, wrong location, and / or wrong sequence of operations. . The user interface (9) displays the part image of the current assembly step, session-specific Part ID and target source location are displayed on the current camera image. It indicates. The interface, according to the assembly verification result, indicates the current step. that it is complete, the wrong part has been selected, or the part is different from its registered source location. It provides the user with a verification output showing that it has been placed in a region. This Through the interface, the user can access data related to the previously performed disassembly operation. By following the reverse process flow obtained from the model, determine in what order and which 15 parts It shows that it will be placed in that location. Part identification module (4), part class and session determined for each part detection. A matching confidence value is established along with the identity. The confidence value is determined in advance. If the value falls below the determined threshold, multiple candidate parts will have similar confidence levels. if it has a value or the source location of the part cannot be determined User verification is required before registration is finalized. By the user The verification or correction performed is added to the relevant part's event log. The processor-based software running on the mobile device (1) during the operation of the system 25 architecture, image acquisition unit (2), disassembly tracking module (3), part identification module (4), disassembly sequence record (5), position relationship record (6), disassembly data model (7), data exchange between the reverse assembly orientation module (8) and the user interface (9) It provides this service, from acquiring image data to part identification and disassembly. From the creation of sequence and position records to the disassembly of the data model, 30 from delivery to providing guidance to the user during the assembly phase The process flow is carried out in an integrated manner. 35

Claims

REQUIREMENTS 5 1- The invention relates to an image processing-based process guidance system, characterized by: — a device that is directed towards the disassembly area and obtains image data during the disassembly process. mobile device (1), ⎯ an image acquisition unit (2) that receives the said image data, 10 — By monitoring the disassembly process via image data, the user can see the parts they have removed. and / or a disassembly tracker that monitors fasteners on a process basis. module (3), — a system that distinguishes the disassembled parts from each other and associates them with the relevant process step. part identification module (4), 15 — a disassembly sequence that records the disassembly stage for each part that is removed. record (5), —the area from which each disassembled part was removed and / or the location where it was left a location relationship record (6), — Disassembly by associating part information, disassembly sequence information, and position information. 20 a disassembly data model (7) that creates structured data for the operation, —the disassembly data model in question is processed in reverse order during the assembly phase. a reverse assembly that processes and creates a reverse assembly guide for the user. the routing module (8) and — a user interface that presents the generated reassembly instructions to the user 25 (9) is included. 2- The image processing-based process routing system mentioned in Claim 1 is characterized by: It is directed to the disassembly area and produces sequential image data during the disassembly process. It is characterized by having an image acquisition unit (2). 30 3- The image processing-based process routing system mentioned in Claim 1 is characterized by: screws, covers, cables, sockets, washers, or fasteners removed via image data Disassembly tracking that identifies the part and matches it with the relevant disassembly step. 16 5 is characterized by having module (3) and part identification module (4). It is done. 4- The image processing-based process routing system mentioned in Claim 1 is characterized by: For each disassembled part, the disassembly sequence, the area from which it was removed and / or where it was left disassembly sequence record (5) and location relationship record (6) which record by associating the location It is characterized by having. 10 5- The image processing-based process routing system mentioned in Claim 1 is characterized by: The part ID, removal sequence, and location information of the removed parts are stored in the same record structure. It is characterized by having a disassembly data model (7) which stores data by relating it under. It is done. 15 6- The image processing-based process routing system mentioned in Claim 1 is characterized by: By reversing the disassembly sequence in the disassembly data model, the part belongs to the assembly phase. with having a reverse assembly orientation module (8) that forms the placement sequence It is characterized. 20 7- The image processing-based process routing system mentioned in Claim 1 is characterized by: During reassembly, part information, process sequence, and location information are displayed visually and / or in writing. It is characterized by having a user interface (9) that presents itself as such. 8- The image processing-based process routing system mentioned in Claim 1 is characterized by: mobile device (1) and image acquisition unit (2), disassembly tracking module (3), part identification module (4), disassembly sequence record (5), position relationship record (6), disassembly data model (7), reverse assembly orientation module (8) and user interface (9) It includes a processor-based software architecture that enables data exchange between them. 30 It is the characterization of the situation. 9- The image processing-based process routing system mentioned in Claim 1 is characterized by: Disassembly of disassembled parts identified by part identification module (4) By matching the sequence record (5) and the position relationship record (6) to the disassembly data model (7) 35 It is characterized by having a transfer disassembly tracking module (3). 17 10- The invention is an image processing-based process routing method, the characteristic of which is; 5 ⎯ Image acquisition of the dismantling area image data via mobile device (1) to be taken with unit (2), ⎯ The disassembly process is tracked via the disassembly tracking module (3) using the acquired image data. monitoring, ⎯ Identification of the disassembled parts with the part identification module (4), 10 ⎯ with the disassembly sequence record of the disassembly stage for each disassembled part (5) recording, —the region from which each disassembled part was removed and / or the location where it was left Recording with location relationship record (6), — Information about the disassembled part, disassembly sequence information, and location information are included in the disassembly data 15. its association within model (7), —Reverse assembly orientation of the disassembly data model during assembly phase The module (8) is processed in reverse order and ⎯ the user interface (9) of the back assembly guidance to the user The presentation includes the process steps. 20 11- The method mentioned in claim 10, its characteristic is; screw removal via image data, Identifying the cover, cable, socket, washer or connector and the identified part. This includes the steps for creating a part record by matching it with the relevant disassembly step. It is characterized. 25 12- The method mentioned in Claim 10, its characteristic is that the area from which the disassembled part was removed... and, as far as possible, recording the location where it was left and for that particular piece By associating the disassembly sequence with the position information, the disassembly data model (7) It is characterized by including the steps involved in its creation. 30 13- The method mentioned in claim 10 is characterized by the assembly of the disassembly data model (7). The process is carried out in reverse order, and which part is reversed in which order. It is characterized by the fact that it includes the step of determining which one will be fitted. 18 14- This is the method mentioned in claim 10, and its characteristic is that it allows the user to see part 5 during reassembly. information, process sequence and related location information are displayed via the user interface (9). It is characterized by the fact that it includes the step. 15 25 35

Images