Information processing device, information processing method, and information processing program

Abstract

An information processing device capable of appropriately managing objects before and after work is provided. [Solution] An information processing device 1 acquires identification information stored on an object to be worked on, acquires position information of the object, and stores the identification information and position information in association with each other. The information processing device 1 then determines whether the identification information before the work and the identification information after the work match, and, using the position information before the work as a reference position, determines whether the position information after the work is within a distance range from the reference position determined by the physical dimensions of the object.

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, a system is known that acquires estimate information for repair work, replacement work, etc., related to a vehicle and manages work to be performed based on the estimate information. For example, Patent Document 1 discloses a system that allows automobile insurance companies, repair shops, and automobile owners to constantly grasp the repair status of automobiles (damaged automobiles). With this system, automobile insurance companies can manage repair management sheets for damaged cars, manage internal payment progress, and search for repair shops, while repair shops can create estimates, manage progress sheets, and sign designated shop contracts. Owners can obtain information on repair progress. Furthermore, Patent Document 2 discloses a management system that can optimize the timing of periodic inspections and maintenance of forklifts, as well as the work content and cost claims for the periodic inspections and maintenance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-208486 [Patent Document 2] Japanese Patent Application Publication No. 2024-79385 Summary of the Invention [Problem to be solved by the invention]

[0004] However, there has been a demand for a system that can appropriately manage work targets before and after work in management systems such as those disclosed in Patent Documents 1 and 2. For example, there has been a demand for a system that can manage work targets such as vehicles and electronic devices without mixing them up.

[0005] An object of the present invention is to provide an information processing device, an information processing method, and an information processing program that are capable of appropriately managing an object to be worked on before and after the work. [Means for solving the problem]

[0006] The above-mentioned object is achieved by the information processing device of the present invention, which comprises a storage unit and a processor capable of information processing using information stored in the storage unit, and the processor and from a vehicle equipped with an electronic control unit (ECU), including the vehicle identification number. an identification information acquisition unit that acquires identification information; The vehicle is detected from a signal received by a GNSS receiver that receives a signal from an artificial satellite. and a location information acquisition unit that acquires the location information of the identification information acquisition unit. Get The identification information and the location information acquisition unit Get The location information Write The processor Made by an identification information determination unit that determines whether or not the identification information before the work and the identification information after the work match; and an identification information determination unit that determines whether or not the identification information before the work and the identification information after the work match, using the position information before the work stored in the storage unit as a reference position, and vehicle and a position information determination unit that determines whether the object is within a distance range determined by the physical dimensions of the object. 。

[0007] The above-mentioned object is also achieved by an information processing method of the present invention, which is executed by a computer including a storage unit and a processor capable of performing information processing using information stored in the storage unit, and the computer and from a vehicle equipped with an electronic control unit (ECU), including the vehicle identification number. Obtaining identification information; The vehicle is detected from a signal received by a GNSS receiver that receives a signal from an artificial satellite. and acquiring location information of the identification information and the location information. Write To remember and Made bydetermining whether or not the identification information before the work matches the identification information after the work; and determining whether or not the identification information before the work matches the identification information after the work, using the position information before the work stored in the storage unit as a reference position, and determining whether or not the position information after the work matches the reference position. vehicle The problem is solved by determining whether the object is within a distance determined by the physical dimensions of the object.

[0008] The above-mentioned object can be achieved by the information processing program of the present invention, which is provided for a computer including a storage unit and a processor capable of information processing using information stored in the storage unit. and from a vehicle equipped with an electronic control unit (ECU), including the vehicle identification number. A process of obtaining identification information; The vehicle is detected from a signal received by a GNSS receiver that receives a signal from an artificial satellite. a process of acquiring location information of the identification information and the location information; Write A process of memorizing the Made by a process of determining whether or not the identification information before the work and the identification information after the work match; and a process of determining whether or not the identification information before the work matches the identification information after the work, the identification information after the work being stored in the storage unit being a reference position, and vehicle and a process of determining whether the object is within a distance range determined by the physical dimensions of the object. [Effects of the Invention]

[0009] According to the information processing device, the information processing method, and the information processing program of the present invention, it becomes possible to appropriately manage the object to be worked on before and after the work. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 2 is a diagram illustrating a hardware configuration of the information processing system. [Figure 2] FIG. 2 is a diagram illustrating a hardware configuration of a vehicle. [Figure 3A] FIG. 1 is a diagram illustrating a function (trail management) of an information processing device. [Figure 3B] FIG. 2 is a diagram illustrating a function (identity management) of an information processing device. [Figure 4A] FIG. 10 is a diagram showing a display screen of a first reception process performed when receiving a vehicle. [Figure 4B]FIG. 4B is a diagram showing a display screen of the first reception process, continuing from FIG. 4A. [Figure 5] FIG. 10 is a diagram showing a display screen of a second reception process performed when receiving a vehicle. [Figure 6] FIG. 10 is a diagram showing a display screen of a list of business process flows relating to vehicles. [Figure 7] FIG. 10 is a diagram showing a display screen for estimate information for repair and replacement work. [Figure 8] FIG. 10 is a diagram showing a screen for managing trail information for each work and work process of an estimate item. [Figure 9] FIG. 10 is a diagram showing a screen for managing trail information for each work and work process of another estimate item. [Figure 10] FIG. 10 is a diagram showing a display screen for registering trail information. [Figure 11] FIG. 10 is a diagram showing a work management screen (first display screen) displayed on a worker terminal. [Figure 12A] FIG. 10 is a diagram showing a work management screen (second display screen) displayed on a client terminal. [Figure 12B] FIG. 10 is a diagram showing a timeline management screen displayed on a client terminal. [Figure 12C] FIG. 10 is a diagram showing a management screen for work record information displayed on a client terminal. [Figure 13] FIG. 10 is a diagram showing a work management screen (third display screen) displayed for a third party. [Figure 14] FIG. 10 is a processing flow diagram showing an information processing method for trail management. [Figure 15] FIG. 10 is a process flow diagram showing an information processing method for identity management. [Figure 16] FIG. 16 is a processing flow diagram continuing from FIG. [Figure 17] FIG. 17 is a processing flow diagram continuing from FIG. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, one embodiment of the present invention will be described with reference to FIGS. In this embodiment, the "object (object to be worked on)" managed by the "information processing device (information processing system)" will be described as being mainly a "mobile body (vehicle)".

[0012] <Outline of the information processing system> As shown in Figure 1, the information processing system S is mainly composed of an information processing device 1 that acquires work mode information that specifies the work mode of work to be performed on elements that make up a "mobile body," generates (hierarchically) business processes, one or more work processes, for work of work mode items that specify the work mode included in this work mode information, and saves and manages "record information (trail information) related to work" for each work process, and a worker terminal 100, a client terminal 200, and a vehicle 300 (mobile body) that are each connected to the information processing device 1 via a network. The worker terminal 100 and the client terminal 200 correspond to an "external server" in relation to the information processing device 1. The vehicle 300 corresponds to a "moving body."

[0013] An example of a "mobile body" is a vehicle, such as a "vehicle (new car, used car (including damaged or broken down vehicles)) that requires repair, replacement or installation of parts." A "mobile body" is completed by assembling one or more elements that make up the mobile body (mobile body components), such as multiple parts (groups of parts), electronic devices (including sensors), drive units (including actuators and motors), etc. It should be noted that the "mobile body" is not limited to a vehicle, but may be a vehicle other than a vehicle (one that carries a person) or a vehicle that carries a non-human object. Other examples of a mobile body include a motorcycle, a bicycle, a ship, an airplane, a robot, a small flying object (drone), and a small mobility vehicle. "Parts (mobile body parts)" are elements that make up a mobile body, such as parts and electronic devices used in vehicles, and are classified by element type. In the case of parts, they are classified by part type. Specifically, there are "first part types (part code, part name, part shape, part image, etc.)" that are classified by the part's location, etc., of the mobile body, and "second part types (genuine parts, used parts, compatible parts, etc.)" that are classified by the part's sales manufacturer, quality, etc.

[0014] "Work on a mobile body" refers to all procedures for vehicle parts used in a vehicle, and mainly corresponds to repair, replacement, installation, and maintenance work (repair work, inspection work) of parts. In addition, "vehicle inspection work" performed at an automobile repair shop, etc., which encompasses repair, replacement, inspection work, etc., also falls under this category. This work may also be called "work related to mobile body parts." In this embodiment, specific examples include bodywork work, painting work, a combination of these, oil change work, and vehicle inspection work, as shown in Figure 6. These are also called "work types." More specifically, the work includes information such as the work content that specifies the work to be performed on the vehicle, the work procedure, the parts and tools used in the work, precautions, a work index, labor costs for the work, and part costs. For example, an "oil change work" is associated with parts such as an oil filter, and a "tire change work" is associated with parts such as tires (wheels), wheel nuts, and wheel screws. By referring to this "work (work information)," the information processing device 1 can identify the work content and work procedures required to repair, replace, or install a vehicle component, and can also calculate the labor costs and part costs required for the work. The information processing device 1 can also create "work status information" that includes specific part information and work information. This work status information may also be created using information obtained from a diagnostic machine (tester).

[0015] "Work-related record information" is information required for each work process corresponding to the work, and records that the work (work process) has been carried out appropriately. More specifically, it is also called "trail information," and is information that proves that the work was carried out objectively, and is information that ensures "post-mortem verifiability." "Post-verification" means that the actual work performed (work type), work procedures, workers, work environment such as work location, and agreements with the work requester can be confirmed after the fact, and the work can be properly verified by the worker (work manager) and the work requester (car owner, insurance company, etc.). Hereinafter, the car owner (vehicle owner) will also be referred to simply as the owner.

[0016] In the following explanation, "mobile body" will be referred to as a vehicle, "parts" will be referred to as vehicle parts, "work related to parts (mobile body)" will be simply referred to as work, part work, etc., and "recorded information related to work" will be simply referred to as recorded information, evidence information, etc.

[0017] <Outline of audit trail management> The information processing device 1 acquires "work mode information" that specifies the work mode of work to be performed on elements that make up a moving body, generates business processes and one or more work processes (hierarchically) for the work of the "work mode items" that specify the work modes included in this work mode information, saves these business processes, work processes, and "work-related record information (evidence information)" for each work process, associates and manages this information, and is a device that enables post-verification to be ensured, and is also called a work management device. Furthermore, the information processing device 1 creates "work instruction information," a business process based on the work items of this work instruction information, and a work process, and stores the business process, the work process, and "work-related record information (trail information)" for each work process. Specifically, the information processing device 1 acquires, from an external server, "work mode information" that specifies the work mode of work to be performed on elements that constitute a moving object. In addition, the information processing device 1 may identify a user who uses an external terminal such as the worker terminal 100 or the requester terminal 200, and receive vehicle information, worker information, requester information, etc. necessary for work on the vehicle to be worked on from the user-identified worker terminal 100 or requester terminal 200 to create ``work status information.''

[0018] The information processing device 1 outputs this "work status information" to the display screens of the worker terminal 100 and the requester terminal 200 (FIGS. 7 and 12A). At this time, the "work status items" included in the work status information are categorized and displayed by vehicle location, part, and work type. Then, the information processing device 1 extracts work status items (trail registration items) that require trail management based on the work type, and generates (hierarchically) a business process and one or more work processes for the work of the work status item. Then, the information processing device 1 associates the work status items, business processes, and work processes, and outputs them to the display screens of the worker terminal 100 (FIGS. 6, 8, and 9). Then, the information processing device 1 accepts "record information (trail information)" from the worker via the worker terminal 100 and saves this record information. Then, the information processing device 1 associates and manages the hierarchically generated business processes and work processes with the record information (trail information), and outputs them to the display screens of the worker terminal 100 and the requester terminal 200 (FIGS. 11, 12A to 12C). At this time, by managing the data in association with a hash value, it is possible to detect and prevent tampering, as will be described in detail later.

[0019] In the above example, the information processing device 1 extracts "work pattern items" related to the work pattern from "work pattern information" that specifies the work pattern of the work to be performed on the elements that make up the moving body, and generates a "business process" and "one or more work processes" for the work of the work pattern specified by the work pattern items.Then, the information processing device 1 may be configured to store the business process, the work process, and "work-related record information (trail information)" for each work process, respectively. Specific examples of this "work mode information" include "quotation information" and "work instruction information," with the quotation information including "quotation items" and the work instruction information including "work instruction information." In other words, it can also be expressed as creating a "business process" and "one or more work processes" based on the quotation information or work instruction information, and saving this business process, work process, and "work-related record information (evidence information)" for each work process.

[0020] This "quote information" is information for external parties such as car owners, insurance companies, and external organizations, and specifies the type of work to be performed on the elements that make up the mobile body, including the number of man-hours, cost, etc. "Work instruction information" is information that indicates the specific work content for the worker who will perform the work, specifies the type of work to be performed on the elements that make up the mobile body, and includes the number of man-hours, cost, etc. This "quote information" and "work information" have different formats due to their different roles, but the content of the information is almost the same. In the following, we will use "quotation information" as an example of "work mode information," but of course, it is not limited to quotation information, and quotation information can be replaced with "work mode information" or "work instruction information." In addition, work status information generally includes a "pre-inspection report (pre-inspection information)" that indicates the details of the pre-inspection of the vehicle, a "receipt (receipt information)" that indicates the details of the check on the vehicle, and a "received receipt (received information)" that indicates the details of the check on the vehicle. Based on each item containing this information, it can also be expressed as generating a "work process" and "one or more work processes" for the work of that item.

[0021] In this way, by appropriately storing and managing recorded information (evidence information) for a series of tasks (work processes) in work on vehicles (work types) and a series of tasks (work processes) within a work, the above-mentioned "post-verification" can be ensured. In particular, the information processing device 1 hierarchically generates a "series of business processes" and a "series of work processes" based on the "quote items" of the quotation information (work estimate), and appropriately manages the necessary record information for each process. This allows appropriate management of the work to be done, and also allows appropriate management of the record information (work results) of the work that has been done as evidence. For example, it makes it possible to reproduce and create quotation information for the same work based on the record information that records a series of work.

[0022] The "quote items" mentioned above are work-related items included in the quotation information (work quotation), and are determined by the work content (work type), vehicle part, vehicle part, etc. Specifically, as shown in Figure 7, "bodywork and painting work" is listed as a work type, the target part is "front bumper," and the target vehicle part is "front bumper cover." Based on the work type, etc., there are "quote items that require trail management" and "quote items that do not require trail management." Estimate items are also called "work items" or "trail registration items," which will be described later. A "work process" is a process that shows the entire work for a task (work type) that a work requester (such as an owner or insurance company) has requested from a worker (such as a worker at a maintenance shop or sheet metal shop). Figure 6 shows a display screen listing information about the work flow related to vehicles, and specific examples include work processes such as "reception," "warehousing," "quotation," and "pre-work check." A "work process" is a detailed work process in a specific business process. Figure 8 shows a display screen that manages the work of estimate items (trail registration items) and the record information for each work process, with specific examples including work processes such as "parts removal," "surface preparation," "masking," and "color matching." "Business processes" and "work processes" have a hierarchical structure, with business processes at the top level and work processes at the bottom level that are contained within the business process. In addition, "business processes" and "work processes" can also be described as having an inclusive structure, where a business process contains one or more work processes. The concept that includes "business processes" and "work processes" can also be called an "estimated process."

[0023] The information processing device 1 has a database (DB) including a vehicle information storage unit 11 that stores "vehicle information" related to vehicles, a parts information storage unit 12 that stores "parts information" related to vehicle parts, a work storage unit 13 that stores "work information" related to work on vehicles and parts, a user information storage unit 14 that stores "user attribute information" such as the worker (request recipient) and the client (vehicle owner, insurance company, requester), and a history storage unit 15 that stores "work history information" such as estimate information related to work (estimate items, trail registration items), trail information, and work change information. The information processing device 1 may be provided with a database (provided database) that manages the above-mentioned "vehicle information," "parts information," "work information," "user attribute information," etc., or may acquire the latest information from an external management server that manages the above-mentioned "vehicle information," "parts information," "work information," etc. at any time and temporarily store it.

[0024] "Vehicle information" is identification information (specific information) related to a vehicle, and includes, for example, vehicle inspection certificate information for each moving object (vehicle), vehicle registration number, VIN code, model name, vehicle name, vehicle shape, vehicle dimensions, vehicle category, model, year, grade, engine displacement, fuel, etc. "Vehicle information" also includes vehicle images for each vehicle, general maintenance information, parts information, and maintenance cost information. By referring to this "vehicle information," the information processing device 1 can identify the type of vehicle. It can also determine the damaged portion (damaged part) of the vehicle and identify the damaged portion.

[0025] "Parts information" is identification information (specific information) related to vehicle parts, and includes, for example, information on the part group for each vehicle, as well as identification information for each part such as the part code, part name, part shape, part dimensions, part year, part grade, and part image. By referring to this "parts information," the information processing device 1 can identify the parts that make up the vehicle. It can also determine damaged parts of the vehicle and identify the damaged parts.

[0026] "Work information" is information relating to the repair, replacement, etc. of a vehicle (vehicle parts), and includes, for example, information necessary for the repair, replacement, etc. of each part. Information necessary for the repair, replacement, etc. of parts is, for example, information on the work content (work procedure) of repair work, replacement work, inspection work, etc., work index, work labor cost, and part cost. By referring to this "work information," the information processing device 1 can identify the type of work (work content) required to repair or replace damaged parts of the vehicle, and can also calculate the labor costs and parts costs required for the work.

[0027] "Work history information" is information about the history of past repair, replacement, or installation work on the vehicle or vehicle part that is the subject of the work, and is stored in association with, for example, the vehicle, vehicle part, work content (work process, work type, work process), and evidence information. Specifically, "work history information" includes information such as the worker, work date and time, work environment (work location, etc.), work content, work procedure, parts used in the work, the order in which the parts were attached, tools used in the work, work man-hours, work costs, part costs, other notes regarding the work (how to apply force, work order, etc.), work ingenuity information, etc. Also included in "work history information" are part identification information for parts used in the work before the work and part identification information for parts used in the work after the work. In addition, if a worker has added, deleted, or updated a task or task process of an estimate item in the past, the change information for that task (task process) is also included in the "task history information." By referring to this "work history information," the information processing device 1 can read and output estimate information, trail information, work change information, and the like that have been carried out in the past.

[0028] The worker terminal 100 is an information terminal used by a worker performing work, and specifically is a computer such as a tablet terminal equipped with an imaging device 101, an ECU diagnostic device 102, and a receiver 103. Of course, a computer other than a tablet may also be used. The worker terminal 100 is connected to the information processing device 1 and receives software services from the information processing device 1. The worker terminal 100 is also connected to the client terminal 200 and can receive, for example, structural information (damage images) of a damaged vehicle from the client terminal 200. "Worker" refers to a business (repairer) that repairs, replaces, installs, etc. a vehicle. In other words, it is a business (acceptor, client) that undertakes after-sales service for a vehicle (damaged vehicle) and interacts with the vehicle owner.

[0029] For example, the worker terminal 100 communicates with the information processing device 1 and accepts, on a predetermined work management screen, "vehicle information to be worked on," "owner information," "requester information," and "vehicle images and vehicle damage images" operated by the worker. Specifically, on the display screens shown in FIGS. 4A and 4B (input screens when receiving a vehicle), the worker accepts "vehicle information to be worked on, owner information, and requester information" operated by the worker, and "vehicle images" captured from multiple directions by the imaging device 101. Furthermore, on the display screen shown in FIG. 5 (input screen when receiving a vehicle), the worker accepts "vehicle damage locations (damage images)" captured by the imaging device 101. Then, this information is output to the information processing device 1. The worker terminal 100 displays a "display screen for list information of work flows for vehicles" shown in Fig. 6, which is output based on this information from the information processing device 1. The worker terminal 100 also displays a "display screen for estimate information for repair and replacement work" shown in Fig. 7, which is output based on this information from the information processing device 1. The worker terminal 100 also transitions from the display screens shown in Figures 6 and 7 to display the "trail information management screen" shown in Figures 8 and 9. The worker terminal 100 then accepts the registration of work trail information by the worker through the "trail information registration screen" shown in Figure 10, which is transitioned from the display screen. Additionally, the worker terminal 100 displays the "work management screen" shown in Figure 11.

[0030] That is, the worker terminal 100 receives detailed information such as vehicle information, parts information, and vehicle work information from the information processing device 1, and displays "quotation information" for work on the vehicle to be worked on, "information on business processes and work processes" for work on the quotation items, and "evidence information" for each work process.

[0031] The information processing device 1 is not limited to acquiring "information on the vehicle to be worked on, etc." through the worker terminal 100, but may also directly accept input or selection of "vehicle information, etc." by the user of the information processing device 1 and manage work on the vehicle based on the vehicle information, etc. In this case, it is preferable to display a management screen for estimate information and trail information for work on the vehicle on the screen of the information processing device 1.

[0032] The client terminal 200 is an information terminal used by a work requester, and specifically, is a computer such as a tablet terminal or a smartphone equipped with an imaging device. The client terminal 200 is connected to the information processing device 1 and the worker terminal 100, and receives software services from the information processing device 1. The "work requester" is the party that requests the work from the worker, such as the vehicle owner or a related party (such as an insurance company or dealer). In other words, the party that receives after-sales service for the vehicle (damaged vehicle) and interacts with the work company.

[0033] For example, the client terminal 200 communicates with the information processing device 1 and displays a display screen showing the main work processes, work steps, and work progress of the work on the vehicle that is the target of the work. Specifically, the client terminal 200 displays a "work status management screen" shown in FIG. 12A, a "timeline management screen" shown in FIG. 12B, and a "work record information management screen" shown in FIG. 12C. Furthermore, the client terminal 200 (the insurance company's terminal) transmits to the information processing device 1 the "validity judgment results" for the work for each quotation item in the quotation information output from the information processing device 1. Specific validity judgment results include approved quotation items, rejected quotation items, and reasons for approval or rejection. These "validity judgment results" are stored as work history information and are reflected in new quotation information when that information is created.

[0034] The above-mentioned information processing system S can appropriately present management information (management status) regarding work on a vehicle (damaged vehicle) to the worker terminal 100 (vehicle repair company, request recipient) and the client terminal 200 (vehicle owner, insurance company, requester). Specifically, this system can ensure that vehicle repairs are performed appropriately by vehicle repair shops, and can standardize repair work processes and procedures among repair shops and repairers. It also allows repair clients to properly understand the repair details involved and determine the appropriateness of costs. Furthermore, it allows for timely verification of repair details after the repair work is completed.

[0035] <Identity Management Overview> In addition to the above-mentioned "evidence management," the information processing device 1 acquires the identification information stored in the vehicle and the vehicle's location information, determines whether the "identification information before and after work" matches, and also determines whether the "location information after work" is within a distance range determined by the vehicle's physical dimensions from the reference position, using the vehicle's "location information before work" as the reference position (performs "identity management"). In other words, as part of vehicle "identity management," the information processing device 1 acquires "identification information (such as vehicle identification number and ECU serial number)" that can uniquely identify the target vehicle, and also acquires "vehicle location information based on GNSS information" via artificial satellites, and by combining this "identification information and location information," it identifies and guarantees with high accuracy that the vehicle is the same before and after the work. Specifically, the information processing device 1 stores the "identification information of the ECU (electronic control unit)" installed in the vehicle, "vehicle position information based on GNSS information," and "time information indicating the time when the identification information and position information were acquired" in association with each other as a single data set (storing them as a data set with metadata).Then, it compares "the identification information, position information, and time information" before, during, and after the work to determine that the vehicle is the same. This prevents fraudulent activities at the work site (repair site) (for example, swapping a vehicle that is to be worked on with a vehicle that is not to be worked on) and allows for appropriate management of vehicles.

[0036] More specifically, the information processing device 1 continuously and in real time acquires "ECU identification information (such as an ECU serial number)," which is electronic information unique to the vehicle, as a "first verification means" using identification information stored in the vehicle. Then, it verifies that the acquired "ECU identification information" is consistent across all work records (work record data including a series of vehicle images) before, during, and after the work (also referred to as "electronic verification"). Since the ECU is physically built into the vehicle, matching the above identification information provides strong proof that the vehicle is the same before and after the work, ensuring the identity of the vehicle and preventing fraudulent vehicle substitution.

[0037] In addition, as a "second proof means" using the vehicle's position information, the information processing device 1 verifies that the "position information during work" and "position information after work" are within a distance range determined by the vehicle's physical dimensions from the reference position, using the vehicle's "position information before work" as the reference position (also referred to as "physical proof"). By constantly acquiring vehicle location information, it is possible to prove that all work records (work record data including vehicle images) before, during, and after work on the vehicle have been recorded (photographed) to the physically possible extent (within the vehicle's external dimensions). In other words, it is possible to prevent fraudulent acts using similar vehicles in different locations (including different locations within the same factory).

[0038] Furthermore, the information processing device 1 verifies that the work process was carried out in a natural temporal progression (also referred to as "temporal proof") by checking the consistency between consecutive timestamps (a group of time information indicating the time when the vehicle's identification information was acquired) and the vehicle's location information as a "third verification means" using the vehicle's location information. That is, the verification process of this temporal progression is carried out by comparing the time information associated with all work records (work record data including vehicle images) before, during, and after the vehicle work. For example, by combining (reinforcing) the above-mentioned "electronic proof (first proof)" with the above-mentioned "physical proof (second proof)," it is possible to prove with higher reliability that the vehicle before and after the work is the same. Furthermore, by combining (reinforcing) the above-mentioned "electronic proof (first proof)" with the above-mentioned "physical proof (second proof)" and "temporal proof (third proof)," it is possible to prove with even higher reliability that the vehicle before and after the work is the same.

[0039] Using these certification means, the information processing device 1 ensures the identity of the vehicle based on the consistency of the "vehicle (ECU) identification information" contained in all work record data (work record data including vehicle images) before, during, and after work on the vehicle. Furthermore, the information processing device 1 stores this "work record data" using blockchain, a distributed ledger technology, to prevent data tampering after the work is completed. Specifically, it generates "transaction data" that includes a hash value of this "work record data" and the first and last time information contained in the data, and stores this transaction data in the "distributed ledger." Details will be described later.

[0040] The information processing device 1 manages the identity of "vehicles" that are the target of work, but is not limited to "vehicles (automobiles)", and may manage the identity of "vehicles other than vehicles (things that carry people)" such as motorcycles, bicycles, buses, trains, ships, and airplanes, or may manage the identity of "things that carry things other than people" such as robots, small aircraft (drones), and small mobility vehicles. Alternatively, the identity of "electronic devices" other than moving objects may be managed.

[0041] <Hardware configuration of information processing system> 1, the information processing device 1 is a computer including a CPU as a data arithmetic and control processing device (processor), a ROM, a RAM, and an HDD (SSD) as storage devices (storage unit, memory), and a communication IF for transmitting and receiving information data via the Internet. The information processing performed in the information processing device 1 is specifically performed by the processor. In addition to a main program that performs the functions necessary for a computer, the storage device of the information processing device 1 also stores an information processing program (work management program), and the functions of the information processing device 1 are realized by executing these programs by the CPU. In this embodiment, the information processing device 1 is configured to include a memory unit 10, a vehicle information memory unit 11, a parts information memory unit 12, a work memory unit 13, a user information memory unit 14, a history memory unit 15, and a distributed ledger memory unit 30, but this is merely an example, and these memory units 10 to 15 and 30 may also be realized in an external storage device provided outside the information processing device 1. In this case, it is preferable that the information processing device 1 and the external storage device are connected via a communication path.

[0042] As shown in FIG. 1, the worker terminal 100 is a computer having the same hardware configuration as the information processing device 1, and is equipped with an imaging device 101, an ECU diagnostic device 102, and a receiver 103. The worker terminal 100 stores a work management program for registering and outputting work flows (each work process) for vehicle-related work, work flows (each work process), and trail information. The worker terminal 100 also has installed therein diagnostic software for communicating with the on-board ECU 330 (electronic control unit), and positioning software for calculating position information based on GNSS information obtained from the artificial satellite SA and the reference station ST.

[0043] The imaging device 101 is an imaging camera that captures external images of the vehicle 300 that is the target of work, and for example, captures images of the vehicle's state before work begins and also captures images of the vehicle's state after each work process, thereby generating "vehicle image data (vehicle images)." These vehicle images are recorded as record information (evidence information) related to the work. Furthermore, the imaging device 101 can receive an operation from an operator and read the stored information in a two-dimensional code written on the vehicle inspection certificate of the vehicle to obtain "vehicle information."

[0044] The imaging device 101 may be a digital imaging camera having a function of embedding real-time metadata (such as imaging date and time, location information at the time of imaging, etc.) in the captured "vehicle image data (vehicle image)."

[0045] The ECU diagnostic device 102 is a device that communicates with an on-board ECU 330 mounted on a vehicle 300 that is the target of work, and acquires "vehicle information (such as vehicle identification information)," and is also called an ECU gateway. Specifically, the ECU diagnostic device 102 communicates with the on-board ECU 330 by connecting to a diagnostic port mounted on the vehicle 300 via an OBD-II interface (communication connector), reads out the "vehicle identification information (body number, vehicle identification number, chassis number, ECU serial number, etc.)" stored in the memory area of ​​the on-board ECU 330, and acquires this identification information.

[0046] The receiver 103 is a GNSS receiver that receives GNSS radio waves (GPS radio waves) from multiple artificial satellites SA or reference stations ST, and is also called an RTK-GNSS receiver. The receiver 103 receives GNSS radio waves from multiple satellites SA and generates "GNSS information" necessary for point positioning. Alternatively, it receives "GNSS correction information" necessary for relative positioning from an external reference station ST. The reference station ST is a fixed reference station set at a known point, receives GNSS radio waves from multiple artificial satellites SA, generates “GNSS correction information”, and transmits it to the receiver 103 . "GNSS information" is distance information between multiple artificial satellites SA and the receiver 103. "GNSS correction information" is distance information in which measurement errors in the "GNSS information" are corrected by a reference station ST located at a known point receiving GNSS radio waves and communicating with the receiver 103. The receiver 103 performs positioning using RTK (Real Time Kinematic) technology and is also compatible with multi-GNSS (Global Navigation Satellite Systems) such as GPS, GLONASS, Galileo, and BeiDou.

[0047] By using the receiver 103, the worker terminal 100 can calculate the vehicle position information at the timing when the image of the vehicle 300 is captured by the imaging device 101, for example, and identify the current position information of the vehicle. More specifically, metadata information such as "vehicle identification information (including ECU information (serial number))" obtained by the ECU diagnostic device 102 at the time of imaging and "GNSS location information" obtained by the receiver 103 can be embedded into "vehicle image data (vehicle image)" captured by the imaging device 101 using steganography. The worker terminal 100 outputs the “vehicle image data” in which the metadata information is embedded to the information processing device 1.

[0048] As shown in FIG. 1, the client terminal 200 is a computer having the same hardware configuration as the information processing device 1, and is equipped with at least an imaging device that captures an image of the outside of the vehicle 300. The client terminal 200 stores a work management program for displaying the main work processes of the vehicle-related work, the progress of the work, and the like.

[0049] <<Vehicles>> 1 and 2, vehicle 300 is a mobile body equipped with a vehicle control device 301, an on-board sensor 310, an on-board locator 320, and an on-board ECU 330, and is a mobile body capable of "autonomous driving" that plans a driving route on behalf of a driver and controls driving based on the driving route. Note that vehicle 300 may also be a mobile body that does not perform autonomous driving.

[0050] The vehicle control device 301 is a computer connected to an on-board sensor 310, an on-board locator 320, and an on-board ECU 330 via an on-board network. For example, in order to perform "autonomous driving," the vehicle control device 301 controls the vehicle's driving by controlling the on-board ECU 330 based on external environment information obtained from the on-board sensor 310, current location information obtained from the on-board locator 320, and vehicle information obtained from the on-board ECU 330.

[0051] The on-board sensor 310 detects the external environment around the vehicle 300, and specifically includes a plurality of imaging devices 311, a plurality of radars 312, and a plurality of lidars 313. The imaging device 311 is a wide-angle camera mounted in a vehicle and captures external video images of the vehicle's surroundings, creates external video data, and transmits the external video data to the vehicle control device 301. The imaging device 311 may also have a function to embed real-time metadata (such as the date and time of video capture, location information at the time of video capture, and vehicle identification information) in the captured "external video data." The radar 312 is a millimeter-wave radar mounted in a vehicle, which transmits radio waves while continuously changing the irradiation direction, detects target objects by receiving reflected waves from the target objects, and performs three-dimensional spatial imaging. The radar 312 acquires detection result data of the target objects and transmits the detection result data to the vehicle control device 301. The LIDAR 313 is a remote sensor mounted on a vehicle, which measures the distance to a target object by emitting laser light and receiving reflected light from the target object, thereby performing three-dimensional spatial imaging. The LIDAR 313 acquires distance measurement data that measures the distance to the target object, and transmits the distance measurement data to the vehicle control device 301.

[0052] The vehicle-mounted locator 320 measures the current position of the vehicle by using a satellite positioning system that uses artificial satellites SA and reference stations ST, and also measures the acceleration and angular velocity of the vehicle. The vehicle-mounted locator 320 includes a GNSS receiver 321 that receives GNSS radio waves from a plurality of artificial satellites SA (reference stations ST), and an inertial measurement unit 322 that measures the acceleration and angular velocity of the vehicle. The GNSS receiver 321 is an RTK-GNSS receiver that receives GNSS radio waves from multiple satellites SA and generates "GNSS information" necessary for point positioning. It also receives "GNSS correction information" necessary for relative positioning from an external reference station ST. The inertial measurement unit 322, also called an IMU, measures the three-dimensional angular velocity and acceleration of the vehicle, and transmits information on the acceleration and angular velocity of the vehicle to the vehicle control device 301. The vehicle control device 301 measures the current position of the vehicle by combining the GNSS information (GNSS correction information) received from the GNSS receiver 321 with the angular velocity and acceleration information of the vehicle received from the inertial measurement unit 322.

[0053] The in-vehicle ECU 330 is an electronic control unit connected to the vehicle control device 301 . The in-vehicle ECU 330 has a hierarchical structure comprising an upper-level control ECU 331 that transmits and receives various data, and lower-level function ECUs 340 that are connected to the control ECU 331 and perform detailed control of the vehicle's steering, acceleration, deceleration, etc.

[0054] The control ECU 331 is an ECU that controls the overall operation of the vehicle 300 and collects various pieces of information, and is also called a central ECU or an integrated ECU. The storage area of ​​the supervisory ECU 331 stores identification information of the vehicle 300 as "first vehicle-specific information (supervisory ECU-specific information)." Specifically, information such as the vehicle body number, vehicle identification number, chassis number, and ECU serial number is stored. An "ECU serial number" is a unique identification number assigned to each ECU at the time of manufacture, and is generally fixed to that vehicle and is different from that of other vehicles. Therefore, the serial number can be used to track the vehicle's maintenance history, parts replacement history, software update history, etc. Note that multiple ECUs may be manufactured with the same specifications for the same vehicle model, so by combining the serial numbers of the master ECU and function ECUs actually installed in the vehicle, the vehicle can be uniquely identified as "vehicle-specific information."

[0055] The functional ECU 340 is an ECU that is responsible for engine control, brake control, body control, airbag control, and the like. Specifically, the function ECU 340 is mainly composed of a powertrain system ECU 341 , a chassis system ECU 342 , a body system ECU 343 , a security system ECU 344 , and a network system ECU 345 .

[0056] The powertrain ECU 341 is an ECU that controls functions related to the power transmission of the vehicle, such as the engine, transmission, etc. Specifically, it includes an engine ECU that is responsible for engine control, a transmission ECU, a hybrid ECU, and the like. The chassis system ECU 342 is an ECU that controls functions related to the running stability and operability of the vehicle, specifically, a brake ECU that controls the brakes, a steering ECU, a suspension ECU, and the like. The body ECU 343 is an ECU that controls body functions related to comfort and convenience inside the vehicle, such as an infotainment ECU, door ECU, light ECU, and air conditioning ECU. The security ECU 344 is an ECU that controls functions related to safety and security, such as an airbag ECU that controls airbags, a security ECU, and an ADAS ECU. The network ECU 345 is an ECU that controls communications inside and outside the vehicle, and specifically includes a gateway ECU, a telematics ECU, and the like.

[0057] The storage area of ​​the function ECU 340 stores identification information of the vehicle 300 as "second vehicle-specific information (function ECU-specific information)." Specifically, information such as an ECU serial number is stored. By combining the serial numbers of the master ECU 331 and the function ECUs 340 mounted on the vehicle, or by combining the serial numbers of a plurality of function ECUs 340, the vehicle can be uniquely identified as "vehicle-specific information."

[0058] <Functions of the information processing system> As shown in FIG. 3A, from a functional perspective, the information processing device 1 comprises, as components, a memory unit 10 that stores various programs and various data such as "quotation item classification information" and "work correspondence information," a vehicle information memory unit 11, a parts information memory unit 12, a work memory unit 13, a user information memory unit 14, and a history memory unit 15 that stores "work history information" such as "quotation information," "evidence information," and "work change information" related to the work. Furthermore, the information processing device 1 has, as its main components, a function for managing work on vehicles (trail management function), a communication unit 16, a work reception unit 17, a work type setting unit 18, a business flow creation unit 19, a display generation unit 20, a management unit 21, a storage unit 22, an estimate acquisition unit 23 (estimate creation unit), an extraction unit 24, a process creation unit 25, an operation reception unit 26, and a second learning unit 27. The communication unit 16 transmits and receives various data to and from external terminals (external servers) such as the worker terminal 100 and the client terminal 200. As shown in FIG. 3B, the information processing device 1 has the following main components as functions for managing work on vehicles (identity management): a memory unit 10 that stores a "dataset that associates identification information, location information, time information, and image data," a distributed ledger memory unit 30 that stores "transaction data that ensures vehicle identity management," an image acquisition unit 31, an identification information acquisition unit 32, a type code generation unit 33, an ECU identifier acquisition unit 34, an authentication unit 35, a location information acquisition unit 36, a time information acquisition unit 37, a metadata generation unit 38, a metadata embedding unit 39, a dataset update unit 40, a judgment unit 41, a time difference calculation unit 42, a warning output unit 43, a work record data generation unit 44, and a hash value calculation unit 45. These are composed of a CPU (processor), ROM, RAM, HDD (memory), a communication interface, various programs, etc.

[0059] In addition, the information processing device 1 further includes, as components, a learning data processing unit 25c (learning processing unit) and a first learning unit 25d (prediction processing unit) that work in cooperation with the process generation unit 25 shown in Figure 3A to optimize work processes using machine learning. The learning data processing unit 25c generates learning data from past history information accumulated in the history storage unit 15 and trains a machine learning model. The first learning unit 25d predicts an optimal work process for new estimate information using the trained model generated and trained by the learning data processing unit 25c.

[0060] The specific flow of the machine learning process by the learning data processing unit 25c and the first learning unit 25d is as follows. The learning data processing unit 25c reads past work history data from the history storage unit 15 and converts this data into a format suitable for learning. Specifically, for each work case, the "work type," "years of experience of the worker," and "time of work execution" are extracted as numerical data, and these are designated as "input data." In addition, the work processes actually performed are associated with the data as "output data." The first learning unit 25d learns patterns from the combination of this "input data" and "output data." A decision tree-based method is used for learning, and by integrating the results of multiple decision trees, more accurate predictions can be achieved.

[0061] Furthermore, the information processing device 1 includes an abnormality detection learning unit 41e and an abnormality degree calculation unit 41f as components that extend the function of the determination unit 41 shown in FIG. 3B. The anomaly detection learning unit 41e trains an "anomaly detection learned model" using normal work patterns as learning data. The anomaly degree calculation unit 41f calculates an "anomaly degree score" from data acquired in real time during work.

[0062] Regarding the worker terminal 100 and the client terminal 200 from a functional standpoint, the main components are memory units 110, 210 that store various programs and various data, communication units 111, 211 that send and receive various data to and from the information processing device 1, display units 112, 212 that display information related to work management provided by the information processing device 1 on a screen, and processing execution units 113, 213 that accept user input and execute processing.

[0063] The functions of the information processing device 1 will be described in detail below. First, the "various types of information (data)" stored in the storage unit 10 will be described. In this embodiment, the information processing device 1 is configured to include memory units 10 to 15, 30, but this is merely an example, and these memory units 10 to 15, 30 may also be realized in an external storage device provided outside the information processing device 1.

[0064] <Various information (data)> "Estimate item classification information" is information that classifies "estimate items (work on estimate items)", which are an example of work items included in estimate information, which is an example of work information, into estimate items that require trail management and estimate items that do not require trail management, and is stored in a centralized manner in memory unit 10. Specifically, "quote items" are classified into "vehicle parts," "parts," and "work (work type)" based on the type of detail. In the "quote item classification information," quote items are classified according to the type of detail (vehicle parts, parts, and work) into quote items that require trail management (first quote items) and quote items that do not require trail management (second quote items). By referring to this "quote item classification information," the information processing device 1 (extraction unit 24) can extract quotation items that require trail management based on the detail type (work type) of the quotation item. Specifically, it can be seen that, of the quotation items shown in Figure 7, the quotation item "Front bumper replacement" shown in Figure 8 and "Headlamp replacement" shown in Figure 9 have been extracted as quotation items requiring evidence management.

[0065] "Work correspondence information" is information that indicates the correspondence (hierarchical correspondence) between "quotation items (trail registration items)" included in the quotation information and "business processes and work processes included in the business processes," and is centrally managed and stored in memory unit 10. The "related parts information" is updated as needed in accordance with updates to the "vehicle information," "parts information," "work information," and "work history information" stored in the storage units 11 to 15. The same applies to the "quote item classification information." By referring to this "work correspondence information," the information processing device 1 (process generation unit 25) can hierarchically generate "work processes" and "one or more work processes" included in the work processes for the work of the estimate items, and manage the estimate items, work processes, and work processes in a manner that allows them to be associated and output. Specifically, by referring to the "Corresponding Parts Information," it can be seen that for the quotation item "Painting and Painting" shown in Figure 7, the business flow and each business process for "Painting and Painting" shown in Figure 7 are generated, and the business flow and each business process for "Front Bumper Replacement" in "Painting and Painting" shown in Figure 9 are generated.

[0066] Next, the "trail management" performed by information processing device 1 will be explained in detail, and then the "identity management" will be explained in detail.

[0067] <Trail Management> <<1. Acceptance of work requests>> The work reception unit 17 receives information on a request for work on a vehicle (damaged vehicle) from a worker via the worker terminal 100, and performs reception processing for the "work request information." The "work request information" for a vehicle includes "vehicle information" (vehicle ID, vehicle registration number, chassis number, etc.) that is the target of work, "vehicle owner information" (owner ID, owner name, etc.), and "requester information" (requester ID, insurance company name, contract details, etc.). If past work history information (history information such as maintenance history) is linked to the vehicle ID that is the target of work in addition to the vehicle information, the work reception unit 17 also reads and receives this work history information. Specifically, the information processing device 1 receives "work request information" from the worker through the display screen (request reception screen) of the worker terminal 100, and performs a work request reception process. The work request information is stored in the history storage unit 15 or the like. The work receiving unit 17 may receive work request information from the client terminal 200 of the client. A specific description will be given below with reference to FIGS. 4A, 4B and 5.

[0068] 4A and 4B are diagrams showing the display screen of the "first reception process" performed when receiving a vehicle. 4A and 4B, the work reception unit 17 receives "vehicle information on the vehicle to be worked on, owner information, and requester information" operated by the worker. Also, on the display screen, the work reception unit 17 receives "vehicle images" captured from multiple directions by the imaging device 101 (these are referred to as a first reception process). As shown in Figure 4A, information such as the vehicle ID, vehicle registration number, manufacturer / model, chassis number, classification model, and production year is registered as "vehicle information." Information such as the owner ID (customer ID), customer name, and contact information is registered as "owner information," and information such as the requester ID, insurance company name, contract details, and policy number is registered as "requester information." As shown in FIG. 4B, images showing the exterior of the vehicle captured from multiple directions (eight directions) and images showing the interior of the vehicle are registered as "vehicle images."

[0069] When capturing the vehicle image shown in FIG. 4B, when the target vehicle is placed at a reception position (front, maintenance stand, aisle, etc.), one or more image capturing devices 101 capture images of the side (top, bottom, front, back, left, right, diagonal) of the target vehicle. For example, the vehicle is captured from eight directions (45 degrees front left, front, 45 degrees front right, right side, 45 degrees rear right, back, 45 degrees rear left, left side). The work receiving unit 17 cuts out and saves the captured vehicle image. The vehicle image may be a still image or a moving image. The vehicle may also be captured from ten directions.

[0070] FIG. 5 is a diagram showing a display screen for the "second reception process" performed when receiving a vehicle. The work acceptance unit 17 (image processing unit 17a) extracts the "vehicle damaged portion (damage image)" based on the "vehicle image" captured by the imaging device 101 through the worker's operation on the display screen shown in Fig. 5. Then, the image of the repair portion is cut out and saved. The process of extracting damaged areas at this time is used to create estimate information. Specifically, image processing unit 17a refers to the "vehicle information" and "parts information" stored in storage units 11 and 12, compares (performs image analysis) an image (for example, a side image) of the target vehicle that has been captured with an image (for example, a side image) of the vehicle model that has been pre-stored, and identifies and extracts areas where deformation (unevenness, damage, etc.) exists. It is also possible for an operator (such as a repair shop worker) to manually identify and capture images of areas with deformations (dents, damage, etc.) and store them.These automatic extraction processes and manual extraction tasks may be combined. Additionally, in the "second reception process," the work reception unit 17 records various information related to the internal state and operation of the vehicle through the OBD (on-board diagnostic device) and ECU (electronic control unit) installed in the vehicle.

[0071] According to FIG. 5, the "second reception process" reveals that the damaged parts of the vehicle are the "front bumper," "head lamp," and "front fender." The first and second reception processes are performed in the "reception process (advance reception process)" or "warehousing reception process" in the business flow of work on damaged vehicles.

[0072] In the above, the work reception unit 17 handles the vehicle images and vehicle videos received in the "first reception process" and the "second reception process" as a "group of data," thereby ensuring the reliability of data registration in the system and ensuring the identity of the target vehicle. In other words, it can be proven that the target vehicle that underwent the first reception process and the second reception process is the same vehicle. One method for appropriately managing a group of data is to calculate a hash value for the data group and manage the data group in association with each other. The reception process performed in the "reception step" or "warehousing reception step" allows the vehicle state (including external and internal vehicle information) before work begins to be accurately recorded in the information processing device 1.

[0073] <<2. Creating a business flow and managing each business process>> The work type setting unit 18 sets the "work type" of work to be done on the vehicle based on the "work request information" received by the work reception unit 17 (first reception process, second reception process). Specifically, it references the "work information" stored in the work memory unit 13 and sets the work type corresponding to the "vehicle damage location (damage image)." Note that the worker may also set the work type manually. For example, in the case of the damaged portion of the vehicle shown in FIG. 6, the work type setting unit 18 sets "sheet metal repair and painting" as the work type corresponding to the damaged portion.

[0074] The business flow creation unit 19 accepts the setting of the "work type" for work on a vehicle, and refers to the "work information" stored in the work memory unit 13 to read and create a "business flow" consisting of multiple business processes corresponding to the work type. The created work flow is managed in association with a work ID. The work ID is associated with the work flow, work type, vehicle ID, owner ID, requester ID, work history information, etc., and is saved. Examples of work types include "maintenance," "maintenance and sheet metal work," "maintenance, sheet metal work and painting," "sheet metal work," "sheet metal work and painting," and "painting." The work processes for these work types include at least "estimation processes, actual work processes (maintenance processes, sheet metal work processes, painting processes, etc.)," ​​and "inspection processes." In other words, a series of work (workflow) is made up of the necessary work processes according to the work type.

[0075] The display generation unit 20 generates a display screen showing the “workflow list information” for each vehicle created by the workflow creation unit 19, as shown in FIG. This display screen, also known as a work process management screen, displays a list of work flows (work processes) according to the type of work for each vehicle, and is a screen for managing the progress of work for each vehicle. For example, it is a screen for work managers (workers) at work shops, maintenance shops, or body repair shops to understand the progress. Below, based on an example of the work type "sheet metal work and painting," the business flow (business process) of "sheet metal work and painting" will be explained with reference to Figure 6.

[0076] As shown in Figure 6, (a) the business flow for the work type "body repair / painting," (b) the business flow for the work type "oil change," and (c) the business flow for the work type "vehicle inspection" are each displayed on the business flow management screen. The work (work flow) for the work type "sheet metal work and painting" consists of the following work processes: "Reception (reception process)", "warehousing", "quotation", "pre-construction confirmation", "instruction sheet", "parts ordering", "sheet metal work", "painting", "assembly", "completion inspection", "record book", "pre-delivery confirmation", "delivery note", and "delivery". The business processes corresponding to "Before warehousing" are Reception and Warehousing. The business processes corresponding to "In Work" are Estimate, Pre-Confirmation before Construction, Instructions, Parts Ordering, Sheet Metal Work, Painting, and Assembly. The business processes corresponding to "Work Completion" are Final Inspection, Record Book, Pre-Delivery Confirmation, and Delivery Note. Finally, the business process corresponding to "Delivered" is Delivery. The above "1. Receiving a work request" corresponds to the work of the business process that is carried out in the "Receiving Task" and "Warehousing Task" in the "Before warehousing" state.

[0077] The management unit 21 (storage unit 22) manages information (work images, work information, etc.) input by workers through the worker terminal 100 (image management), report management, time management, display management, etc. for each work process for each vehicle, and performs work management related to the process transition of work. Specifically, as part of the management of information input by workers (image management), the storage unit 22 stores exterior images of the damaged vehicle from eight directions and images of necessary areas during the "reception process" or "warehousing process," and also stores images of damaged areas of the target vehicle by part. Furthermore, the storage unit 22 stores images of the damaged vehicle during work by part during each work process during the "bodywork process" and "painting process." Furthermore, the storage unit 22 stores exterior images of the vehicle from eight directions after work has been completed and images of necessary areas during the "completion inspection process."

[0078] The management unit 21 displays and manages the work content required for each business process and the tools used for the work, and when the required input information is "all input" or "input through cooperation with other systems," it registers the time information, completes the current business process, and transitions to the next business process. The storage unit 22 stores information such as the worker, task completion time, and task location for each task as it transitions through each task. The management unit 21 also manages the overall task flow by managing the manager of the entire task flow that has been created, the overall task time, and so on. The management unit 21 manages the vehicle information, owner information, requester information, vehicle images, damage images, and forms related to the target vehicle stored in the storage unit 22 in association with the work ID on the cloud (database).

[0079] On the "business flow display screen" shown in Fig. 6, the management unit 21 can perform ordering processing for work parts in the business process "parts ordering" based on the work instructions created in the previous business process "instructions." Specifically, when the display generation unit 20 receives a selection operation for the business process "parts ordering" on the display screen shown in Fig. 6, it transitions the screen and generates a parts ordering screen. When the management unit 21 receives an operation to execute a parts order on the parts order screen, it performs processing to order the parts from a parts dealer or a recycling company.

[0080] Furthermore, in the "Business Flow Display Screen" shown in Figure 6, the management unit 21 can perform evidence registration processing (inspection result registration processing) for the vehicle completion inspection in the business process "Completion Inspection", and can also perform processing to create a vehicle maintenance record book in the business process "Record Book". Specifically, when the display generation unit 20 receives a selection operation for the work process "completion inspection" on the display screen shown in Fig. 6, it transitions the screen and generates an evidence registration screen for the completion inspection. Also, when the display generation unit 20 receives a selection operation for the work process "record book", it transitions the screen and generates a maintenance record book creation screen. The management unit 21 accepts input operations for evidence registration processing and maintenance record book creation processing by the worker on the above screen, and stores and manages the evidence information of the completion inspection of the target vehicle and the maintenance record book in association with the work ID.

[0081] <<3. Obtaining work estimate information>> The estimate acquisition unit 23 acquires estimate information (work information) related to work on a vehicle. As described above, this estimate information indicates an example of work mode information, so the "estimate acquisition unit 23" can also be expressed as a "work mode information acquisition unit," and is capable of acquiring work mode information from an external server. In addition, the information processing device may also be equipped with an estimate creation unit, which creates "work estimate information (work estimate)" for the target vehicle based on the "work request information" received by the work reception unit 17 and the "work type" set by the work type setting unit 18, by referring to the "vehicle information," "parts information," and "work information" stored in the memories 11 to 13. Then, the estimate acquisition unit 23 acquires the estimate information created by the estimate creation unit. The estimate acquisition unit 23 acquires estimate information in the "estimate process" of the "business flow for the target vehicle" shown in FIG.

[0082] The "quotation information" acquired by the quotation acquisition unit 23 includes information such as the type of details, work content (work type), work parts, vehicle images before work (damage images), work classification, part units, unit price, index, labor cost, and technical fee, in addition to vehicle information, owner information, and requester information.

[0083] The display generation unit 20 generates a display screen showing the “estimate information” for each vehicle acquired by the estimate acquisition unit 23, as shown in FIG. This display screen is a screen for displaying estimate information for repair, replacement, etc., and is a screen for workers at, for example, a repair shop, a maintenance shop, or a sheet metal shop to understand. Specifically, the display generation unit 20 generates a display screen for the estimate information in a different display format depending on the type of terminal from which communication access originates, such as the worker terminal 100, the client terminal 200 (owner terminal, insurance company terminal), etc. The vehicle owner approves the estimate contents through the estimate display screen displayed on the client terminal 200 (see FIG. 12A) and transmits the approval result to the information processing device 1. The insurance company judges the validity of the work contents through the estimate display screen displayed on the client terminal 200 and transmits the "validity judgment result" to the information processing device 1. The display screen for "repair and replacement work estimate information" will be described below with reference to FIG. 7, using the example of the work type "sheet metal work and painting."

[0084] According to Figure 7, the first estimate item is set with a detail type of "main work" and work content (work type) of "bodywork and painting." Specifically, (a) detail type of "part" and work content of "front bumper," (b) detail type of "part" and work part of "front bumper cover," and (c) detail type of "work" and work content of "front bumper replacement." In addition, for (b) the item type "parts" and the work part "front bumper cover", further information such as the work category "replacement", index (work index), labor cost price, and technical fee is set. The second estimate item is primarily set as "Work" with "Headlamp replacement." The third estimate item is primarily set as "Work" with "Front fender sheet metal repair." Furthermore, images of the vehicle (damage images) before the work is performed are registered for each of these estimate items. When the display generation unit 20 receives a selection operation of the "Image" button for a specific estimate item by the worker, it transitions the screen, generates a list screen of "damage images" corresponding to the work of the estimate item, and outputs it to the client terminal 200.

[0085] <<4. Extraction of quotation items that require trail management>> The extraction unit 24 classifies the estimate items included in the estimate information shown in Figure 7 into work types such as vehicle parts, parts, and work, and extracts "estimate items that require evidence management" based on the work type by referring to the "estimate item classification information." In other words, the extraction unit 24 classifies each quotation item included in the quotation information shown in Figure 7 into "quotation items that require evidence management" and "quotation items that do not require evidence management" by referring to the "quotation item classification information," and extracts the former quotation items. Specifically, it can be seen that of the quotation items shown in Figure 7, the quotation items "Front bumper replacement" shown in Figure 8, "Headlamp replacement" shown in Figure 9, and "Front fender sheet metal repair" (not shown) have been extracted as quotation items requiring evidence management.

[0086] More specifically, the extraction unit 24 (first extraction unit 24a) first extracts "quotation items that require trail management" from among the quotation items included in the quotation information. Then, the second extraction unit 24b performs processing to further extract "trail registration items" for the extracted quotation items. Each estimate item in the estimate information has a detail type set. These detail types include "parts," "components," and "labor" for the vehicle, and explain the details of the estimate item. "Parts" indicate a certain range of repairs to be performed on the vehicle. "Parts" indicate vehicle parts, and "labor" indicates work such as removal, installation, detachment, adjustment, bodywork, and painting. In particular, "work" refers to a series of inseparable tasks that include related tasks. For example, there are three tasks as follows:

[0087] First, the work of "front bumper replacement" is defined as the replacement (removal and installation) of the front bumper and stays (reinforcements). This work also includes the related work of removing and installing some of the accessories necessary for the front bumper replacement. Specifically, the related work includes the work of partially removing and installing the fender liner (splash shield), partially removing and installing the fender arch molding, and partially removing and installing the engine undercover. On the other hand, related work that is not included in the series of work includes the work of removing and installing accessories that remain on the body after removing the front bumper, and the replacement of headlights. Secondly, the work of "headlamp replacement" is defined as the work to be carried out after removing the front bumper and radiator grille, and the work to remove the retractable headlamp including the motor and link, reassemble it according to the parts supply format, and then install it. These operations are a series of tasks. Third, the term "hood (hood hinge) replacement (removal)" is defined as removal and installation of the hood hinge while it remains attached to the body, replacement of the hood hinge while it remains attached, or work performed after removing the hood so that it can be accessed. This work includes related work such as the removal and installation or replacement of air intakes, insulators, washer nozzles, hoses, ornaments, seal rubber, adjustment of the position of moldings, and the removal and installation or replacement of torsion bars. On the other hand, removal and installation of front fenders or cowl top ventilator louvers is a related work but not included in the series of work.

[0088] Based on the above, the first extraction unit 24a performs extraction processing by specifying (pre-specifying) the type of details of the quotation items as processing for extracting "quotation items that require trail management." The first extraction unit 24a may perform a process of extracting "quotation items that require trail management" by specifying all detail types, or may perform a process of extracting "quotation items that require trail management" by accepting manual selection by the worker. When specifying the item type in advance, the first extraction unit 24a specifies the item type including items that require trail management (items that have been specified in advance to pass the inspection). This ensures that all quotation items that require trail management are extracted and selected.

[0089] The second extraction unit 24b performs processing to further extract "trail registration items" for the extracted "quotation items requiring trail management." Specifically, the "trail registration item" is an item that specifies the extracted estimate item in more detail, and although it is displayed as a single (uniform) estimate item in the estimate information, it makes it possible to specify different tasks as work for that estimate item. In other words, the second extraction unit 24b designates the extracted estimate items as items to be incorporated into the work content for the estimate items. For example, for "headlamp replacement" extracted by the first extraction unit 24a as an "estimated item requiring evidence management," the second extraction unit 24b further breaks it down into either "headlamp replacement requiring painting" or "headlamp replacement not requiring painting," and extracts the resulting item as a "trail registration item."

[0090] In addition, the management unit 21 may store and manage trail information based on the ``quotation items requiring trail management'' extracted by the first extraction unit 24a, or may store and manage trail information based on the ``trail registration items'' extracted by the first extraction unit 24a and the second extraction unit 24b.

[0091] <<5. Hierarchical generation of work processes and generation of audit trail management screens>> The process generation unit 25 hierarchically generates a "business process" and "one or more work processes" included in the business process for the work of the estimate items (trail registration items) extracted by the extraction unit 24 based on a predetermined correspondence relationship. Specifically, for repair work that is an "estimate item (trail registration item) that requires trail management," the process generation unit 25 refers to the "work correspondence information" stored in the memory unit 10 and hierarchically generates a "business process" and "one or more work processes" for the repair work.

[0092] More specifically, the process generation unit 25 performs a "first process generation process" by the first process generation unit 25a and a "second process generation process" by the second process generation unit 25b. The first process generation unit 25a reads out the work processes (work processes having work processes such as sheet metal work, painting work, and assembly work) that have been previously specified (corresponding) for the "quotation item (trail registration item)" and identifies the differences from the work processes of the work flow shown in Fig. 6 created by the work flow creation unit 19. Then, it performs processing to add the work processes that are the differences as work processes of the work flow. Specifically, suppose that the initial workflow for the vehicle "Tokyo ***AA Wagon" and the work type "sheet metal work and painting" had two settings: "sheet metal work process" and "painting work process." In this case, the first process generation unit 25a reads the work process specified for the "trail registration item" and identifies the "assembly process" as a difference from the existing workflow (work process). Then, it generates a new workflow in which the "assembly process" is added as a work process (work process) following the "sheet metal work process" and "painting process." The business flow (business process) of the vehicle "Tokyo***AA Wagon" and the work type "sheet metal work and painting" shown in Fig. 6 shows a business flow (business process) in a state where an "assembly process" has already been added by the process generation unit 25. By adding the "assembly process" as a business process, one or more work processes included in the "assembly process" are also added to the business flow.

[0093] The second process generation unit 25b identifies work processes for the "trail registration items" in the business processes of sheet metal work, painting, and assembly, and generates a "work process flow" by arranging each identified work process in order of priority. As shown in FIGS. 8 and 9, the display generation unit 20 generates a management screen for the trail information including the "work process flow" generated by the process generation units 25a and 25b. More specifically, the display generation unit 20 outputs the estimate items, business processes, and work processes related to the work type "sheet metal work and painting" to the display screen of the worker terminal 100 in association with each other, as shown in FIGS.

[0094] For example, when the display generation unit 20 receives a worker's selection of the "Estimation Process" for the vehicle "Tokyo ***AA Wagon" on the display screen of the business flow list information shown in Figure 6, it transitions the screen and outputs the display screen of the estimation information shown in Figure 7. In addition, when the display generation unit 20 receives a worker's selection of either the "bodywork process," "painting process," or "assembly process" for the vehicle "Tokyo***AA Wagon" on the display screen of the business flow list information shown in Figure 6, it transitions the screen and outputs a display screen for managing the evidence information shown in Figures 8 and 9. In addition, when the display generation unit 20 receives the worker's selection of the "vehicle image" icon for "front bumper replacement" on the estimate information display screen shown in Figure 7, it transitions the screen and outputs a display screen for managing the evidence information shown in Figure 8. The following describes the "display screen for managing the work of the evidence registration items and the evidence information for each work process" shown in Figures 8 and 9.

[0095] The left side of the display screen in Fig. 8 displays "Vehicle Information, Vehicle Owner Information." Also displayed is a list of trail registration items such as the vehicle image received at the time of entry, "Vehicle Outer Rim, Damaged Areas," the trail item for "Replacement Parts" required to confirm completion, the vehicle image "Vehicle Outer Rim" required at the time of delivery, and the trail registration items required for work such as "Front Bumper Replacement," "Headlamp Replacement," and "Front Fender Sheet Metal Repair." When the selection operation of these trail registration items is accepted, the display generation unit 20 outputs detailed information (work process flow) of the selected trail registration items to the right side of the display screen in FIG. For example, when the trail registration item "Vehicle Outer Circumference" is selected, images of the vehicle's exterior from eight directions before work and an image of the vehicle's interior are displayed. These vehicle images are included in the "Work Request Information" received and recorded by the work reception unit 17 when the vehicle was brought into the warehouse.

[0096] Figure 8 is a screen for managing the trail information for the work "front bumper replacement." The trail registration item "front bumper replacement" has been selected, and the work process for front bumper replacement is displayed in a list. According to Figure 8, the work processes required for the job "front bumper replacement" include pre-repair, part removal, surface preparation, masking, color matching, painting, polishing, part assembly, and post-repair. FIG. 9 is a screen for managing the trail information for the work "headlamp replacement." The trail registration item "headlamp replacement" has been selected, and the work process for headlamp replacement is displayed in a list. According to Figure 9, the work processes required for the task of "headlamp replacement" include pre-repair, part removal, replacement part, part assembly, and post-repair.

[0097] <<6. Work Process Organization>> The second process generation unit 25b reads out the work processes that are specified in advance for the "trail registration item," organizes the processes as necessary, and organizes the "work process flow." For example, FIG. 8 is a diagram showing all work steps that have been pre-specified for the "trail registration item" for the work "front bumper replacement" that have been read out and displayed. The display generation unit 20 displays execution buttons "Full Display" and "Initialize" in the right part of the display screen shown in FIG. 8, adjacent to the part where the list of work processes is displayed. "Full Display" is an execution button for performing a process to display all of the work processes. "Initialize" is an execution button for displaying work processes selected based on past work history information.

[0098] In the above process organization process included in the "initialization" process, learning is performed based on the past work history of each maintenance workshop and the following "input information (explanatory variables)" and "output information (objective variables)". The "input information" includes work setting information (e.g., work type, target vehicle type, request details) set in past work history, information on the worker in charge (e.g., years of experience, area of ​​expertise), and work environment information (e.g., work date, work lane, weather conditions, etc.). The "output information" includes the work process actually organized in the past. In this process organization process, machine learning is performed based on the above "input information" and "output information" to predict a work process optimized for the work environment of each maintenance factory. Then, when the "initialization" process is executed, an optimal work process according to the work environment of each maintenance factory is generated and the generated work process is displayed. In this process organization process, it is preferable to use a trained model constructed by the training data processing unit 25c described below to learn based on the above-mentioned "input information" and "output information" and predict a work process optimized for the work environment of each maintenance factory.

[0099] When the second process generation unit 25b receives a selection operation of the execution button "full display" or "initialization" by the worker, it organizes the work processes and generates an "work process flow" after the process organization. The display generation unit 20 generates a management screen for the trail information including the “work process flow” after the process organization by the second process generation unit 25b, and outputs the screen to the worker terminal 100.

[0100] Figure 8 shows the evidence management screen after the second process generation unit 25b has performed a "full display" process organization, and the display generation unit 20 has generated a display screen that shows all work processes for the work "front bumper replacement." The evidence management screen shown in Figure 8 corresponds to the work process flow when performing the more detailed work (work process) of "front bumper replacement (with painting)" within the "front bumper replacement" work.

[0101] 8, if the second process generation unit 25b performs process organization for "initialization," the second process generation unit 25b performs organization to delete work processes such as "surface preparation," "color matching," and "painting," and generates the organized work process flow. Note that the second process generation unit 25b may also perform organization to further delete the work processes of "parts removal" and "after repair." Then, the display generation unit 20 hides the above work process for the work "front bumper replacement" and generates a display screen for the "work process flow" made up of the remaining work processes. This evidence management screen is a work process flow suitable for performing the more detailed work of "front bumper replacement (without painting)" within the work "front bumper replacement."

[0102] Also, Figure 9 shows the evidence management screen after the second process generation unit 25b has performed a "full display" process organization, and the display generation unit 20 has generated a display screen in which all work processes have been generated for the task "headlamp replacement." 9, if the second process generation unit 25b performs process organization for "initialization," the second process generation unit 25b performs organization by deleting, for example, "before repair" and "after repair," and generates a work process flow after organization. Then, the display generation unit 20 deletes the work processes "before repair" and "after repair" from the work "headlamp replacement," and displays on the screen a "work process flow" consisting of the remaining work processes.

[0103] <<7. Registering Evidence Trail Information>> The storage unit 22 accepts input of trail information by a worker for each trail registration item and for each work process on the "trail information management screen" shown in Figures 8 and 9, and stores the trail information. Specifically, when the storage unit 22 receives a user selection of the work process "parts removal" for the evidence registration item "front bumper replacement" on the display screen shown in Figure 8, it transitions to the "evidence information registration screen" shown in Figure 10 and accepts the worker's registration of "evidence information for parts removal work" through the registration screen. When the storage unit 22 receives input of "part removal evidence information" from the worker, it stores the evidence information. The display generation unit 20 embeds the "parts removal evidence information" in the item column for the work process "parts removal" of the evidence registration item "front bumper replacement" in the "trail information management screen" shown in Figure 8, and generates a display screen that makes the evidence information accessible.

[0104] The evidence information includes the name of the work process, the worker, an image before the work (vehicle image, part image) or an image after the work, the date and time the image was taken, the person who registered the work, the date and time of registration, and comments about the work. The vehicle's trail information showing the state before work is defined as "first record information," and the vehicle's trail information after work for each work process is defined as "second record information." The storage unit 22 stores the trail information including this "first record information" and "second record information." The record information is recorded by input operations by the worker.

[0105] As described above, the storage unit 22 accepts registration of corresponding trail information for each trail registration item and for each work step of the trail registration item on the left side of the trail management screen shown in Figures 8 and 9, and stores the trail information. The display generation unit 20 embeds the trail information stored by the storage unit 22 in the item column for each corresponding work step, and displays the details of the trail information in an accessible state. In this way, by generating work processes hierarchically for each work process, workers can reliably perform all the work required for the repair work. Also, for each work process, vehicle images before the work (vehicle images included in the estimate information) and vehicle images after the work can be appropriately saved.

[0106] <<8. Changes to work processes and reflecting quotation information>> While performing the actual work for each work step in "7. Registration of authentication information" above, the worker may determine that there is additional work or unnecessary work for a given work step. In this case, the worker must temporarily stop the actual work and add the necessary work to the estimate information. The process for this will be described below. The operation receiving unit 26 receives, via the worker terminal 100, an operation to add, delete, or change the order of work processes generated in the above "5. Generate work processes hierarchically". The process generation unit 25 organizes the existing "work process flow" and generates a new "work process flow" based on the change operation received by the operation reception unit 26. The process generation unit 25 also organizes a business flow (business process flow) if necessary in accordance with the change in the work process.

[0107] When a worker adds, deletes, or changes the order of the work processes, the process generation unit 25 learns using the details of these changes and generates "the next and subsequent work processes" based on the prediction results obtained through this learning. Specifically, this is as follows: First, the operation receiving unit 26 receives, via the worker terminal 100, a change operation for adding, deleting, or changing the order of work processes generated by the process generating unit 25. The process generation unit 25 (learning data processing unit 25c) processes the changes based on these change operations as learning data by associating them with the work type, worker information, and work environment information. Specifically, the learning data processing unit 25c generates a multidimensional feature vector including, as "explanatory variables (features)," features indicating the type of work, worker information (e.g., the worker's years of experience and field of expertise), and features indicating the time, location, and equipment information of the work environment. Furthermore, as "objective variables," the content of the changes actually performed by the worker (e.g., which work processes were added, deleted, or rearranged) is set. Then, using this learning data, a "learning model" is constructed to predict the changes. Then, the first learning unit 25d uses the constructed trained model to perform machine learning using the work type, worker information, and work environment information as "input information" and the work items as "output information," and predicts the work process for the work of the optimal work style item based on the work type, worker information, and work environment information for the new work style information. Then, the process generation unit 25 generates a work process for the new work pattern information based on the prediction result by the first learning unit 25d. This makes it possible to generate a work process that reflects past change trends and is optimized for the worker.

[0108] The process flow for generating work processes using machine learning in the process generation unit 25 is as follows: First, "(1) Learning Phase (processing by the learning data processing unit 25c)" is performed, and then "(2) Prediction Phase (processing by the first learning unit 25d)" is performed. In the "learning phase," work history data for the past year is acquired from the history storage unit 15. This data includes the work process actually selected for each work type and the work environment at that time (worker, time, location). The learning data processing unit 25c extracts common patterns from this data and trains a rule that "this work process is selected under these conditions" as a learning model. Next, in the "prediction phase," when a new work case is input, the first learning unit 25d uses the trained model to predict the optimal work process for that case. For the prediction, the current work conditions (work type, responsible worker, current time) are input into the trained model (first learning unit), and a process (task process, work process) is output. Of course, the necessity of each work process may be output as a probability value, and the work processes may be presented in order of the highest probability value. Note that this probability value can be used to calculate the "reliability score," which will be described later.

[0109] In addition, when the estimate acquisition unit 23 (estimate creation unit) creates "optimal estimate information for the next time and thereafter," it is preferable that the history memory unit 15 accumulates "history information of estimate items" that have been added, deleted, or updated in past work. The process generation unit 25 (learning data processing unit 25c) constructs a learning model using the work type, worker information, and work environment information contained in the accumulated "history information of estimate items" as "input information (explanatory variables)" and the estimate items (work processes included in the estimate items) as "output information (objective variables)." Then, when new estimate information is input, the first learning unit 25d uses the learned model to predict the work process corresponding to the optimal estimate item based on the input work type, worker information, and work environment information. The process generation unit 25 generates a work process for the new estimate information based on the prediction results obtained through this learning process.

[0110] The above will be explained in more detail as follows. The learning data processing unit 25c generates learning data from the accumulated "history information." More specifically, the learning data processing unit 25c extracts pairs of "explanatory variables (input variables)" and "objective variables (output variables)" from the history information of past work cases. As "explanatory variables," the learning data processing unit 25c generates a multidimensional feature vector including feature quantities indicating the type of work, the worker's years of experience and field of expertise, and feature quantities indicating the time, location, and equipment information of the work environment.As "target variables," the learning data processing unit 25c sets the work process that was actually performed.

[0111] The first learning unit 25d uses the above learning data to learn the model. When new estimate information is input, the first learning unit 25d predicts the optimal work process using the trained model. At this time, the first learning unit 25d calculates a reliability score for each work process. It determines whether the reliability score is equal to or greater than a predetermined threshold, and selects work processes that are equal to or greater than the threshold as confirmed items, and presents work processes that are less than the threshold as candidates to the worker. This allows the process generation unit 25 to generate a work process for new estimate information more efficiently based on the prediction result by the first learning unit 25d. The "trained model" used by the first learning unit 25d continuously improves prediction accuracy by using the "trained model (initial learning model)" that predicts change operations shown above and "additional learning data" obtained from change operations performed by workers.

[0112] The "reliability score" output by the first learning unit 25d is an index indicating the accuracy of the prediction. For example, in the case of the "front bumper replacement" task, if the "masking" process is performed with a 90% probability based on past data, the "reliability score" will be 0.9. The process generation unit 25 performs a process to determine whether or not to add a work process based on this reliability score. For example, if the reliability score is "0.8 or more," it determines to automatically add it as a work process, if the reliability score is "0.5 or more but less than 0.8," it checks with the worker and determines whether or not to add it as a work process based on the confirmation, and if the reliability score is "less than 0.5," it determines not to add it as a work process.

[0113] <<9. Work Management with Hash Values>> As shown in FIG. 11, the management unit 21 manages the hierarchically generated business processes and operation processes in association with the trail information. Specifically, the management unit 21 generates a hash value for a series of evidence information including first recorded information indicating the vehicle's state before the work and second recorded information indicating the vehicle's state after each work process, and associates the hash value with the series of evidence information.The management unit 21 then associates the evidence information with the associated hash value with the work process and manages it in chronological order.

[0114] More specifically, the management unit 21 first sets "process identification information" for each of the hierarchically generated business processes and work processes, and sets "record information identification information" for the first record information and the second record information included in the trail information (performing the identification information setting process). The management unit 21 generates "identification correspondence information" that indicates the correspondence between the "process identification information" and the "recorded information identification information." Then, it generates a "hash value" for this identification correspondence information or for the combination of the process identification information and the recorded information identification information included in the identification correspondence information (performs a hash value generation process). The management unit 21 manages the generated hash value in association with the identification correspondence information.

[0115] More specifically, the "process identification information" is a process ID assigned to each process, and the "recorded information identification part" is a recorded information ID (for example, an image ID) assigned to each piece of recorded information. The management unit 21 applies a hash function to the "identification correspondence information" that associates these IDs with each other to calculate a "hash value." Then, the management unit 21 associates this identification correspondence information with the hash value and manages it. This allows the management unit 21 to manage the three pieces of information, the process identification information, the recorded information identification information, and the hash value, in a state where they are associated with each other. In this way, checking using hash values ​​makes it possible to detect and prevent tampering, ensuring "post-verification" based on correspondence.

[0116] An example of the processing procedure for the above "post-verification" is as follows. (1) Check whether or not the hash value has been tampered with. In other words, check that the recorded hash value has not been changed (that the hash value is the same). (2) Identify the "business processes and work processes" that were actually carried out. (3) Check the correspondence between each process and the "recorded information." In other words, check that the appropriate vehicle images (recorded information) are associated with the identified work processes and workers. (4) Identify the "quote items (trail registration items)" corresponding to the business process and work process. In other words, identify the quotation items required for the confirmed business process and work process. (5) Obtain "quotation information" including the specified quotation items. (6) Verify the identity of the "acquired estimate information" and the "actual estimate information." In other words, verify that the acquired estimate information is exactly the same as the estimate information presented to the vehicle owner and the estimate information managed by the repair shop, etc. This makes it possible to reliably verify whether the "work details for the estimate items agreed upon between the repair shop and the vehicle owner" and the "work details that were actually performed" are the same. In other words, it becomes possible to accurately reproduce the estimate information (quote) from the details of the work that was actually performed.

[0117] <<10. Work management screen>> When managing the trail information stored by the storage unit 22, the management unit 21 manages the trail information by associating it with the hierarchically generated business processes and operation processes. The display generation unit 20 outputs the business processes and work processes managed by the management unit 21 and the record information (trail information) to the display screens of the worker terminal 100 and the client terminal 200 (FIG. 11, FIGS. 12A to 12C). It also outputs a work management screen to a terminal for third parties (FIG. 13). At this time, the display generation unit 20 generates a display screen showing the business process and the progress of the work processes included in this business process in a different display format depending on the type of terminal from which the communication access originates. Specifically, this is as shown in FIG. 11, FIG. 12A to FIG. 12C, and FIG.

[0118] FIG. 11 shows a work management screen displayed on the worker terminal 100. The display generation unit 20 generates a display screen including all business processes, work steps, and trail information for the worker terminal 100 as a "first display screen" shown in FIG. When the display generation unit 20 receives a selection operation by a worker regarding work management of the vehicle "Tokyo***AA Wagon" on the "Business Flow List Information Screen" shown in FIG. 6, for example, the display generation unit 20 transitions the display screen shown in FIG. 6 and outputs the work management screen shown in FIG. 11. Alternatively, when the display generation unit 20 receives a selection operation by a worker regarding work management, for example, on the "quotation information display screen" shown in FIG. 7, it transitions the display screen shown in FIG. 7 and outputs the work management screen shown in FIG. 11.

[0119] The work management screen shown in Figure 11 displays the business flow (all business processes) for the work "bodywork and painting" for the vehicle "Tokyo ***AA Wagon," all trail registration items (work items) for the work processes "bodywork," "painting," and "assembly," the work processes for each trail registration item, and the trail information for each work process, all in correspondence with each other. To explain in more detail, on the work display screen shown in Figure 11, the worker selects the work processes "sheet metal work," "painting," and "assembly" (any one of the work processes may be selected), and the evidence information for each work process in this work process is displayed in a chronological order. In addition, if a worker selects the business process "Estimate" on the work display screen shown in FIG. 11, the display generation unit 20 will display the "Estimate information (summary information of estimate information)" shown in FIG. 7 in association with the section below the section where the business flow is displayed. Alternatively, if an operator selects the business process "completion inspection" on the display screen shown in Figure 11, the display generation unit 20 will display "recorded information (evidence information) recorded in the completion inspection" in association with the business flow.

[0120] According to FIG. 11, the work processes for each business process "(1) sheet metal work," "(2) painting," and "(3) assembly" are displayed in association with the work processes for each evidence registration item. For example, among the work processes for the evidence registration item "Front bumper replacement," the first half of the process, "Before repair," "Parts removal," and "Surface preparation," are displayed in a display format related to (corresponding to) the work process "(1) Sheet metal work." This means that the work processes of "Before repair," "Parts removal," and "Surface preparation" correspond to the work processes of the business process "(1) Sheet metal work." Similarly, it can be seen that among the work processes for the evidence registration item "front bumper replacement," "masking," "color matching," "painting," and "polishing" correspond to the work processes of the work process "(2) painting." It can also be seen that the work processes "parts assembly" and "post-repair" correspond to the work processes of the work process "(3) assembly." Note that this assumes a metal front bumper. In this way, the display generation unit 20 generates a display screen including all business processes, work steps, and evidence information for the worker terminal 100 as a "first display screen."

[0121] FIG. 12 shows a work management screen displayed on the client terminal 200 (owner terminal). The display generation unit 20 generates a display screen for the client terminal 200 as a "second display screen" shown in FIGS. 12A to 12C, which is different from the "first display screen" shown in FIG. 11 and includes main business processes and work progress. When the display generation unit 20 receives a selection operation by the requester (vehicle owner) regarding work management for the vehicle "Tokyo***AA Wagon", it displays the management screens shown in FIGS. 12A, 12B, and 12C.

[0122] Specifically, when the display generation unit 20 receives a selection operation of "Work Status" by the worker on the work management screen of the vehicle "Tokyo***AA Wagon", it outputs the "Work Status Management Screen" shown in FIG. 12A. The "Work Status Management Screen" shown in Figure 12A displays the "Work Progress Status" for vehicle repairs. For example, the vehicle owner has already "approved the estimate," and the current status is displayed as "repair work in progress." In addition, vehicle information, information on the person in charge of repairs, etc. are displayed.

[0123] When the display generation unit 20 receives a selection operation of "timeline" by the worker on the vehicle work management screen, it outputs a "timeline management screen" shown in FIG. 12B. The "Timeline Management Screen" shown in Figure 12B displays vehicle information, owner information, and major business processes. For example, the business processes "Reception," "Storage," "Estimate," "Repair Work," "Billing," "Billing Content Approval," and "Delivery" are displayed, and it can be seen that the business process "Repair Work" is currently being performed.

[0124] When the display generation unit 20 receives a selection operation of "trail" by the worker on the vehicle work management screen, it outputs the "trail management screen" shown in FIG. 12C. The "evidence management screen" shown in Figure 12C can display vehicle information, owner information, and evidence information such as time of entry, completion confirmation, time of delivery, evidence registration items, and document list. For example, as evidence information at the time of entry, exterior images of the vehicle from eight directions before work and interior images are registered and can be displayed. Looking at the exterior image of the front of the vehicle, it can be seen that the "front bumper" is damaged.

[0125] Figure 13 shows the work management screen displayed on a terminal for third parties. The display generation unit 20 generates a work progress display screen for a terminal intended for a third party as a "third display screen" shown in FIG. The display generation unit 20 outputs the work management screen shown in FIG. 13 to a display terminal (display screen) that is hung from the ceiling at the front of the maintenance workshop, for example, and that can be viewed by third parties. The "Work Management Screen" shown in Fig. 13 displays work environment information (work pit), work progress information, and images of the work in progress (vehicle images). For example, it can be seen that work to replace a front bumper is being carried out in the first work pit.

[0126] <<Other: Reflection of the client's validity judgment results>> In the business flow shown in Figure 4, after the quotation information is created or obtained in the business step "Quotation," the quotation is approved by the client (vehicle owner) in the next business step "Confirmation before construction begins." Furthermore, if there is a client other than the vehicle owner (for example, an insurance company), it is necessary to obtain the "results of a validity judgment" on the quotation information from the client as an insurance agreement. If any quotation items are rejected as a result of the above judgment, it is necessary to add, delete, or update the quotation items. Even after trail information has been created, the requester (insurance company) may receive a "validity judgment result" for the trail information. If there is any denied trail information, the trail information is added, deleted, or updated. The processing at this time is explained below.

[0127] The communication unit 16 communicates with the client terminal 200 (requesting terminal) which is an external server, transmits estimate information and trail information to the requesting terminal, and receives the "validity judgment result" of the work content from the requesting terminal. The "validity judgment result" includes the approved quotation items (evidence information), the rejected quotation items (evidence information), and the reasons for the approval or rejection. The estimate acquisition unit 23 modifies the existing "quotation information" based on the "rejected quotation items" received by the communication unit 16, and creates or acquires new "quotation information." Alternatively, the extraction unit 24 and the process generation unit 25 modify the existing "trail registration item" based on the "rejected trail information" received by the communication unit 16, and generate a new "trail registration item."

[0128] In this way, estimate information (quotation) and maintenance record book are sent from the repair shop etc. to the insurance company, and a process is performed to determine the validity of the contents. This determination process is performed based on information such as work information (standard work time), vehicle information (vehicle type), and parts information (parts prices) stored in the storage units 11 to 15 according to the vehicle type and damaged part. If the validity assessment results in "approval," the worker will begin bodywork, painting, etc. based on the estimate information (estimate items and evidence registration items included in the estimate information). Alternatively, the worker will create a work log and delivery note, issue an invoice to the vehicle owner, and deliver the vehicle. That is, the management unit 21 completes the work related to the business processes "quote" and "pre-construction check" and then transitions to the next business processes "sheet metal work," "painting," and "assembly." Alternatively, the management unit 21 completes the work related to the business processes "record book" and "pre-delivery check" and then transitions to the next business process "delivery."

[0129] On the other hand, if the validity assessment results in a "denial," the worker will modify the existing quotation information (quote items and trail registration items included in the quotation information) based on the rejected quotation items (trail registration items) and the reason for the rejection (reason for rejection). Alternatively, the worker will modify the existing work log or delivery note. These "rejected quotation items (trail registration items)" and "reason for approval (reason for denial)" are stored in the history storage unit 15 as history information. If the result of the validity assessment is "rejected" as described above, learning should be performed using the rejected quotation items and the reason for rejection, and "quotation information for the next time onwards" should be generated based on the learning results. The specific process is as follows:

[0130] The history storage unit 15 stores, as "history information," the quotation items that were approved and rejected in the "validity judgment result," and the reasons for the approval or rejection. When creating or acquiring new estimate information, the second learning unit 27 trains the learning model by reflecting this "history information" (also referred to as second learning). Specifically, the second learning unit 27 learns by using the above-mentioned approved and rejected quotation items and the reasons for their approval or rejection (for example, non-compliance with the work content, overestimation of the quotation amount, non-insurance coverage of the target parts, etc.) as "input information (explanatory variables)" and the quotation items included in the newly presented quotation information (items that may be approved or rejected) as "output information." The second learning unit 27 uses the learning model constructed by the learning data processing unit 25c described above to automatically propose and generate highly appropriate quotation items when creating quotation information in the future. This makes it possible to systematically accumulate and manage historical information on quotation items that were rejected in past insurance agreements (work content approvals) and the reasons for rejection, and to reflect this information in the next quotation.

[0131] The learning process by the second learning unit 27 that reflects the judgment results of the insurance company is executed as follows. The second learning unit 27 stores (accumulates) the "validity judgment results" received through the communication unit 16 in the history storage unit 15. These judgment results include which quotation items were approved and which quotation items were rejected, as well as the reasons for approval and rejection. The second learning unit 27 learns the patterns of these judgment results. Based on this information, the process generation unit 25 performs processing to either exclude from the start work processes that are likely to be denied or to propose alternative work processes.

[0132] The information processing device 1 can classify estimate items included in estimate information related to vehicle work, extract estimate items (trail registration items) that require trail management, and hierarchically generate business processes and one or more work processes for the work of the extracted estimate items. It can also store trail information for each work process and manage the business processes, work processes, and trail information in association with each other. This allows for appropriate management of work on vehicles.

[0133] <<Information processing method (evidence management)>> Next, the processing of the information processing program (information processing method) executed by the information processing device 1 will be described with reference to FIG. The above program is a program for realizing the above-mentioned function units 16 to 27 as functional components of the information processing device 1 having the storage units 10 to 15 (memories). The CPU (processor) of the information processing device 1 executes this information processing program.

[0134] In the processing flow shown in FIG. 14, first, the work reception unit 17 receives request information for work on a damaged vehicle from a worker via the worker terminal 100, and performs reception processing for the "work request information" (step 1 (S1)). 4A, 4B, and 5, the "work request information" includes "vehicle information" of the work target (vehicle ID, vehicle registration number, etc.), "owner information" (owner ID, owner name, etc.), "requester information" (requester ID, insurance company name, etc.), vehicle images, images of damaged areas, etc. The "work request information" is stored in the history storage unit 15 or the like.

[0135] In step 2, the work type setting unit 18 sets a "work type" for work on the vehicle based on the "work request information." Then, the workflow creation unit 19 accepts the setting of the "work type," references the "work information" stored in the work memory unit 13, and reads and creates a "work flow" consisting of multiple work processes corresponding to the work type (see the vehicle "Tokyo***AA Wagon" in Figure 6).

[0136] In step 3, the estimate acquisition unit 23 acquires estimate information from the external server. In addition, the estimate creation unit creates "work estimate information (work estimate)" for the vehicle based on the "work request information" and the "work type" by referring to the "vehicle information," "parts information," and "work information" stored in the memories 11 to 13 (see FIG. 7), and the created estimate information is acquired by the estimate acquisition unit 23. The "quote information" includes vehicle information, owner information, requester information, as well as the type of details, work content (work type), work parts, and vehicle images (damage images) before the work, which are listed as quotation items.

[0137] In step 4, the extraction unit 24 classifies the estimate items included in the "quote information" shown in Fig. 7 into work types of vehicle parts, parts, and work, and extracts "quote items requiring trail management" based on the work types by referring to the "quote item classification information." Then, it performs a process to further extract "trail registration items" for the extracted estimate items.

[0138] In step 5, the process generation unit 25 hierarchically generates a "business process" and "one or more work processes" included in the business process for the work of the estimate item (trail registration item) extracted by the extraction unit 24 based on a predetermined correspondence relationship. The display generation unit 20 generates a management screen for the evidence information including the "work process flow" generated by the process generation unit 25, as shown in FIGS. For example, FIG. 8 shows a screen for managing the trail information for the trail registration item "front bumper replacement," which displays a list of work processes for front bumper replacement.

[0139] In step 6, when the process generation unit 25 receives a selection operation of the execution button "Full display" or "Initialize" shown in FIG. 8, it organizes the work processes and generates an "work process flow" after the process organization. The display generation unit 20 generates a management screen for the trail information including the “work process flow” after the process organization by the process generation unit 25 , and outputs the screen to the worker terminal 100 . Figure 8 shows the trail management screen after "full display" process organization has been performed.

[0140] In step 7, the storage unit 22 accepts the input of trail information by the worker for each trail registration item and for each work process on the "trail information management screen" shown in Figures 8 and 9, and stores the trail information. According to the "Trail Information Registration Screen" shown in Figure 10, the "trail information" includes the name of the work process, the worker, an image before the work (vehicle image, part image) or an image after the work, the date and time the image was taken, the person who registered the work, the date and time of registration, and comments regarding the work.

[0141] In step 8, the operation receiving unit 26 receives, via the worker terminal 100, an operation to add, delete, or change the order of the work processes generated in step 5. The process generation unit 25 organizes the existing "work process flow" based on the change operation received by the operation reception unit 26, and generates a new "work process flow." In addition, if a change operation is performed to add, delete, or change the order of a work process, the process generation unit 25 (learning data processing unit 25c) learns using the change operation content and generates the ``next and subsequent work processes'' based on the learning results.

[0142] In step 9, as shown in FIG. 11, the management unit 21 manages by associating the hierarchically generated business processes and work processes with the trace information respectively. Specifically, the management unit 21 generates a "hash value" for the "series of trace information" related to the work of the vehicle and associates it with the series of trace information. Then, the trace information associated with the "hash value" is associated with the work process and managed in chronological order.

[0143] In step 10, when the management unit 21 manages the trace information stored by the storage unit 22, it manages by associating the hierarchically generated business processes and work processes with the trace information. At this time, the display generation unit 20 outputs the business processes and work processes managed by the management unit 21 and the record information (trace information) on the display screens of the worker terminal 100 and the requester terminal 200 in different display modes (FIGS. 11, 12A to 12C). Also, it outputs a work management screen to a terminal for a third party (FIG. 13).

[0144] After going through the above steps 1 to step 10, the process in FIG. 14 is terminated. According to the above information processing method, it becomes possible to appropriately manage the work (repair work, replacement work, etc.) on the vehicle.

[0145] <<Identity Management>> Next, the "identity management" by the information processing apparatus 1 will be described in detail. Regarding the identity management of the vehicle to be worked on, there are "I. Pre-work Preparation Phase", "II. Work Phase", and "III. Verification and Storage Phase (Post-work Phase)". Note that "1. Reception of Work Request" in the trace management of the above vehicle corresponds to "I. Pre-work Preparation Phase" in the identity management of the vehicle. Also, the above "7. Registration of Trace Information" corresponds to "II. Work Phase". Also, the above "9. Work Management with Associated Hash Value" corresponds to "III. Verification and Storage Phase".

[0146] <<I. Pre-work Preparation Phase>> In this phase, (1) the "vehicle acceptance process," (2) the "ECU connection process," and (3) the "vehicle authentication process" are carried out. These are explained in detail below. (1) In the "vehicle reception process," the work reception unit 17 receives information on a request for work on a vehicle (damaged vehicle) from a worker via the worker terminal 100, and performs reception processing for the "work request information." As mentioned above, the "work request information" for a vehicle includes the "vehicle information" to be worked on (vehicle ID, vehicle registration number, chassis number, etc.), "vehicle owner information" (owner ID, owner name, etc.), "requester information" (requester ID, insurance company name, contract details, etc.), date of receipt, vehicle images, damage images, etc. The above-mentioned "vehicle work request information" and the "vehicle work type" set by the work type setting unit 18 based on this work request information are stored in the history storage unit 15, respectively.

[0147] (2) In the "ECU connection process", the identification information acquisition unit 32 acquires, via the worker terminal 100, "vehicle-specific information" stored in the on-board ECU 330 mounted on the vehicle as "vehicle identification information". Specifically, first, the worker terminal 100 (ECU diagnostic device 102) communicates with the on-vehicle ECU 330 by connecting to a diagnostic port mounted on the vehicle 300 via an OBD-II interface (communication connector). Then, the worker terminal 100 reads out "vehicle-specific information (such as the vehicle body number, vehicle identification number, chassis number, and ECU serial number)" stored in the storage area of ​​the on-vehicle ECU 330, and acquires the "vehicle-specific information." Then, the identification information acquisition unit 32 communicates with the operator terminal 100 and acquires the “vehicle-specific information” obtained by the ECU diagnostic device 102 . In other words, the identification information acquisition unit 32 performs communication control for communicating with the worker terminal 100 and the vehicle 300 (on-vehicle ECU 330) via a communication connector connected to a diagnostic port mounted on the vehicle. The identification information acquisition unit 32 then acquires "vehicle-specific information" including the vehicle identification number and the ECU serial number from the on-vehicle ECU 330, and outputs this vehicle-specific information as "identification information."

[0148] As shown in FIG. 2, the vehicle 300 is equipped with a supervisory ECU 331 and a plurality of function ECUs 340 connected to the supervisory ECU 331. The identification information acquisition unit 32 may acquire, as the identification information, the "first vehicle-specific information" obtained from the supervisory ECU 331. Alternatively, the identification information acquisition unit 32 may acquire, as the identification information, a combination of the "first vehicle-specific information" obtained from the supervisory ECU 331 and the "second vehicle-specific information" obtained from the function ECU 340. Alternatively, the identification information acquisition unit 32 may acquire, as the identification information, a combination of the "second vehicle-specific information" obtained from a plurality of function ECUs 340. Preferably, the identification information acquisition unit 32 acquires, as the identification information, "vehicle-specific information" corresponding to the "work type" of the work to be performed on the vehicle. Specifically, this is as follows.

[0149] The type code generation unit 33 generates a "work type code" that indicates the type of work to be done on the vehicle, based on the "work type" set by the work type setting unit 18 when the vehicle is received. The ECU identifier acquisition unit 34 refers to the “work corresponding ECU data” stored in the storage unit 10 and acquires the “identifier of the functional ECU” corresponding to the “work type code” generated by the type code generation unit 33. The "work-corresponding ECU data" stored in the memory unit 10 is information indicating the correspondence between the work type code and the identifier of the functional ECU related to the work type, and is centrally managed and stored in the memory unit 10. In the above, the identification information acquisition unit 32 、「 The "first vehicle-specific information" and the "second vehicle-specific information" are combined and output as identification information. This makes it possible to obtain vehicle-specific information from the functional ECU 340 corresponding to the type of work, thereby enabling the vehicle to be appropriately identified.

[0150] For example, when the work type is "sheet metal work", the identification information acquisition unit 32 specifies, as the function ECU 340 related to that work type, the body system ECUs (information - entertainment ECU, door ECU, light ECU, air - conditioner ECU). Then, it acquires "vehicle - specific information" from these function ECUs 340. When the overall control ECU 331 and the plurality of function ECUs 340 are specified based on the work type, the identification information acquisition unit 32 acquires identification information from all the specified ECUs.

[0151] These vehicle - specific information (such as vehicle identification number, ECU serial number, etc.) obtained by the identification information acquisition unit 32 are stored as "a group of data". Specifically, the management unit 21 calculates the "hash value" for these vehicle - specific information groups and manages them in association. The "hash value" functions as the electronic fingerprint of the vehicle and is used to prove that it is the same vehicle before, during, and after the work.

[0152] (3) In the "vehicle authentication process", the authentication unit 35 authenticates the data consistency between the "vehicle - specific information" obtained by the identification information acquisition unit 32 and the "vehicle information" received by the work reception unit 17. Specifically, the authentication unit 35 checks the association between the "vehicle - specific information (such as vehicle identification number)" obtained from the in - vehicle ECU 330 and the "vehicle information (automobile registration number)" received by the work reception unit 17. That is, the authentication unit 35 matches the two pieces of information to confirm that they are identical (corresponding to each other). Furthermore, when the "work history information" of the target vehicle is stored in the history storage unit 15, by collating the above - mentioned "vehicle - specific information" and "work history information" together, the identity of the vehicle can be confirmed, and the accuracy of vehicle authentication can be improved. When the vehicle is authenticated by the authentication unit 35, it transitions from "I. Pre - work preparation phase" to the next "II. Work phase".

[0153] <<II. Work phase>> In this phase, (1) the "Work Start Recording Process," (2) the "Work In Progress Recording Process," and (3) the "Work Completion Recording Process" are carried out. These will be explained in order below.

[0154] (1) In the "work start recording process," when work begins on a vehicle (damaged vehicle), the "vehicle image," "identification information," "location information," and "time information" indicating the time when the identification information was acquired and the time when the location information was acquired are recorded and stored in the memory unit 10. The "vehicle image" corresponds to the above-mentioned trail information (part of the trail information).

[0155] Specifically, by activating and linking the imaging device 101, ECU diagnostic device 102, and receiver 103, the worker terminal 100 acquires a "vehicle image" of the vehicle before work begins, the vehicle's "identification information," "location information," and "time information" indicating the time at which this information was acquired. In addition, metadata such as "vehicle identification information (vehicle identification number, ECU serial number)" obtained from the on-board ECU 330 at the time of image capture and "location information based on GNSS information" received by the GNSS receiver 321 are embedded in the "vehicle image" captured by the imaging device 101 using steganography. The information processing device 1 acquires this information through the worker terminal 100, associates it as one data set, and stores it in the storage unit 10. It is preferable that the information processing device 1 synchronizes with an NTP server to acquire the correct time, and store the time in association with the time when the location information was acquired. More specific processing is as follows.

[0156] The image acquisition unit 31 acquires a "vehicle image (vehicle image data)" captured by the imaging device 101 through the worker terminal 100. At this time, the imaging signal generation unit 31a generates an "imaging signal" indicating that the imaging device 101 has captured an image. In response to the "imaging signal" generated by the imaging signal generation unit 31a, the identification information acquisition unit 32 acquires the "vehicle identification information" before the work at this point in time (before the work) through the worker terminal 100 (ECU diagnostic device 102) and the vehicle 300 (on-board ECU 330). The identification information acquisition unit 32 may acquire the "vehicle identification information" embedded in the "vehicle image data."

[0157] In response to the "imaging signal" generated by the imaging signal generator 31a, the position information acquirer 36 acquires "vehicle position information" before the work via the worker terminal 100 (receiver 103) at this point in time. Note that in practice, the position information acquired is the position information of the worker terminal 100 that has approached the vehicle. Specifically, the location information acquisition unit 36 ​​acquires the GNSS signal received by the receiver 103, which receives signals from artificial satellites, and calculates the location coordinates including the latitude, longitude, and altitude of the vehicle as "location information" based on this GNSS signal, thereby acquiring the "vehicle location information" before the work. In addition, the location information acquisition unit 36 ​​may acquire the GNSS signal received by the GNSS receiver 321 installed in the vehicle 300, calculate the vehicle's "location coordinates" based on this GNSS signal, and acquire the "vehicle location information" before the work. The position information acquisition unit 36 ​​may acquire "vehicle position information" embedded in "vehicle image data."

[0158] The time information acquisition unit 37 acquires "time information" indicating the time when the "identification information" and the "position information" were acquired in response to the "imaging signal" generated by the imaging signal generation unit 31a. The storage unit 10 stores the "vehicle image data," "identification information," "position information," and "time information" of the vehicle at the time before the work in association with each other as one data set. In addition, the memory unit 10 stores the "vehicle image data," "identification information," "location information," and "time information" in association with each other as a data set not only before the work, but also at multiple points during the work and after the work.

[0159] The "data set" stored in the storage unit 10 will now be described in detail. A "data set" is a group of data obtained from a target vehicle, and includes "vehicle image data," "identification information," "position information," and "time information" of the vehicle. The metadata generating unit 38 extracts identification information, location information, and time information from the "data set" stored in the storage unit 10, and generates "metadata." The metadata embedding unit 39 embeds the "metadata" generated by the metadata generating unit 38 into pixel values ​​of the "vehicle image data" included in the same data set. Then, the dataset update unit 40 executes a process of storing the dataset including the "vehicle image data" in which the "metadata" has been embedded by the metadata embedding unit 39 in the storage unit 10 as a "metadata-included dataset." This allows information such as when (time information), where (location information), and which vehicle (identification information) the image was taken to be linked to the "vehicle image data" itself, ensuring the reliability of the data. Also, by embedding metadata in vehicle image data, it becomes possible to extract necessary information from the vehicle image data itself.

[0160] (2) In the "Work Recording Process," the recording process (storage process) of "vehicle image data" taken at each required work step of the work on the vehicle (for example, bodywork and painting) is repeatedly carried out. Note that "vehicle image data (vehicle images)" corresponds to the above-mentioned trail information (part of the trail information). In the above recording process, the above-mentioned "electronic certification" (first certification means), "physical certification" (second certification means), and "temporal certification" (third certification means) are performed.

[0161] First, as "electronic proof," when "vehicle image data" is captured by the imaging device 101 during work, a process is performed to reacquire "vehicle identification information" from the on-board ECU via the ECU diagnostic device 102, and the information is associated with the "vehicle image data." Then, a process is performed (a determination process) to confirm whether the "identification information" associated with the "vehicle image data" captured immediately before matches the "identification information" associated with the "vehicle image data" captured at the current time. The specific "determination process" performed by the determination unit 41 is as follows.

[0162] The identification information determination unit 41a determines whether or not the "identification information included in the data set before operation" stored in the storage unit 10 matches the "identification information included in the data set during operation." More specifically, the identification information acquisition unit 32 acquires the vehicle's "identification information" at multiple work points for each work process. The identification information determination unit 41a then sequentially compares the "identification information contained in the data sets" stored in the storage unit 10 at the time before the work and at multiple work points, and determines whether the "identification information" matches between all of the adjacent data sets. In this way, by re-acquiring the "vehicle identification information" each time an image is taken, it is possible to prove that the vehicle has not been replaced during work.

[0163] More specifically, the identification information acquisition unit 32 reads out the "vehicle identification information" stored in the memory area of ​​the on-board ECU at predetermined intervals (every 1 ms, every 1 s, every 1 m, every 10 m) through the worker terminal 100 (ECU diagnostic device 102), and accumulates the "vehicle identification information" at each predetermined interval in the memory unit 10. The identification information determination unit 41a can confirm whether or not "all of the identification information" stored in the memory unit 10 ultimately matches by comparing "identification information" that is adjacent in time (before and after in time) among the "multiple identification information" stored in the memory unit 10. If all of the "vehicle identification information" for temporally adjacent vehicles matches during the period from the start to the end of a certain task, it can be confirmed that the "vehicle identification information" has not been changed during the task, i.e., that the vehicle has not been replaced during the task. On the other hand, if there is a mismatch in even a part of the identification information for a series of tasks, it indicates the possibility that the vehicle may have been changed during the task, or that a different vehicle may have been the subject of the task.

[0164] In the above, the identification information acquisition unit 32 acquires "first vehicle-specific information" from the master ECU 331, acquires "second vehicle-specific information" from the functional ECU 340 corresponding to the identifier obtained by the ECU identifier acquisition unit 34, and combines and outputs this "first vehicle-specific information" and "second vehicle-specific information" as identification information. In this case, the identification information determination unit 41a performs both a comparison between parts of the identification information contained in the multiple data sets stored in the memory unit 10 that correspond to the "first vehicle-specific information" and a comparison between parts that correspond to the "second vehicle-specific information." This provides more reliable proof that the vehicle being worked on has not been swapped.

[0165] Secondly, as "physical proof," "vehicle location information based on GNSS information" is acquired at any time via satellite, and a process (determination process) is performed to confirm whether the "vehicle location information" at the time the vehicle image was captured is within a certain range from the "vehicle location information" at the time the previous vehicle image was captured. "Within a certain range" refers to a distance range determined according to the physical dimensions of the vehicle (work object), for example, a distance range determined by the physical dimensions of the vehicle. Also, "a distance determined by the physical dimensions" is, for example, the length of the diagonal calculated from the overall length, overall width, and overall height of the vehicle (work object). The specific "determination process" performed by the determination unit 41 is as follows.

[0166] The position information determination unit 41b uses the "vehicle position information" included in the data set before the work stored in the memory unit 10 as a reference position and determines whether the "position information" included in the data set during the work is within a distance range determined by the physical dimensions of the vehicle from the reference position. Specifically, the position information acquisition unit 36 ​​acquires a data set including "vehicle position information" at multiple work points for each work process. Then, the position information determination unit 41b determines whether the "position information" included in all of the data sets stored in the storage unit 10 is within a distance range determined by the physical dimensions of the vehicle from the reference position, which is the position information included in the first data set. In this way, the collection of location information (collective history) can objectively prove that no unauthorized vehicle movements have occurred.

[0167] Third, as "temporal proof," the system performs a verification process of the temporal progression by comparing "time information" indicating the acquisition time of the vehicle images, which is associated with "vehicle image data" captured at multiple work points. In other words, it verifies that the work process was carried out in a natural chronological order. The specific "determination process" performed by the determination unit 41 is as follows.

[0168] First, the time difference calculation unit 42 arranges the "time information contained in the multiple data sets (time information indicating the time when the vehicle was imaged)" stored in the memory unit 10 in chronological order, and calculates the difference in time information between temporally adjacent data sets as each "time difference." The time determination unit 41c determines whether or not each of the "time differences" calculated by the time difference calculation unit 42 exceeds a predetermined "upper limit value." An "upper limit" is a value set for each work object, each work type, and each work process included in a work type, and indicates the upper limit (allowable upper limit) of the time required under natural chronological progression when transitioning from one work process to the next.

[0169] If the time determination unit 41c determines that the respective time differences do not exceed the "upper limit value," it further determines whether the correspondence between the "time differences" calculated by the time difference calculation unit 42 and the "amount of change in location information" between the corresponding data sets satisfies a predetermined "time correspondence condition." If the above correspondence satisfies the "time correspondence condition," by combining it with the above-mentioned "electronic proof," it is possible to prove with high reliability that the vehicle before and during work is the same.

[0170] The "time correspondence condition" will be explained in detail. First, the "time difference" refers to the difference between adjacent pieces of "time information" indicating the image capture time when a vehicle is captured and the vehicle image, vehicle identification information, and location information are acquired. The difference between the "vehicle location information" acquired at each of the adjacent pieces of time information is referred to as the "amount of change in location information." This "amount of change in location information" is, for example, the distance from point A to point B, or the distance from point A to point B via point C, and corresponds to the actual distance traveled by the vehicle. For example, if the distance from point A to point B is "3 m," the distance from point A to point C is 2 m, and the distance from point C to point B is 2 m, then the distance from point A to point B via point C is 2 m, and the distance from point A to point B is 4 m, not 3 m. Then, based on the correspondence relationship between the "amount of change in position information (amount of movement of the vehicle)" and the "time difference," the conditions under which it is recognized that the same vehicle is being worked on in a natural time progression are set as "time correspondence conditions." These "time correspondence conditions" are stored in the storage unit 10.

[0171] For example, if the "time difference" is as short as 10 minutes, but the "change in location information" is 5 meters or more, the time determination unit 41c determines that the time correspondence condition is not met. This means that it has detected that the work target may have changed. On the other hand, if the "time difference" is as long as 60 minutes, but the "change in location information" is 6 m, the time determination unit 41c determines that the time correspondence condition is met. This means that it has detected that there is no possibility that the work target has been changed. This is because, when setting the "time response condition," it is taken into consideration that the longer the work time (work time difference), the more work will be performed and the greater the possibility that the vehicle will move. For example, this means that the possibility of the vehicle moving due to moving to the pit or changing direction increases. In this way, the longer the work time, the wider the allowable range of the vehicle's movement distance is set.

[0172] If a negative determination result is obtained in any of the determination processes by the above-mentioned determination units 41a, 41b, and 41c, the information processing device 1 outputs a "warning signal" to the outside. Specifically, the determination result summarizing unit 41d receives the determination result by the identification information determining unit 41a, the determination result by the position information determining unit 41b, and the determination result by the time determining unit 41c. Then, when at least one of the judgment results received by the judgment result aggregation unit 41d indicates a negative judgment result, the warning output unit 43 generates a "warning signal" including information identifying the judgment unit 41 that output the negative judgment result, and outputs this "warning signal" to the outside. This "warning signal" can warn the worker that the target vehicle may not be the same at multiple points during or after the work. Furthermore, the information contained in this "warning signal" can also allow the worker to confirm which determination means produced a negative determination result.

[0173] "Enhancing anomaly detection through machine learning" Furthermore, the determination unit 41 cooperates with the anomaly detection learning unit 41e and the anomaly degree calculation unit 41f to perform advanced anomaly detection using machine learning. The anomaly detection learning unit 41e constructs "learned data" from normal work patterns stored in the history storage unit 15. Specifically, it extracts (1) the change pattern of the identification information (acquisition interval and acquisition order of the identification information in a time series), (2) the movement trajectory of the position information (change amount of the position coordinate, movement speed, movement direction), and (3) the interval distribution of the time information (statistical distribution of the time difference between work processes) as "features." Using these feature amounts, the anomaly detection learning unit 46 trains the "anomaly detection learned model."

[0174] The anomaly calculation unit 47 inputs the identification information, location information, and time information acquired in real time during work into a trained "anomaly detection model" and calculates an "anomaly score." The "anomaly score" is an index that indicates the degree to which the current work pattern deviates from the normal pattern.

[0175] In the anomaly detection process, the anomaly detection learning unit 41e extracts only data on tasks that have been completed successfully from the history storage unit 15 and learns this as a "normal pattern." The normal pattern includes the interval between acquisition of identification information, the amount of change in location information, the length of task time, etc. The anomaly degree calculation unit 41f compares the data on the task currently in progress with the normal pattern constructed by the anomaly detection learning unit 41e and quantifies the degree of deviation. For example, if identification information that is normally acquired at five-minute intervals is not acquired even after the abnormality determination period (30 minutes) has elapsed, a higher "abnormality score" than usual is calculated.

[0176] The warning output unit 43 determines whether the "anomaly score" calculated by the anomaly calculation unit 47 exceeds a predetermined threshold, and if it does, generates a "warning signal" including the anomaly detection result obtained by machine learning. This "warning signal" includes the value of the anomaly score and the reason for the determination of an anomaly (for example, "a sudden change in location information," "anomaly in the interval between acquisition of identification information," etc.). This enables "statistical anomaly detection using machine learning" in addition to electronic proof, physical proof, and temporal proof by the judgment unit 41, thereby realizing more accurate vehicle identity management.

[0177] Possible methods for outputting the "warning signal" to the outside include, for example, displaying warning information on a display screen or emitting a warning sound. In other words, the information processing device 1 can generate warning information or a warning sound based on the "warning signal" and output it to an external display or speaker.

[0178] (3) In the "work completion recording process," when all work steps (all work steps) are completed, the management unit 21 sets the work status to "work completed." At this time, the "vehicle image data," "vehicle identification information," "location information," "time information," and the status of diagnostic trouble codes (information indicating that all trouble codes have been resolved) at all points in time before, during, and after the work are recorded as a "series of data sets" and stored in the memory unit 10. Furthermore, upon completion of the work, a comprehensive digital signature is generated for all data from the start to the end of the work and attached to the entire data set, thereby ensuring the authenticity of the data for the entire work. The specific processing is as follows:

[0179] The storage unit 10 stores "vehicle image data," "identification information," "position information," and "time information" as data sets in association with each other at all points in time, before, during, and after the work. As described above, the dataset update unit 40 executes a process of storing a dataset including "vehicle image data" in which "metadata" has been embedded by the metadata embedding unit 39 as a "dataset with metadata" in the storage unit 10 and the history storage unit 15. This ensures the reliability of the data by linking information about when (time information), where (location information), and which vehicle (identification information) the image was taken at all points in time, from before work to after work, to the "vehicle image data" itself. Also, by embedding metadata in the vehicle image data, necessary information can be extracted from the vehicle image data itself. When a series of operations is completed, the "dataset with a series of metadata" is stored in the history storage unit 15 (database), and all the datasets stored in the storage unit 10 are cleared from the cache. As a result, the information processing device 1 can store the dataset for the next operation in the storage unit 10.

[0180] <<III. Verification and Saving Phase (Post-operation Phase)>> In this phase, when the "dataset with a series of metadata" is stored in the database for the operations performed on the vehicle and the predetermined timing (data confirmation timing) is reached, a process of comprehensively verifying the "dataset with metadata" is performed. Specifically, the information processing device 1 performs a process of "verifying the identification information of the vehicle", a process of "verifying the position information of the vehicle", and a process of "verifying whether there is any tampering with the vehicle image", respectively. The following is a specific description.

[0181] In the process of "verifying the identification information of the vehicle", it is verified that the identification information of the vehicle recorded as all "datasets with metadata including vehicle images" is the same (performing the above-described electronic proof). Specifically, the identification information determination unit 41a sequentially compares the "identification information of the vehicle" included in the datasets that are temporally adjacent and stored in the history storage unit 15, and determines whether the identification information matches between adjacent datasets at all times before, during, and after the operation.

[0182] In the process of "verifying the position information", for each "dataset with metadata", it is verified that all the "position information of the vehicle" is within the physical size of the vehicle (performing the above-described physical proof). Specifically, the position information determination unit 41b determines whether the "position information of the vehicle" included in all the datasets stored in the history storage unit 15 is within the range of the distance determined by the physical dimensions of the vehicle from the reference position, with the "position information of the vehicle" included in the first dataset as the reference position, at all times during and after the operation.

[0183] In the "process of verifying whether vehicle images have been tampered with," the consistency of the metadata is verified for each "data set with metadata." That is, using the metadata of vehicle images before and after in the timeline, it is verified that the data is the same, that the data is consecutive, and that the temporal relationship is consistent (the above-mentioned temporal proof is performed). Specifically, first, the time difference calculation unit 42 arranges the "time information contained in multiple data sets" stored in the history storage unit 15 in chronological order, and calculates the difference in time information between temporally adjacent data sets as each "time difference." The time determination unit 41c determines whether or not the respective time differences exceed a predetermined "upper limit value (upper limit value of the time required under natural time progression)." If the time determination unit 41c determines that the respective time differences do not exceed the "upper limit value," it further determines whether the correspondence relationship between the "time differences" calculated by the time difference calculation unit 42 and the "amount of change in position information" between the corresponding data sets satisfies the "time correspondence condition." This "time correspondence condition" is a condition under which it is recognized that the same vehicle is being worked on in a natural time progression.

[0184] Once all of the above verification processes have been performed and all positive determination results have been obtained (confirmation has been completed), the information processing device 1 performs a "blockchain storage process" on the "series of metadata-attached data sets."

[0185] <<Blockchain storage process (tamper prevention)>> Once the above verification process is complete, the verified "dataset with metadata" is recorded on the distributed ledger (blockchain). This recording process is carried out in the following steps: The work record data generation unit 44 combines the "plurality of metadata-attached data sets" stored in the history storage unit 15, and generates "work record data" that summarizes a series of tasks. The hash value calculation unit 45 calculates a unique "hash value" for the "work record data" generated by the work record data generation unit 44. This hash value guarantees the integrity and non-tampering of the work record data. The distributed ledger storage unit 30 generates "transaction data" including the "hash value" calculated by the hash value calculation unit 45 and the first time information and the last time information included in the "work record data."Then, the distributed ledger storage unit 30 stores this "transaction data" in the distributed ledger (blockchain). The above-mentioned "transaction data" is issued as a smart contract that includes a "hash value" of the entire generated work record and a "timestamp" of when the hash value was generated. This smart contract is then stored as a transaction in a distributed ledger (blockchain).

[0186] Transaction data stored in the distributed ledger follows the general blockchain protocol, and is assigned unique information such as transaction IDs and block numbers, and is permanently recorded in an immutable form, making it possible to confirm with high accuracy that the work being performed is on the same vehicle.

[0187] <<Information processing method (identity management)>> Next, the processing of the information processing program (information processing method) executed by the information processing device 1 will be described with reference to FIGS. The above program is a program for realizing the above-mentioned function units 16 to 45 as functional components of the information processing device 1 having the storage units 10 to 15 and 30 (memory). The CPU (processor) of the information processing device 1 executes this information processing program.

[0188] In addition, in the "identity management" of this embodiment, in addition to the judgment processing by the identification information judgment unit 41a, the location information judgment unit 41b, and the time judgment unit 41c of the judgment unit 41 described above, it is also possible to perform "anomaly detection using machine learning." The determination unit 41 uses, as "learning data," past normal work history data stored in the history storage unit 15. This learning data is a "data set with metadata" for work cases that have been completed normally from the start to the end of the work. During learning, the judgment unit 41 extracts, from the data set of each work case, for example, as "explanatory variables" information such as the ECU serial number acquisition interval (in seconds) and acquisition frequency per unit time as "identification information related," information such as the vehicle's travel distance (in meters), travel speed (m / s), and maximum distance from a reference position as "location information related," and further extracts, as "explanatory variables" information such as the time difference (in minutes) between adjacent work processes and the time required for each work process as "time information related." The determination unit 41 uses these explanatory variables as input to learn normal work patterns. During actual work, the same explanatory variables as those used during learning are calculated from the identification information, location information, and time information acquired in real time via the worker terminal 100. These explanatory variables are then input into the "trained model," which calculates an "anomaly score (a continuous value from 0 to 1)" as the "objective variable," indicating the degree to which the current work pattern deviates from the normal pattern.

[0189] For example, if the work process of "front bumper replacement" is completed in an average of 5 minutes in past normal data, and the vehicle travels less than 2 m during that time, but the actual work takes about 30 minutes and the vehicle travels about 10 m, a "high abnormality score" will be output. The determination unit 41 determines whether the abnormality score exceeds a preset threshold, and if it does exceed the threshold, it transmits the values ​​of all explanatory variables and the abnormality score at that time to the warning output unit 43 via the determination result aggregation unit 41 d. The warning output unit 43 generates a warning message and displays it on the worker terminal 100.

[0190] This makes it possible to detect complex abnormal patterns that combine multiple factors, which are difficult to detect using conventional fixed thresholds. A specific processing flow of identity management will be described below with reference to FIGS.

[0191] In the processing flow shown in FIGS. 15 to 17, first, processing in "I. Pre-work preparation phase" is performed. First, in step 101 (S101), the type code generation unit 33 generates a "work type code" indicating the type of work performed on a vehicle, based on the "work type" acquired through the worker terminal 100. Specifically, the work reception unit 17 receives request information for work on a vehicle (damaged vehicle) through the worker terminal 100, and receives the "work request information" and a "work type for the vehicle" set based on the work request information. Then, the type code generation unit 33 generates a "work type code" based on this "work type."

[0192] In step 102, the ECU identifier acquisition unit 34 refers to the "work-corresponding ECU data" stored in the memory unit 10, acquires the "functional ECU identifier" corresponding to the "work type code" generated by the type code generation unit 33, and outputs it to the worker terminal 100. This makes it possible to obtain vehicle-specific information (vehicle identification information) from the functional ECU 340 corresponding to the type of work, thereby enabling the vehicle to be appropriately identified.

[0193] In step 103, the identification information acquisition unit 32 acquires the "vehicle identification information." Specifically, first, the worker terminal 100 acquires the "identifier of the function ECU" from the information processing device 1, and determines the function ECU corresponding to the "identifier of the function ECU." Then, the worker terminal 100 (ECU diagnostic device 102) communicates with the vehicle (on-board ECU), acquires "first vehicle-specific information" from the control ECU 331, and acquires "second vehicle-specific information" from the function ECU 340 corresponding to the identifier of the function ECU. Then, the identification information acquisition unit 32 acquires the "first vehicle-specific information" and the "second vehicle-specific information" from the worker terminal 100, and acquires identification information that combines this "first vehicle-specific information" and "second vehicle-specific information."

[0194] In step 104 , the authentication unit 35 certifies the consistency of the data between the “vehicle identification information” obtained by the identification information acquisition unit 32 and the “vehicle information” accepted by the work acceptance unit 17 . Once the authentication unit 35 has authenticated the vehicle, the process moves from "I. Pre-work preparation phase" to the next "II. Work phase."

[0195] In step 105, the information processing device 1 acquires the "vehicle image data," "vehicle identification information," "location information," and "time information" at the time before the work via the worker terminal 100, and stores them in the memory unit 10 in association with each other as a single data set. Furthermore, the information processing device 1 acquires the above data groups at multiple points during the work and at points after the work, associates them as one data set, and stores them in the storage unit 10. Specifically, by activating and linking the imaging device 101, ECU diagnostic device 102, and receiver 103, the worker terminal 100 acquires a "vehicle image" of the vehicle, "identification information" and "location information" of the vehicle, and "time information" indicating the time at which this information was acquired.

[0196] In step 106, the dataset update unit 40 executes a process of storing the "dataset including vehicle image data" in which the "metadata" has been embedded by the metadata embedding unit 39 in the storage unit 10 as a "dataset with metadata." This allows information such as when (time information), where (location information), and which vehicle (identification information) captured the image to be linked to the "vehicle image data" itself.

[0197] In step 107, the determination unit 41 confirms the identity of the vehicle to be worked on before, during, and after the work. Specifically, as described above, the identification information determination unit 41a performs determination processing using "electronic proof," the location information determination unit 41b performs determination processing using "physical proof," and the time determination unit 41c performs determination processing using "temporal proof."

[0198] When all work steps (all work steps) are completed, the management unit 21 sets the work status to "Work Completed." At this time, the "vehicle image data," "vehicle identification information," "location information," "time information," and the status of diagnostic trouble codes (information indicating that all trouble codes have been resolved) at all points in time before, during, and after the work are recorded. Once the work is completed, the process moves from "II. Work Phase" to the next "III. Verification and Storage Phase."

[0199] In step 108, the information processing device 1 comprehensively verifies the "series of metadata-attached data sets" for work performed on the vehicle at a predetermined timing, with the "series of metadata-attached data sets" stored in the database. Specifically, as described above, the judgment unit 41 performs a "process to verify the vehicle's identification information," a "process to verify the vehicle's location information," and a "process to verify whether the vehicle image has been tampered with." Once all of the above-mentioned "verification processes" have been performed and a positive judgment result is obtained, the process proceeds to the step of performing "blockchain storage processing" on the "series of metadata-attached data sets."

[0200] In step 109, the information processing device 1 records the verified "series of data sets with metadata" in the distributed ledger. This is achieved by executing a smart contract. Specifically, the work record data generation unit 44 combines the "multiple metadata-attached data sets" stored in the history storage unit 15 to generate "work record data" that summarizes a series of tasks. The hash value calculation unit 45 calculates a unique "hash value" for this "work record data." The distributed ledger storage unit 30 generates "transaction data" including this "hash value" and the first and last time information included in the "work record data."Then, it stores this "transaction data" in the distributed ledger (blockchain). The above-mentioned "transaction data" is issued as a smart contract that includes a "hash value" of the entire work record data and a "timestamp" at the time the hash value was generated.

[0201] In step 110, the information processing device 1 obtains the transaction ID assigned to the transaction data stored in the distributed ledger. By assigning this transaction ID, the "work record data" is permanently recorded in an unalterable form. This information is later used as a highly reliable reference to prove the integrity and non-tampering of the "work record data."

[0202] In step 111, the information processing device 1 outputs to the worker terminal 100 a "work record completion notice" indicating that the work record for the vehicle has been saved.

[0203] After going through steps 101 to 111, the process of FIGS. 15 to 17 is completed. According to the above information processing method, it is possible to appropriately manage the vehicle to be worked on before and after the work.

[0204] <Industrial Applicability> The information processing device (information processing method) described above can directly prevent fraudulent activities at repair shops and vehicle inspection centers when performing, for example, "automobile maintenance work and vehicle inspection work." In particular, it can provide a technical solution to the problem of so-called "paper maintenance," where an item is recorded as having been maintained when in fact it has not. In the automobile insurance industry, this will enable insurance companies to efficiently verify the legitimacy of insurance claims for vehicle repair and maintenance work. This will not only help prevent fraudulent claims, but also enable them to provide appropriate insurance services by assessing risks and setting premiums based on work history information. Furthermore, in the used car market, where maintenance history information is an important factor in purchasing decisions, vehicles with properly managed maintenance history information can be circulated, improving the reliability of the vehicles. As a result, this will lead to the revitalization of the entire used car market.

[0205] <Other> In the above embodiment, the information processing device 1 performs trail management and identity management of the "vehicle" that is the target of the work, but it is not limited to "vehicle (automobile)" and may perform trail management and identity management of "moving objects" such as motorcycles, buses, trains, ships, airplanes, etc. Alternatively, it may perform trail management and identity management of "electronic devices" other than moving objects. In particular, the information processing device 1 can manage the identity of an "object (work object)" in which "identification information (such as an identification number)" is stored.

[0206] In the above embodiment, an information processing program is stored in a recording medium readable by the information processing device, and the information processing device executes processing by reading and executing the program. Examples of recording media readable by the information processing device 1 include magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, semiconductor memories, and cloud storage. Alternatively, a configuration may be adopted in which dedicated software (web application) is started using a terminal (mobile terminal) as an information processing device, and an information processing program is executed on a web browser or in a local environment.

[0207] In the above embodiment, the learning data processing unit 25c and the first learning unit 25d have been described as operating in cooperation with the process generation unit 25, but they may also be implemented as independent functional units. Furthermore, the abnormality detection learning unit 41e and the abnormality degree calculation unit 41f may be implemented as part of the determination unit 41, or may be implemented as an independent abnormality detection unit. Furthermore, the "features used in machine learning" are not limited to the above examples, and may be added, deleted, or changed as appropriate depending on the type of object to be worked on, the work environment, the required accuracy, etc. For example, weather information, traffic conditions, parts inventory status, etc. may be used as "additional features."

[0208] In the above embodiment, the information processing device, the information processing method, and the information processing program according to the present invention have been mainly described. However, the above embodiment is merely an example for facilitating understanding of the present invention, and does not limit the present invention. The present invention can be modified or improved without departing from the spirit thereof, and the present invention naturally includes equivalents thereof.

[0209] <Appendix 1> <Optimization of work processes through machine learning> The "processor" further includes a "learning processing unit" that extracts task type, worker information, and work environment information as "explanatory variables" from past history information (work history information) and trains a machine learning model using the actually performed work process as the "target variable," and a "prediction processing unit" that predicts the optimal work process using the trained model when estimate information for a new task is input. The learning processing unit generates a multidimensional feature vector including features indicating the task type, the worker's years of experience, and the worker's field of expertise. The prediction processing unit calculates a reliability score for the predicted work process and selects work processes whose reliability score is equal to or greater than a predetermined threshold.

[0210] <Appendix 2> <Anomaly detection using machine learning> The "determination unit" further includes an "anomaly detection learning unit" that trains an anomaly detection model using normal work patterns as learning data, and an "anomaly calculation unit" that inputs identification information, location information, and time information acquired in real time during work into the anomaly detection trained model and calculates an anomaly score. The "warning output unit" generates a warning signal when the anomaly score exceeds a predetermined threshold. [Explanation of symbols]

[0211] S Information Processing System 1. Information processing equipment 10 Storage section 11 Vehicle information storage unit 12 Part information storage unit 13 Working Memory 14 User information storage unit 15 History memory section <Trail Management> 16 Communications Department 17 Work Reception Department 17a Image processing unit 18 Work type setting section 19 Business Flow Creation Department 20 Display generation section 21 Management Department 22 Preservation Department 23 Estimate acquisition unit (work status acquisition unit, work instruction acquisition unit) 24 Extraction part 24a 1st extraction part 24b 2nd extraction part 25 Process generation department 25a 1st process generation section 25b 2nd process generation section 25c Learning data processing section 25d First Study Section (First Study Section) 26 Operation reception section 27 Second Study Section (Second Study Section) <Identity management> 30 Distributed ledger storage 31 Image acquisition unit 31a Imaging signal generation unit 32 Identification information acquisition unit 33 Type code generation unit 34 ECU identifier acquisition section 35 Authentication Department 36 Location information acquisition unit 37 Time information acquisition unit 38 Metadata Generation Unit 39 Metadata embedding section 40 Dataset Update Section 41 Judgment section 41a Identification information determination unit 41b Location information determination unit 41c Time judgment section 41d Judgment result collection unit 41e Anomaly detection learning unit 41f Abnormality calculation section 42 Time difference calculation section 43 Warning output section 44 Work record data generation unit 45 Hash value calculation unit 100 Worker terminal 101 Imaging device 102 ECU diagnostic equipment 103 Receiver 110 Storage section 111 Communications Department 112 Display section 113 Operation Execution Unit 200 Requester terminal 210 Storage section 211 Communications Department 212 Display section 213 Operation Execution Unit 300 Vehicles (moving objects) 301 Vehicle control device 310 In-vehicle sensors 311 Imaging device 312 Radar (millimeter wave radar) 313 Rider 320 In-Vehicle Locator 321 GNSS receiver 322 Inertial Measurement Unit (IMU) 330 Automotive ECU 331 Control ECU 340 function ECU 341 Powertrain ECU 342 Chassis ECU 343 Body ECU 344 Security ECU 345 Network ECU SA satellite ST reference station

Claims

1. A memory unit; a processor capable of information processing using the information stored in the storage unit, The processor: an identification information acquisition unit that acquires identification information including a vehicle identification number from a vehicle that is a target of the work and that is equipped with an electronic control unit (ECU); a location information acquisition unit that acquires location information of the vehicle from a signal received by a GNSS receiver that receives a signal from an artificial satellite, the storage unit stores the identification information acquired by the identification information acquisition unit and the location information acquired by the location information acquisition unit; The processor: an identification information determination unit that determines whether the identification information before the work and the identification information after the work match; an information processing device comprising: a position information determination unit that determines whether the position information after the work is within a distance range determined by the physical dimensions of the vehicle from the reference position, using the position information before the work stored in the memory unit as a reference position.

2. A memory unit; a processor capable of information processing using the information stored in the storage unit, The processor: an identification information acquisition unit that acquires identification information including a vehicle identification number from a vehicle that is a target of the work and has an electronic control unit (ECU) mounted thereon by controlling communication with the ECU via a communication connector that is connected to a port mounted on the vehicle; a location information acquisition unit that acquires location information of the vehicle from a signal received by a GNSS receiver that receives a signal from an artificial satellite, the storage unit stores the identification information acquired by the identification information acquisition unit and the location information acquired by the location information acquisition unit in association with each other; The processor: an identification information determination unit that determines whether the identification information before the work and the identification information after the work match; a position information determination unit that determines whether or not the position information after the work is within a distance range determined by the physical dimensions of the vehicle, using the position information before the work stored in the storage unit as a reference position, An information processing device, wherein the distance determined by the physical dimensions is a length calculated from values ​​of the overall length, overall width, and overall height of the vehicle.

3. A memory unit; a processor capable of information processing using the information stored in the storage unit, The processor: an identification information acquisition unit that acquires identification information including a vehicle identification number from a vehicle that is a target of the work and has an electronic control unit (ECU) mounted thereon by controlling communication with the ECU via a communication connector that is connected to a port mounted on the vehicle; a location information acquisition unit that acquires location information of the vehicle from a signal received by a GNSS receiver that receives a signal from an artificial satellite, the storage unit stores the identification information acquired by the identification information acquisition unit and the location information acquired by the location information acquisition unit in association with each other; The processor: an identification information determination unit that determines whether the identification information before the work and the identification information after the work match; and a position information determination unit that determines whether the position information of the vehicle after the work is within a certain range from the reference position, using the position information of the vehicle before the work stored in the memory unit as the reference position.

4. the processor further includes a time information acquisition unit that acquires time information indicating a time when the identification information acquisition unit acquired the identification information and a time when the location information acquisition unit acquired the location information; the storage unit stores the identification information obtained by the identification information acquisition unit, the location information obtained by the location information acquisition unit, and the time information obtained by the time information acquisition unit in association with each other as one data set; the identification information determination unit compares the identification information included in the data set before the operation stored in the storage unit with the identification information included in the data set after the operation, and makes a determination; The information processing device according to claim 1 , wherein the position information determination unit determines the position information included in the post-work data set using the position information included in the pre-work data set stored in the storage unit as a reference position.

5. the identification information acquisition unit and the location information acquisition unit acquire corresponding information before the work, at multiple points during the work, and after the work, the storage unit stores the identification information and the position information obtained at a time point before the work, at a plurality of time points during the work, and at a time point after the work, in association with each other; the identification information determination unit sequentially compares the identification information stored in the storage unit that is adjacent in time to each other and determines whether or not all the adjacent identification information match; 4. The information processing device according to claim 1, wherein the position information determination unit determines whether all of the position information stored in the memory unit is within a distance range determined by the physical dimensions of the vehicle from the reference position, using the first position information as the reference position.

6. The vehicle is equipped with a general ECU that controls the overall operation of the vehicle as the electronic control unit, and a plurality of function ECUs that are responsible for engine control, brake control, body control, and airbag control, respectively; the storage unit stores a correspondence relationship between a work type code indicating a work type of the work and an identifier of a functional ECU associated with the work type; the processor includes an ECU identifier acquisition unit that refers to the correspondence relationship based on the work type code and acquires an identifier of a corresponding functional ECU; The identification information acquisition unit acquiring first vehicle-specific information from the supervisory ECU; acquiring second vehicle-specific information from a functional ECU corresponding to the identifier obtained by the ECU identifier acquisition unit; combining the first vehicle-specific information and the second vehicle-specific information and outputting the combined information as the identification information; The information processing device according to claim 1 , wherein the storage unit stores at least the identification information and the location information obtained by the location information acquisition unit in association with each other as one data set.

7. An information processing device as described in Claim 6, wherein the identification information determination unit compares the parts of the identification information of the data set stored in the memory unit that correspond to the first vehicle-specific information and the parts that correspond to the second vehicle-specific information.

8. The processor: a determination result aggregation unit that receives as input a determination result by the identification information determination unit and a determination result by the position information determination unit; 4. The information processing device according to claim 1, further comprising: a warning output unit that, when at least one of the judgment results received by the judgment result aggregation unit indicates a negative judgment, generates a warning signal including information identifying the judgment unit that output the negative judgment, and outputs the warning signal to the outside.

9. An information processing method executed by a computer including a storage unit and a processor capable of performing information processing using information stored in the storage unit, The computer acquiring identification information including a vehicle identification number from a vehicle that is a target of the work and that is equipped with an electronic control unit (ECU); Acquiring position information of the vehicle from signals received by a GNSS receiver that receives signals from artificial satellites; storing the identification information and the location information; determining whether the identification information before the work and the identification information after the work match; An information processing method that executes the following: determining whether the position information after the work is within a distance range determined by the physical dimensions of the vehicle from the reference position, using the position information before the work stored in the memory unit as a reference position.

10. An information processing method executed by a computer including a storage unit and a processor capable of performing information processing using information stored in the storage unit, The computer Acquiring identification information including a vehicle identification number from a vehicle that is a target of the work and has an electronic control unit (ECU) mounted thereon by controlling communication with the ECU via a communication connector connected to a port mounted on the vehicle; Acquiring position information of the vehicle from signals received by a GNSS receiver that receives signals from artificial satellites; storing the identification information and the location information in association with each other; determining whether the identification information before the work and the identification information after the work match; and determining whether or not the position information after the work is within a distance range determined by the physical dimensions of the vehicle from the reference position, using the position information before the work stored in the storage unit as a reference position; An information processing method, wherein the distance determined by the physical dimensions is a length calculated from the overall length, overall width, and overall height of the vehicle.

11. An information processing method executed by a computer including a storage unit and a processor capable of performing information processing using information stored in the storage unit, The computer Acquiring identification information including a vehicle identification number from a vehicle that is a target of the work and has an electronic control unit (ECU) mounted thereon by controlling communication with the ECU via a communication connector connected to a port mounted on the vehicle; Acquiring position information of the vehicle from signals received by a GNSS receiver that receives signals from artificial satellites; storing the identification information and the location information in association with each other; determining whether the identification information before the work and the identification information after the work match; and determining whether the position information of the vehicle after the work is within a certain range from the reference position, using the position information of the vehicle before the work stored in the memory unit as a reference position.

12. A computer including a storage unit and a processor capable of information processing using information stored in the storage unit, A process of acquiring identification information including a vehicle identification number from a vehicle that is a target of the work and that is equipped with an electronic control unit (ECU); A process of acquiring position information of the vehicle from signals received by a GNSS receiver that receives signals from artificial satellites; a process of storing the identification information and the location information; a process of determining whether or not the identification information before the work and the identification information after the work match; an information processing program that executes a process of determining whether the position information after the work is within a distance range determined by the physical dimensions of the vehicle from the reference position, using the position information before the work stored in the memory unit as a reference position.

13. A computer including a storage unit and a processor capable of information processing using information stored in the storage unit, A process of acquiring identification information including a vehicle identification number from a vehicle that is a target of the work and has an electronic control unit (ECU) mounted thereon by controlling communication with the ECU via a communication connector connected to a port mounted on the vehicle; A process of acquiring position information of the vehicle from signals received by a GNSS receiver that receives signals from artificial satellites; a process of storing the identification information and the location information in association with each other; a process of determining whether or not the identification information before the work and the identification information after the work match; and determining whether or not the post-operation position information is within a distance range determined by the physical dimensions of the vehicle from the pre-operation position information stored in the storage unit as a reference position, An information processing program, wherein the distance determined by the physical dimensions is a length calculated from the overall length, overall width, and overall height of the vehicle.

14. A computer including a storage unit and a processor capable of information processing using information stored in the storage unit, A process of acquiring identification information including a vehicle identification number from a vehicle that is a target of the work and has an electronic control unit (ECU) mounted thereon by controlling communication with the ECU via a communication connector connected to a port mounted on the vehicle; A process of acquiring position information of the vehicle from signals received by a GNSS receiver that receives signals from artificial satellites; a process of storing the identification information and the location information in association with each other; a process of determining whether or not the identification information before the work and the identification information after the work match; and determining whether the position information of the vehicle after the work is within a certain range from the reference position, using the position information of the vehicle before the work stored in the memory unit as the reference position.

Images