Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device, an information processing method and an information processing program capable of appropriately providing information required to appraise a secondhand car without depending on specialized knowledge and experience of a user (e.g., an examiner).SOLUTION: In an information processing system 1, an information processing device used to appraise a secondhand car includes a defect information acquisition part 11 acquiring defect information on a defect about a vehicle body detected by image recognition of an image of the vehicle body of the secondhand car, and a defect specification part 12 for specifying a part having the defect on the basis of the defect information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] In recent years, the used car distribution market has expanded, and various systems for appraising used cars have been considered. For example, Patent Document 1 describes a method in which an inspector inputs information about defects in the car body (e.g., scratches, dents, etc. on the exterior).

[0003] Specifically, Patent Document 1 describes displaying an exploded view showing multiple parts of a vehicle body on a terminal used by a used car inspector, and displaying information about defects visually confirmed by the inspector (for example, information indicating the part, type, etc.) on the exploded view at the part containing the defect. According to Patent Document 1, since information about the defect is displayed at the part containing the defect on the exploded view, it becomes easy to distinguish whether or not there is a defect in each part. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-097679 A Summary of the Invention [Problem to be solved by the invention]

[0005] Generally, appraisals of used cars are carried out based on information about defects in the car body (e.g., scratches on the exterior, dents, etc.) and information about the accident history of the car frame (e.g., dents, replaced, etc.). In addition, as described in Patent Document 1, it is assumed that such information is input via a specified terminal by an inspector visually checking the car body.

[0006] However, inputting information required for used car appraisal (e.g., information on defects in the vehicle body and information on the accident history of the vehicle frame) requires the inspector's specialized knowledge and experience. For example, if an inspector does not have knowledge of parts of the vehicle body (e.g., names and locations), the inspector may not be able to properly identify the part where a defect exists. Therefore, when an inspector visually checks information required for used car appraisal, as in Patent Document 1, the reliability of the information may depend on the inspector's specialized knowledge and experience.

[0007] Therefore, the present invention provides an information processing device, an information processing method, and an information processing program that can appropriately provide information required for appraisal of a used car, without relying on the specialized knowledge or experience of a user (eg, an inspector). [Means for solving the problem]

[0008] An information processing device according to one embodiment of the present invention is an information processing device used for appraising used cars, and includes an acquisition unit that acquires defect information regarding defects in the car body detected by image recognition of an image of the car body of the used car, and an identification unit that identifies the area where the defect exists based on the defect information.

[0009] According to this aspect, the part where the defect exists is identified based on the defect information detected by image recognition of the image of the vehicle body, so the user does not need to visually identify the part where the defect exists. Therefore, it is possible to appropriately provide information indicating the part where the defect exists, which is necessary for the appraisal of a used car, without relying on the user's specialized knowledge or experience.

[0010] In the above aspect, the information processing device may include a providing unit that provides information indicating the presence of the defect in the identified portion, which is displayed in an area corresponding to the identified portion on the development view of the vehicle body. Also, in the above aspect, the identifying unit may identify a type and / or a size of the defect based on the defect information, and the providing unit may provide information indicating the identified type and / or the identified size, which is displayed in an area corresponding to the identified portion.

[0011] According to this aspect, the type and / or size of the defect is identified based on the defect information detected by image recognition of the vehicle body image, so that the user does not need to visually identify the type and / or size of the defect. Therefore, it is possible to appropriately provide information indicating the type and / or size of the defect required for the appraisal of a used car without relying on the user's specialized knowledge or experience.

[0012] In the above aspect, when a specified user operation on an area corresponding to the identified part is accepted, the providing unit may provide information indicating a list of the types and / or sizes of the defects expected in the identified part, and the user may be allowed to reselect or deselect the types and / or sizes of the defects on a screen on which the list is displayed.

[0013] According to this aspect, it becomes possible for the user to confirm and correct the validity of the type and / or size of the defect identified based on the defect information detected by image recognition of the vehicle body image.

[0014] An information processing device according to another aspect of the present invention may be an information processing device used for appraising used cars, and may include an acquisition unit that acquires historical information regarding the collision, impact or accident history of the body of the used car, and an identification unit that identifies the impact point received by the body, the direction of the impact relative to the impact point, and the magnitude of the impact based on the historical information.

[0015] According to this aspect, the impact point, direction and magnitude of the impact are identified based on history information related to the history of collisions, impacts or accidents of the vehicle body, so that the user does not need to visually identify the impact point, direction and magnitude of the impact. Therefore, it is possible to appropriately provide information indicating the impact point, direction and magnitude of the impact required for appraisal of a used car without relying on the user's specialized knowledge or experience.

[0016] In the above aspect, the information processing device may further include a providing unit that provides information indicating the impact point, the direction, and the magnitude to be displayed on the development view of the vehicle body. In the above aspect, the providing unit may provide information indicating a list of accident histories assumed for the skeleton when a predetermined operation of a user on an area corresponding to a skeleton of the vehicle body is accepted, and a selection of an accident history of the skeleton may be accepted on a screen on which the list is displayed.

[0017] According to this aspect, when a specified user operation is accepted for an area corresponding to a specific skeleton based on the impact point, direction and magnitude of the impact displayed in the unfolded diagram, a list of accident histories corresponding to that skeleton is displayed on the screen, so that the user can appropriately select the accident history for that skeleton from the list.

[0018] Another aspect of the present invention provides an information processing system for appraising used cars, the information processing device comprising: an acquisition unit that acquires defect information regarding defects in the vehicle body detected by image recognition of an image of the body of the used car; an identification unit that identifies the portion where the defect exists based on the defect information; and a provision unit that provides information indicating the presence of the defect in the identified portion, which is displayed in an area corresponding to the identified portion on an exploded view of the vehicle body; and an information display device, wherein the provision unit provides the information to the information display device, and the information display device comprises a display unit that displays the information provided from the provision unit.

[0019] Another aspect of the present invention provides an information processing system for use in appraising used cars, the information processing system including an information processing device used in appraising used cars, the information processing device including an acquisition unit that acquires historical information regarding the collision, impact or accident history of the body of the used car, an identification unit that identifies the impact point received by the car body, the direction of the impact relative to the impact point and the magnitude of the impact based on the historical information, and a provision unit that provides information indicating the impact point, the direction and the magnitude to be displayed on an exploded view of the car body, and an information display device, the provision unit providing the information to the information display device, and the information display device including a display unit that displays the information provided by the provision unit. Effect of the Invention

[0020] According to the present invention, it is possible to appropriately provide information required for the appraisal of a used car without relying on the user's specialized knowledge or experience. [Brief description of the drawings]

[0021] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an information processing device according to an embodiment of the present invention. [Diagram 2] FIG. 4 is a diagram showing an example of a defect discrimination image according to the embodiment; [Diagram 3] 5A to 5C are diagrams illustrating an example of the type and size of defects according to the embodiment. [Figure 4] FIG. 1 is a diagram showing an example of a development view of a vehicle body according to an embodiment of the present invention; [Diagram 5] FIG. 13 is a diagram showing an example of a confirmation screen regarding defects in a specific portion according to the present embodiment. [Figure 6] FIG. 11 is a diagram showing another example of a development view of the vehicle body according to the embodiment. [Figure 7] FIG. 13 is a diagram showing an example of an input screen for a skeletal accident history according to the present embodiment. [Figure 8] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device according to the present embodiment. [Figure 9] 5 is a flowchart showing an example of a defect confirmation operation according to the present embodiment. [Figure 10]13 is a flowchart showing another example of the skeletal accident history input operation according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described with reference to the accompanying drawings, in which the same reference numerals denote the same or similar configurations.

[0023] (Configuration of information processing device) The information processing device according to the present embodiment is a device used for appraising a used car. The information processing device provides information required for appraising the used car on an exploded view of the body of the used car. The information required for appraising the used car is, for example, information on defects in the body (e.g., exterior) and / or information on the impact the body has received. In the following, an example of a mode in which the information on the defects and / or the information on the impact is displayed on the exploded view will be described.

[0024] In this embodiment, the provision by the information processing device may include various aspects (e.g., transmission, display, etc.) for providing the user with information required for the appraisal of a used car. For example, the provision may include transmitting information required for the appraisal of a used car identified by the information processing device to a terminal (which may be called an information display device) that displays the information on an exploded view, or may include the information processing device itself displaying the information on an exploded view.

[0025] <Function block configuration> Fig. 1 is a diagram showing an example of the configuration of an information processing system according to the present embodiment. As shown in Fig. 1, the information processing system 1 includes an information processing device 10 that identifies the information on the defect and / or the information on the impact, and a terminal 20 that displays the information on the defect and / or the information on the impact on a development view.

[0026] The information processing device 10 includes a defect information acquisition unit 11, a defect identification unit 12, a memory unit 13, a history information acquisition unit 14, an impact identification unit 15, and a transmission / reception unit 16. The defect information acquisition unit 11 and the history information acquisition unit 14 may constitute an acquisition unit of the present invention. The defect identification unit 12 and the impact identification unit 15 may constitute an identification unit of the present invention.

[0027] The defect information acquisition unit 11 acquires information about defects in a used car body (hereinafter referred to as "car body image") detected by image recognition of an image of the car body. Here, the car body image is an image of the car body, and may be a moving image or a still image taken of the car body from multiple directions. For example, the car body image may be multiple still images converted from a moving image of the exterior of the car body taken from a 360-degree direction, or may be a still image taken from multiple directions.

[0028] The defect information is information about a defect of the vehicle body detected by image recognition of the vehicle body image. The defect information indicates a position of the defect in the vehicle body image. The defect information may also indicate at least one of a type and a size of the defect.

[0029] Specifically, the defect information acquisition unit 11 may acquire an image in which the above-mentioned defect information is added to a vehicle body image (hereinafter, referred to as a "defect discrimination image"), and acquire the defect information.

[0030] Fig. 2 is a diagram showing an example of a defect detection image according to this embodiment. Fig. 2(a) to (f) show defect detection images in which the vehicle body is captured from directions that differ by 60 degrees each. Note that the defect detection images are not limited to those in which the vehicle body is captured from the directions shown in Fig. 2(a) to (f), and may be images in which the vehicle body is captured from a plurality of different directions.

[0031] 2(a) to (f), when a defect is detected by image recognition of the vehicle body image, defect information indicating the position and type of the defect is added to the defect detection image. For example, in the defect detection image shown in FIG. 2(a), since a defect is not detected by image recognition of the vehicle body image, the defect detection image does not need to include defect information.

[0032] On the other hand, in the defect discrimination images shown in Fig. 2(b) to (f), defects are detected by image recognition of the vehicle body image, so defect information indicating the position and type of the defect may be included. As shown in Fig. 2(b) to (f), the defect information may be, for example, a frame F surrounding the defect and a character string C indicating the type of the defect (e.g., scratch, dent, etc.). Note that the frame F and the character string C are merely examples, and the defect information indicating the position of the defect is not limited to the frame F, and the defect information indicating the type of the defect is not limited to the character string C. In addition, the defect information only needs to indicate at least the position of the defect, and does not need to indicate the type of the defect, and may indicate the size of the defect.

[0033] The defect identification unit 12 identifies a portion including a defect detected by image recognition of the vehicle body image based on the defect information acquired by the defect information acquisition unit 11. Here, a portion of the vehicle body is a predetermined area constituting the vehicle body. One portion may be composed of one or more parts constituting the vehicle body, or may be composed of a part obtained by dividing one part constituting the vehicle body. Furthermore, each portion may correspond to a predetermined area on a development view (described later) of the vehicle body.

[0034] Specifically, the defect identifying unit 12 may identify a portion including a defect based on defect information indicating the position of the defect (e.g., frame F in Figs. 2(b) to (f)). Specifically, the defect identifying unit 12 may map the presence of a defect to a predetermined portion on a development diagram of the vehicle body based on the position indicated by the defect information. The predetermined portion may be, for example, a portion corresponding to each region on the development diagram of Fig. 4 described later (e.g., the clearance lenses on the left and right sides of the vehicle body, etc.).

[0035] Furthermore, the defect identifying unit 12 may identify at least one of the type and size of the defect based on the defect information acquired by the defect information acquiring unit 11.

[0036] Specifically, the defect identification unit 12 may identify the type of defect based on defect information indicating the type of defect (e.g., character string C in Figs. 2(b) to (f)). Alternatively, the defect identification unit 12 may identify the type of defect based on defect information indicating the position of the defect (e.g., frame F in Figs. 2(b) to (f)). For example, the defect identification unit 12 may input an image of the area indicated by the defect information (e.g., frame F in Figs. 2(b) to (f)) to a predetermined algorithm stored in the memory unit 13 to identify the type of defect. The specified algorithm may be trained to generate defect type information corresponding to a defect image through machine learning based on an image showing a defect in a vehicle body (defect image) and information indicating the type of the defect (defect type information).

[0037] Furthermore, the defect identification unit 12 may identify the size of the defect based on defect information (not shown) indicating the size of the defect. Alternatively, the defect identification unit 12 may identify the size of the defect based on defect information indicating the position of the defect (for example, frame F in Fig. 2(b) to (f)). For example, the defect identification unit 12 may input an image of the area indicated by the defect information (for example, frame F in Fig. 2(b) to (f)) to a predetermined algorithm stored in the storage unit 13 to identify the size of the defect. The predetermined algorithm may be trained to generate defect size information corresponding to the defect image by machine learning based on an image indicating a defect of the vehicle body (defect image) and information indicating the size of the defect (defect size information).

[0038] FIG. 3 is a diagram showing an example of the type and size of a defect according to this embodiment. As shown in FIG. 3(a), the type of defect identified by the defect identification unit 12 may be identified by defect type information. Also, as shown in FIG. 3(b), the size of the defect identified by the defect identification unit 12 may be identified by defect size information. Note that FIG. 3 is merely an example, and the defect type and size are not limited to those shown in the figure. Also, the defect type information indicating the type and the defect size information indicating the size are not limited to those shown in the figure.

[0039] The history information acquisition unit 14 acquires information (hereinafter referred to as "history information") related to the history of collisions, impacts, or accidents of the vehicle body. Here, the history information may be, for example, at least one of the following, during a predetermined period before and after the occurrence of a vehicle body collision (accident): speed, accelerator operation, engine throttle, RPM, motor RPM, brake pedal, brake oil pressure, acceleration, steering wheel angle, and yaw rate. The history information may also be, for example, information recorded in an event data recorder (EDR) or a drive recorder. The history information may also be, for example, data retrieved by crash data retrieval (CDR).

[0040] The impact identification unit 15 identifies a point or area where an impact was received (hereinafter referred to as an "impact point") based on the history information acquired by the history information acquisition unit 14. The impact identification unit 15 may also identify the direction and magnitude of the impact with respect to the impact point based on the history information acquired by the history information acquisition unit 14.

[0041] The transmitting / receiving unit 16 transmits and / or receives information to and from the terminal 20. Specifically, the transmitting / receiving unit 16 transmits information indicating a portion in which a defect identified by the defect identification unit 12 exists to the terminal 20. The information may be displayed in an area corresponding to the portion on the development view of the vehicle body on the terminal 20. The transmitting / receiving unit 16 may also transmit to the terminal 20 defect type information indicating the type of the defect identified by the defect identification unit 12 and / or defect size information indicating the size of the defect. The defect type information and / or defect size information may be displayed in an area corresponding to the portion on the development view of the vehicle body on the terminal 20.

[0042] Furthermore, the transmitting / receiving unit 16 may transmit and / or receive information based on receipt of a predetermined operation by the user on the terminal 20. Specifically, when a predetermined operation (e.g., tap) by the user on an area corresponding to the specified part displayed on the terminal 20 is received, the transmitting / receiving unit 16 may transmit information indicating a list of types and / or sizes of defects expected in the part to the terminal 20. The list is displayed on the terminal 20. The transmitting / receiving unit 16 may receive information from the terminal 20 indicating the types and / or sizes of the defects reselected or cancelled by the user on the screen on which the list is displayed.

[0043] Furthermore, the transmitting / receiving unit 16 transmits to the terminal 20 information indicating the impact point identified by the impact identification unit 15, the direction of the impact relative to the impact point, and the magnitude of the impact. Furthermore, when a predetermined operation (e.g., tapping) by the user on an area corresponding to a specific skeleton on the development view of the terminal 20 is accepted, the transmitting / receiving unit 16 may transmit to the terminal 20 information indicating a list of accident histories expected for the skeleton. Furthermore, the transmitting / receiving unit 16 may receive from the terminal 20 information indicating the accident history of the skeleton selected by the user on the screen of the terminal 20 on which the list is displayed.

[0044] As shown in FIG. 1, the terminal 20 includes a transmitter / receiver 21, a defect display control unit 22, and an impact display control unit .

[0045] The transmitting / receiving unit 21 transmits and / or receives information between the information processing device 10. Specifically, the transmitting / receiving unit 21 may receive information indicating a portion in which a defect identified by the information processing device 10 exists from the information processing device 10. The transmitting / receiving unit 21 may also receive defect type information and / or defect size information to be displayed in the above-mentioned area.

[0046] The transmitting / receiving unit 21 may transmit to the information processing device 10 information indicating that a predetermined operation (e.g., tap) by the user on an area corresponding to the specified part displayed on the terminal 20 has been accepted by the input unit 10d, and may receive information indicating a list of types and / or sizes of defects expected in the part transmitted from the information processing device 10 based on the information. Furthermore, the transmitting / receiving unit 21 may transmit to the information processing device 10 information indicating the types and / or sizes of the defects reselected or cancelled by the user on the screen displaying the list.

[0047] The transmitting / receiving unit 21 receives information indicating the impact point specified by the information processing device 10, the direction of the impact on the impact point, and the magnitude of the impact. The transmitting / receiving unit 21 may also transmit to the information processing device 10 information indicating that a predetermined operation (e.g., tapping, etc.) by the user on an area corresponding to a specific skeleton on the development view displayed on the terminal 20 has been accepted by the input unit 10d, and receive information indicating a list of accident histories expected for the skeleton, transmitted from the information processing device 10 based on the information. The transmitting / receiving unit 21 may also transmit to the information processing device 10 information indicating the accident history of the skeleton selected by the user on the screen on which the list is displayed.

[0048] The defect display control unit 22 causes the output unit 10e (for example, a display) to display information indicating a portion where a defect identified by the information processing device 10 exists. The defect display control unit 22 may also cause the output unit 10e to display defect type information indicating the type of the defect identified by the information processing device 10 and / or defect size information indicating the size of the defect.

[0049] Specifically, the defect display control unit 22 may display, in an area on the developed view corresponding to the identified area, information indicating that a defect exists in that area (hereinafter referred to as "defect presence information"). Also, the defect display control unit 22 may display, in that area, defect type information indicating the type of the defect and / or defect size information indicating the size. On the other hand, the defect display control unit 22 may display, in an area on the developed view corresponding to a part where no defect exists, information indicating that no defect exists in that part (hereinafter referred to as "defect absence information").

[0050] Fig. 4 is a diagram showing an example of a development view of a vehicle body according to this embodiment. In Fig. 4, regions corresponding to each part of the vehicle body are shown on the development view of the vehicle body displayed on the output unit 10e of the terminal 20. For example, the following regions are shown on the development shown in Fig. 4. Areas 201L and 201R corresponding to the clearance lenses on the left and right sides of the vehicle Areas 202L and 202R corresponding to the first and second portions of the front bumper Areas 203L and 203R corresponding to the left and right headlights of the vehicle Area 204 corresponding to the grill Areas 205La, 205Lb, 205Ra and 205Rb corresponding to the first and second portions of the left and right fenders of the vehicle body Areas 206a and 206b corresponding to the first and second parts of the bonnet Areas 207La, 207Lb, 207Ra and 207Rb corresponding to the first and second parts of the front doors on the left and right sides of the vehicle body Areas 208La, 208Lb, 208Ra and 208Rb corresponding to the first and second portions of the rocker panels on the left and right sides of the vehicle body Areas 209La, 209Lb, 209Ra and 209Rb corresponding to the first and second parts of the rear doors on the left and right sides of the vehicle body Areas 210a and 210b corresponding to the first and second portions of the windshield Areas 211L and 211R correspond to the front pillars on the left and right sides of the vehicle body. Areas 212L and 212R correspond to the center pillars on the left and right sides of the vehicle body. Areas 213L and 213R corresponding to the rear pillars on the left and right sides of the vehicle Areas 214a and 214b corresponding to the first and second portions of the roof Areas 215La, 215Lb, 215Ra and 215Rb corresponding to the first and second portions of the left and right quarter panels of the vehicle body Areas 216a and 216b corresponding to the first and second portions of the trunk hood Areas 217L and 217R correspond to the front door windows on the left and right sides of the vehicle. Areas 218L and 218R correspond to the rear door glass on the left and right sides of the vehicle. Areas 219L and 219R correspond to the rear side windows on the left and right sides of the vehicle. Area 220 corresponding to rear window Areas 221Lb and 221Rb correspond to the left and right tail lights of the vehicle. Areas 222a and 222b corresponding to the first and second portions of the back panel Areas 223a and 223b corresponding to the first and second portions of the rear bumper Areas 224a and 224b corresponding to the left and right front wheels of the vehicle body Areas 225a and 225b corresponding to the left and right rear wheels of the vehicle -Area 226 for spare tire wheel Areas 227R and 227L corresponding to the front wheel grooves on the left and right sides of the vehicle Areas 228R and 228L corresponding to the rear wheel grooves on the left and right sides of the vehicle Area 229 corresponding to spare tire wheel groove

[0051] 4 is merely an example, and the number of parts constituting the development view, the positions of the areas corresponding to the parts, the display format, etc. are not limited to those shown in the figure. In addition, the development view may include areas other than those described above, as long as at least one of the above areas is shown.

[0052] For example, in Fig. 4, it is assumed that the defect identification unit 12 identifies a "first portion of the bonnet" and a "second portion of the roof" as portions in which a defect exists. In this case, the defect display control unit 22 displays defect presence information indicating the presence of a defect in an area 206a corresponding to the first portion of the bonnet and an area 214b corresponding to the second portion of the roof, as shown in Fig. 4. On the other hand, the defect display control unit 22 may display defect absence information indicating the absence of a defect in areas corresponding to the other portions.

[0053] Furthermore, as shown in FIG. 4, the defect display control unit 22 may display defect type information and / or defect size information identified by the defect identification unit 12 in areas 206a and 214b corresponding to the areas where the defects exist, respectively.

[0054] 4, for example, it is assumed that the type of defect present in the first portion of the bonnet, "dent accompanied by scratch," and the size, "10 cm or less," are identified by the defect identification unit 12. Therefore, the defect display control unit 22 displays the defect type information "B" indicating "dent accompanied by scratch" and the defect size information "1" indicating "10 cm or less" in the area 206a corresponding to the first portion of the bonnet (see FIG. 3).

[0055] 4, it is assumed that the type of defect present in the second portion of the roof, "scratch", and its size, "more than 10 cm and equal to or less than 20 cm", are identified by the defect identification unit 12. Therefore, the defect display control unit 22 displays defect type information "A" indicating "scratch" and defect size information "2" indicating "more than 10 cm and equal to or less than 20 cm" in the area 214b corresponding to the second portion of the roof (see FIG. 3).

[0056] Although not shown, when multiple defects exist in the same area, the defect display control unit 22 may display multiple defect type information indicating the type of each of the multiple defects and / or multiple defect size information indicating the size of each of the multiple defects in the area corresponding to the same area on the unfolded view.

[0057] Furthermore, when a predetermined operation (e.g., tapping, etc.) by the user on an area corresponding to a specific portion on the development view is accepted by the input unit 10d, the defect display control unit 22 may display a screen (hereinafter, referred to as a "confirmation screen") showing a list of types and / or sizes of defects expected in the specified portion. In the confirmation screen, the input unit 10d may accept reselection or cancellation of the types and / or sizes of the defects by the user.

[0058] Fig. 5 is a diagram showing an example of a confirmation screen regarding defects in a specific portion according to the present embodiment. Fig. 5 shows an example of the confirmation screen when, for example, a predetermined operation (e.g., tap) by a user on an area 214b corresponding to the second portion of the roof on the development shown in Fig. 4 is received by the input unit 10d.

[0059] As shown in Fig. 5, the confirmation screen may display a list of defect type information and defect size information expected in the specific portion corresponding to the area where the predetermined operation was received. For example, in Fig. 5, the specific portion is the second portion of the roof, and glass scratches are not expected. Therefore, the confirmation screen shown in Fig. 5 does not display defect type information "G" indicating glass scratches shown in Fig. 3(a).

[0060] Furthermore, in the second portion of the roof, the sizes of rust, corrosion, painting required, and repair marks of defect type information "S", "C", "P", and "W" are not expected to exceed 40 cm. For this reason, the confirmation screen shown in FIG. 5 does not show defect size information "4", which indicates a size exceeding 40 cm. Furthermore, for defect type information "X" and "XX" indicating need for replacement and replaced, as shown in FIG. 5, defect size information does not need to be displayed. In this way, it may be predetermined for each portion which defect type information and / or defect size information to include in the list on the confirmation screen.

[0061] In Fig. 5, similarly to Fig. 4, the type of defect present in the second portion of the roof, "scratch", and its size, "more than 10 cm and equal to or less than 20 cm", have been identified by the defect identification unit 12. For this reason, on the confirmation screen shown in Fig. 5, defect type information "A" indicating the defect type "scratch" and defect size information "2" indicating the size, "more than 10 cm and equal to or less than 20 cm", have been selected.

[0062] The user can, for example, visually check the second portion of the roof from the defect discrimination image to determine the validity of the defect type information "A" and the defect size information "2" displayed on the confirmation screen. Based on the results of checking the defect discrimination image, the user may reselect different defect type information and / or defect size information on the confirmation screen, or may cancel the selection.

[0063] For example, if the size of the defect in the second portion of the roof confirmed by the user from the defect discrimination image exceeds 20 cm, the user may reselect the defect type information "A" and the defect size information "3" on the confirmation screen and perform a predetermined operation (for example, tapping "OK"). Also, if there is no defect in the second portion of the roof in the defect discrimination image, the user may deselect the defect type information "A" and the defect size information "2" on the confirmation screen and perform a predetermined operation (for example, tapping "OK").

[0064] The impact display control unit 23 causes the output unit 10e (e.g., a display) to display information indicating the impact point identified by the impact identification unit 15, the direction of the impact relative to the impact point, and the magnitude of the impact. Hereinafter, the information indicating the direction of the impact is referred to as "impact direction information" and the information indicating the magnitude of the impact is referred to as "impact value." For example, a G value may be used as the impact value.

[0065] Specifically, the impact display control unit 23 may display the impact point identified by the impact identification unit 15, the impact direction information, and / or the impact value on a development view of the vehicle body.

[0066] Fig. 6 is a diagram showing another example of the development of the vehicle body according to the present embodiment. In Fig. 6, the development of the vehicle body displayed on the output unit 10e of the terminal 20 shows areas corresponding to each skeleton that affects the impact on the vehicle body. For example, the development shown in Fig. 6 shows the following areas: -Front bumper corresponding area 301 Areas 302L and 302R corresponding to the left and right headlights of the vehicle Area corresponding to the grill 303 -Areas 304L and 304R corresponding to the left and right fenders of the vehicle Areas 305L and 305R correspond to the front pillars on the left and right sides of the vehicle. Areas 306L and 306R correspond to the center pillars on the left and right sides of the vehicle - Areas 307L and 307R corresponding to the left and right quarter panels of the vehicle -Areas 308L and 308R corresponding to the rear pillars on the left and right sides of the vehicle Areas 309L and 309R correspond to the left and right tail lights of the vehicle -Trunk hood corresponding area 310 -Area 311 corresponding to rear bumper

[0067] 6 is merely an example, and the number of skeletons constituting the development, the positions of the regions corresponding to the skeletons, the display format, etc. are not limited to those shown in the figure. In addition, the development may show at least one of the above regions, and may have regions other than the above. In addition, the skeleton may be simply called a region, and may overlap with at least one of the regions shown in FIG. 5.

[0068] For example, in FIG. 6, the impact display control unit 23 displays arrows indicating the direction of the impact as impact direction information for each of the two impact points identified by the impact identification unit 15. The impact display control unit 23 also displays G values ​​(for example, 3.0G and 5.0G in FIG. 6) indicating the magnitude of the impact as impact values ​​for each of the two impact points identified by the impact identification unit 15. The impact display control unit 23 also displays the positions indicated by the two arrows as impact points. Note that FIG. 6 is merely an example, and the information indicating the impact direction information, impact values, and impact points is not limited to those shown in the figure. For example, a ● may not be displayed as the impact point, and the impact point may be indicated by the tip of the arrow.

[0069] Furthermore, when a predetermined operation (e.g., tapping, etc.) by the user on an area corresponding to a specific skeleton on the development view is accepted by the input unit 10d, the impact display control unit 23 may display a screen (hereinafter, referred to as an "input screen") showing a list of accident histories assumed for the skeleton. In the input screen, the input unit 10d may accept a selection of the accident history by the user. Also, which accident histories are to be included in the list on the input screen may be determined in advance for each skeleton.

[0070] 7 is a diagram showing an example of an input screen for inputting the accident history of the frame according to the present embodiment. For example, an example of the input screen is shown when a predetermined operation (e.g., tap) by the user on the area 301 corresponding to the rear bumper on the development view shown in FIG. 6 is received by the input unit 10d.

[0071] As shown in FIG. 7, the input screen may display a list of accident histories of the skeleton corresponding to the area where the predetermined operation is accepted. For example, in FIG. 7, distortion, repair marks, need to be replaced, and replaced are displayed as the skeleton accident history, and "U", "W", "X", and "XX" are displayed as information indicating these, respectively (hereinafter, "skeleton accident history information"). The user may select the skeleton accident information of the skeleton based on the impact direction information, impact value, and impact point shown in FIG. 6. Furthermore, when the selection of the skeleton accident history information on the input screen is completed, the user may perform a predetermined operation (for example, tapping "OK").

[0072] <Hardware configuration> Next, the hardware configuration of the information processing device 10 and the terminal 20 according to this embodiment will be described. As shown in Fig. 8, the information processing device 10 and the terminal 20 each have a CPU (Central Processing Unit) 10a corresponding to a calculation device, a storage device 10b, a communication unit 10c, an input unit 10d, and an output unit 10e. These components are connected via a bus so that they can transmit and receive data to each other. In this example, the information processing device 10 is configured by one computer, but may be configured by multiple computers.

[0073] The CPU 10a is a control unit that controls the execution of the programs stored in the storage device 10b and performs calculations and processing of data. The CPU 10a may be a calculation device (also called a calculation unit, control unit, control device, etc.) that executes at least one of an information processing program that provides information indicating the presence of a defect in a specified part, which is displayed in an area corresponding to a part specified based on defect information on a development view of the vehicle body, and an information processing program that provides information indicating an impact point on the development view of the vehicle body specified based on history information, the direction of the impact at the impact point, and the magnitude of the impact. The CPU 10a receives various input data from the input unit 10d and / or the communication unit 10c, and outputs (for example, displays) the calculation results of the input data to the output unit 10e, stores the input data in the storage device 10b, or transmits the input data via the communication unit 10c.

[0074] The storage device 10b is at least one of a memory, a hard disk drive (HDD), and a solid state drive (SSD). The storage device 10b of the information processing device 10 may constitute the storage unit 13. The storage device 10b of the information processing device 10 may store an information processing program executed by the CPU 10a.

[0075] The communication unit 10c is an interface that connects the information processing device 10 to an external device. The communication unit 10c may receive at least one of the defect information (or the defect discrimination image) and the history information transmitted from another device. The communication unit 10c may also output at least one of the defect information (or the defect discrimination image) and the history information to the storage device 10b under the control of the CPU 10a. The defect information acquisition unit 11 may acquire the defect information (or the defect discrimination image) from the communication unit 10c or the storage device 10b. The history information acquisition unit 14 may acquire the history information from the communication unit 10c or the storage device 10b. The transmission / reception units 16 and 21 may be configured by the communication unit 10c.

[0076] The input unit 10d receives data input from a user and may include, for example, at least one of a keyboard, a mouse, a touch panel, and a microphone. The input unit 10d may receive a predetermined operation by the user (for example, tapping a predetermined area on the display, etc.).

[0077] The output unit 10e outputs the calculation results by the CPU 10a, and may be composed of at least one of a display such as an LCD (Liquid Crystal Display) and a speaker. The output unit 10e may display a development diagram (e.g., FIG. 4) and a confirmation screen (e.g., FIG. 5) under the control of the defect display control unit 22. The output unit 10e may also display a development diagram (e.g., FIG. 6) and an input screen (e.g., FIG. 7) under the control of the impact display control unit 23. The output unit 10e may constitute the display unit of the present invention.

[0078] The information processing program may be provided by being stored in a computer-readable storage medium such as the storage device 10b, or may be provided via a network connected by the communication unit 10c. The storage medium storing the information providing program may be a non-transitory computer-readable storage medium. The non-transitory storage medium is not particularly limited, and may be, for example, a storage medium such as a USB memory, a CD-ROM, or a DVD.

[0079] In the information processing device 10, the CPU 10a executes an information processing program to realize the operations of the defect information acquisition unit 11, defect identification unit 12, history information acquisition unit 14, impact identification unit 15, etc. In the terminal 20, the CPU 10a executes an information processing program to realize the operations of the defect display control unit 22, impact display control unit 23, etc. Note that these physical configurations are merely examples and do not necessarily have to be independent configurations. For example, the information processing device 10 may include an LSI (Large-Scale Integration) in which the CPU 10a and the storage device 10b are integrated.

[0080] The configuration of the information processing system 1 is merely an example and is not limited to the above. For example, in the above, an example was described in which the terminal 20 displays information specified by the information processing device 10 on the development diagram (for example, information indicating the part where the defect exists, defect type information, defect size information, impact point, and the direction and magnitude of the impact relative to the impact point, etc.), but the information processing device 10 itself may display the information on the development diagram. In the latter case, the information processing device 10 may be equipped with a defect display control unit 22 and an impact display control unit 23 described later, and the information processing system 1 may or may not include the terminal 20. In addition, the providing unit of the present invention may be composed of the transmitting / receiving unit 16 in the former case, and may be composed of the output unit 10e equipped in the information processing device 10 in the latter case.

[0081] (Information processing method) The operations of the information processing device 10 and the terminal 20 will be described with reference to Figs. 9 and 10. Note that the flowcharts shown in Figs. 9 and 10 are merely examples, and the defect confirmation operation and the frame accident history input operation of the information processing device 10 are not limited to those shown in the drawings. For example, various modifications may be made, such as omission of some steps, addition of steps not shown, and rearrangement of the order. For example, in Figs. 9 and 10, the terminal 20 displays an exploded view of the vehicle body, but the information processing device 10 itself may display the exploded view of the vehicle body. In the latter case, the terminal 20 in the following description may be rephrased as the information processing device 10.

[0082] <Defect confirmation operation> Fig. 9 is a flowchart showing an example of a defect confirmation operation according to the present embodiment. As shown in Fig. 9, the information processing device 10 acquires defect information related to a defect in a vehicle body detected by image recognition of a vehicle body image (step S101). Specifically, the information processing device 10 may acquire a defect discrimination image (e.g., Figs. 2(a) to (f)) in which the defect information is added to the vehicle body image, and recognize the defect information.

[0083] The information processing device 10 identifies the area including the defect, and the type and size of the defect based on the defect information acquired in step S101 (step S102). Note that in step S102, the information processing device 10 only needs to identify at least the area including the defect, and may omit identifying the type and / or size of the defect. The information processing device 10 transmits information indicating the area identified in step S102 (and defect type information and / or defect size information) to the terminal 20.

[0084] The terminal 20 displays defect presence information indicating the presence of the defect in an area corresponding to the portion specified in step S102 on the development view of the vehicle body (step S103). For example, as shown in Fig. 4, the terminal 20 may display the defect type information and / or defect size information in addition to the defect presence information in the area corresponding to the specified portion.

[0085] The terminal 20 judges whether or not a predetermined operation (e.g., tapping, etc.) on an area corresponding to a specific portion on the development diagram displayed in step S103 has been accepted by the input unit 10d (step S104). If the predetermined operation has been accepted (step S104; Yes), the terminal 20 may receive information indicating a list of types and / or sizes of defects expected in the specific portion from the information processing device 10, and may display a confirmation screen regarding defects in the specific portion on the output unit 10e based on the information, for example, as shown in FIG. 5 (step S105). If the predetermined operation has not been accepted (step S104; No), the operation proceeds to step S107.

[0086] The terminal 20 judges whether or not completion of a predetermined operation by the user on the confirmation screen displayed in step S105 has been detected (step S106). The predetermined operation may be, for example, reselection or cancellation of the type and / or size of the specific defect. Information indicating the reselected or cancelled type and / or size may be notified from the terminal 20 to the information processing device 10 and stored in the information processing device 10.

[0087] When the completion of the user's predetermined operation on the confirmation screen is detected (step S106; Yes), the terminal 20 judges whether or not the completion of confirmation of the development drawing is detected (step S107). When the completion of confirmation of the development drawing is detected (step S107; Yes), this operation ends. On the other hand, when the completion of confirmation of the development drawing is not detected, this operation returns to step S103. Note that the completion of confirmation of the development drawing may be detected when a predetermined operation (e.g., tapping on a predetermined area) by the user on the display screen of the development drawing is accepted.

[0088] According to the above defect confirmation operation, the part where the defect exists is identified based on the defect information detected by image recognition of the image of the vehicle body, so the user does not need to visually identify the part where the defect exists. Therefore, it is possible to appropriately provide information indicating the part where the defect exists, which is necessary for the appraisal of a used car, without relying on the user's specialized knowledge or experience. In addition, since the defect existence information is displayed in the area corresponding to the part on the development view, the user can easily recognize the part where the defect exists.

[0089] In addition, since the type and / or size of the defect is identified based on the defect information detected by image recognition of the vehicle body image, the user does not need to visually identify the type and / or size of the defect. Therefore, it is possible to appropriately provide information indicating the type and / or size of the defect required for the appraisal of a used car without relying on the user's specialized knowledge or experience.

[0090] In addition, when a user's predetermined operation on the area corresponding to the specified part is accepted, the screen showing a list of the defect types and / or sizes expected in the specified part accepts the user's reselection or cancellation of the defect type and / or size. This allows the user to confirm and correct the validity of the defect type and / or size specified based on the defect information.

[0091] <Skeletal accident history input operation> 10 is a flowchart showing an example of a frame accident history input operation according to the present embodiment. As shown in FIG 10, the information processing device 10 acquires history information related to the history of collisions, impacts, or accidents of the vehicle body (step S201).

[0092] The information processing device 10 identifies the impact point on the vehicle body and the direction and magnitude of the impact relative to the impact point based on the history information acquired in step S201 (step S202). The information processing device 10 transmits information indicating the impact point identified in step S202 and the direction and magnitude of the impact relative to the impact point to the terminal 20.

[0093] The terminal 20 displays the information indicating the impact point identified in step S202, the impact direction information, and the impact value on the development view of the vehicle body (step S203). For example, as shown in Fig. 6, the terminal 20 may display the information indicating the impact point, an arrow as the impact direction information, and the impact value (e.g., G value) on the development view.

[0094] The terminal 20 judges whether or not a predetermined operation (e.g., tapping, etc.) for a region corresponding to a specific skeleton on the development diagram displayed in step S203 is accepted by the input unit 10d (step S204). If the predetermined operation is accepted (step S204; Yes), the terminal 20 may receive information indicating a list of accident histories expected for the skeleton from the information processing device 10, and may display an input screen regarding the accident history of the specific skeleton on the output unit 10e based on the information, for example, as shown in Fig. 7 (step S205). The region corresponding to which skeleton the predetermined operation is to be performed may be determined by the user based on the information indicating the impact point, the impact direction information, and the impact value displayed on the development diagram.

[0095] The terminal 20 judges whether or not completion of a predetermined operation by the user on the input screen displayed in step S205 has been detected (step S206). The predetermined operation may be, for example, selection of the skeleton accident history information of the skeleton. The selected skeleton incident history information may be notified from the terminal 20 to the information processing device 10 and stored in the information processing device 10.

[0096] When the completion of the user's predetermined operation on the input screen is detected (step S206; Yes), the terminal 20 judges whether or not the completion of confirmation of the development drawing is detected (step S207). When the completion of confirmation of the development drawing is detected (step S207; Yes), this operation ends. On the other hand, when the completion of confirmation of the development drawing is not detected, this operation returns to step S203.

[0097] According to the above frame accident history input operation, the impact point, impact direction and magnitude are identified based on the history information related to the collision, impact or accident history of the vehicle body, so the user does not need to visually identify the impact point, impact direction and magnitude. Therefore, it is possible to appropriately provide information indicating the impact point, impact direction information and impact value required for the appraisal of a used car without relying on the user's specialized knowledge or experience.

[0098] In addition, when a user's predetermined operation is accepted for an area corresponding to a specific skeleton based on the impact point, impact direction information, and impact value displayed in the development view, a screen showing a list of accident histories expected for the specified skeleton is displayed, allowing the user to appropriately select an accident history for the skeleton from the list.

[0099] As described above, the information processing device 10 according to the present embodiment can provide information required for appraisal of a used car appropriately, without relying on the user's specialized knowledge or experience.

[0100] The above-described embodiments are intended to facilitate understanding of the present invention, and are not intended to limit the present invention. The elements of the embodiments, as well as their arrangements, materials, conditions, shapes, sizes, etc., are not limited to those shown as examples and can be changed as appropriate. In addition, configurations shown in different embodiments can be partially substituted or combined with each other. [Explanation of symbols]

[0101] 10...information processing device, 20...terminal, 11...defect information acquisition unit, 12...defect identification unit, 13...storage unit, 14...history information acquisition unit, 15...impact identification unit, 16...transmission / reception unit, 21...transmission / reception unit, 22...defect display control unit, 23...impact display control unit, 10a...CPU, 10b...storage device, 10c...communication unit, 10d...input unit, 10e...output unit

Claims

1. An information processing device used for appraisal of used cars, an acquisition unit that acquires defect information regarding defects in the vehicle body by image recognition of a moving image of the body of the used vehicle captured from a plurality of directions or a plurality of still images converted from the moving image; and an identification unit that identifies a portion where the defect exists based on the defect information.

2. a providing unit that provides information indicating the presence of the defect in the specified portion; The information processing apparatus according to claim 1 , further comprising:

3. the providing unit provides information indicating the presence of the defect in the identified portion in an area corresponding to the identified portion on the development view of the vehicle body. The information processing device according to claim 2 .

4. The providing unit further provides information indicating that the defect does not exist, the information being displayed in an area corresponding to the portion not identified on the development view of the vehicle body.

4. The information processing device according to claim 2 or 3.

5. The identification unit identifies a type and a size of the defect based on the defect information, The providing unit provides information indicating a type and a size of the identified defect. The information processing device according to claim 2 .

6. the providing unit provides information indicating a list of types and / or sizes of the defects expected in the identified portion when a predetermined operation by a user on an area corresponding to the identified portion is accepted; A user's reselection or cancellation of the type and / or size of the defect is accepted on the screen on which the list is displayed. The information processing device according to claim 5 .

7. An information processing device according to any one of claims 2 to 6; An information display device; Equipped with The providing unit provides the information to the information display device, The information display device is a display unit that displays the information provided by the providing unit; An information processing system comprising:

Images