Information processing system, program, and information processing method

Abstract

To provide an information processing system which more appropriately determines a damage to a lease car.SOLUTION: In the information processing system, a server device comprises one or more processors. The processor includes: an acquisition step of acquiring image data of a lease car being a vehicle that is an object of car lease and reference data at least used in reference to a degree of damage to the lease car in the image; and a first output step of outputting damage information being information about the damage of the lease car on the basis of the image data and the reference data.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing system, a program, and an information processing method. [Background technology]

[0002] In the prior art, there is known an improvement in the technology for presenting vehicle lease plans suitable for users (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-158527 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, there has been a demand for technology that can more appropriately determine damage to leased cars.

[0005] In view of the above circumstances, the present invention provides a technology that can more appropriately determine damage to a leased car. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing system. The information processing system includes at least one processor that executes the following steps: In the acquisition step, image data, which is an image of a leased car, and reference data that is used at least to refer to the degree of damage to the leased car in the image are acquired, the leased car being a vehicle that is the subject of a car lease; In the first output step, damage information is output based on the image data and the reference data, and the damage information is information regarding damage to the leased car.

[0007] According to the present disclosure, it is possible to provide a technology that can more appropriately determine damage to a leased car. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing the overall configuration of an information processing system 1. FIG. [Figure 2] 2 is an example of a block diagram showing functions realized by a processor 21 of the server device 2. FIG. [Figure 3] FIG. 10 is an example of an activity diagram showing an overview of information processing when a contracted driver returns a leased car. [Figure 4] FIG. 10 is an example of an activity diagram showing an overview of information processing when a collection driver returns a leased car. [Figure 5] FIG. 2 is a diagram showing an example of an input screen 5. [Figure 6] FIG. 10 is a diagram showing an example of a post-determination screen 6. [Figure 7] FIG. 10 is a diagram showing an example of a post-determination details screen 7. [Figure 8] FIG. 10 is a diagram showing an example of an agreement screen 8. [Figure 9] FIG. 10 is a diagram for explaining a trained model 92. DETAILED DESCRIPTION OF THE INVENTION

[0009] [Embodiment] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings. Various features shown in the following embodiments can be combined with each other.

[0010] 1. Definitions The program for realizing the software appearing in this embodiment may be provided as a non-transitory computer-readable medium, or may be provided so that it can be downloaded from an external server, or may be provided so that the program is started on an external computer and its functions are realized on a client device (so-called cloud computing).

[0011] In this embodiment, the term "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. Furthermore, this embodiment handles various types of information, which may be represented by, for example, physical values of signal values representing voltages and currents, high and low signal values as a binary bit set consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculations may be performed on the circuit in the broad sense.

[0012] In a broad sense, a circuit is a circuit realized by at least an appropriate combination of a circuit, circuitry, a processor, a memory, etc. That is, a circuit includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc. The circuit also includes a serverless architecture that uses container-based services to run applications in an environment abstracted from the management of physical infrastructure.

[0013] In this specification, the term "acquire" may be a concept that includes both receiving data or the like from another device and generating data or the like by oneself.

[0014] "Car leasing" refers to a service in which a contracted driver rents a leased car by paying a usage fee as a lease fee. In this specification, a car lease is a service in which the leasing company is registered as the owner of the leased car, and the contracted driver is registered as the user of the leased car. If the vehicle to be leased is a car, motorcycle, or other vehicle with a vehicle inspection certificate, the owner and user may be registered on the vehicle inspection certificate. A car lease may be established, for example, by a contract such as a lease agreement between the leasing company and the contracted driver.

[0015] A "lease car" is a vehicle that is subject to car leasing. A vehicle is an object that can move in response to the driver's operation. A vehicle may be an object that a driver can operate while riding in, and may include, for example, automobiles, motorcycles and other saddle-ride vehicles, kick scooters, boats, airplanes, etc.

[0016] "Driver" means a person who operates a leased car. Drivers include contract drivers and recovery drivers. A contract driver is a driver who drives a leased car as the user of the leased car based on a car lease. A recovery driver is a driver who recovers a leased car used by a contract driver.

[0017] 2. System Configuration In this section, the system configuration of the information processing system 1 according to this embodiment will be described.

[0018] [Information Processing System 1] The information processing system 1 in FIG. 1 includes a server device 2, a collection driver terminal 3, a contract driver terminal 4, and a network N. Here, the system exemplified as the information processing system 1 is made up of one or more devices or components. Therefore, the system exemplified as the information processing system 1 includes the server device 2 alone, the collection driver terminal 3 alone, or the contract driver terminal 4 alone. The server device 2, the collection driver terminal 3, and the contract driver terminal 4 are each an example of an information processing device. The server device 2, the collection driver terminal 3, and the contract driver terminal 4 each execute the processing according to the embodiment. The collection driver terminal 3 and the contract driver terminal 4 can be in any form, such as a smartphone, tablet terminal, computer, or any other device that can access the server device 2 via a telecommunications line.

[0019] [Server device 2] 1, the server device 2 includes a processor 21, a storage unit 22, and a communication unit 23, and these components are electrically connected within the server device 2.

[0020] The processor 21 is, for example, a central processing unit (CPU) not shown. The processor 21 realizes various functions related to the information processing system 1 by reading out specific programs stored in the storage unit 22. In other words, information processing by software stored in the storage unit 22 is specifically realized by the processor 21, which is an example of hardware, and can be executed as each functional unit included in the processor 21. These will be described in more detail in the next section. The processor 21 is not limited to being single, and may be implemented with multiple processors 21 for each function. Furthermore, multiple processors may be configured to be distributed across multiple servers, or a combination thereof may be used.

[0021] The storage unit 22 stores various pieces of information defined above. This can be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs and the like related to the information processing system 1 executed by the processor 21, or as a memory such as a random access memory (RAM) that stores temporarily required information (arguments, arrays, etc.) related to the program operations. The storage unit 22 stores various programs, variables, etc. related to the information processing system 1 executed by the processor 21. The storage unit 22 is an example of a recording medium.

[0022] The communication unit 23 is configured to be able to transmit various electrical signals from the server device 2 to external components. The communication unit 23 is also configured to be able to receive various electrical signals from the external components to the server device 2. More preferably, the communication unit 23 has a network communication function, which allows various pieces of information to be communicated between the server device 2 and external devices via electrical communication lines.

[0023] [Collection Driver Terminal 3] The collection driver terminal 3 is a terminal used by a collection driver. As shown in Fig. 1 , the collection driver terminal 3 includes a processor 31, a storage unit 32, a communication unit 33, an input unit 34, an output unit 35, and an imaging unit 36, and these components are electrically connected within the collection driver terminal 3. The processor 31, the storage unit 32, and the communication unit 33 may differ in performance and detailed specifications, but have similar hardware characteristics to the processor 21, the storage unit 22, and the communication unit 23 of the server device 2.

[0024] The input unit 34 may be included in the housing of the collection driver terminal 3 or may be externally attached. For example, the input unit 34 may be implemented as a touch panel integrated with a display unit. A touch panel allows a user to input tapping, swiping, and the like. Of course, a switch button, a mouse, a QWERTY keyboard, or the like may be used instead of a touch panel. That is, the input unit 34 accepts an operation input made by the user. The input is transferred as a command signal to the processor 31 via a communication bus, and the processor 31 can execute specific control or calculation as necessary.

[0025] The output unit 35 may be included in the housing of the collection driver terminal 3, or may be externally attached. The output unit 35 displays a screen of a graphical user interface (GUI) that can be operated by a user. It is preferable that such an output unit 35 is implemented by selectively using display devices such as a CRT display, a liquid crystal display, an organic EL display, and a plasma display depending on the type of the collection driver terminal 3. Here, the output unit 35 will be described as being included in the housing of the collection driver terminal 3.

[0026] The imaging unit 36 is a so-called camera configured to be able to extract information of the external world as an image. The extracted image is saved with an arbitrary file extension. The image may include a video. The imaging unit 36 may be configured as being built into the collection driver terminal 3, or may be configured as being external to the collection driver terminal 3.

[0027] [Contract driver terminal 4] The contract driver terminal 4 is a terminal used by a contract driver. The contract driver terminal 4 has a processor 41, a memory unit 42, a communication unit 43, an input unit 44, an output unit 45, and an imaging unit 46, and these components are electrically connected via a communication bus inside the contract driver terminal 4. For the processor 41, memory unit 42, and communication unit 43 of the contract driver terminal 4, please refer to the processor 21, memory unit 22, and communication unit 23 of the server device 2. For the input unit 44, output unit 45, and imaging unit 46 of the contract driver terminal 4, please refer to the input unit 34, output unit 35, and imaging unit 46 of the collection driver terminal 3.

[0028] 2. Functional configuration of information processing system 1 In this section, the functional configuration of the processor 21 of this embodiment will be described with reference to Fig. 2. Fig. 2 is an example of a block diagram showing functions realized by the processor 21 of the server device 2. The processor 21 of the server device 2, which is an example of the information processing system 1, includes an information receiving unit 210, an information output unit 211, an information storage unit 212, and a learning unit 213. As described above, information processing by software stored in the storage unit 22 is specifically realized by the processor 21, which is an example of hardware, and can be executed as each functional unit included in the processor 21.

[0029] The information receiving unit 210 receives, receives, or acquires various information from other terminals or systems via the network N and the communication unit 23. The other terminals include the collection driver terminal 3 and the contract driver terminal 4. The information receiving unit 210 executes an acquisition step, a first reception step, a second reception step, and a third reception step.

[0030] The information output unit 211 outputs various information. The output destination may be another terminal or system in addition to the storage unit 22. When the output destination is another terminal or system, the information output unit 211 outputs or transmits the various information to the other terminal or system via the communication unit 23 and the network N. The various information output to the collection driver terminal 3 or the contract driver terminal 4 includes display information. Here, display information is a concept that includes not only the information itself generated in a manner that is visible to the user, such as a screen, image, icon, text, etc., but also rendering information for displaying the information. Based on the display information, the processor 31 or the processor 41 causes the output unit 35 or the output unit 45, which serves as a display unit, to display the information. The information output unit 211 executes a notification step, a first output step, and a second output step.

[0031] The information storage unit 212 stores any information in the storage unit 22. The information storage unit 212 executes a first information storage step and a second information storage step.

[0032] The learning unit 213 executes a process for constructing / updating a trained model. The learning unit 213 executes a learning step.

[0033] Specific information processing by the information receiving unit 210, the information output unit 211, the information storage unit 212, and the learning unit 213 will be described later.

[0034] 3. Information Processing System 1 Next, an example of a preferable information process executed by the information processing system 1 of this embodiment will be described.

[0035] 3.1. Overview of Information Processing An overview of the information processing of this embodiment will be explained with reference to Figures 3 and 4. In this embodiment, an example will be explained in which the contracted driver does not return the leased car directly to the leasing company, but rather the collection driver temporarily receives the leased car and transports it to the leasing company. Figure 3 is an example of an activity diagram showing an overview of the information processing when the contracted driver returns the leased car. This activity is executed when the contracted driver finishes using the leased car and hands it over to the collection driver. In activities A1 to A7, the collection driver uses the collection driver terminal 3 to check whether the leased car handed over by the contracted driver has any damage and to what extent. In activities A8 to A16, the contracted driver uses the contracted driver terminal 4 to reach an agreement on the damage confirmed by the collection driver.

[0036] [Activity A1] The processor 31 of the collection driver terminal 3 acquires image data of the leased car handed over from the contracted driver by the imaging unit 36. At this time, the processor 31 may also acquire input of reference data via the input unit 34. Activity A1 will be described later with reference to FIG. 5.

[0037] The image data is data of images related to a leased car. The image data may be composed of multiple images. For example, the image data may be composed of multiple images of a leased car captured from various directions. The various directions may include the front, rear, right side, left side, left front diagonal (a position halfway between the front and left side), right front diagonal (a position halfway between the front and right side), left rear diagonal (a position halfway between the rear and left side), right rear diagonal (a position halfway between the rear and right side), etc. of the leased car. The various directions correspond to the direction of capture. The image data may also be images of objects or documents containing information about the leased car, such as a vehicle inspection certificate or a lease agreement.

[0038] The reference data is data used at least to reference the degree of damage to the leased car in the image. For example, the reference data is data that can reference the degree of damage to the leased car in the image based on any object contained in the image that can reference its actual size. More specifically, the reference data is data indicating the size of the leased car. Even more specifically, the reference data may be data indicating the height, width, or length of the leased car, or data indicating the scale of the image. The reference data may also be data that can identify the leased car by combining the brand name, grade name, model, engine displacement, price, model name, chassis number, etc. of the leased car. Once the vehicle can be identified, the size of the leased car can be determined. With this configuration, damage information is output using data on the size of the leased car, allowing the user to verify the size of the damaged area, for example.

[0039] [Activity A2] The processor 31 of the collection driver terminal 3 transmits the acquired image data and reference data to the server device 2 via the communication unit 33 and the network N.

[0040] [Activity A3] The information receiving unit 210 acquires image data and reference data. In acquiring the reference data, in addition to acquiring data input from a user, the information receiving unit 210 may acquire the reference data by referring to the reference data stored in the storage unit 22, or by referring to a predetermined database via the network N.

[0041] [Activity A4] The information output unit 211 outputs damage information based on the image data and the reference data. An example of output of damage information will be described later with reference to Fig. 9. With this configuration, it is possible to output information regarding damage to the leased car based on the image of the leased car and the reference data.

[0042] Damage information is information regarding damage to a leased car. The damage information may be information regarding whether damage has occurred to the leased car. The damage information may also include information regarding whether damage to the leased car will result in compensation. The damage information may also include information regarding the extent of damage and the location of the damage. The extent of damage indicates the extent of damage to the leased car. The extent of damage may further include the size and condition of the damage, and may be represented, for example, by symbols used in vehicle condition certification. For example, the size of the damage may be represented by a "0" indicating "less than 500 yen coin size," a "1" indicating "less than card size," or a "2" indicating "less than A4 size." The state of damage may be represented by a "U" indicating "dent / bend," an "A" indicating "scratch / fray," or a "P" indicating "discoloration / fading / peeling / sticker (tape) marks." The extent of damage may be represented by other notations or by text. The location of the damage may be represented by superimposing the extent of the damage on the corresponding part of the image. The location of the damage may also be expressed by a sentence.

[0043] [Activity A5] The information output unit 211 displays the output damage information on the output unit 35. For example, a post-determination screen 6 shown in Fig. 6 is displayed as the output damage information.

[0044] [Activity A6] The processor 31 of the collection driver terminal 3 receives a notice that the damage information has been confirmed and an instruction to edit the damage information as necessary, via a user's operation on the input unit 34. Confirmation of the damage information and editing of the damage information will be described later with reference to FIGS. 6 and 7.

[0045] [Activity A7] The processor 31 of the collecting driver terminal 3 transmits a message that the damage information has been confirmed and the damage information corrected as necessary to the server device 2 via the communication unit 33 and the network N. The information receiving unit 210 receives, from the collecting driver terminal 3, a message that the damage information has been confirmed and the damage information (degree of damage and / or location of damage) corrected as necessary.

[0046] When corrected damage information is received and the trained model 92 is used to output the damage information, the learning unit 213 may update the trained model 92 (damage determination model) based on the corrected damage information. With this configuration, the trained model 92 can be optimized for use, reducing the possibility of misidentifying stains or shadows as damage and enabling damage information to be output with higher accuracy.

[0047] In the following, the information processing of activities A8 to A16 will be described as being performed between the server device 2 and the contracted driver terminal 4, but since it is assumed that the collection driver and the contracted driver are checking the damage in the same place, the contracted driver may temporarily borrow the collection driver's terminal 3 from the collection driver to perform the operations for reaching an agreement. In other words, activities A9 and A10 may be performed on the driver's terminal 3.

[0048] [Activity A8] The information output unit 211 notifies the contract driver terminal 4 of the leased car of the damage information. When notifying the contract driver terminal 4, it is preferable that the contract driver terminal 4 be brought with the contract driver when handing over the leased car to the collection driver. In addition, if the contract driver temporarily borrows the collection driver terminal 3 from the collection driver to perform operations for agreement, the damage information is notified to the collection driver terminal 3.

[0049] [Activity A9] The information receiving unit 210 receives from the driver an agreement regarding the damage to the leased car indicated by the damage information at the information output unit 211. With this configuration, an agreement regarding the presence or absence of damage is received from the driver, making it easy to clarify the intention to take responsibility for damage to the leased car.

[0050] [Activity A10] The processor 41 of the contract driver terminal 4 transmits, via the communication unit 43 and the network N, to the server device 2, a notice of agreement to the damage to the leased car indicated by the damage information. The information receiving unit 210 receives, from the contract driver terminal 4, a notice of agreement to the damage to the leased car indicated by the damage information.

[0051] [Activity A11] If processor 21 receives that the contracted driver agrees to the damage information, it proceeds to activity A12. On the other hand, if processor 21 receives that the contracted driver does not agree to the damage information, it proceeds to activity A13.

[0052] [Activity A12] The information output unit 211 determines whether or not compensation is due for each damage agreed upon by the driver and outputs the result. Whether or not compensation is due is determined based on the damage information. More specifically, for example, the information output unit 211 may output whether or not compensation is due and the approximate amount of compensation, in association with the degree of damage and the location of the damage. The information storage unit 212 stores in the storage unit 22, for damage information that corresponds to damage agreed upon by the driver and for which compensation is due, in association with the location of the damage. This configuration makes it easier for the leasing company to refer to information for compensation when the driver agrees to the damage and damage to the leased car results in compensation. This also allows the leasing company to seek compensation from the contract driver at its own discretion, without requiring the knowledge of the recovery driver.

[0053] [Activity A13] The information output unit 211 transmits a request for detailed image data from the contract driver to the contract driver terminal 4. The processor 41 of the contract driver terminal 4 receives the request for detailed image data from the contract driver via the network N and the communication unit 43.

[0054] [Activity A14] If the leased car is damaged and if the contract driver indicates that he or she does not agree, the information receiving unit 210 further receives input of detailed image data.

[0055] The detailed image data is image data used to confirm the details of damage to the leased car. That is, the detailed image data may include image data showing the damage to the leased car in a manner different from the damage shown in the image shown by the image data. The different manner means, for example, different resolution, size, or imaging angle. Furthermore, the detailed image data may include image data showing the damage to the leased car at a higher resolution than the image shown by the image data, or may include image data of a portion of the leased car where damage is suspected taken from a different angle.

[0056] [Activity A15] The information storage unit 212 stores the received detailed image data in the storage unit 22. With this configuration, if the driver does not agree to damage to the leased car, the damage can be considered while referring to the detailed image data with the damaged area further enlarged. Also, for example, negotiations between the contract driver and the recovery driver can be put on hold at the time and negotiations can be held between the leasing company and the contract driver at a later date.

[0057] The above activities A1 to A16 are an overview of the information processing when a contract driver returns a leased car. Next, referring to Figure 4, we will explain the information processing that determines whether the recovery driver has damaged the leased car by moving it after the recovery driver has moved it to a specified location. Figure 4 is an example of an activity diagram that shows an overview of the information processing when a recovery driver returns a leased car.

[0058] [Activity A101] When the collection driver moves the leased car to a predetermined location, the processor 31 of the collection driver terminal 3 acquires post-transport image data of the leased car using the imaging unit 36 of the collection driver.

[0059] The post-transportation image data is data of an image of a leased car captured after the leased car is returned and transported. The post-transportation image data may include information similar to that of the image data.

[0060] The post-transportation damage information is data indicating whether the leased car has been damaged by being transported. The post-transportation damage information may include information similar to the damage information.

[0061] [Activity A102] The processor 31 of the collection driver terminal 3 transmits the acquired post-transportation image data to the server device 2 via the communication unit 33 and the network N.

[0062] [Activity A103] The information receiving unit 210 acquires the post-transport image data and the reference data. The reference data may be acquired again from the data acquired in activity A3 in FIG.

[0063] [Activity A104] The information output unit 211 outputs post-transportation damage information based on the post-transportation image data and the reference data. The output of the post-transportation damage information may be performed in the same manner as the output of the damage information, and may be performed, for example, by a method using the trained model 92 shown in FIG. 9. This configuration makes it possible to output data indicating whether damage occurred during transportation after the leased car was returned.

[0064] [Activity A105] The information output unit 211 causes the output unit 35 of the collection driver terminal 3 to display the output post-transportation damage information.

[0065] [Activity A106] The processor 31 of the collection driver terminal 3 receives, via a user's operation on the input unit 34, a notice that the post-transportation damage information has been confirmed and an instruction to edit the post-transportation damage information as necessary. The confirmation and editing of the post-transportation damage information may be similar to the confirmation and editing of the damage information described below with reference to Figures 6 and 7. In addition, in activity A106, the processor 31 also receives consent to the fact that damage caused by the collection driver's transportation of the leased car will result in compensation for damages.

[0066] [Activity A107] The processor 31 of the collection driver terminal 3 transmits, via the communication unit 33 and the network N, to the server device 2, a notification that the post-transport damage information has been confirmed and, if necessary, the corrected post-transport damage information. The information receiving unit 210 of the server device 2 receives, from the collection driver terminal 3, a notification that the post-transport damage information has been confirmed and, if necessary, the corrected post-transport damage information.

[0067] [Activity A108] The information storage unit 212 stores, among the damage information, damage information corresponding to damage agreed to by the recovery driver and for which compensation is to be paid, in association with the fact that damage will be paid and the location of the damage. With this configuration, when the recovery driver agrees to the damage and compensation is to be paid due to damage to the leased car, it is possible to more easily refer to information for compensation.

[0068] The above activities A101 to A108 are an outline of the information processing when the collection driver returns the leased car.

[0069] According to these activity diagrams, the leasing company can check the leased car after the collection driver has transported it, and therefore, if there is any damage to the leased car, it can identify whether it was caused by the collection driver or the contract driver. Furthermore, even if the collection driver does not have the knowledge to determine the damage, it is possible to provide a technology that can more appropriately determine the damage to the leased car.

[0070] 3.2 Details of data processing Next, the details of the information processing outlined above will be described with reference to FIGS.

[0071] [Input screen 5] 5 is a diagram showing an example of the input screen 5. The input screen 5 is a screen for accepting input of information about the leased car to be returned. The input screen 5 includes an image input area 50, a vehicle model name input area 51, a chassis number input area 52, a length input area 53, a width input area 54, a height input area 55, and a judgment button 56.

[0072] The image input area 50 is an area configured to allow image data to be uploaded. The photographing direction of an image uploaded to the image input area 50 may be determined by a direction determination model, which will be described later.

[0073] The vehicle model name input area 51 and the chassis number input area 52 are areas configured so that the name of the vehicle model and the chassis number of the leased car can be input, respectively.

[0074] The length input area 53, width input area 54, and height input area 55 are areas configured so that information on the length, width, and height of the lease car can be input as reference data, respectively.

[0075] The judgment button 56 is a button for executing a judgment as to whether or not there is any damage to the leased car from the image data uploaded via the image input area 50. In response to pressing of the judgment button 56, the information output unit 211 outputs display information of the post-judgment screen 6.

[0076] [Post-judgment screen 6] 6 is a diagram showing an example of the post-determination screen 6. The post-determination screen 6 is a screen on which the results of the determination of whether each image data is damaged are displayed. The post-determination screen 6 includes a post-image determination area 60, a vehicle model name input area 51, a chassis number input area 52, a length input area 53, a width input area 54, a height input area 55, and a save button 61. The vehicle model name input area 51, the chassis number input area 52, the length input area 53, the width input area 54, and the height input area 55 are omitted.

[0077] The post-image determination area 60 is an area where information about the image data for which a damage determination has been performed is displayed. The post-image determination area 60 includes a damage confirmation button 600 or a determination confirmation button 601 for each image. The damage confirmation button 600 is a button for displaying image data in a format that includes damage information. In response to pressing the damage confirmation button 600, the information output unit 211 outputs display information for the post-determination details screen 7 shown in FIG. 7. The determination confirmation button 601 is a button for displaying the image shown by the image data and information indicating that there is no damage to the leased car within the range of the image.

[0078] The save button 61 is a button for saving the information input via the input screen 5 (post-determination screen 6) and the damage information corrected via the post-determination details screen .

[0079] [Details screen 7 after judgment] 7 is a diagram showing an example of a post-determination detail screen 7. The post-determination detail screen 7 is a screen for checking damage in image data after determination. The post-determination detail screen 7 includes an enlarged image data area 70, a damage selection area 71, a damage check box 72, and a save button 73.

[0080] The enlarged image data area 70 is an area where the selected image data is enlarged and displayed. If it is determined that the leased car is damaged, damage information 700 may be displayed in the enlarged image data area 70.

[0081] The damage information 700 is displayed in a manner that allows the location and extent of the damage to be identified. In the example of Figure 7, "A2" is displayed superimposed on the damaged area of the leased car, allowing the location and extent of the damage to be identified.

[0082] The damage selection area 71 is an area configured so that the degree of damage can be changed by selection, and in the example of Figure 7, it may be changed from "A2" to any level such as "A1", "A3", "U1", "U2", "U3", etc.

[0083] The damage check box 72 is a check box that is selected when determining whether or not damage is to be included in the agreement.

[0084] The save button 73 is a button for saving the information edited via the damage selection area 71 and the damage checkboxes 72 .

[0085] [Agreement Screen 8] 8 is a diagram showing an example of the agreement screen 8. The agreement screen 8 is a screen for the contract driver to agree to damage to the leased car. The agreement screen 8 includes an image confirmation area 80, an agreement check box 81, and a damage agreement button 82.

[0086] The image confirmation area 80 is an area where the contracted driver can check damage to the leased car. The image confirmation area 80 includes a damage confirmation button 800 or a judgment confirmation button 801 for each image. The damage confirmation button 800 and the judgment confirmation button 801 have the same functions as the damage confirmation button 600 or the judgment confirmation button 601.

[0087] The agreement check box 81 is a check box that is selected when the contract driver agrees to damage to the leased car.

[0088] The damage agreement button 82 is a button that is selected when the contract driver confirms the agreement regarding damage to the leased car. The damage agreement button 82 may be configured to be pressable when the agreement check box 81 is selected.

[0089] [92 trained models] Next, the trained model 92 will be described. The trained model 92 is constructed by an arbitrary machine learning algorithm. FIG. 9 is a diagram for explaining the trained model 92. The trained model 92 is configured to be able to output output data 93 in response to input data 91. The trained model 92 may be divided into a direction determination model and a damage determination model.

[0090] The direction determination model is a model that has been trained to be able to output the direction of imaging of a leased car as output data 93 in response to image data being input as input data 91. The imaging direction is, for example, the front or back of the leased car as described above. The feature quantities of the direction determination model are data acquired from the image data. More specifically, for example, in the direction determination model, the results of image processing of the image data are used as explanatory variables, and the orientation of the leased car included in the image data is used as a target variable.

[0091] The damage assessment model is a model that has been trained to be able to output damage information as output data 93 (or, from another perspective, be able to assess damage to a leased car) in response to image data and reference data being input as input data 91. The features of the damage assessment model are data obtained from the image data, reference data, and damage information. More specifically, for example, in the damage assessment model, the results of image processing of the image data and the actual size of the object included in the image indicated by the reference data are used as explanatory variables, and the damage information is used as a target variable.

[0092] The direction determination model and the damage determination model may be used in combination. That is, the information output unit 211 outputs damage information in association with the image capture direction of the leased car in response to inputting the image data of the leased car, the image capture direction of which has been determined by the direction determination model, and the reference data into the damage determination model. With this configuration, determination is made by combining the direction determination model and the damage determination model, so that damage information can be output while determining the image capture direction with higher accuracy.

[0093] According to the present invention, it is possible to provide a technology that can more appropriately determine damage to a leased car.

[0094] [others] With respect to the information processing system 1 according to the above-described embodiment, the present invention may be a program that causes a computer to function as a processor included in the information processing system 1. The present invention may also be an information processing method executed by the processor included in the information processing system 1.

[0095] In the embodiment, a trained model is used to output damage information, but in a modified example, a rule-based model may be used. However, compared to applying a general rule-based method to the present invention, using a trained model makes it easier to set variables.

[0096] Furthermore, it may be provided in the following aspects.

[0097] (1) An information processing system comprising at least one processor that executes the following steps: in an acquisition step, image data that is an image of a leased car and reference data that is at least used to refer to the degree of damage to the leased car in the image are acquired, the leased car is a vehicle that is the subject of a car lease; in a first output step, damage information is output based on the image data and the reference data, and the damage information is information regarding damage to the leased car.

[0098] With this configuration, information regarding damage to the leased car can be output based on an image of the leased car and the reference data.

[0099] (2) In the information processing system described in (1) above, in the notification step, the damage information is notified to the driver of the leased car, and in the first reception step, agreement to the damage to the leased car indicated by the damage information is received from the driver in the notification step.

[0100] With this configuration, an agreement as to whether or not there is any damage is received from the driver, making it easier to clarify the driver's intention to take responsibility for damage to the leased car.

[0101] (3) In the information processing system described in (2) above, in the second reception step, if there is damage to the leased car and it is received that the driver does not agree, the input of detailed image data is further received, and the detailed image data is image data in which the location of the damage to the leased car is shown in a manner different from the image, and in the first information storage step, the received detailed image data is stored.

[0102] With this configuration, if the driver does not agree to damage to the leased car, the damage can be considered while referring to detailed image data that further enlarges the damaged area.

[0103] (4) In the information processing system described in (2) or (3) above, in the second information storage step, for the damage information corresponding to damage agreed upon by the driver and for which compensation is due, the information processing system stores the fact that compensation will be due and the location of the damage in correspondence with the information.

[0104] With this configuration, if the driver agrees to the damage and compensation is due due to the damage to the leased car, it is easier to refer to information for compensation.

[0105] (5) In the information processing system described in any one of (1) to (4) above, the image data is an image taken by the driver of the leased car and includes multiple images of the leased car taken from various angles, the driver includes a first driver or a second driver, the first driver is a driver who drives the leased car based on the car lease, and the second driver is a driver who collects the leased car used by the first driver.

[0106] With this configuration, image data can be acquired from drivers who may use the leased car, and damage information can be output.

[0107] (6) In the information processing system according to any one of (1) to (5) above, the reference data is data indicating the size of the leased car.

[0108] According to this configuration, damage information is output using data on the size of the leased car, so that, for example, the user can verify the size of the damaged area.

[0109] (7) In the information processing system described in any one of (1) to (6) above, in the second output step, post-transportation damage information is output based on post-transportation image data and the reference data, the post-transportation image data being data of an image of the leased car taken after the leased car is transported after the leased car is returned as part of the car lease, and the post-transportation damage information being data indicating whether damage has occurred to the leased car due to the transportation of the leased car.

[0110] With this configuration, it is possible to output data indicating whether damage has occurred during transportation after the leased car has been returned.

[0111] (8) In the information processing system described in any one of (1) to (7) above, in the first output step, the damage information is output in response to inputting the image data and the reference data into a trained model, the trained model is a model trained to be able to determine damage to the leased car in response to input of the image data, and the features of the trained model are data obtained from the image data, the reference data, and the damage information.

[0112] According to this configuration, a trained model is used as a method for determining damage information, so that damage information can be output with high accuracy.

[0113] (9) In the information processing system described in (8) above, the trained model includes a direction determination model, and the direction determination model is a model trained to be able to determine the direction of imaging of the leased car in accordance with the input of the image data, and in the first output step, the direction of imaging of the leased car is determined in accordance with inputting the image data into the direction determination model, and the damage information is output in association with the direction of imaging of the leased car in accordance with inputting the image data of the leased car whose imaging direction has been determined and reference data into the trained model.

[0114] According to this configuration, a direction determination model that can determine the direction of imaging is also used, so damage information can be output with higher accuracy.

[0115] (10) In the information processing system described in (8) or (9) above, in the first output step, the damage information is displayed, and the damage information includes information indicating the location of the damage; in the third reception step, an instruction to correct the location or degree of the damage indicated by the damage information is received; and in the learning step, the trained model is updated based on the damage information for which corrections have been received.

[0116] With this configuration, the trained model can be optimized and used, thereby outputting damage information with higher accuracy.

[0117] (11) A program for causing a computer to function as the processor of the information processing system according to any one of (1) to (10) above.

[0118] (12) An information processing method executed by an information processing system, the information processing method comprising each process executed by the processor of the information processing system described in any one of (1) to (10) above. Of course, this is not the case.

[0119] Finally, while various embodiments of the present invention have been described, they are presented by way of example only and are not intended to limit the scope of the invention. The novel embodiments may be embodied in various other forms, and various omissions, substitutions, and modifications may be made without departing from the spirit of the invention. Such embodiments and modifications are intended to be included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as defined in the accompanying claims. [Explanation of symbols]

[0120] 1: Information processing system 2: Server device 21: Processor 210: Information Reception Department 211: Information output unit 212: Information storage section 213: Learning Department 22: Storage section 23: Communications Department 3: Collection driver terminal 31: Processor 32: Storage section 33: Communications Department 34: Input section 35: Output section 36: Imaging unit 4: Contract driver terminal 41: Processor 42: Storage section 43: Communications Department 44: Input section 45: Output section 46: Imaging unit 5: Input screen 50: Image input area 51: Car model name input area 52: Vehicle identification number input area 53: Input area 54: Width input area 55: Height input area 56: Judgment button 6: Screen after judgment 60: Area after image judgment 61: Save button 600: Damage check button 601: Judgment confirmation button 7:Details screen after judgment 70: Enlarged image data area 700: Damage information 71: Damage selection area 72: Damage checkbox 73: Save button 8: Agreement screen 80: Image confirmation area 800: Damage check button 801: Judgment confirmation button 81: Agreement checkbox 82: Damage Agreement Button N: Network

Claims

1. An information processing system, at least one processor that executes the following steps: In the acquisition step, image data which is an image of a leased car and reference data which is used at least for referring to the degree of damage to the leased car in the image are acquired, and the leased car is a vehicle which is the subject of a car lease; In the first output step, damage information is output based on the image data and the reference data, and the damage information is information regarding damage to the leased car. Information processing system.

2. 2. The information processing system according to claim 1, In the notification step, the damage information is notified to the driver of the leased car; In a first receiving step, an agreement to the damage to the leased car indicated by the damage information in the notification step is received from the driver. Information processing system.

3. 3. The information processing system according to claim 2, In the second receiving step, if the leased car is damaged and if it is received that the driver does not agree, the input of detailed image data is further received, The detailed image data is data of an image in which the damaged part of the leased car is shown in a manner different from the image, In the first information storage step, the received detailed image data is stored. Information processing system.

4. 3. The information processing system according to claim 2, In the second information storage step, for the damage information corresponding to the damage agreed upon by the driver and for which compensation is to be paid, information indicating that compensation will be paid and the location of the damage are stored in association with each other. Information processing system.

5. 2. The information processing system according to claim 1, The image data is an image captured by a driver of the leased car and includes a plurality of images of the leased car captured from various directions, the driver includes a first driver or a second driver; the first driver is a driver who drives the leased car based on the car lease, The second driver is a driver who collects the leased car used by the first driver. Information processing system.

6. 2. The information processing system according to claim 1, The reference data is data indicating the size of the leased car, Information processing system.

7. 2. The information processing system according to claim 1, In the second output step, post-transportation damage information is output based on the post-transportation image data and the reference data; The post-transportation image data is data of an image of the leased car captured after the leased car is transported after the leased car is returned under the car lease, The post-transportation damage information is data indicating whether damage has occurred to the leased car due to the transportation of the leased car. Information processing system.

8. 2. The information processing system according to claim 1, In the first output step, the damage information is output in response to inputting the image data and the reference data into a trained model; The trained model is a model trained to be able to determine damage to the leased car in response to input of the image data, The features of the trained model are data obtained from the image data, the reference data, and the damage information. Information processing system.

9. 9. The information processing system according to claim 8, The trained model includes a direction determination model, and the direction determination model is a model trained to be able to determine the direction of an image capture of the leased car in response to input of the image data, In the first output step, determining a direction of an image of the leased vehicle in response to inputting the image data into a direction determination model; In response to inputting the image data of the leased car whose imaging direction has been determined and reference data into the trained model, the damage information is output in association with the imaging direction of the leased car. Information processing system.

10. 9. The information processing system according to claim 8, In the first output step, the damage information is displayed, and the damage information includes information indicating a location of the damage. In a third receiving step, an instruction to correct the location or degree of the damage indicated by the damage information is received, In the learning step, the learned model is updated based on the corrected damage information. Information processing system.

11. A program, A program for causing a computer to function as the processor of the information processing system according to any one of claims 1 to 10.

12. An information processing method executed by an information processing system, The information processing system according to any one of claims 1 to 10, comprising: Information processing methods.

Images