Image recognition device, image recognition method, and program

Abstract

To recognize an area in which a mobile vehicle can travel without changing a trained model depending on the type of road on which the mobile body travels.SOLUTION: An image recognition device includes: a storage unit that stores a first trained model that has been trained to take an image containing a road surface as input and output, as one area, a region on the image that is estimated to be a road surface having the same attribute, and a second trained model that has been trained to take the image containing the road surface as input and output a boundary of a plurality of areas on the image; and a recognition unit that recognizes a travelable region in which a mobile body can travel based on the area and the boundary obtained by inputting an image including a road surface captured by a camera mounted on the mobile body into the first trained model and the second trained model.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image recognition device, an image recognition method, and a program. [Background technology]

[0002] Conventionally, there are known techniques for recognizing a driving area of ​​a vehicle. For example, Patent Document 1 discloses a technique for recognizing a driving area of ​​a vehicle by analyzing at least one of a plurality of images captured of the surrounding environment of the vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-12709 Summary of the Invention [Problem to be solved by the invention]

[0004] The technology described in Patent Document 1 recognizes a drivable area for a vehicle by analyzing images using a trained system (machine learning or deep learning system). Conventionally, in an analysis using such a trained model, it was necessary to appropriately select and use a trained model trained in advance on the premise that the vehicle will travel only on roadways, or a trained model trained on the premise that the vehicle will travel on roadways and sidewalks. As a result, it was sometimes time-consuming to change the trained model to be used depending on the type of road the moving object was traveling on.

[0005] The present invention has been made in consideration of the above circumstances, and one of its objectives is to provide an image recognition device, an image recognition method, and a program that can recognize a drivable area without changing a trained model depending on the type of road on which a moving body is traveling. [Means for solving the problem]

[0006] The image recognition device, the image recognition method, and the program according to the present invention employ the following configuration. (1): An image recognition device according to one embodiment of the present invention includes a memory unit that stores a first trained model that is trained to receive an input image including a road surface and output areas on the image that are estimated to have the same road surface attribute as one area, and a second trained model that is trained to receive an input image including the road surface and output boundaries of multiple areas on the image, and a recognition unit that recognizes a drivable area in which the moving body can travel based on the area and the boundary obtained by inputting an image including a road surface captured by a camera mounted on the moving body into the first trained model and the second trained model.

[0007] (2) In the above aspect (1), the recognition unit recognizes the area including the current location of the moving object as the drivable area.

[0008] (3): In the above aspect (1), the vehicle further includes a reception unit that receives the setting of a destination of the moving body, and when the area separated from the moving body is present on the route from the current location of the moving body to the destination, the recognition unit recognizes the area and the boundary existing between the area and the moving body as the drivable area.

[0009] (4): In the above aspect (1), the recognition unit recognizes the area including the current location of the moving body as the drivable area, and the image recognition device further includes a reception unit that receives a setting of a destination of the moving body, and when a second area different from a first area including the current location of the moving body exists on the route from the current location of the moving body to the destination, the recognition unit recognizes the first area, the second area, and the boundary existing between the first area and the second area as the drivable area, and the first area and the second area are each output by the first trained model.

[0010] (5): In the above aspect (1), when the moving body crosses the boundary and moves from the area including the current location of the moving body to a different area, the recognition unit recognizes the different area as the drivable area.

[0011] (6): In any of the above aspects (1) to (4), the first trained model is a trained model generated by unsupervised learning, and the second trained model is a trained model generated by supervised learning.

[0012] (7): An image recognition method according to one embodiment of the present invention includes a computer that stores a first trained model trained to receive an input image including a road surface and output areas on the image that are estimated to have the same road surface attributes as one area, and a second trained model trained to receive an input image including the road surface and output boundaries of multiple areas on the image, and recognizes a drivable area in which the moving body can travel based on the areas and boundaries obtained by inputting an image including a road surface captured by a camera mounted on the moving body into the first trained model and the second trained model.

[0013] (8): A program according to one embodiment of the present invention causes a computer to store a first trained model that has been trained to receive an image including a road surface and output areas on the image that are estimated to have the same road surface attributes as one area, and a second trained model that has been trained to receive an image including the road surface and output boundaries of multiple areas on the image, and recognizes a drivable area in which the moving body can travel based on the areas and boundaries obtained by inputting an image including a road surface captured by a camera mounted on the moving body into the first trained model and the second trained model. Effect of the Invention

[0014] According to aspects (1) to (8), a drivable area can be recognized without changing the trained model depending on the type of road on which the moving object travels. [Brief description of the drawings]

[0015] [Figure 1] 1 is a diagram illustrating an example of the configuration of a moving object 1 and a control device 100 according to an embodiment. [Diagram 2] 1 is a perspective view of a moving body 1 seen from above. [Diagram 3] A diagram for explaining the functions of the first trained model 73 and the second trained model 74. [Figure 4] 1 is a diagram showing an example of a destination of a moving object 1 accepted by a accepting unit 130. FIG. [Diagram 5] FIG. 11 is a diagram showing an example of a target trajectory generated by the control unit 140 based on a set destination. [Figure 6] 13 is a diagram showing an example of an integrated area acquired by a recognition unit 120. FIG. [Figure 7] FIG. 4 is a diagram showing an example of a flow of processing executed by the image processing apparatus according to the embodiment. [Figure 8] FIG. 11 is a diagram showing another example of the flow of processing executed by the image processing device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, an embodiment of an image recognition device, an image recognition method, and a program of the present invention will be described with reference to the drawings. The image recognition device is mounted on a moving object. The moving object moves on both roadways and a predetermined area different from the roadway. The moving object may be called micromobility. An electric kick scooter is a type of micromobility. The predetermined area is, for example, a sidewalk. The predetermined area may be a part or all of a sidewalk, a bicycle lane, a public open space, etc., or may include all of a sidewalk, a sidewalk, a bicycle lane, a public open space, etc. In the following description, the predetermined area is a sidewalk. In the following description, the part written as "sidewalk" may be appropriately read as "predetermined area".

[0017] FIG. 1 is a diagram showing an example of the configuration of a moving body 1 and a control device 100 according to an embodiment. The moving body 1 is equipped with, for example, an external environment detection device 10, a moving body sensor 12, an operator 14, an internal camera 16, a positioning device 18, a mode switching switch 22, a dial switch 24, a moving mechanism 30, a driving device 40, an external notification device 50, a storage device 70, and a control device 100. Note that some of these configurations that are not essential for realizing the functions of the present invention may be omitted. The moving body is not limited to a vehicle, and may include a small mobility that runs alongside a walking user to carry luggage or lead a person, and may also include other moving bodies capable of autonomous movement (e.g., a walking robot, etc.).

[0018] The external environment detection device 10 is a device having a detection range in the traveling direction of the moving object 1. The external environment detection device 10 includes an external camera, a radar device, a LIDAR (Light Detection and Ranging), a sensor fusion device, etc. The external environment detection device 10 outputs information indicating the detection result (image, object position, etc.) to the control device 100.

[0019] The mobile body sensor 12 includes, for example, a speed sensor, an acceleration sensor, a yaw rate (angular velocity) sensor, a direction sensor, and an operation amount detection sensor attached to the operator 14. The operator 14 includes, for example, an operator for instructing acceleration / deceleration (for example, an accelerator pedal or a brake pedal) and an operator for instructing steering (for example, a steering wheel). In this case, the mobile body sensor 12 may include an accelerator opening sensor, a brake depression amount sensor, a steering torque sensor, etc. The mobile body 1 may be provided with an operator of a type other than those described above (for example, a non-annular rotary operator, a joystick, a button, etc.) as the operator 14.

[0020] Internal camera 16 captures an image of at least the head of an occupant of moving body 1 from the front. Internal camera 16 is a digital camera that uses an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). Internal camera 16 outputs the captured image to control device 100.

[0021] The positioning device 18 is a device that measures the position of the mobile object 1. The positioning device 18 is, for example, a Global Navigation Satellite System (GNSS) receiver, and identifies the position of the mobile object 1 based on a signal received from a GNSS satellite, and outputs the position information. Note that the position information of the mobile object 1 may be estimated from the position of a Wi-Fi base station to which a communication device described later is connected.

[0022] The HMI 20 includes a display device, a speaker, a touch panel, keys, etc. For example, a passenger of the moving object 1 sets a destination of the moving object 1 via the HMI 20, and a control unit 140 described later drives the moving object 1 to the set destination.

[0023] The mode changeover switch 22 is a switch operated by the occupant. The mode changeover switch 22 may be a mechanical switch or a GUI (Graphical User Interface) switch set on a touch panel of the HMI 20. The mode changeover switch 22 accepts an operation to change the driving mode to one of, for example, mode A: an assist mode in which one of the steering operation and the acceleration / deceleration control is performed by the occupant and the other is performed automatically, and there may be mode A-1 in which the steering operation is performed by the occupant and the acceleration / deceleration control is performed automatically, and mode A-2 in which the acceleration / deceleration operation is performed by the occupant and the steering control is performed automatically, mode B: a manual driving mode in which the steering operation and the acceleration / deceleration operation are performed by the occupant, and mode C: an automatic driving mode in which the operation control and the acceleration / deceleration control are performed automatically.

[0024] The moving mechanism 30 is a mechanism for moving the moving body 1 on a road. The moving mechanism 30 is, for example, a group of wheels including steering wheels and drive wheels. The moving mechanism 30 may also be legs for walking on multiple legs.

[0025] The driving device 40 outputs a force to the moving mechanism 30 to move the moving body 1. For example, the driving device 40 includes a motor that drives the driving wheels, a battery that stores the power to be supplied to the motor, a steering device that adjusts the steering angle of the steering wheels, and the like. The driving device 40 may include an internal combustion engine, a fuel cell, or the like as a driving force output means or a power generation means. The driving device 40 may further include a brake device that utilizes frictional force or air resistance.

[0026] The external notification device 50 is, for example, a lamp, a display device, a speaker, or the like provided on an outer panel of the moving body 1 for notifying the outside of the moving body 1 of information. The external notification device 50 operates differently depending on whether the moving body 1 is moving on a sidewalk or a roadway. For example, the external notification device 50 is controlled to emit a lamp when the moving body 1 is moving on a sidewalk and not emit a lamp when the moving body 1 is moving on a roadway. The light emission color of this lamp is preferably a color specified by law. The external notification device 50 may be controlled to emit a lamp in green when the moving body 1 is moving on a sidewalk and emit a lamp in blue when the moving body 1 is moving on a roadway. When the external notification device 50 is a display device, the external notification device 50 displays a message "traveling on a sidewalk" in text or graphics when the moving body 1 is traveling on a sidewalk.

[0027] FIG. 2 is a perspective view of the moving body 1 seen from above. In the figure, FW is a steering wheel, RW is a driving wheel, SD is a steering device, MT is a motor, and BT is a battery. The steering device SD, the motor MT, and the battery BT are included in the driving device 40. AP is an accelerator pedal, BP is a brake pedal, WH is a steering wheel, SP is a speaker, and MC is a microphone. The moving body 1 shown in the figure is a one-seater moving body, and an occupant P is seated in the driver's seat DS and fastened with a seat belt SB. An arrow D1 indicates the traveling direction (velocity vector) of the moving body 1. The external environment detection device 10 is provided near the front end of the moving body 1, the internal camera 16 is provided at a position where the head of the occupant P can be imaged from in front of the occupant P, and the mode changeover switch 22 is provided at the boss part of the steering wheel WH. In addition, an external notification device 50 as a display device is provided near the front end of the moving body 1.

[0028] Returning to FIG. 1, the storage device 70 is a non-transitory storage device such as a hard disk drive (HDD), a flash memory, or a random access memory (RAM). The storage device 70 stores navigation map information 72, a first trained model 73, a second trained model 74, and the like. In the figure, the storage device 70 is illustrated outside the frame of the control device 100, but the storage device 70 may be included in the control device 100. The storage device 70 may also be provided on a server (not shown).

[0029] The navigation map information 72 is stored in advance in the storage device 70, and is map information including, for example, information on the center of a road including a roadway and a sidewalk, information on the boundary of a road, etc. The navigation map information 72 further includes information (such as name, address, area, etc.) on facilities and buildings adjacent to the boundary of a road.

[0030] The first trained model 73 is a trained model trained to receive an image including a road surface and output an area on the image that is estimated to be a road surface with the same attribute as one area. Here, the same attribute means, for example, a classification such as "sidewalk" or "lane (left lane and right lane)". The second trained model 74 is a trained model trained to receive an image including a road surface and output boundaries of multiple areas on the image. In the present invention, the first trained model 73 is a trained model generated by any unsupervised learning, and the second trained model 74 is a trained model generated by any supervised learning. By generating the first trained model 73 by unsupervised learning without generating all the trained models used in the present invention by supervised learning, the cost of preparing training data and the processing load of the CPU that executes the learning can be reduced.

[0031] FIG. 3 is a diagram for explaining the functions of the first trained model 73 and the second trained model 74. FIG. 3 shows an example of the contents output by the first trained model 73 and the second trained model 74 in response to the input of an image including a road surface. In the case of FIG. 3, the first trained model 73 outputs area A1 (left sidewalk), area A2 (left lane), area A3 (right lane), and area A4 (right sidewalk) in the image in response to the input of an image including a road surface. On the other hand, the second trained model 74 outputs boundaries L1, L2, and L3 between areas in the image in response to the input of an image including a road surface. As shown in FIG. 3, the "boundary" in this embodiment does not mean a one-dimensional line, but a two-dimensional area that the moving object 1 can cross. That is, the teacher data used to generate the second trained model 74 is, for example, data defined by annotating the boundaries between areas as two-dimensional areas in the image.

[0032] Generally, the area of ​​an area boundary occupies a small proportion of an image, and in a trained model that outputs the area and the boundary together, the accuracy of outputting the boundary may decrease. In contrast, in the present invention, a trained model that outputs the area and a trained model that outputs the boundary are separately provided, thereby improving the accuracy of outputting the boundary.

[0033] [Control device] The control device 100 includes, for example, a recognition unit 120, a reception unit 130, and a control unit 140. The recognition unit 120, the reception unit 130, and the control unit 140 are realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by cooperation between software and hardware. The program may be stored in the storage device 70 in advance, or may be stored in a removable storage medium (non-transient storage medium) such as a DVD or CD-ROM, and may be installed in the storage device 70 by mounting the storage medium in a drive device. The storage device 70, the recognition unit 120, and the reception unit 130 are an example of an "image processing device", and the storage device 70, the recognition unit 120, the reception unit 130, and the control unit 140 are an example of a "mobile object control device".

[0034] The recognition unit 120 recognizes objects present around the moving body 1 based on the output of the external environment detection device 10. The objects include some or all of the following obstacles: moving bodies such as vehicles, bicycles, and pedestrians, road boundaries such as road dividing lines, steps, guardrails, road shoulders, and median strips, structures installed on the road such as road signs and billboards, and objects that have fallen on the road.

[0035] The recognition unit 120 further inputs an image captured by the external camera of the external environment detection device 10 into the first trained model 73 and the second trained model 74, thereby acquiring one or more areas and boundaries in the image. Based on the installation position of the external camera in the moving body 1, the recognition unit 120 recognizes an area including the current location of the moving body 1 as a drivable area among the acquired areas based on the installation position of the external camera in the moving body 1. For example, when the image shown in FIG. 3 is captured with the external camera installed in the center of the moving body 1, the recognition unit 120 determines that the area A2 located in the center of the image includes the current location of the moving body 1, and recognizes the area A2 as a drivable area. Also, for example, the recognition unit 120 may recognize an area including coordinates located in the center of the horizontal axis and at the bottom of the vertical axis of the captured image as a drivable area among the acquired areas.

[0036] The reception unit 130 receives the setting of the destination of the moving object 1 via the HMI 20. FIG. 4 is a diagram showing an example of the destination of the moving object 1 received by the reception unit 130. As shown in FIG. 4, the occupant of the moving object 1 sets the destination, for example, by inputting the name of the destination in an input area R1 provided on the HMI 20. Also, for example, the HMI 20 may display navigation map information 72, and the occupant of the moving object 1 may set the destination by specifying a building or facility displayed in the navigation map information 72. Also, for example, the HMI 20 may provide an input area for inputting address information and a telephone number, and the occupant of the moving object 1 may set the destination by inputting the address information and a telephone number.

[0037] When a passenger of the moving object 1 sets a destination and presses the travel start button B1, the control unit 140 generates a target trajectory to the set destination by referring to the navigation map information 72. FIG. 5 is a diagram showing an example of a target trajectory generated by the control unit 140 based on the set destination. FIG. 5 shows a target trajectory generated by the control unit 140 based on the destination set on the HMI 20 shown in FIG. 4. As shown in FIG. 5, the target trajectory TT generated by the control unit 140 extends from the current location of the moving object 1 to the parking lot of the restaurant A, and the target trajectory TT passes through the area A1 (corresponding to the sidewalk L2) and area A2 (corresponding to the roadway L1) output by the first trained model 73, and the boundary L1 between the area A1 and the area A2.

[0038] Area A1 is an area separated from area A2 including the current location of the mobile object 1, but exists on the route from the current location of the mobile object 1 to the destination, and therefore it is assumed that the mobile object 1 can travel through area A1. Therefore, the recognition unit 120 recognizes area A1 and boundary L1 as a travelable area in addition to area A2.

[0039] When the recognition unit 120 recognizes the areas A1 and A2 and the boundary L1 as a drivable area, it acquires an integrated area by integrating these two areas and the boundary, and recognizes it as the drivable area. Fig. 6 is a diagram showing an example of an integrated area acquired by the recognition unit 120. As shown in Fig. 6, the recognition unit 120 acquires an integrated area IA by integrating the areas A1 and A2 and the boundary L1, and recognizes it as the drivable area. The control unit 140 controls the mobile object 1 to travel in the drivable area recognized by the recognition unit 120, and travels to the destination.

[0040] The recognition of the above-mentioned drivable area is executed when the occupant sets a destination and the moving body 1 drives to the destination in an automatic driving mode. When the moving body 1 drives in a manual driving mode, the recognition unit 120 may recognize an area into which the moving body 1 has entered by driving of the occupant as the drivable area. More specifically, when the moving body 1 moves from an area including the current location to a different area across a boundary, the recognition unit 120 may recognize the different area as the drivable area.

[0041] Furthermore, the drivable area recognized by the above method may be associated with the position information measured by the positioning device 18 and stored in the navigation map information 72. In that case, the control unit 140 may acquire the drivable area by referring to the navigation map information 72 the next time the moving object 1 travels along the same road, and may cause the moving object 1 to travel through the drivable area without performing processing using the first trained model 73 and the second trained model 74 described above.

[0042] Thus, compared to the conventional technology that requires changing the trained model according to the type of road on which the mobile body 1 travels in order to recognize the travelable area of ​​the mobile body 1, the present invention makes it possible to recognize the travelable area of ​​the mobile body 1 using the same trained model, regardless of the type of road on which the mobile body 1 travels. This makes it possible to recognize the travelable area without changing the trained model according to the type of road on which the mobile body travels.

[0043] Next, a flow of processing executed by the image processing device according to the embodiment will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of a flow of processing executed by the image processing device according to the embodiment. The processing shown in Fig. 7 is repeatedly executed while the moving object 1 is traveling.

[0044] The recognition unit 120 first acquires an image including a road surface ahead in the traveling direction of the moving object 1, captured by the external camera of the external environment detection device 10 (step S100). Next, the recognition unit 120 inputs the acquired image into the first trained model 73 and the second trained model 74, thereby acquiring one or more areas and boundaries (step S102).

[0045] Next, the recognition unit 120 recognizes the host vehicle area to which the moving object 1 belongs as a drivable area among the areas output from the first trained model 73 (step S104). Next, the recognition unit 120 determines whether or not there is another area between the host vehicle area and the destination set via the HMI 20 (step S106).

[0046] If it is determined that no other areas exist between the vehicle area and the set destination, the recognition unit 120 recognizes only the vehicle area as the drivable area (step S108). On the other hand, if it is determined that other areas exist between the vehicle area and the set destination, the recognition unit 120 integrates the vehicle area with the other areas and their boundaries to recognize them as the drivable area (step S110).

[0047] 8 is a diagram showing another example of the flow of processing executed by the image processing device according to the embodiment. The processing shown in FIG. 8 is repeatedly executed while the moving body 1 is traveling.

[0048] The recognition unit 120 first acquires an image including a road surface ahead in the traveling direction of the moving object 1, captured by an external camera of the external environment detection device 10 (step S200). Next, the recognition unit 120 acquires one or more areas and boundaries by inputting the acquired image into the first trained model 73 and the second trained model 74 (step S202). Next, the recognition unit 120 recognizes the host vehicle area to which the moving object 1 belongs, among the areas output from the first trained model 73, as a drivable area (step S204).

[0049] The recognition unit 120 then refers to the navigation map information 72, which stores areas and boundaries that have been recognized as drivable areas in the past in association with location information, and determines whether the acquired areas and boundaries are registered as drivable areas for areas other than the vehicle area (step S206). If it is determined that the acquired areas and boundaries are not registered as drivable areas, the recognition unit 120 shifts the process to step S106 in FIG. 7. On the other hand, if it is determined that the acquired areas and boundaries are registered as drivable areas, the recognition unit 120 recognizes the acquired areas and boundaries as drivable areas (step S208). This ends the process of this flowchart.

[0050] According to the present embodiment described above, an image including a road surface captured by a camera mounted on a moving body is input into the first trained model and the second trained model, and based on the area and boundary obtained by the input, a drivable area in which the moving body can travel is recognized. This makes it possible to recognize the drivable area without changing the trained model according to the type of road on which the moving body travels.

[0051] The above-described embodiment can be expressed as follows. a storage medium for storing computer-readable instructions; a processor coupled to the storage medium; The processor executes the computer-readable instructions to: A first trained model is trained to receive an image including a road surface as an input and output an area on the image that is estimated to be a road surface with the same attribute as one area, and a second trained model is trained to receive an image including the road surface as an input and output boundaries of a plurality of the areas on the image, Recognizing a drivable area in which the moving body can travel, based on the area and the boundary obtained by inputting an image including a road surface captured by a camera mounted on the moving body into the first trained model and the second trained model; The image processing device is configured as follows.

[0052] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0053] 10. External sensing devices 12 Mobile Sensor 14 Controls 16 Internal Camera 18 Positioning Device 20 Human Machine Interfaces 22 Mode switch 30 Moving mechanism 40 Drive unit 50 External alarm device 70 Storage device 72 Navigation Map Information 73 First trained model 74 Second trained model 100 Control device 120 Recognition part 130 Reception 140 Control section

Claims

1. A recognition unit that recognizes a drivable area of ​​the moving body from an image including a road surface captured by a camera mounted on the moving body, the recognition unit estimates the area in the image by inputting the image including the road surface into a first trained model capable of estimating an area of ​​a roadway on the road surface and a predetermined area on the road surface different from the roadway as one separate area, estimates the area of ​​the boundary in the image by inputting the image including the road surface into a second trained model that estimates boundaries of a plurality of the areas in an image, and outputs a drivable area based on the area estimated by the first trained model and the boundary estimated by the second trained model, or a drivable area based on the area estimated by the first trained model, depending on a route to a destination to which the moving body is heading. Image recognition device.

2. The predetermined area includes at least one of a sidewalk, a shoulder strip, a bicycle lane, and a public open space, The image recognition device according to claim 1 .

3. a reception unit that receives a setting of the destination of the moving body, and when the area separated from the moving body exists on a route from a current location of the moving body to the destination, the recognition unit recognizes and outputs the area and the boundary existing between the area and the moving body as the drivable area. The image recognition device according to claim 1 .

4. The recognition unit recognizes the area including a current location of the moving object as the travelable area, The image recognition device further includes a reception unit that receives a setting of the destination of the moving object, When a second area different from a first area including the current location of the moving body is present on a route from the current location of the moving body to the destination, the recognition unit recognizes and outputs the first area, the second area, and the boundary existing between the first area and the second area as the drivable area, and the first area and the second area are each output by the first trained model. The image recognition device according to claim 1 .

5. When the moving object crosses the boundary and moves from the area including the current location of the moving object to the different area, the recognition unit recognizes and outputs the different area as the travelable area. The image recognition device according to claim 1 .

6. The first trained model is a trained model generated by unsupervised learning, and the second trained model is a trained model generated by supervised learning. The image recognition device according to claim 1 .

7. The computer Recognizing a drivable area of ​​a moving object from an image including a road surface captured by a camera mounted on the moving object; an image including the road surface is input into a first trained model capable of estimating an area of ​​a roadway on the road surface and a predetermined area on the road surface different from the roadway as separate areas, thereby estimating the area of ​​the boundary in the image, by inputting the image including the road surface into a second trained model that estimates boundaries of a plurality of the areas in an image, and a drivable area based on the area estimated by the first trained model and the boundary estimated by the second trained model, or a drivable area based on the area estimated by the first trained model, depending on a route to a destination to which the moving body is heading, is output; Image recognition methods.

8. On the computer, Recognizing a drivable area of ​​a moving object from an image including a road surface captured by a camera mounted on the moving object; an image including the road surface is input into a first trained model capable of estimating an area of ​​a roadway on the road surface and a predetermined area on the road surface different from the roadway as separate areas, thereby estimating the area of ​​the boundary in the image by inputting the image including the road surface into a second trained model that estimates boundaries of a plurality of the areas in an image, and outputting a drivable area based on the area estimated by the first trained model and the boundary estimated by the second trained model, or a drivable area based on the area estimated by the first trained model, depending on a route to a destination to which the moving body is heading; program.

Images