Electronic apparatus, information processing method, and program

The electronic device allows users to set a desired parking position by displaying a map with a frame and travel route deviation, ensuring accurate automatic parking.

JP2024157985AInactive Publication Date: 2024-11-08KYOCERA CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023072718
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-26
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing parking assistance systems cannot determine whether the manually set parking position for automatic driving is the desired parking position.

Method used

An electronic device that displays a surrounding map with a frame to allow users to specify a reference stop position, shows the travel route and deviation from this position, and generates an automatic parking route based on user input.

Benefits of technology

Enables the user to confirm that the set parking position is desired and facilitates automatic parking by visually confirming the deviation and generating a suitable parking route.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024157985000001_ABST
    Figure 2024157985000001_ABST
Patent Text Reader

Abstract

To understand whether a set parking position is a desired parking position.SOLUTION: An electronic apparatus 10 includes a control section 18. The control section 18 allows a display section 14 to display a first image including a peripheral map of a mobile body and a frame. The control section 18 determines a reference stop position based on an operation input to identify a position of the frame in the peripheral map. The control section 18 allows the display section 14 to display a second image including a travel route to stop completion and a deviation between a stop position in the stop completion and the reference stop position.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an electronic device, an information processing method, and a program. [Background technology]

[0002] Support for parking of moving objects such as automobiles is being considered. For example, it has been proposed to store in advance the route to a parking position that the driver manually operates together with the parking position, and to park the vehicle at the parking position based on the stored route and surrounding information recognized by a sensor during automatic driving (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-530867 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the parking assistance described in Patent Document 1, the parking position is the actual parking position determined by manual operation by the driver, so it is not possible to determine whether the parking position set for automatic driving, etc. is the desired parking position.

[0005] Therefore, in consideration of the problems of the conventional technology as described above, the object of the present disclosure is to provide an electronic device, an information processing method, and a program that enable a driver to determine whether the parking position being set is the desired parking position. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, an electronic device according to a first aspect comprises: displaying, on a display unit, a first image including a map of the surroundings of the moving object and a frame corresponding to the moving object shown on the map of the surroundings; determining the frame as a reference stopping position of the moving object based on an operation input that specifies the position of the frame on the surrounding map; The control unit causes the display unit to display a second image including the travel path until the moving object has stopped, the stop position at the time of stopping completion, and the deviation of the reference stop position.

[0007] The information processing method according to the second aspect comprises: displaying, on a display unit, a first image including a map of the surroundings of the moving object and a frame corresponding to the moving object shown on the map of the surroundings; determining the frame as a reference stopping position of the moving object based on an operation input that specifies the position of the frame on the surrounding map; A second image including the travel path until the moving object has stopped, the stop position at the time of stopping, and the deviation of the reference stop position is displayed on the display unit.

[0008] The third perspective program is: displaying, on a display unit, a first image including a map of the surroundings of the moving object and a frame corresponding to the moving object shown on the map of the surroundings; determining, based on an operation input specifying a position of the frame on the surrounding map, the frame as a reference stopping position of the moving object; The method causes the computer to execute an operation including a step of displaying, on the display unit, a second image including the travel path of the moving body until the moving body has completely stopped, the stopping position at the time of the stopping completion, and the deviation of the reference stopping position. Effect of the Invention

[0009] According to the present disclosure configured as described above, it is possible to know whether the set parking position is a desired parking position. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a configuration of a vehicle including an electronic device according to an embodiment of the present disclosure. [Diagram 2]2 is a diagram illustrating an example of a first image displayed on the display unit in FIG. 1. [Diagram 3] 1. FIG. 4 is a diagram illustrating an example of a second image displayed on the display unit in FIG. [Figure 4] FIG. 13 is a diagram illustrating an example of a reference route including route points. [Diagram 5] 11 is a diagram illustrating a reference path and a first rotation path for explaining a first intersection point; FIG. [Figure 6] 4 is a diagram for explaining a relationship between a reference path and a first rotation path and a second rotation path. FIG. [Figure 7] 13 is a diagram showing the relationship between the rotation angle of the second rotation path, the first intersection point, and the point of interest for calculating the second radius. FIG. [Figure 8] FIG. 13 is a diagram for explaining a state in which the first rotation path does not intersect with the reference path. [Figure 9] 4 is a flowchart for explaining a learning process executed by a control unit in FIG. [Figure 10] 4 is a flowchart for explaining a route generation process executed by a control unit in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of an electronic device to which the present invention is applied will be described with reference to the drawings.

[0012] An electronic device according to an embodiment of the present disclosure may process information related to a specific mobile object 11. The electronic device 10 may be mounted on the mobile object 11, for example, as shown in FIG. 1 . The electronic device 10 does not have to be mounted on the mobile object 11. In the following description, the electronic device 10 is mounted on the mobile object 11.

[0013] The moving body 11 may include, for example, vehicles, aircraft, and the like. The vehicles may include, for example, automobiles, industrial vehicles, railroad vehicles, lifestyle vehicles, and fixed-wing aircraft that run on runways. The automobiles may include, for example, passenger cars, trucks, buses, motorcycles, and trolley buses. The industrial vehicles may include, for example, industrial vehicles for agriculture and construction. The industrial vehicles may include, for example, forklifts and golf carts. The industrial vehicles for agriculture may include, for example, tractors, cultivators, transplanters, binders, combines, and lawnmowers. The industrial vehicles for construction may include, for example, bulldozers, scrapers, excavators, cranes, dump trucks, and road rollers. The classification of vehicles is not limited to the above examples. For example, automobiles may include industrial vehicles that can run on roads. The same vehicle may be included in multiple classifications. The aircraft may include, for example, fixed-wing aircraft and rotary-wing aircraft.

[0014] The mobile object 11 may include an electronic device 10, a sensor unit 12, an input unit 13, a display unit 14, a memory unit 15, and a driving control ECU (Electronic Control Unit) 16. The electronic device 10, the sensor unit 12, the input unit 13, the display unit 14, the memory unit 15, and the driving control ECU 16 may be connected to each other via a wired and / or wireless network so as to be able to transmit and receive information.

[0015] The sensor unit 12 may detect the surrounding situation of the mobile object 11 on which it is mounted. The surrounding situation is, for example, an image of the surroundings, a distance value of a surrounding object, etc. The sensor unit 12 may include an in-vehicle camera, a distance measurement sensor, etc. as a sensor for detecting the surrounding situation. The sensor unit 12 may also detect the situation of the mobile object 11 relative to the surroundings. The situation of the mobile object 11 is, for example, the position of the mobile object 11, the direction of the mobile object 11, etc. The sensor unit 12 may include a direction sensor and a position detection sensor as sensors for detecting the situation of the mobile object 11.

[0016] The on-board camera generates an image of the surroundings of the moving body 11 on which the on-board camera is mounted. The on-board camera may be a monocular camera or a stereo camera, and may be capable of capturing images of visible light, near-infrared light, and far-infrared light. In a configuration in which the sensor unit 12 includes an on-board camera, multiple on-board cameras may be mounted so as to face in different directions from the moving body 11. Scenes on all sides of the moving body 11 may be captured by the multiple on-board cameras.

[0017] The distance measuring sensor detects the position of an object located in each direction. The distance measuring sensor may emit a projected wave such as a millimeter wave, near infrared light, or sound wave. The distance measuring sensor may measure a distance value to a reflection point on an object based on the time from the emission of the projected wave to the reception of the reflected wave by the object on which the projected wave is irradiated. The distance measuring device may be, for example, a millimeter wave radar, LiDAR, ultrasonic sonar, etc. Alternatively, the distance measuring sensor may detect a distance value based on information from an on-board camera using a single camera, a stereo camera, or a system using multiple cameras. The distance measuring sensor using a system using an on-board camera may perform distance measurement using the aberration of an image obtained from the on-board camera, distance measurement using AI technology based on the relationship between the image obtained from the on-board camera and the distance, distance measurement using triangulation technology for the image obtained from the on-board camera, etc. In addition, in the distance measurement of the present disclosure, distance measurement using an on-board camera and distance measurement using millimeter wave radar, LiDAR, ultrasonic sonar, etc. may be arbitrarily combined. In a configuration in which the sensor unit 12 includes multiple distance measurement sensors, the multiple distance measurement sensors may be mounted so as to face different directions from the mobile object 11. The multiple distance measurement sensors may measure distances to objects on all four sides of the mobile object 11.

[0018] The orientation sensor may detect the vehicle orientation in the forward direction of the mobile object 11 based on a change in geomagnetism. The orientation sensor is, for example, a magnetic sensor.

[0019] The position detection sensor may detect the position of the mobile object 11. The position detection sensor is, for example, a positioning sensor such as a Global Navigation Satellite System (GNSS). The GNSS may include a Global Positioning System (GPS).

[0020] The input unit 13 may include one or more interfaces for detecting a user's operation input. The input unit 13 may include, for example, a physical key, a capacitive key, and a touch screen that is integral with the display unit 14. The input unit 13 may include other appropriate operation input interfaces such as a voice input, a gesture input, and the like.

[0021] The display unit 14 is, for example, a liquid crystal display, an organic electro-luminescence (EL) display, or an inorganic EL display. The display device may include any display device such as a 3D electro-luminescence panel.

[0022] The storage unit 15 includes one or more memories. In this embodiment, the "memory" is, for example, a semiconductor memory, a magnetic memory, an optical memory, or the like, but is not limited to these. Each memory included in the storage unit 15 may function as, for example, a main memory device, an auxiliary memory device, or a cache memory. The storage unit 15 may store any information used in the operation of the mobile object 11. The storage unit 15 may store a system program, an application program, or the like.

[0023] The memory unit 15 may store, for example, the position of a landmark in the real world. The memory unit 15 may store the latitude and longitude of the landmark as the position. The memory unit 15 may store, for example, the position of a drawn object such as a white line drawn on a road or in a parking lot in the real world. The memory unit 15 may store, as the position, the latitude and longitude of the drawn object, or a relative position based on a nearby landmark. Information on the position of the drawn object, etc. may be stored in the memory unit 15 by user input. Information on the position of the drawn object, etc. may be acquired by the electronic device 10 via a network from a server, etc. connected to an external network, and stored in the memory unit 15.

[0024] The driving control ECU 16 may generate control information based on the surrounding conditions acquired from the sensor unit 12. The control information is information for controlling the speed, braking, and steering angle of the moving body 11. The driving control ECU 16 may output the generated control information to a prime mover ECU that controls the engine or motor, a braking ECU that controls the brakes, a steering ECU that controls the steering angle, and the like. In addition, when parking the moving body 11, the driving control ECU 16 may acquire an automatic parking path as information from the electronic device 10, as described below. The driving control ECU 17 may generate control information for parking based on the automatic parking path acquired as information. Note that in the present disclosure, parking refers to stopping the movement of the moving body 11 in a configuration in which the moving body is an automobile, but stopping the movement of the moving body in a configuration other than an automobile may be stopping. Therefore, the automatic parking path may be an automatic stopping path.

[0025] As described below, in creating a reference route, the electronic device 10 stores a travel route by driving a specific mobile object 11 as a reference route in the storage unit 15. In addition, in performing automatic parking, the electronic device 10 may generate an automatic parking route based on the reference route and provide it to the driving control ECU 16. The electronic device 10 may be, for example, an ECU dedicated to creating the reference route. Alternatively, the electronic device 10 may be integrated with the above-mentioned driving control ECU 16. Alternatively, the electronic device 10 may be a mobile terminal such as a tablet or a smartphone that incorporates the above-mentioned input unit 13, display unit 14, and storage unit 15.

[0026] The electronic device 10 includes an acquisition unit 17 and a control unit 18.

[0027] The acquisition unit 17 acquires information and commands from an external device. The acquisition unit 17 is, for example, a communication interface, and communicates with the external device via wired or wireless communication. The acquisition unit 17 acquires, for example, the surrounding situation of the specific moving body 11 from the sensor unit 12 as information. The acquisition unit 17 also acquires, for example, an operation input to the input unit 13 as information or commands. The acquisition unit 17 also acquires, for example, the travel route of the specific moving body 11 as information from the sensor unit 12 or the driving control ECU 16. The information on the travel route may be a formula indicating the trajectory of the travel route, or may be a combination of the position and direction of the moving body 11 at each of a plurality of points constituting the travel route. The acquisition unit 17 may acquire the position of a drawn object or the like as information from the memory unit 15.

[0028] The control unit 18 may include at least one of a general-purpose processor that loads a specific program to execute a specific function and a dedicated processor specialized for a specific process. The dedicated processor may include an application specific integrated circuit (ASIC). The processor 16 may include a programmable logic device (PLD). The PLD may include a field-programmable gate array (FPGA). The control unit 18 controls the operation of each component of the electronic device 10.

[0029] As described below, in the learning mode, the control unit 18 determines a reference route to be used in automatic parking based on the surrounding conditions, operation input, and driving route acquired by the acquisition unit 17. The control unit 18 also stores the reference route in the memory unit 15. As described below, in the automatic parking mode, the control unit 18 may also generate an automatic parking route as information. The control unit 18 may provide the automatic parking route to the driving control ECU 16 as information.

[0030] The control unit 18 switches the operation mode to the learning mode when the input unit 13 detects an operation input to start learning parking. In the learning mode, the control unit 18 acquires a surrounding map of the specific mobile object 11 based on the surrounding situation. The control unit 18 acquires the position and direction of the specific mobile object 11 relative to the surrounding map. The surrounding map may be a diagram showing the surrounding situation when the specific mobile object 11 is viewed vertically from above.

[0031] The surrounding map may be based on information formed by, for example, three-dimensional coordinates of buildings, structures, etc. around the mobile object 11. The surrounding map may indicate an area of ​​three-dimensional coordinates corresponding to a road surface as a drivable area. The control unit 18 may calculate the three-dimensional coordinates of the surrounding buildings, etc. based on the distances of multiple object points acquired from a distance measuring sensor. The control unit 18 may acquire the surrounding map by creating the surrounding map based on the three-dimensional coordinates of the surrounding buildings, etc.

[0032] In a configuration in which a surrounding map based on three-dimensional coordinates is acquired, the control unit 18 may acquire the direction and position of a specific moving body 11 by calculating based on the three-dimensional coordinates of buildings and the like in the surrounding map.

[0033] The surroundings map may include, for example, an image of the surroundings viewed from above. The control unit 18 may generate the image of the surroundings viewed from above by performing viewpoint conversion on an image acquired from an in-vehicle camera. The control unit 18 may acquire the surroundings map by creating the surroundings map using the image of the surroundings viewed from above.

[0034] In a configuration for acquiring a surrounding map using an image, the control unit 18 may acquire the direction and position of a specific moving body 11 by calculating based on the distance of objects such as buildings included in the image calculated by image analysis.

[0035] Regardless of whether or not the surrounding map is applied as three-dimensional coordinates and images, the control unit 18 may obtain the direction and position of a particular moving object 11 from an orientation sensor and a position detection sensor, respectively.

[0036] The control unit 18 may include the positions of drawn objects in the surrounding map by comparing the position and direction of the moving body 11, as well as the three-dimensional coordinates of buildings, etc., with the positions of drawn objects stored in the memory unit 15 and, if necessary, with the positions of landmarks.

[0037] 2, the control unit 18 may generate a first image im1 including a surrounding map mp and a frame fm. The frame fm is large enough to include a specific moving object 11 scaled down to the surrounding map mp. The frame fm is, for example, a rectangle having a length equal to the total length and width of the specific moving object 11 plus a margin. The control unit 18 may superimpose the frame fm on the surrounding map mp in the first image im1.

[0038] The control unit 18 may generate the first image im1 so as to further include a first button bt1 and a second button bt2. The first button bt1 is a button for detecting an operation input for moving the frame fm within the surrounding map mp in a configuration in which the input unit 13 is a touch screen. The first button bt1 may include a movement button bm for changing the position of the frame fm, and a rotation button br for changing the orientation of the frame fm. The second button bt2 is a button for detecting an operation input for determining the position of the frame fm superimposed on the surrounding map mp as a reference parking position. The reference parking position is a planned position for parking a specific moving object 11 in the learning mode.

[0039] The control unit 18 causes the generated first image im1 to be displayed on the display unit 14. The control unit 18 determines the frame fm as a reference parking position for the specific moving object 11 based on an operation input specifying the position of the frame fm on the surrounding map mp. For example, in a configuration in which the input unit 13 is a touch screen as described above, the control unit 18 determines the position and orientation on the surrounding map mp on which the frame fm is superimposed as the reference parking position by detecting an operation input that is a touch on the display area of ​​the second button bt2.

[0040] After determining the reference parking position, the control unit 18 may acquire the driving route of the specific moving body 11 until the specific moving body 11 completes parking via the acquisition unit 17. The control unit 18 may acquire the driving route itself from the driving control ECU. The control unit 18 may acquire multiple combinations of positions and directions of the specific moving body 11 during its movement acquired from the sensor unit 12 as the driving route. The driving route may be multiple combinations of positions and directions, or may be an equation indicating a trajectory.

[0041] In the learning mode, it is assumed that driving for parking by the driver of a specific mobile body 11 is learned. Therefore, the acquired driving route is a route in driving based on manual input to the specific mobile body 11. The control unit 18 may acquire control information of the mobile body 11 in combination with the driving route. The control information is, for example, speed control, steering angle control, etc. Acquiring control information in combination with the driving route means combining control information at each point on the driving route with each point.

[0042] After the specific moving body 11 has completed parking, the control unit 18 may generate a second image im2 including the deviation msa between the parking position and the reference parking position at the time of completion of parking and the driving route rt, as shown in Fig. 3. The deviation msa between the parking position and the reference parking position may include the deviation in the front-rear direction, the deviation in the width direction, and the deviation in the direction of the specific moving body 11. The parking position used to calculate the deviation in the front-rear direction and the left-right direction is, for example, the center position of the rear wheel axle of the specific moving body 11. The reference parking position used to calculate the deviation in the front-rear direction and the left-right direction is, for example, the center position of the rear wheel axle of the specific moving body 11 when the specific moving body 11 is parked in an ideal state within the frame fm. The ideal stopped state is, for example, a state in which the distance from the front end of the moving body 11 to the front end of the frame fm is equal to the distance from the rear end of the moving body 11 to the rear end of the frame fm, and the distance from the left end of the moving body 11 to the left end of the frame fm is equal to the distance from the right end of the moving body 11 to the right end of the frame fm. The directional deviation may be represented by the angle between the orientation of the moving body 11 and the front-rear direction of the frame fm.

[0043] The control unit 18 may generate a second image im2 so as to further include a surrounding image ima and a third button bt3. The surrounding image ima may be an image of the surroundings of the specific moving object 11 in the parking position viewed from vertically above. The third button bt3 is a button that detects an operation input that determines the saving of the acquired travel route rt.

[0044] The control unit 18 may generate the second image im2 so as to further include a fourth button bt4. The fourth button bt4 is a button for detecting an operation input for deciding to discard the acquired travel route rt.

[0045] The control unit 18 causes the generated second image im2 to be displayed on the display unit 14. The control unit 18 stores the displayed driving route rt in the storage unit 15 as a reference route. The control unit 18 may store the driving route rt in the storage unit 15 based on an operation input that determines to save the driving route rt. More specifically, as described above, in a configuration in which the input unit 13 is a touch screen, the control unit 18 stores the driving route rt included in the second image im2 in the storage unit 15 by detecting an operation input that is a touch on the display area of ​​the third button bt3. The control unit 18 may store the reference parking position or the parking position at the time of parking completion in the storage unit 15 together with the reference route.

[0046] In a configuration in which the travel route rt acquired by the control unit 18 is a combination of multiple positions and directions during the movement of a specific moving object 11 in the learning mode, the control unit 18 may store multiple route points as a reference route in the storage unit 15. As shown in Fig. 4, a route point rp is a point indicated by a position acquired on the travel route rt stored as the reference route rrt. Therefore, the control unit 18 may store in the storage unit 15, as the reference route rrt, a combination of the position at each of the multiple route points rp and the direction at that position, in other words, the direction of the reference route rrt.

[0047] The control unit 18 switches the operation mode to the automatic parking mode when the input unit 13 detects an operation input to start automatic parking. In the specific mobile body 11, the automatic parking mode can be executed in the vicinity of the reference parking position rpp. In the specific mobile body 11, it is assumed that an operation input to start automatic parking is detected in the vicinity of the reference parking position rpp.

[0048] In the automatic parking mode, the control unit 18 may acquire a surrounding map mp of the specific moving object 11 based on the surrounding conditions. The control unit 18 may acquire the position and direction of the specific moving object 11 relative to the surrounding map mp. The control unit 18 may further read out a reference parking position rpp and a reference route rrt for the specific moving object 11 from the storage unit 15.

[0049] The control unit 18 may determine whether or not a specific mobile object 11 is located on the reference route rrt at the start of automatic parking. If the specific mobile object 11 is located on the reference route rrt, the control unit 18 may determine whether or not it is possible to proceed to the reference route rrt, as described below. If the specific mobile object 11 is not located on the reference route rrt, the control unit 18 may calculate a relay route to reach the reference route rrt, as described below.

[0050] The control unit 18 may perform a first setting to search for a relay route. In the first setting, the rotation radius of the specific moving body 11 is set to a first radius that is equal to or greater than the minimum rotation radius. An initial value of the first radius is, for example, the minimum rotation radius of the moving body 11. The control unit 18 may perform a first calculation. In the first calculation, as shown in FIG. 5, a rotation path of the specific moving body 11 based on the first radius is calculated as a first rotation path rt1.

[0051] The control unit 18 determines whether the first rotation path rt1 intersects with the reference path rrt. When the first rotation path rt1 intersects with the reference path rrt, the control unit 18 may determine an intersection where the first rotation path rt1 and the reference path rrt intersect as a first intersection is1. The control unit 18 may perform a first determination based on the direction of the specific moving object 11 at the first intersection is1 and the position of the first intersection is1. In the first determination, it is determined whether the specific moving object 11 can proceed to the reference path rrt via the first intersection is1.

[0052] Specifically, the control unit 18 may calculate a second radius of the second turning path described below, and perform the first determination based on whether the second radius is equal to or greater than the minimum turning radius of the specific moving object 11. If the second radius is less than the minimum turning radius, the control unit 18 may determine that the specific moving object 11 cannot proceed to the reference route rrt via the first intersection point is1.

[0053] As shown in FIG. 6, the second rotation path rt2 is continuous with the first rotation path rt1 at the first intersection point is1. The second rotation path rt2 and the first rotation path rt1 are continuous may mean that the orientation of the specific moving object 11 coincides at the point where the paths switch, i.e., at the first intersection point is1. The second rotation path rt2 may be a path that proceeds with a constant rotation radius. At the first arrival point ap1 where the second rotation path rt2 proceeds from the first intersection point is1 and reaches the reference path rrt again, the direction of the specific moving object 11 coincides with the direction of the reference path rrt at the first arrival point ap1.

[0054] The calculation of the second radius will be described in more detail below. As described above, as an example, a plurality of route points rp, each including a combination of a position and a direction, are stored in the storage unit 15 as a reference route rrt. As shown in FIG. 5, the control unit 18 may perform a first determination. In the first determination, a route point rp on the reference route rrt that is closer to the reference parking position rpp than the first intersection is1 is determined as a focus point fp. The control unit 18 may perform a second calculation after the first determination. In the second calculation, the second radius may be calculated based on the distance between the first intersection is1 and the focus point fp, the direction of the specific moving object 11 at the first intersection is1, and the direction of the reference route rrt at the focus point fp.

[0055] The second calculation will be specifically described with reference to Fig. 7. The distance from the rotation center o of the second rotation path rt2 to the first intersection point is1 and the focus point fp is the second radius r. The angle between the direction d1 of the moving body 11 at the first intersection point is1 and the direction df of the reference path rrt at the focus point fp is the rotation angle θ of the second rotation path rt2. If the distance between the first intersection point is1 and the focus point fp is l, the second radius r is calculated by equation (1) based on the relationship of a right-angled triangle drawn by drawing a perpendicular line from the focus point fp to the line segment connecting the first intersection point is1 and the rotation center o.

[0056]

number

[0057] The first determination when the second calculation is performed will be described in more detail. As described above, the control unit 18 may determine whether the second radius when a specific route point rp is determined to be the attention point fp is equal to or larger than the minimum turning radius of the moving body 11. If the second radius is less than the minimum turning radius, the control unit 18 may perform a first determination so as to determine a route point rp on the reference route rrt that is closer to the reference parking position rpp than the route point rp determined to be the attention point fp as a new attention point fp. The control unit 18 may perform a second calculation for the attention point fp by the first determination. The control unit 18 may repeat the first determination and the second calculation until the second radius calculated by the second calculation is equal to or larger than the minimum turning radius.

[0058] The control unit 18 may determine that it is possible to proceed from the first turning route rt1, which is the first radius set by the first setting, to the reference route rrt when the second radius calculated for any route point rp that can be recognized as the attention point fp is equal to or greater than the minimum turning radius. On the other hand, the control unit 18 may determine that it is impossible to proceed to the reference route rrt using the first radius when the second radius calculated for all route points rp that can be recognized as the attention point fp is less than the minimum turning radius. In this way, the control unit 18 may perform the first determination based on whether the second radius calculated for all route points rp is less than the minimum turning radius.

[0059] The control unit 18 may repeat the first setting of increasing the first radius, the first calculation, and the first determination until travel to the reference route rrt with the first radius is possible. As shown in Fig. 8, when the first rotation route rt1 and the reference route rrt do not intersect in the first determination, the control unit 18 may determine that travel to the reference route rrt with the first radius is impossible.

[0060] The control unit 18 may generate an automatic parking path including the first rotation path rt1 and the reference path rrt when proceeding to the reference path rrt by the first radius is possible. The control unit 18 may also include the second rotation path rt2 in the automatic parking path. As described above, the control unit 18 may provide the generated automatic parking path as information to the driving control ECU 16. The control unit 18 may provide control information on the reference path rrt to the driving control ECU 16 together with the automatic parking path.

[0061] Next, the learning process executed by the control unit 18 in the learning mode in this embodiment will be described with reference to the flowchart of Fig. 9. The learning process starts when the operation mode is switched to the learning mode.

[0062] In step S100, the control unit 18 acquires surrounding conditions as information via the acquisition unit 17. After acquisition, the process proceeds to step S101.

[0063] In step S101, the control unit 18 generates a first image im1 including a surrounding map mp based on the surrounding situation acquired in step S100. Furthermore, the control unit 18 causes the generated first image im1 to be displayed on the display unit 14. After display, the process proceeds to step S102.

[0064] In step S102, the control unit 18 determines whether or not an operational input for moving the frame fm has been detected. If it has been detected, the process proceeds to step S103. If it has not been detected, the process proceeds to step S104.

[0065] In step S103, the control unit 18 moves the frame fm in the first image im1 based on the operation input for moving the frame fm detected in step S102. After the movement, the process proceeds to step S104.

[0066] In step S104, the control unit 18 determines whether or not an operation input for determining the reference parking position rpp is detected. If not detected, the process returns to step S102. If detected, the process proceeds to step S105.

[0067] In step S105, the control unit 18 acquires the travel route rt via the acquisition unit 17. After acquisition, the process proceeds to step S106.

[0068] In step S106, the control unit 18 determines whether parking is complete. The determination of parking completion may be performed, for example, by detecting an operation input notifying the completion of parking, the length of time the vehicle is stopped in the reference parking position rpp, etc. If parking is not complete, the process returns to step S105. If parking is complete, the process proceeds to step S107.

[0069] In step S107, the control unit 18 generates a second image im2 based on the travel route rt acquired in step S105. Furthermore, the control unit 18 causes the second image im2 to be displayed on the display unit 14. After display, the process proceeds to step S108.

[0070] In step S108, the control unit 18 determines whether or not an operation input for deciding to store the travel route rt is detected. If it is detected, the process proceeds to step S109. If it is not detected, the learning process ends.

[0071] In step S109, the control unit 18 stores the travel route rt acquired in step S105 as a reference route rrt in the storage unit 15. After storage, the learning process ends.

[0072] Next, a route generation process executed by the control unit 18 in the automatic parking mode in this embodiment will be described with reference to the flowchart of Fig. 10. The route generation process starts when the operation mode is switched to the automatic parking mode.

[0073] In step S200, the control unit 18 acquires surrounding conditions as information via the acquisition unit 17. After acquisition, the process proceeds to step S201.

[0074] In step S201, the control unit 18 reads the reference route rrt from the storage unit 15. After reading, the process proceeds to step S202.

[0075] In step S202, the control unit 18 sets a first radius. As described above, the control unit 18 sets the first radius to the minimum turning radius of the specific moving body 11 as an initial value. After the setting, the process proceeds to step S203.

[0076] In step S203, the control unit 18 calculates a first rotation path rt1 based on the first radius set in step S202 or the first radius updated in step S212, and the position and direction of the specific moving object 11. After the calculation, the process proceeds to step S204.

[0077] In step S204, the control unit 18 determines whether the reference path rrt read in step S201 and the first rotation path rt1 calculated in step S203 intersect. If they intersect, the process proceeds to step S205. If they do not intersect, the process proceeds to step S212.

[0078] In step S205, the control unit 18 acquires the position and direction of a first intersection point is1 which is an intersection point between the reference path rrt and the first rotated path rt1. After acquisition, the process proceeds to step S206.

[0079] In step S206, the control unit 18 designates one of the route points rp on the reference route rrt as a point of interest fp. After the designation, the process proceeds to step S207.

[0080] In step S207, the control unit 18 calculates a second radius based on the first intersection point is1 and the attention point fp identified in step S206 or updated in step S211. After the calculation, the process proceeds to step S208.

[0081] In step S208, the control unit 18 determines whether the second radius calculated in step S207 is less than the minimum turning radius. If the second radius is not less than the minimum turning radius, the process proceeds to step S209. If the second radius is less than the minimum turning radius, the process proceeds to step S210.

[0082] In step S209, the control unit 18 calculates a second rotation path rt2 having the second radius calculated in the most recent step S207. Furthermore, the control unit 18 generates an automatic parking path by combining the calculated second rotation path rt2, the reference path rrt read in step S201, and the first rotation path rt1 calculated in the most recent step S203. Furthermore, the control unit 18 provides the generated automatic parking path to the driving control ECU 16. After providing, the path generation process ends.

[0083] In step S210, the control unit 18 determines whether all the target route points rp, in other words, all the route points rp on the reference parking position rpp side of the first intersection point is1, have been recognized as attention points fp. If they have not been recognized, the process proceeds to step S211.

[0084] In step S211, the control unit 18 updates the route point rp on the reference parking position rpp side on the reference route rrt next to the route point rp recognized as the attention point fp as a new attention point fp. After updating, the process returns to step S207.

[0085] In step S212, the control unit 18 updates the first radius by resetting the first radius so as to enlarge the first radius that has been set. After updating, the process returns to step S203.

[0086] In the electronic device 10 of the present embodiment configured as described above, the control unit 18 displays on the display unit 14 a first image im1 including a surrounding map mp and a frame fm of a specific moving body 11 based on the surrounding situation, determines the frame fm as a reference parking position rpp of the specific moving body 11 based on an operation input specifying the position of the frame fm in the surrounding map mp, displays on the display unit 14 a second image im2 including a driving route rt until parking is completed in driving based on a manual input to the specific moving body 11, and a parking position in the surrounding map mp at the time of parking completion and a deviation msa of the reference parking position rpp, and stores the driving route rt as a reference route rrt in the storage unit 15. With such a configuration, the electronic device 10 allows the operator to visually confirm the deviation msa between the parking position at the time of parking completion and the reference parking position rpp, thereby allowing the operator to understand whether the parking position for automatic parking is an acceptable position for the reference parking position rpp, in other words, whether the parking position to be set is a desired parking position.

[0087] In the electronic device 10, the surrounding situation includes an image of the surroundings of the specific moving object 11, and the control unit 18 includes the surrounding image ima in the second image im2. With this configuration, the electronic device 10 allows the user to visually confirm the actual surrounding scenery, so that the user can visually know whether the parking position to be set is the desired parking position.

[0088] Moreover, the electronic device 10 generates a first image im1 including a surrounding map mp on which a frame fm is superimposed, a first button bt1 for changing the position and orientation of the frame fm on the surrounding map mp, and a second button bt2 for determining the position of the frame fm superimposed on the surrounding map mp as the reference parking position rpp. With this configuration, the electronic device 10 can arbitrarily change the position of the frame fm within the surrounding map mp.

[0089] Moreover, the electronic device 10 stores the travel route rt based on an operation input that determines to save the travel route rt. With this configuration, the electronic device 10 can give the operator an opportunity to determine the travel route rt as a reference route rrt.

[0090] The electronic device 10 also performs a first setting to set the turning radius of the specific moving object 11 to a first radius equal to or greater than the minimum turning radius, performs a first calculation to calculate a first turning path rt1 based on the first radius, performs a first determination to determine whether the specific moving object 11 can proceed to the reference path rrt via the first intersection is1 based on the direction d1 of the specific moving object 11 at the first intersection is1 where the first turning path rt1 and the reference path rrt intersect, and repeats the first setting to increase the first radius, the first calculation, and the first determination until the specific moving object 11 can proceed to the reference path rrt, and generates an automatic parking path including the first turning path rt1 and the reference path rrt when the specific moving object 11 can proceed to the reference path rrt. With this configuration, the electronic device 10 can provide information for reaching a parking position from the starting position of automatic parking using the stored reference path rrt.

[0091] Furthermore, the electronic device 10 calculates a second radius of the second rotation path rt2, in which the direction of the specific moving object 11 at the first arrival point ap1, which continues from the first rotation path rt1 at the first intersection point is1 and proceeds with a constant rotation radius to arrive at the reference path rrt, coincides with the direction of the reference path rrt at the first arrival point ap1, and performs a first determination based on whether the second radius is equal to or greater than the minimum rotation radius. With this configuration, the electronic device 10 can generate an automatic parking path that does not require a fixed steering wheel when connecting from the first rotation path rt1 to the second rotation path rt2 and from the second rotation path rt2 to the reference path rrt.

[0092] In addition, the electronic device 10 calculates a second radius by performing a first determination to determine a route point rp on the reference route rrt that is closer to the reference parking position rpp than the first intersection is1 as the focus point fp, and a second calculation based on the distance between the first intersection is1 and the focus point fp, the direction d1 of the specific moving body 11 at the first intersection is1, and the direction df of the reference route rrt at the focus point fp, and if the second radius is less than the minimum turning radius, the electronic device 10 repeats the first determination to determine a route point rp on the reference route rrt that is closer to the reference parking position rpp than the route point rp determined as the focus point fp as the focus point fp and the second calculation until the second radius becomes equal to or greater than the minimum turning radius, and determines that proceeding to the reference route rrt via the first radius is impossible if the second radii calculated for all route points rp that can be determined as the focus point fp are less than the minimum turning radius. With this configuration, the electronic device 10 calculates the second radius and compares it with the minimum turning radius for each route point rp, the number of which is finite, on the reference route rrt, so that the processing load and processing time in the electronic device 10 can be reduced.

[0093] In one embodiment, (1) an electronic device includes: displaying, on a display unit, a first image including a map of the surroundings of the moving object and a frame corresponding to the moving object shown on the map of the surroundings; determining the frame as a reference stopping position of the moving object based on an operation input that specifies the position of the frame on the surrounding map; The control unit causes the display unit to display a second image including the travel path until the moving object has stopped, the stop position at the time of stopping completion, and the deviation of the reference stop position.

[0094] (2) The electronic device in (1) above is An acquisition unit that acquires a surrounding situation of a specific moving object, an operation input to the input unit, and a traveling route of the moving object, The control unit is storing a reference route in a storage unit based on the surrounding conditions, the operation input, and the travel route; The travel route is stored in the storage unit as a reference route.

[0095] (3) The electronic device in (2) above is The surrounding situation includes an image of the surroundings of the moving object, The control unit includes an image of the surrounding area in the second image.

[0096] (4) In the electronic device described in (1) to (3) above, The control unit generates the first image including the surrounding map with the frame superimposed thereon, a first button for changing the position and orientation of the frame on the surrounding map, and a second button for determining the position of the frame superimposed on the surrounding map as the reference stopping position.

[0097] (5) In any of the electronic devices described in (1) to (4), The control unit stores the travel route based on an operation input that determines storage of the travel route.

[0098] (6) In any of the electronic devices described in (1) to (5), The control unit includes a third button in the second image for deciding to save the driving route.

[0099] (7) In any of the electronic devices described in (1) to (6), The control unit is performing a first setting of setting a rotation radius of the moving object to a first radius equal to or larger than a minimum rotation radius; performing a first calculation to calculate a first rotation path according to the first radius; performing a first determination, when the first rotation path and the reference path intersect, based on a direction of the moving object at a first intersection point where the first rotation path and the reference path intersect and a position of the first intersection point, of determining whether or not the moving object can proceed to the reference path via the first intersection point; repeating the first setting of increasing the first radius, the first calculation, and the first determination until the vehicle is able to proceed along the reference path; If the reference path can be traveled, an automatic stop path is generated that includes the first rotation path and the reference path.

[0100] (8) In the electronic device described in (7) above, The control unit calculates a second radius of a second rotation path that continues from the first rotation path at the first intersection, progresses at a constant rotation radius, and reaches the reference path, and where the direction of the moving body at the first arrival point matches the direction of the reference path at the first arrival point, and performs the first judgment based on whether the second radius is greater than or equal to the minimum rotation radius.

[0101] (9) In the electronic device described in (8) above, A combination of a position of each of a plurality of route points on the reference route and a direction of the reference route at each of the route points is stored in the storage unit as the reference route; The control unit is calculating the second radius by performing a first determination of the path point on the reference path that is closer to the reference position than the first intersection as a point of interest, and a second calculation based on a distance between the first intersection and the point of interest, a direction of the moving body at the first intersection, and a direction of the reference path at the point of interest; when the second radius is less than the minimum turning radius, repeating the first determination of determining, as the attention point, a route point on the reference route that is closer to the reference stopping position than the route point determined as the attention point, and the second calculation, until the second radius becomes equal to or greater than the minimum turning radius; If the second radius calculated for all the path points that can be recognized as the attention point is less than the minimum turning radius, it is determined that proceeding to the reference path using the first radius is not possible.

[0102] In one embodiment, (10) an information processing method includes: displaying, on a display unit, a first image including a map of the surroundings of the moving object and a frame corresponding to the moving object shown on the map of the surroundings; determining the frame as a reference stopping position of the moving object based on an operation input that specifies the position of the frame on the surrounding map; A second image including the travel path until the moving object has stopped, the stop position at the time of stopping, and the deviation of the reference stop position is displayed on the display unit.

[0103] In one embodiment, the program (11) further comprises: displaying, on a display unit, a first image including a map of the surroundings of the moving object and a frame corresponding to the moving object shown on the map of the surroundings; determining, based on an operation input specifying a position of the frame on the surrounding map, the frame as a reference stopping position of the moving object; The method causes the computer to execute an operation including a step of displaying, on the display unit, a second image including the travel path of the moving body until the moving body has completely stopped, the stopping position at the time of the stopping completion, and the deviation of the reference stopping position.

[0104] The above describes an embodiment of electronic device 10. However, the embodiment of the present disclosure can also be implemented as a method or program for implementing the device, or as a storage medium on which a program is recorded (for example, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a CD-RW, a magnetic tape, a hard disk, or a memory card, etc.).

[0105] The form of implementation of the program is not limited to application programs such as object code compiled by a compiler or program code executed by an interpreter, but may be a program module incorporated into an operating system, etc. Furthermore, the program may or may not be configured so that all processing is performed only by the CPU on the control board. The program may be configured so that a part or all of it is executed by another processing unit mounted on an expansion board or expansion unit added to the board as necessary.

[0106] The drawings for explaining the embodiments according to the present disclosure are schematic, and the dimensional ratios and the like in the drawings do not necessarily correspond to the actual ones.

[0107] Although the embodiments of the present disclosure have been described based on the drawings and examples, it should be noted that those skilled in the art can make various modifications or alterations based on the present disclosure. Therefore, it should be noted that these modifications or alterations are included in the scope of the present disclosure. For example, the functions, etc. included in each component, etc. can be rearranged so as not to cause logical inconsistencies, and multiple components, etc. can be combined into one or divided.

[0108] All of the features described in this disclosure and / or all steps of any method or process disclosed herein may be combined in any combination except those combinations in which the features are mutually exclusive. Furthermore, each feature described in this disclosure may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly denied. Thus, unless expressly denied, each disclosed feature is merely one example of a generic series of the same or equivalent features.

[0109] Furthermore, the embodiments of the present disclosure are not limited to any of the specific configurations of the embodiments described above, but rather extend to any novel feature or combination of features described herein, or any novel method or process step or combination of features described herein.

[0110] In this disclosure, descriptions such as "first" and "second" are identifiers for distinguishing the configuration. Configurations distinguished by descriptions such as "first" and "second" in this disclosure may have their numbers exchanged. For example, a first image may exchange identifiers "first" and "second" with a second image. The exchange of identifiers is performed simultaneously. The configurations remain distinguished even after the exchange of identifiers. Identifiers may be deleted. A configuration from which an identifier has been deleted is distinguished by a symbol. Descriptions of identifiers such as "first" and "second" in this disclosure alone should not be used to interpret the order of the configurations or to justify the existence of an identifier with a smaller number. [Explanation of symbols]

[0111] 10 Electronic equipment 11 Vehicles 12 Sensor section 13 Input section 14 Display section 15 Storage section 16 Driving control ECU 17 Acquisition Department 18 Control Unit ap1 First destination bt1 First button bt2 Second button bt3 third button df Direction of the reference path at the point of interest d1 Direction of the moving object at the first intersection fm frame fp points of interest ima surrounding images im1 1st image im2 2nd image is1 First intersection mp surrounding area map msa Parking position deviation from reference parking position rrt Referral Route rp Path point rpp reference parking position rt Travel route rt1 First rotation path rt2 Second rotation path

Claims

1. displaying, on a display unit, a first image including a map of the surroundings of the moving object and a frame corresponding to the moving object shown on the map of the surroundings; determining the frame as a reference stopping position of the moving object based on an operation input that specifies the position of the frame on the surrounding map; a control unit that causes the display unit to display a second image including a travel path until the moving object has stopped, a stop position at the time of the stop completion, and a deviation between the reference stop position and the travel path; electronic equipment.

2. 2. The electronic device according to claim 1, An acquisition unit that acquires a surrounding situation of a specific moving object, an operation input to the input unit, and a traveling route of the moving object, The control unit is storing a reference route in a storage unit based on the surrounding conditions, the operation input, and the travel route; The travel route is stored in the storage unit as a reference route. electronic equipment.

3. 3. The electronic device according to claim 2, The surrounding situation includes an image of the surroundings of the moving object, The control unit includes an image of the surrounding area in the second image. electronic equipment.

4. 4. The electronic device according to claim 2, The control unit generates the first image including the surrounding map on which the frame is superimposed, a first button for changing a position and an orientation of the frame on the surrounding map, and a second button for determining the position of the frame superimposed on the surrounding map as the reference stopping position. electronic equipment.

5. 4. The electronic device according to claim 2, The control unit stores the travel route based on an operation input that determines the storage of the travel route. electronic equipment.

6. 4. The electronic device according to claim 2, The control unit includes a third button for deciding to save the travel route in the second image. electronic equipment.

7. 4. The electronic device according to claim 2, The control unit is performing a first setting for setting a rotation radius of the moving object to a first radius equal to or larger than a minimum rotation radius; performing a first calculation to calculate a first rotation path according to the first radius; performing a first determination, when the first rotation path and the reference path intersect, based on a direction of the moving object at a first intersection point where the first rotation path and the reference path intersect and a position of the first intersection point, of determining whether or not the moving object can proceed to the reference path via the first intersection point; repeating the first setting of increasing the first radius, the first calculation, and the first determination until the vehicle is able to proceed along the reference path; If the reference path can be reached, an automatic stop path is generated that includes the first rotation path and the reference path. electronic equipment.

8. 8. The electronic device according to claim 7, The control unit calculates a second radius of a second rotation path that continues from the first rotation path at the first intersection, travels at a constant rotation radius, and reaches the reference path, and a direction of the moving body at the first arrival point coincides with a direction of the reference path at the first arrival point, and performs the first determination based on whether the second radius is equal to or greater than the minimum rotation radius. electronic equipment.

9. 9. The electronic device according to claim 8, A combination of a position of each of a plurality of route points on the reference route and a direction of the reference route at each of the route points is stored in the storage unit as the reference route; The control unit is calculating the second radius by performing a first determination of a path point on the reference route that is closer to the reference stopping position than the first intersection as a point of interest, and a second calculation based on a distance between the first intersection and the point of interest, a direction of the moving body at the first intersection, and a direction of the reference route at the point of interest; when the second radius is less than the minimum turning radius, repeating the first determination of determining, as the attention point, a route point on the reference route that is closer to the reference stopping position than the route point determined as the attention point, and the second calculation, until the second radius becomes equal to or greater than the minimum turning radius; If a second radius calculated for all the path points that can be recognized as the attention point is less than the minimum turning radius, it is determined that it is impossible to proceed to the reference path according to the first radius. electronic equipment.

10. displaying, on a display unit, a first image including a map of the surroundings of the moving object and a frame corresponding to the moving object shown on the map of the surroundings; determining the frame as a reference stopping position of the moving object based on an operation input that specifies the position of the frame on the surrounding map; displaying, on the display unit, a second image including the travel path until the moving object has stopped, a stop position at the time of the stop completion, and a deviation of the reference stop position; Information processing methods.

11. displaying, on a display unit, a first image including a map of the vicinity of the moving object and a frame corresponding to the moving object shown on the map of the vicinity; determining, based on an operation input specifying a position of the frame on the surrounding map, the frame as a reference stopping position of the moving object; and causing the display unit to display a second image including the travel path until the moving object has stopped, the stop position at the time of the stop completion, and a deviation between the reference stop position and the travel path until the stop completion is completed. program.

Citation Information

Patent Citations

  • A method for assisting the driver of an automobile when parking in a parking space, a driver assistance device, and an automobile.

    JP2013530867A