Program

The program in remote parking systems displays the vehicle image from the operator's perspective, addressing confusion in vehicle direction recognition, enabling intuitive and accurate vehicle exit control.

JP2024158273AInactive Publication Date: 2024-11-08TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023073342
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-27
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In remote parking systems, the vehicle's direction on the display screen of a mobile phone terminal can be confusing, making it difficult for operators to intuitively recognize the vehicle's direction of travel and orientation.

Method used

A program that displays a vehicle image representing the shape of the vehicle from the perspective of the remote control device, aligning it with the operator's viewpoint, and allows setting the exit direction as front right, front left, rear right, or rear left on the display screen.

Benefits of technology

Enables intuitive recognition of the vehicle's status and direction, facilitating accurate vehicle exit control regardless of the operator's position relative to the vehicle.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024158273000001_ABST
    Figure 2024158273000001_ABST
Patent Text Reader

Abstract

To enable an operator of a remote operation device to intuitively recognize a state of a vehicle.SOLUTION: Acquired are information about a position of a vehicle (1) and a travel direction of the vehicle (1), and information about a position of a remote operation device (25) for remotely operating an automatic operation of the vehicle (1). A vehicle image displaying a shape of the vehicle (1) when viewed from above is displayed on a display image (24) of the remote operation device (25), and at this time, the vehicle image is displayed as a vehicle image when the vehicle (1) is viewed from the position of the remote operation device (25), based on the above-described information.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a program. [Background technology]

[0002] A known remote parking system parks a vehicle by remote operation using a mobile phone terminal, and detects the positional relationship between the vehicle, the target parking space, and surrounding obstacles in real time while the vehicle is parking, and displays the positional relationship between the vehicle, the target parking space, and surrounding obstacles on a plane in real time on the display screen of the mobile phone terminal (see, for example, Patent Document 1). On the display screen of this mobile phone terminal, the vehicle is fixed in position at the center of the display screen while the target parking space and surrounding obstacles around the vehicle are displayed as if they are moving in real time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] China Patent Application Publication No. 111754809 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when the vehicle is fixed in the center of the display screen in this manner, if the direction of the vehicle as viewed by the operator of the mobile phone terminal, e.g. the direction in which the vehicle is traveling, differs from the direction of the vehicle on the display screen, e.g. the direction in which the vehicle is traveling, there is a problem that it is difficult to intuitively recognize the state of the vehicle, e.g. the direction in which the vehicle is traveling. [Means for solving the problem]

[0005] In order to solve such problems, according to the present invention, a program is provided that causes a computer to obtain information regarding the position of a vehicle and the direction of travel of the vehicle, as well as information regarding the position of a remote control device that remotely controls the automatic driving of the vehicle, and display a vehicle image representing the shape of the vehicle as viewed from above on the display screen of the remote control device, and at that time, display this vehicle image as the vehicle is viewed from the position of the remote control device based on the above-mentioned information. Effect of the Invention

[0006] The vehicle's condition can be intuitively recognized. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating the process of a vehicle leaving a parking space. [Diagram 2] FIG. 2 is a diagram showing the configuration of a vehicle. [Diagram 3] FIG. 3 is a diagram showing the shape of the vehicle as viewed from above. [Figure 4] FIG. 4 is a diagram showing an image of a vehicle displayed on the display screen of a mobile terminal. [Diagram 5] FIG. 5 is a diagram for explaining changes in the image of the vehicle displayed on the display screen of the mobile terminal. [Figure 6] FIG. 6 is a flowchart for adjusting a vehicle image and the like displayed on the display screen of a mobile terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Figures 1(A) and 1(B) show typical examples of exit processing in which a vehicle is automatically driven to exit a parking space. Note that Figure 1(A) shows a case where an exit operation of a certain vehicle 1 is performed from among many vehicles parked in parallel. In this case, in the example shown in Figure 1(A), the vehicle 1 is automatically driven to the left front from the parking space 2 to an exit position 3 as shown by the arrow. On the other hand, Figure 1(B) shows a case where an exit operation of a certain vehicle 1 is performed from among many vehicles parked in parallel. In this case, in the example shown in FIG. 1(B), the vehicle 1 is driven forward by automatic driving while turning to the right front as shown by the arrow from the parking space 2 to the exit position 3a, the vehicle 1 is driven forward by automatic driving while turning to the left front as shown by the arrow from the parking space 2 to the exit position 3b, the vehicle 1 is driven backward by automatic driving while turning to the left rear as shown by the arrow from the parking space 2 to the exit position 3c, or the vehicle 1 is driven backward by automatic driving while turning to the right rear as shown by the arrow from the parking space 2 to the exit position 3d.

[0009] The present invention is directed to a case where the vehicle 1 is equipped with a parking assistance system that controls the vehicle's departure by automatic driving, the departure assistance by the parking assistance system can be started and stopped by remote control of a remote control device, and when the departure assistance of the vehicle 1 by the parking assistance system is started, a vehicle image showing the shape of the vehicle as seen from above is displayed on the display screen of the remote control device. In such a case, in one embodiment of the present invention, the departure direction of the vehicle 1 from the parking space 2 can be set to the right front, left front, right rear, and left rear on the display screen of the remote control device. However, when the departure direction of the vehicle 1 can be set to the right front, left front, right rear, and left rear on the display screen of the remote control device in this way, if the direction of the vehicle on the display screen of the remote control device, for example, the traveling direction of the vehicle, differs from the direction of the vehicle as viewed by the operator of the remote control device, for example, the traveling direction of the vehicle, it becomes difficult to intuitively recognize in which direction the vehicle 1 should be made to leave the parking space 2 so that the vehicle 1 can be left in the direction desired by the remote operator.

[0010] For example, in the case shown in Fig. 1(A), when the remote operator of the remote control device is located at point P, if the vehicle image on the display screen of the remote control device is displayed in a manner opposite to that seen from point P, i.e., with the front of the vehicle on the left and the rear of the vehicle on the right, the remote operator will be confused for a moment as to whether to set the exit direction to the left front when exiting to exit position 3. On the other hand, in the case shown in Fig. 1(B), when the remote operator of the remote control device is located at point Q, if the vehicle image on the display screen of the remote control device is displayed in a manner opposite to that seen from point Q, i.e., with the rear of the vehicle on the near side and the front of the vehicle on the far side, the remote operator will not be able to intuitively recognize in which direction to exit vehicle 1 from parking space 2 so that vehicle 1 can be exited in the direction desired by the remote operator.

[0011] Therefore, in the present invention, even in such a case, the vehicle image displayed on the display screen of the remote control device is displayed as a vehicle image as seen from the position of the remote control device so that the remote operator can intuitively recognize whether the vehicle 1 can be pulled out in the direction desired by the remote operator. Note that the present invention can be applied particularly effectively when the direction in which the vehicle 1 is to be pulled out from the parking space 2 can be set to the right front, left front, right rear, or left rear, but is not limited to such a case and can be applied to various automatic driving states.

[0012] For example, even when the vehicle 1 determines an optimal exit direction by itself based on the surrounding conditions and the vehicle 1 heading in the optimal exit direction determined by the vehicle 1 is displayed on the display screen of the remote control device, it is difficult to intuitively recognize in which direction the vehicle 1 will exit. Therefore, the present invention is applicable to such cases as well. The present invention is also applicable to a case where the vehicle 1 is displayed on the display screen of the remote control device in a parking process for parking the vehicle 1 in a parking space by automatic driving, and is also applicable when the vehicle 1 is automatically driven by remote control regardless of the entrance / exit process of the vehicle 1.

[0013] An embodiment of the present invention will be described below by taking as an example a case where the exit direction of the vehicle 1 from the parking space 2 can be set to the right front, left front, right rear, or left rear. First, with reference to FIG. 2, a configuration of an automatically operable vehicle 1 suitable for implementing the present invention will be described. With reference to FIG. 2, reference numeral 10 denotes a vehicle drive section for applying drive force to the drive wheels of the vehicle 1, 11 denotes a braking device for braking the vehicle 1, 12 denotes a steering device for steering the vehicle 1, and 13 denotes an electronic control unit mounted in the vehicle 1. As shown in FIG. 2, the electronic control unit 13 is a digital computer and includes a CPU (microprocessor) 15, a memory 16 consisting of ROM and RAM, and an input / output port 17, which are connected to each other by a bidirectional bus 14.

[0014] On the other hand, as shown in FIG. 2, the vehicle 1 is provided with various sensors 18 necessary for the vehicle 1 to perform automatic driving, that is, sensors for detecting the state of the vehicle 1 and sensors for detecting the periphery of the vehicle 1. In this case, an acceleration sensor, a speed sensor, an azimuth sensor, and a geomagnetic sensor are used as sensors for detecting the state of the vehicle 1, and a camera for photographing the front, side, and rear of the vehicle 1, a lidar, a radar, and the like are used as sensors for detecting the periphery of the vehicle 1. The vehicle 1 is also provided with a GNSS (Global Navigation Satellite System) receiver 19, a map data storage device 20, a navigation device 21, and an operation unit 22 for performing various operations. The GNSS receiver 19 can detect the current position of the vehicle 1 (for example, the latitude and longitude of the vehicle 1) based on information obtained from a plurality of artificial satellites. Therefore, the current position of the vehicle 1 can be acquired by the GNSS receiver 19. For example, a GPS receiver is used as the GNSS receiver 19.

[0015] The map data storage device 20 stores map data and the like necessary for the vehicle 1 to perform automatic driving. This map data also includes information on the positions of parking spaces provided on roads, parking lots, and the like. These various sensors 18, the GNSS receiver 19, the map data storage device 20, the navigation device 21, and the operation unit 22 are connected to the electronic control unit 13. The vehicle 1 is also equipped with a communication device 35 connected to the electronic control unit 13. Meanwhile, FIG. 2 illustrates a remote control device 25 having a display screen 24. In the example shown in FIG. 2, the remote control device 25 is made up of a mobile terminal, and the mobile terminal 25 is capable of short-distance communication with the communication device 23 mounted on the vehicle 1.

[0016] In the example shown in Fig. 2, the vehicle 1 can be manually driven, and when a request for automatic driving control is made to the vehicle 1, the vehicle 1 can be made to perform automatic driving control. In the example shown in Fig. 2, the vehicle drive unit 10 of the vehicle 1 is composed of an electric motor driven by a secondary battery or an electric motor driven by a fuel cell, and the drive wheels are driven and controlled by these electric motors in accordance with an output signal from an electronic control unit 13. In the example shown in Fig. 2, when a request for automatic driving control is made to the vehicle 1, the braking control of the vehicle 1 is performed by the braking device 11 in accordance with the output signal from the electronic control unit 13, and the steering control of the vehicle 1 is also performed by the steering device 12 in accordance with the output signal from the electronic control unit 13.

[0017] Now, in one embodiment of the present invention, vehicle 1 is equipped with a parking assistance system that controls the departure of vehicle 1 by automatic driving, and this parking assistance system allows starting and stopping of departure assistance by the parking assistance system to be performed by mobile terminal 25. When departure assistance of vehicle 1 by the parking assistance system is started, a vehicle image representing the shape of the vehicle as seen from above is displayed on display screen 24 of mobile terminal 25, and the departure direction of vehicle 1 from parking space 2 can be set on display screen 24 of mobile terminal 25 to be right front, left front, right rear, or left rear.

[0018] In this case, the leaving assistance system uses a leaving control program that is stored in the memory 16 of the electronic control unit 13 and that can drive the vehicle 1 by automatic driving from the parking space 2 in the leaving direction set on the display screen 24 of the mobile terminal 25 without coming into contact with surrounding obstacles based on the detection results of the various sensors 18, the GNSS receiver 19, and the map data storage device 20, and when this leaving control program is started, the leaving control of the vehicle 1 is performed according to this leaving control program. Note that a detailed explanation of this leaving control program will be omitted.

[0019] Meanwhile, this leaving assistance is performed using, for example, an leaving assistance app that can be downloaded to the mobile terminal 25. When this leaving assistance app is downloaded to the mobile terminal 25, for example, a vehicle image showing the shape of the vehicle as seen from above is displayed on the display screen 24 of the mobile terminal 25 first. Furthermore, at this time, for example, four selection fields "right front", "left front", "right rear", and "left rear" for the leaving direction of the vehicle 1 from the parking space 2 are displayed on the display screen 24 of the mobile terminal 25. At this time, when any of the selection fields is touched, an arrow indicating the traveling direction of the vehicle 1 corresponding to the selection field is displayed on the display screen 24 of the mobile terminal 25, and at the same time, a leaving request button is displayed on the display screen 24 of the mobile terminal 25.

[0020] When it is recognized that there is no problem with the traveling direction of the vehicle 1 indicated by the arrow, the leaving request button is touched. When the leaving request button is touched, the leaving control program stored in the memory 16 of the vehicle 1 is started, and the leaving support by the leaving support system is started. When the leaving support is started, the vehicle 1 starts traveling by automatic driving toward the set destination position. On the other hand, when the leaving support is started, the leaving stop button is displayed on the display screen 24 of the mobile terminal 25. When it is desired to stop the vehicle 1 before the vehicle 1 reaches the set destination position, the leaving stop button is touched. When the leaving stop button is touched, the leaving control program is stopped, the leaving support by the leaving support system is stopped, and the vehicle 1 is stopped. Note that the details of the control program of this leaving support app will also be omitted.

[0021] Next, an embodiment of the present invention applied to such a parking assistance will be described with reference to Figs. 3 to 6. Fig. 3 shows the shape of the vehicle 1 as viewed from above, and the vehicle 1 shown in Fig. 3 is shown leaving a parking space. In Fig. 3, an arrow indicates the traveling direction of the vehicle 1. In the embodiment of the present invention, the traveling direction of the vehicle 1 is determined by touching any of the selection fields on the display screen 24 of the mobile terminal 25. Therefore, Fig. 3 shows a case where "right front" is selected from the four selection fields "right front", "left front", "right rear", and "left rear" on the display screen 24 of the mobile terminal 25 and "right front" is touched. Meanwhile, A, B, C, and D in Fig. 3 indicate the position of the terminal operator who is operating the mobile terminal 25.

[0022] As described above, in the embodiment of the present invention, when any one of the four selection fields "right front", "left front", "right rear", and "left rear" for the exit direction of the vehicle 1 is touched, an arrow indicating the traveling direction of the vehicle 1 corresponding to the selection field is displayed on the display screen 24 of the mobile terminal 25. Therefore, in the example shown in Fig. 3, an arrow indicating "right front" is displayed on the display screen 24 of the mobile terminal 25.

[0023] In Fig. 4, when the terminal operator is at the positions A, B, C, and D in Fig. 3, the vehicle image and the arrow indicating the traveling direction of the vehicle 1 displayed on the display screen 24 of the mobile terminal 25 are shown at A, B, C, and D, respectively. With reference to Fig. 3 and Fig. 4, when the terminal operator is located behind the vehicle 1 in the traveling direction as shown in A of Fig. 3, the vehicle image showing the shape of the vehicle 1 when viewed from above behind the vehicle 1 in the traveling direction and the arrow indicating the traveling direction of the vehicle 1 are displayed on the display screen 24 of the mobile terminal 25 as shown in A of Fig. 4, and when the terminal operator is located to the side of the vehicle 1 as shown in B of Fig. 3, the vehicle image showing the shape of the vehicle 1 when viewed from above to the side of the vehicle 1 (B side of Fig. 3) and the arrow indicating the traveling direction of the vehicle 1 are displayed on the display screen 24 of the mobile terminal 25 as shown in B of Fig. 4.

[0024] Also, when the terminal operator is located in front of the vehicle 1 in the traveling direction as shown in C of Fig. 3, a vehicle image showing the shape of the vehicle 1 when viewed from above in the traveling direction of the vehicle 1 and an arrow showing the traveling direction of the vehicle 1 are displayed on the display screen 24 of the mobile terminal 25 as shown in C of Fig. 4, and when the terminal operator is located to the side of the vehicle 1 as shown in D of Fig. 3, a vehicle image showing the shape of the vehicle 1 when viewed from above at the side of the vehicle 1 (D side of Fig. 3) and an arrow showing the traveling direction of the vehicle 1 are displayed on the display screen 24 of the mobile terminal 25 as shown in D of Fig. 4. Thus, in the embodiment according to the present invention, the vehicle image showing the shape of the vehicle 1 when viewed from above and the arrow showing the traveling direction of the vehicle 1 are displayed on the display screen 24 of the mobile terminal 25 as a vehicle image when the vehicle 1 is viewed from the position of the mobile terminal 25 and an arrow showing the traveling direction of the vehicle 1.

[0025] In this way, when a vehicle image showing the shape of vehicle 1 as seen from above and an arrow indicating the traveling direction of vehicle 1 are displayed on display screen 24 of mobile terminal 25 as a vehicle image of vehicle 1 as seen from the position of mobile terminal 25 and an arrow indicating the traveling direction of vehicle 1, the terminal operator can intuitively recognize in which direction vehicle 1 is going to travel no matter where he or she is around vehicle 1. Therefore, it becomes possible to appropriately perform the process of leaving the vehicle 1.

[0026] Next, with reference to FIG. 5, an example of a method of displaying a vehicle image and an arrow indicating the traveling direction of the vehicle 1 on the display screen 24 of the mobile terminal 25 will be described. In the example shown in FIG. 5, a standard position of the mobile terminal 25 serving as a reference is set in advance. For example, in FIG. 5, this standard position is set to a rear position A located behind the vehicle 1 on a central axis P that passes through the center G of the vehicle 1 and extends in the traveling direction of the vehicle 1, and when the terminal operator is at this standard position A, a display of a vehicle image representing the shape of the vehicle 1 when viewed from above, that is, a display of a vehicle image shown in A of FIG. 4, is set as a standard display, that is, a default display. This standard display of the vehicle image, that is, a default display, is transmitted from the vehicle 1 to the mobile terminal 25 by short-range communication as a vehicle image, and is stored in the mobile terminal 25. The arrow indicating the traveling direction of the vehicle 1 displayed on the display screen 24 of the mobile terminal 25 is displayed at a position that is predetermined for the vehicle 1 according to the traveling direction of the vehicle 1.

[0027] On the other hand, in FIG. 5, it is assumed that the terminal operator is located at a lateral position B on the axis Q that passes through the center G of the vehicle 1 and extends laterally of the vehicle 1. That is, it is assumed that the terminal operator is located at a lateral position B on the axis Q rotated clockwise by an angle Θ around the center G of the vehicle 1 with respect to the standard position A in FIG. 5. At this time, the vehicle image showing the shape of the vehicle 1 when the terminal operator sees it from above at position B is a display that is rotated counterclockwise by an angle Θ around the center G of the vehicle 1 with respect to the standard position A in FIG. 5, as shown in FIG. 4B, from the standard display shown in FIG. 4A, that is, the display of the vehicle image of the default display and the arrow indicating the traveling direction of the vehicle 1, as shown in FIG. 5B. In this way, the display form of the display of the vehicle image and the arrow indicating the traveling direction of the vehicle 1 on the display screen 24 of the mobile terminal 25 can be determined accordingly when the position B of the terminal operator with respect to the standard position A is determined, that is, when the angle Θ between the central axis P and the axis Q in FIG. 5 is determined.

[0028] In this case, when the traveling direction of the vehicle 1, the central axis P, the position of the center G of the vehicle 1, and the position of the terminal operator, i.e., the position of the mobile terminal 25, are known, the angle Θ between the central axis P and the axis Q in Fig. 5 is known, and when the angle Θ is known, the standard display, i.e., the default display vehicle image shown in A of Fig. 4 is rotated by this angle Θ, so that the display of the vehicle image and the arrow indicating the traveling direction of the vehicle 1 on the display screen 24 of the mobile terminal 25 can be changed to a display of a vehicle image representing the shape of the vehicle 1 as seen from above and an arrow indicating the traveling direction of the vehicle 1 at the position of the terminal operator. Therefore, in the embodiment according to the present invention, the central axis P, the position of the vehicle 1, and the position of the mobile terminal 25 are detected, and based on the traveling direction of the vehicle 1 and the detected central axis P, the position of the vehicle 1, and the position of the mobile terminal 25, the vehicle image and the arrow indicating the traveling direction of the vehicle 1 are displayed as shown in A, B, C, and D of Fig. 4 according to the position of the mobile terminal 25.

[0029] 6 shows a display adjustment routine for adjusting the display of the vehicle image and the arrow indicating the traveling direction of the vehicle 1, which are displayed on the display screen 24 of the mobile terminal 25. A program for executing this display adjustment routine is included in the control program of the leaving assistance app downloaded to the mobile terminal 25, and this display adjustment routine is executed within the mobile terminal 25.

[0030] Referring to FIG. 6, first, in step 30, it is determined whether or not assistance has been started. In an embodiment according to the present invention, it is determined that the leaving assistance has been started when any one of the four selection fields "right front", "left front", "right rear", and "left rear" for the leaving direction of the vehicle 1 is touched. For example, when "right front" is touched, it is determined that assistance has been started, and when "left front" is then touched to change the leaving direction from "right front" to "left front", it is also determined that assistance has been started. If it is determined that assistance has been started, the process proceeds to step 31. On the other hand, if it is determined that assistance has not been started, the process ends the processing cycle.

[0031] In step 31, the position of the vehicle 1, the traveling direction of the vehicle 1, and the direction of the central axis P of the vehicle 1 are acquired from the vehicle 1 by short-range communication. That is, in the vehicle 1, the current position of the vehicle 1 is detected by the GNSS receiver 19, and the direction of the vehicle 1, i.e., the direction of the central axis P of the vehicle 1, is detected by a geomagnetic sensor in the vehicle 1. Therefore, in step 31, the current position of the vehicle 1 and the direction of the central axis P of the vehicle 1 detected in the vehicle 1 are acquired from the vehicle 1 by short-range communication, together with the traveling direction of the vehicle 1. Next, in step 32, the position of the remote operator of the remote operation device 25, i.e., the position of the terminal operator of the mobile terminal 25, is acquired. Note that the mobile terminal 25 has a built-in GPS receiver, and therefore, in step 32, the position of the mobile terminal 25, i.e., the position of the terminal operator of the mobile terminal 25, is acquired by this GPS receiver.

[0032] Next, in step 33, it is determined whether the shape of the vehicle in the default display, i.e., the shape of the vehicle shown in A of FIG. 4, is the same as the shape of the vehicle 1 as seen from above at the position of the terminal operator. In this case, the shape of the vehicle in the default display becomes the same as the shape of the vehicle 1 as seen from above at the position of the terminal operator when the terminal operator is on the central axis P and at the rear position A of the vehicle 1 in FIG. 5. Therefore, in step 33, it is determined whether the terminal operator is on the central axis P and at the rear position A of the vehicle 1 based on the traveling direction of the vehicle 1 acquired from the vehicle 1, the direction of the central axis P, and the acquired position of the mobile terminal 25, and when it is determined that the terminal operator is on the central axis P and at the rear position A of the vehicle 1, it is determined that the shape of the vehicle in the default display is the same as the shape of the vehicle 1 as seen from above at the position of the terminal operator.

[0033] If it is determined in step 33 that the shape of the vehicle in the default display is the same as the shape of the vehicle 1 as seen from above at the position of the terminal operator, the process proceeds to step 34, where the vehicle image is displayed in the default display on the display screen 24 of the mobile terminal 25. At this time, in this embodiment, the vehicle image shown in A of Fig. 4 and an arrow indicating the traveling direction of the selected vehicle 1 are displayed on the display screen 24 of the mobile terminal 25. Next, the process proceeds to step 36.

[0034] On the other hand, when it is determined in step 33 that the shape of the vehicle in the default display is not the same as the shape of the vehicle 1 as seen from above at the position of the terminal operator, the process proceeds to step 34, where the vehicle image displayed on the display screen 24 of the mobile terminal 25 is changed to the shape of the vehicle 1 as seen from above at the position of the terminal operator by the above-mentioned method. That is, based on the acquired traveling direction of the vehicle 1, the central axis P, the position of the vehicle 1, and the position of the mobile terminal 25, a rotation angle Θ of the vehicle image in the default display required to match the shape of the vehicle on the display screen 24 of the mobile terminal 25 to the shape of the vehicle 1 as seen from above at the position of the terminal operator is obtained, and the standard display shown in A of FIG. 4, i.e., a vehicle image obtained by rotating the vehicle image in the default display by this angle Θ and an arrow indicating the traveling direction of the selected vehicle 1 are displayed on the display screen 24 of the mobile terminal 25. Next, the process proceeds to step 36.

[0035] In step 36, it is determined whether the support has ended. In the embodiment according to the present invention, a departure request button is displayed on the display screen 24 of the mobile terminal 25, and when the departure request button is touched, it is determined that the support has ended. When it is determined in step 36 that the support has not ended, the process returns to step 31, and the default display vehicle image is rotated according to the position of the terminal operator so that the shape of the vehicle on the display screen 24 of the mobile terminal 25 matches the shape of the vehicle 1 when viewed from above at the position of the terminal operator. That is, unless the departure request button is touched, the vehicle image displayed on the display screen 24 of the mobile terminal 25 and the arrow indicating the traveling direction of the selected vehicle 1 continue to change as shown by A, B, C, and D in FIG. 4 according to the position of the terminal operator. On the other hand, when it is determined in step 36 that the support has ended, that is, when the departure request button is touched, the processing cycle is ended. As described above, in the embodiment according to the present invention, when the departure request button is touched, the departure control program stored in the memory 16 of the vehicle 1 is started, and departure support by the departure support system is started.

[0036] So far, the present invention has been described as being applied to the leaving control of the vehicle 1, but the present invention is not limited to such a case, and as described above, the present invention is also applicable to a case where the vehicle 1 determines the optimal leaving direction by itself based on the surrounding conditions, and is also applicable when the vehicle 1 is automatically driven by remote control regardless of the entering process of the vehicle 1 or the entering and leaving process of the vehicle 1. The present invention is also applicable to a case where an arrow indicating the traveling direction of the vehicle 1 is not displayed. Therefore, according to the present invention, a program is provided that causes a computer to acquire information regarding the position and direction of travel of vehicle 1, as well as information regarding the position of a remote control device 25 that remotely controls the automatic driving of vehicle 1, and display a vehicle image representing the shape of vehicle 1 as viewed from above on the display screen 24 of the remote control device 25, and at that time, display the vehicle image as the vehicle 1 is viewed from the position of the remote control device 25 based on this information.

[0037] In addition, when it is impossible to acquire the traveling direction of the vehicle 1, the central axis P, the position of the vehicle 1, or the position of the mobile terminal 25, it is also possible to cause the computer to function to photograph the vehicle 1 with the camera of the mobile terminal 25, obtain the traveling direction of the vehicle 1, the direction of the central axis P of the vehicle 1, and the position of the vehicle 1 relative to the position of the mobile terminal 25 based on the photographed data, and display the vehicle image displayed on the display screen 24 of the mobile terminal 25 as the vehicle image when the vehicle 1 is viewed from the position of the mobile terminal 25 based on the obtained results. In addition, it is also possible to configure the mobile terminal 25 so that the terminal operator can arbitrarily set the display on the display screen 24 of the mobile terminal 25 to display the vehicle image when the vehicle 1 is viewed from the front, the vehicle image when the vehicle 1 is viewed from the rear, or the vehicle image when the vehicle 1 is viewed from the side. [Explanation of symbols]

[0038] 1 vehicle 2 Parking spaces 13 Electronic Control Unit 24 display screen 25 Mobile Devices

Claims

[Claim 1] A program that causes a computer to acquire information relating to the position and direction of a vehicle, and information relating to the position of a remote control device that remotely controls the vehicle's automatic driving, and to display a vehicle image representing the shape of the vehicle as viewed from above on a display screen of the remote control device, and at that time, to display the vehicle image as the vehicle is viewed from the position of the remote control device based on the above information.

Citation Information

Patent Citations

  • Mobile phone APP remote control parking dynamic display method and system, vehicle and storage medium

    CN111754809A