INFORMATION PROCESSING DEVICE, PARKING ASSISTANCE METHOD, AND PROGRAM

Abstract

An information processing device comprising a control unit and a display unit. The control unit is configured to detect a parking space as a rectangular area with long and short sides and, using the rear view display, provide supporting information regarding an angle difference between the long side and the longitudinal axis of the vehicle.

Description

CROSS-REFERENCE TO A RELATED APPLICATION

[0001] This application claims priority to Japanese Patent Application No. 2023-212420, filed on December 15, 2023, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD

[0002] This disclosure relates to an information processing device, a parking assistance method and a program. BACKGROUND

[0003] Conventionally, parking aids are known that provide guidance for setting target parking positions to assist vehicle parking. See, for example, Patent Literature (PTL) 1. CITATION LISTPatent literature

[0004] PTL 1: JP 2007-118878 A SUMMARY

[0005] Vehicle parking spaces are marked by white lines or similar markings on the roadway and are rectangular in shape, with the long sides corresponding to the longitudinal axes of the vehicles and the short sides corresponding to the transverse axes of the vehicles. If the long axis of a parked vehicle is not approximately parallel to the long axis of a parking space, the vehicle may not fit into the space. To ensure that the vehicle fits into the parking space, it is desirable to park the vehicle so that the long axis of the vehicle and the long side of the parking space are approximately parallel to each other. Technology to assist vehicle parking maneuvers therefore has room for improvement.

[0006] It would be helpful to improve the technology to support vehicle parking operations.

[0007] An information processing device according to an embodiment of the present disclosure comprises: a control unit; and an advertisement, wherein the control unit is configured to: Recognizes a parking space in which a vehicle is to be parked as a rectangular area with one long side and one short side; and by means of a rear view indicator, displays guidance information regarding an angular difference between the long side of the rectangular area and the longitudinal axis of the vehicle.

[0008] A parking assistance method according to an embodiment of the present disclosure is a parking assistance method performed by an information processing device, the parking assistance method comprising: Capturing a parking space in which a vehicle is to be parked as a rectangular area with one long side and one short side; and Display of supporting information on a rear view display regarding an angular difference between the long side of the rectangular area and a longitudinal axis of the vehicle.

[0009] A program according to an embodiment of the present disclosure is configured to cause a computer to perform operations, the operations comprising: Capturing a parking space in which a vehicle is to be parked as a rectangular area with one long side and one short side; and Display of supporting information on a rear view display regarding an angular difference between the long side of the rectangular area and a longitudinal axis of the vehicle.

[0010] According to an embodiment of the present disclosure, the technology for supporting vehicle parking operations is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In the attached drawings: Fig. 1 is a block diagram showing a schematic configuration of a system according to an embodiment of the present disclosure; Fig. 2 is a block diagram showing a schematic configuration of an information processing apparatus; Fig. 3 is a flowchart illustrating the operation of the information processing apparatus; Fig. 4 is a diagram showing an example of a mission statement; and Fig. Figure 5 is a diagram showing the angle difference between the long side of a rectangular area and the longitudinal axis of a vehicle. DETAILED DESCRIPTION

[0012] An embodiment of the present disclosure is described below. (Sketch of the embodiment)

[0013] An overview of the technology according to the embodiment of the present disclosure will be described with reference to Fig. 1. The technology according to the embodiment of the present disclosure includes a vehicle 1 and an information processing device 10 installed in the vehicle 1.

[0014] Vehicle 1 is, for example, but is not limited to, an automobile and may be any suitable vehicle. The automobile is, for example, but is not limited to, a gasoline vehicle, a battery electric vehicle (BEV), a hybrid electric vehicle (HEV), a plug-in hybrid electric vehicle (PHEV), a fuel cell electric vehicle (FCEV), or the like.

[0015] The information processing device 10 is any device used by an occupant of the vehicle 1. For example, a special device in the vehicle can be used as the information processing device 10.

[0016] First, the present embodiment will be described in outline, and details will be explained later. The information processing device 10 detects a parking space in which the vehicle 1 is to be parked as a rectangular area having a long side and a short side. The information processing device 10 also displays, on a rearview display, supporting information regarding an angular difference between the long side of the rectangular area and the longitudinal axis of the vehicle 1.

[0017] According to the present embodiment, the parking space in which the vehicle 1 is to be parked is recognized as a rectangular area having the long side and the short side, and guidance information regarding the angle difference between the long side of the rectangular area and the longitudinal axis of the vehicle 1 is displayed. Therefore, the vehicle parking assistance technology is improved by being able to provide the parking assistance guidance information such that the longitudinal axis of the vehicle 1 and the long side of the parking space are approximately parallel to each other. (Configuration of information processing devices)

[0018] The following describes in detail a configuration of the information processing device 10. The information processing device 10 is any device used by a user.

[0019] As in Fig. 2, the information processing device 10 comprises a control unit 11, a memory 12, an input interface 13, a display unit 14, a communication interface 15 and an image recording unit 16.

[0020] The control unit 11 comprises at least one processor, at least one dedicated circuit, or a combination thereof. The processor is a general-purpose processor, such as a central processing unit (CPU) or a graphics processing unit (GPU), or a dedicated processor specialized for a specific processing. The dedicated circuit is, for example, a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC). The control unit 11 executes processes related to the operation of the information processing device 10 and simultaneously controls components of the information processing device 10.

[0021] The memory 12 comprises at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these memories. The semiconductor memory is, for example, a random access memory (RAM) or a read-only memory (ROM). The RAM is, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The ROM is, for example, an electrically erasable programmable read-only memory (EEPROM). The memory 12 functions, for example, as main memory, auxiliary memory, or cache memory. The memory 12 stores data to be used in the operations of the information processing device 10 and data obtained by the operations of the information processing device 10.

[0022] The input interface 13 includes at least one interface for input. The input interface is, for example, a physical button, a capacitive button, a pointing device, or a touchscreen integrated with a display device. The input interface may, for example, be an audio sensor that accepts audio input, a camera that accepts gesture input, or the like. The input interface 13 accepts an operation for inputting data to be used for the operations of the information processing device 10. The input interface 13 may be connected to the information processing device 10 as an external device instead of being integrated into the information processing device 10. As a connection method, for example, any method such as Universal Serial Bus (USB), High-Definition Multimedia Interface (HDMI ®) (HDMI is a registered trademark in Japan, other countries, or both) or Bluetooth ® (Bluetooth is a registered trademark in Japan, other countries, or both).

[0023] The display device 14 includes at least one interface for display output. The display output interface is, for example, a display that displays a rear view and the like. The rear view is image information representing an external view of the rear of the vehicle 1. The display device is, for example, a liquid crystal display (LCD) or an organic electroluminescence (EL) display. On the display device 14, the data obtained by the operations of the information processing device 10 is displayed and output. The display device 14 may be connected to the information processing device 10 as an external device, rather than being integrated into the information processing device 10. The connection method may be any method such as USB, HDMI ® or Bluetooth ® be used.

[0024] The communication interface 15 includes a communication interface for connecting to a network. The communication interface 15 may include a communication interface for connecting to CAN. The communication interface for connecting to the network conforms to the mobile communication standards or the like, but is not limited to these and may conform to any communication standard. In the present embodiment, the information processing device 10 possessed by one mobile object is wirelessly connected to the information processing device possessed by another mobile object via the communication interface 15 and the network. The communication interface 15 receives data to be used in the operations of the information processing device 10 and transmits data obtained by the operations of the information processing device 10.

[0025] The image pickup unit 16 includes an on-board camera that generates images of the exterior view of the vehicle rear 1. In the present embodiment, the images can be still images or moving images. The in-vehicle camera included in the image pickup unit 16 can be a monocular camera or a stereo camera. The image pickup unit 16 is installed in the vehicle 1 such that the image pickup unit 16 can image the exterior view of the vehicle rear 1. Since the image pickup unit 16 images the exterior view of the rear of the vehicle 1, the aforementioned rear view can be displayed on the display 14.

[0026] The functions of the information processing device 10 can be realized by a processor corresponding to the information processing device 10 and executing a program according to the present embodiment. That is, the functions of the information processing device 10 are realized by software. The program causes a computer to execute the operations of the information processing device 10, so that the computer functions as the information processing device 10. That is, the computer executes the operations of the information processing device 10 in accordance with the program, thereby functioning as the information processing device 10.

[0027] In the present embodiment, the program may be recorded on a computer-readable recording medium. The computer-readable recording medium includes a non-transitory computer-readable medium and is, for example, a magnetic recording device, an optical disk, a magneto-optical recording medium, or a semiconductor memory. The program is distributed, for example, by selling, transferring, or renting a portable recording medium such as a Digital Versatile Disc (DVD) or a Compact Disc Read Only Memory (CD-ROM) on which the program is recorded. The program may also be distributed by storing the program in a memory of an external server and transferring the program from the external server to another computer. The program may be provided as a program product.

[0028] Some or all of the functions of the information processing device 10 may be realized by a dedicated circuit corresponding to the control unit 11. That is, some or all of the functions of the information processing device 10 may be realized by hardware. (Operation of information processing equipment)

[0029] The operation of the information processing apparatus 10 according to the present embodiment will be described with reference to Fig. 3 described.

[0030] Step S100: The control unit 11 of the information processing device 10 detects a parking space in which the vehicle 1 is to be parked as a rectangular area with one long side and one short side. Any suitable method can be used to detect the parking space. For example, the parking space can be detected by image recognition of the rear images captured by the image capture unit 16.

[0031] Step S200: The control unit 11 displays, via the display 14, guidance information regarding an angle difference between the longitudinal direction of the rectangular area and the longitudinal axis of the vehicle 1 on a rear view display.

[0032] Fig. 4 is an example of a user interface 100 including a guidance image. The user interface 100 includes a rectangular area 200 indicating a parking space, as well as supporting information 300. The rectangular area 200 is recognized based on a white line 210, a white line 220, and parking blocks 230. As described above, the supporting information 300 includes information about an angular difference between a long side of the rectangular area 200 and the front and rear directions of the vehicle 1. In Fig. 4, the supporting information 300 includes that such an angular difference is θ degrees.

[0033] Fig. 5 is a conceptual diagram showing the angle difference between the long side of the rectangular area 200 and the longitudinal axis of the vehicle 1. As in Fig. 5, such an angle difference is a value determined based on an angle between the long side of the rectangular area 200 and the longitudinal axis of the vehicle 1. Specifically, the angle difference is an angle θ formed between an auxiliary line 400 in the direction of the long side of the rectangular area 200 and an auxiliary line 500 parallel to the longitudinal axis of the vehicle 1.

[0034] The guidance information 300 may contain supporting information indicating a driving action that brings the angle difference to zero. For example, the guidance information 300 in Fig. 4 as such driving support information the direction of a steering operation. In particular, the supporting information 300 in Fig.4, driving assistance information such as "Please turn the steering wheel to the left." This allows the driver to easily steer vehicle 1 so that the angle difference approaches zero. The driving assistance information may also include the extent of the steering operation. For example, the driving assistance information may contain information about the angle at which the steering wheel is turned as the amount of the steering operation.

[0035] As described above, the information processing device 10 according to the present embodiment detects the parking space in which the vehicle 1 is to be parked as a rectangular area 200 having long and short sides, and provides assistive information 300 regarding the angle difference between the long side of the rectangular area 200 and the longitudinal axis of the vehicle 1. Therefore, the vehicle parking assistive technology is improved by being able to provide the assistive parking assistive information 300 such that the longitudinal axis of the vehicle 1 and the long side of the parking space are approximately parallel to each other.

[0036] While this disclosure has been described with reference to the drawings and examples, it should be noted that various changes and revisions may be made by those skilled in the art based on this disclosure. Accordingly, such changes and revisions are included within the scope of this disclosure. For example, functions or the like included in each component, step, or the like may be rearranged without logical inconsistency, and a plurality of components, steps, or the like may be combined into a single component, step, or the like, or a single component, step, or the like may be split.

[0037] For example, the control unit 11 can predict a travel route when parking and, if it determines that a reversing operation is necessary, inform the driver of the need for the reversing operation.

[0038] The control unit 11 can, for example, store an actual driving trajectory during parking and an ideal trajectory and later display the ideal and actual driving trajectories in a comparable manner via the display unit 14.

[0039] The supporting information 300 may also include information about a difference between the center of the rectangular area 200 and the center of the vehicle 1. This may assist the driver in parking so that the vehicle 1 fits into the center of the rectangular area 200.

[0040] Some embodiments of the present disclosure will be described below. However, it should be noted that the embodiments of the present disclosure are not limited to these examples. [Annex 1] An information processing device comprising: a control unit; and a display unit, wherein the control unit is configured to: Recognizes a parking space in which a vehicle is to be parked as a rectangular area with one long side and one short side; and by displaying on a rear view display supporting information regarding an angular difference between the long side of the rectangular area and a longitudinal axis of the vehicle. [Annex 2] Information processing equipment according to Annex 1, wherein the control unit is configured to display, using the rear view display, driver assistance information indicating a driving operation which brings the angle difference closer to zero. [Annex 3] Information processing device according to Annex 2, wherein the driver assistance information includes a steering operation which brings the angle difference closer to zero. [Annex 4] Information processing equipment according to Annex 2 or 3, wherein the driver assistance information includes an amount of steering operation which brings the angle difference closer to zero. [Annex 5] The information processing device according to Annex 1, wherein the control unit is configured to predict a travel trajectory during the parking operation and, upon determining a need for a reversing operation, notify a driver of the need for the reversing operation. [Annex 6] The information processing device according to any one of Annexes 1 to 5, wherein the control unit is arranged to store the actual driving trajectory during parking and an ideal driving trajectory, and to display the actual driving trajectory and the ideal driving trajectory in a manner that can be understood later by means of the display device. [Annex 7] The information processing device according to any one of Annexes 1 to 6, wherein the supporting information includes information regarding a difference between the center of the rectangular area and the center of the vehicle. [Appendix 8] Parking assistance method performed by an information processing device, which includes: Capturing a parking space in which the vehicle is to be parked as a rectangular area with one long side and one short side; Display of supporting information using the rear view indicator regarding the angle difference between the long side of the rectangular area and the longitudinal axis of the vehicle. [Annex 9] Parking assistance method according to Annex 8, which additionally includes the display of supporting information indicating a driving operation which brings the angle difference towards zero. [Annex 10] The parking assistance method according to Annex 9, in which the assisting information includes a steering operation that brings the angle difference closer to zero. [Annex 11] Parking assistance method according to Annex 9 or 10 in which the assisting information indicates an extent of steering operation which brings the angle difference towards zero. [Annex 12] The parking assistance method according to any one of Annexes 8 to 11, in which a driving trajectory is predicted during the parking operation and, upon determining a need for a reversing operation, the driver is notified of the need for the reversing operation. [Annex 13] The parking assistance method according to one of Annexes 8 to 12, in which the actual driving trajectory during parking and an ideal driving trajectory are additionally stored, and the actual driving trajectory and the ideal driving trajectory are displayed in a manner that can be understood later. [Annex 14] A parking assistance method according to any one of Annexes 8 to 13, in which the assisting information includes information regarding the difference between the centre of the rectangular area and the centre of the vehicle. [Annex 15] A program comprising program instructions which, when executed on a computer, causes it to perform the following operations: Recording a parking space in which the vehicle is to be parked as a rectangular area with one long side and one short side; Display of supporting information using the rear view indicator regarding the angle difference between the long side of the rectangular area and the longitudinal axis of the vehicle. [Annex 16] The program according to Annex 15, characterized in that the operations further comprise the display of supporting information, the information indicating a driving operation which brings the angular difference closer to zero. [Annex 17] The program according to Annex 16, characterized in that the supporting information includes a steering operation which brings the angle difference closer to zero. [Annex 18] The program according to Annex 16 or 17 in which the supporting information indicates an extent of steering operation which brings the angular difference towards zero. [Annex 19] The program according to any one of Annexes 15 to 18, in which a driving trajectory is predicted during the parking operation and, upon determining a need for a reversing operation, the driver is notified of the need for the reversing operation. [Annex 20] The program according to one of the Annexes 15 to 19, in which the actual driving trajectory during parking and an ideal driving trajectory are additionally stored, and the actual driving trajectory and the ideal driving trajectory are displayed in a manner that can be understood later. QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] JP 2023-212420

[0001] JP 2007-118878 A

[0004]

Claims

[1] Information processing device, comprising: a control unit; and a display device, The control unit is designed to: a parking space in which the vehicle is to be parked shall be recorded as a rectangular area with one long side and one short side; and to display supporting information regarding an angular difference between the long side of the rectangular area and the longitudinal axis of the vehicle using a rear view indicator. [2] The information processing apparatus according to claim 1, wherein the control unit is configured to display, using the rear view display, driver assistance information indicating a driving operation that brings the angle difference closer to zero. [3] The information processing apparatus according to claim 2, wherein the driver assistance information includes a steering operation that makes the angle difference approach zero. [4] The information processing apparatus according to claim 3, wherein the driver assistance information includes an amount of the steering operation that makes the angle difference approach zero. [5] The information processing apparatus according to claim 1, wherein the control unit is configured to predict a travel trajectory during the parking operation, and upon determining a need for a reversing operation, notify a driver of the need for the reversing operation. [6] The information processing apparatus according to claim 1, wherein the control unit is configured to store the actual driving trajectory during parking and an ideal driving trajectory, and to display the actual driving trajectory and the ideal driving trajectory in a manner understandable later by means of the display device. [7] The information processing apparatus according to claim 1, wherein the supporting information includes a difference between the center of the rectangular area and the center of the vehicle. [8] Parking assistance method performed by an information processing device, which includes: Capturing a parking space in which the vehicle is to be parked as a rectangular area with one long side and one short side; Display of supporting information using the rear view indicator regarding the angle difference between the long side of the rectangular area and the longitudinal axis of the vehicle. [9] A parking assistance method according to claim 8, further comprising displaying assistive information indicating a driving operation that brings the angle difference closer to zero. [10] A parking assistance method according to claim 9, wherein the assisting information includes a steering operation that brings the angle difference closer to zero. [11] A parking assist method according to claim 10, wherein the assisting information indicates an amount of steering operation that makes the angle difference approach zero. [12] A parking assistance method according to claim 8, in which a driving trajectory is predicted during the parking operation, and upon determining a need for a reversing operation, the driver is notified of the need for the reversing operation. [13] Parking assistance method according to claim 8, in which additionally the actual driving trajectory during parking and an ideal driving trajectory are stored, and the actual driving trajectory and the ideal driving trajectory are displayed in a manner that can be understood later. [14] A parking assist method according to claim 8, wherein the assisting information includes information regarding the difference between the center of the rectangular area and the center of the vehicle. [15] A program comprising program instructions which, when executed on a computer, cause it to perform the following operations: Recording a parking space in which the vehicle is to be parked as a rectangular area with one long side and one short side; Display of supporting information using the rear view indicator regarding the angle difference between the long side of the rectangular area and the longitudinal axis of the vehicle. [16] A program according to claim 15, characterized in that the operations further comprise displaying supporting information, the information indicating a driving operation which brings the angle difference closer to zero. [17] Program according to claim 16, characterized in that the supporting information includes a steering operation which brings the angle difference closer to zero. [18] A program according to claim 17, wherein the supporting information indicates an amount of steering operation which brings the angle difference closer to zero. [19] A program according to claim 15, in which a driving trajectory is predicted during the parking operation, and upon determining a need for a reversing operation, the driver is notified of the need for the reversing operation. [20] Program according to claim 15, in which additionally the actual driving trajectory during parking and an ideal driving trajectory are stored, and the actual driving trajectory and the ideal driving trajectory are displayed in a manner that can be understood later.

Images