Vehicle control system

The vehicle control system addresses inefficient parking and complex device operations by using sensors to recognize user gestures and voice commands, enabling easy and efficient vehicle positioning.

JP2024159857AActive Publication Date: 2024-11-08KOITO MFG CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024139111
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2019-06-28
Filing Date
2024-08-20
Publication Date
2024-11-08
Estimated Expiration
2040-06-24

Smart Images

  • Figure 2024159857000001_ABST
    Figure 2024159857000001_ABST
Patent Text Reader

Abstract

To facilitate parking an automatic operation vehicle to a parking space from the outside of the vehicle.SOLUTION: A sensor 321 is mounted on an automatic operation vehicle 302 to detect a gesture of a user U around the vehicle. A control unit 311 of the vehicle 302 is provided with: a recognition unit 313 which recognizes the gesture as an instruction for moving the vehicle; and a vehicle drive mechanism 331 which drives the vehicle 2 based on the moving instruction. The control unit 311 generates a control signal (a pulse) based on the moving instruction, and the vehicle drive mechanism 331 into which the control signal is input moves the vehicle for every unit pulse.SELECTED DRAWING: Figure 17
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a vehicle control system. [Background technology]

[0002] In recent years, there has been progress in the development of technology for externally operating an unmanned autonomous vehicle and moving it to a desired location such as a parking lot or a vehicle dispatch location. For example, Patent Document 1 (particularly, paragraphs 0114-0115 of the specification and FIG. 8 of the drawings) discloses a technology for receiving an automatic parking instruction signal from a mobile device and performing automatic parking based on parking location information of the automatic parking instruction signal. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 073632 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the technology of Patent Document 1, even if there is a space for pulling over as seen by the human eye, the automatic driving system sets the vehicle interval large, which means that parking space cannot be saved. In addition, there is also the problem that it takes time to refer to and learn how to set up and operate the mobile device.

[0005] SUMMARY OF THE PRESENT EMBODIMENT An object of the present invention is to provide a vehicle control system for an autonomous vehicle that allows the vehicle to be easily pulled up to a desired position from outside the vehicle. [Means for solving the problem]

[0006] In order to solve the above problems, the vehicle control system of the present invention comprises a sensor mounted on an autonomous vehicle, a control means for controlling the vehicle based on input from the sensor, and a vehicle driving means for driving the vehicle based on a control signal input from the control means, wherein the sensor detects gestures of people around the vehicle, the control means includes a recognition means for recognizing the gestures as instructions for moving the vehicle, and the vehicle driving means moves the vehicle based on the instructions. Effect of the Invention

[0007] According to the vehicle control system of the present invention, a sensor detects gestures of people around the vehicle and moves the self-driving vehicle based on the gestures, which has the effect of allowing the user to pull up to a desired location based on their own sense. In addition, since the user can pull up to a desired location using gestures similar to those used to give instructions to drivers, there is also the effect that the user does not need to learn how to set up the device again. [Brief description of the drawings]

[0008] [Figure 1] 1 is a schematic diagram of a vehicle information display system according to a first embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing a side module. [Diagram 3] FIG. 2 is a block diagram of the vehicular information display system of FIG. 1. [Figure 4] FIG. 11 is an explanatory diagram showing how information is projected onto a palm. [Diagram 5] FIG. 13 is an explanatory diagram showing a state in which information is projected onto a display in security mode. [Figure 6] FIG. 1 is an explanatory diagram showing a state in which information is projected onto a screen. [Figure 7] FIG. 13 is an explanatory diagram showing how information is projected onto the knee. [Figure 8] 4 is a flowchart showing the operation of the vehicular information display system of FIG. 1. [Figure 9] FIG. 11 is a schematic diagram showing a vehicle equipped with a vehicle information display device according to a second embodiment. [Figure 10] FIG. 11 is a schematic diagram of a vehicle information display device according to a second embodiment. [Figure 11] 10 is a block diagram of the vehicle information display device of FIG. 9. [Figure 12] FIG. 11 is an explanatory diagram showing how information is projected onto a palm. [Figure 13] FIG. 13 is an explanatory diagram showing a state in which information is projected onto a display in security mode. [Figure 14] FIG. 1 is an explanatory diagram showing a state in which information is projected onto a screen. [Figure 15] FIG. 13 is an explanatory diagram showing how information is projected onto the knee. [Figure 16] 10 is a flowchart showing a display destination selection operation performed when the vehicle information display device of FIG. 9 displays information; [Figure 17] FIG. 11 is a schematic diagram of a vehicle control system according to a third embodiment. [Figure 18] FIG. 18 is a block diagram of the vehicle control system of FIG. 17. [Figure 19] FIG. 2 is a schematic diagram of a side module. [Figure 20] FIG. 11 is an explanatory diagram showing how a vehicle is moved by a gesture. [Figure 21] FIG. 13 is an explanatory diagram showing how a vehicle is moved by voice. [Figure 22] FIG. 13 is an explanatory diagram showing a state in which a vehicle is moved while checking a minimum movement unit drawn on a road surface. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, specific embodiments of the present invention will be described with reference to the drawings, in which the present invention is embodied in a vehicle information display system, a vehicle information display device, and a vehicle control system that are mounted on an autonomous shared car. EXAMPLES

[0010] As shown in FIG. 1, when the vehicle information display system 101 recognizes a user U using a shared car 102, it draws an image 151 on the road surface including hospitality information such as "Welcome!" and usage information such as the destination and usage time.

[0011] 2, the vehicle information display system 101 is mainly mounted on a side module 103 that displays information toward the outside of the vehicle body. An AD marker (automatic driving marker) 4 that indicates the automatic driving state is provided on the periphery of the side module 103.

[0012] 3, the vehicle information display system 101 includes a display unit 114 that displays predetermined information for a user U, a camera 120 for detecting a user U using the shared car 102, a sensor 121 that measures the environment in which the display unit 114 displays information, a storage unit 125 that stores information to be presented to the user U, an external server 124 that distributes the information to be presented to the user U via cloud communication, wired communication, or the like, a control unit 111 that controls the display unit 114, an actuator 122 that adjusts the position and orientation of the display unit 114, and an interface 123 that inputs information distributed from the external server 124. As the sensor 121, LiDAR, millimeter wave radar, a sound sensor, or the like can be used.

[0013] The display unit 114 includes a display 116, a drawing light 117 that draws an image generated by the image generation unit 112, and a projection target 115 onto which the drawing light 117 projects an image, and the projection target 115 includes a screen 118, a road surface 119, and the body of the user U, such as the palms of the hands and knees. The screen 118 is normally stored in the side module 103, and is extended from the side module 103 during projection (see FIG. 6). The drawing light 117 can be a single type capable of drawing a fixed image, or a generating type capable of free drawing using a DMD (Digital Micromirror Device) or the like.

[0014] The control unit 111 includes an image generation unit 112 that generates an image 151 to be displayed on the display unit 114 based on information input from a memory unit 125 or an external server 124, and a display destination selection unit 113 that selects the display unit 114 on which to display information depending on the content of the information.

[0015] The display destination selection unit 113 performs face authentication of the user U based on the person photographed by the camera 120 and the usage information of the shared car 102 acquired from the external server 124. Then, when the user U is detected, the display destination is selected according to the content of the information to be displayed and the display environment.

[0016] For example, when the content of the information to be displayed does not include information related to security or privacy, such as "Welcome!", the display destination selection unit 113 selects either the display 116 or the road surface 119 as the display destination. Furthermore, the display destination selection unit 113 judges whether or not the road surface 119 is suitable as a display environment based on the measurement results input from the sensor 121. Examples of cases in which the road surface 119 is not suitable as a display environment include cases where there is a step on the road surface 119 that may cause the drawing to become distorted, or cases where the road surface 119 is wet with rain or covered with snow, making it difficult to read the drawn information.

[0017] When the display destination selection unit 113 determines that the road surface 119 is suitable as the projection target 115, it selects the drawing light 117 and the road surface 119 as the display destination. At this time, the image generation unit 112 generates an image 151 for display based on information to be displayed toward the user U, and the control unit 111 outputs the image 151 to the drawing light 117. Conversely, when it determines that the road surface 119 is not suitable as the projection target 115, it selects the display 116 as the display destination. In this case, the control unit 111 causes the image 151 to be displayed on the display 116.

[0018] When the content of the information to be displayed includes information related to security or privacy, such as "Mr. / Ms. XX" or "Destination is XX", the display destination selection unit 113 first displays guidance 152 on the display 116. For example, as shown in Fig. 4, it displays "Please hold your hand over." Here, the display destination selection unit 113 detects whether or not the designated projection target 115, that is, the hand of the user U, is held over a position where projection is possible, based on the measurement result input from the sensor 121.

[0019] Then, if the hand of user U is detected, the hand of user U is selected as the display destination, and control unit 111 outputs image 151 to be displayed on drawing lamp 117. In this case, user U can confirm image 151 by looking at the palm of his / her hand. On the other hand, if the hand of user U is not detected, display destination selection unit 113 selects display 116 in security mode as the display destination, as shown in Fig. 5. As display 116 in security mode, for example, a display configured so that image 151 can be seen only from the front of display 116 can be used.

[0020] As shown in FIG. 6, it is also possible to select the screen 118 as the display destination, display the message "Please look at the screen" on the display 116, and then extend the screen 118 from the side module 103 and project the image 151 onto it.

[0021] However, depending on the user U, it may be difficult for the user U to put out his / her hand or check the screen 118. As shown in FIG. 7, for example, when it is found that the user U is using a wheelchair based on information acquired from the external server 124, guidance 152 such as "Please move forward" or "Projection will be made on the knees" is displayed on the display 116. Then, when the display destination selection unit 113 detects the knees of the user U, it selects the knees of the user U as the display destination, and then the control unit 111 outputs the image 151 to the drawing lamp 117. In this way, it is also possible to display the guidance 152 according to the state of the user U and appropriately select a part of the user U's body to be used as the projection target 115.

[0022] Next, the operation of the vehicle information display system 101 will be described with reference to FIG. 8. First, the display destination selection unit 113 detects the user U based on an image input from the camera 120 (S101), and acquires information to be displayed to the user U (S102). If the acquired information does not include information related to security or privacy (S103: No), the display destination selection unit 113 judges whether drawing on the road surface 119 is possible or not based on the measurement result input from the sensor 121. If it is judged that it is possible (S104: Yes), the display destination selection unit 113 selects the road surface 119 as the display destination, and the control unit 111 outputs the image 151 generated by the image generation unit 112 based on the information to be displayed to the drawing light 117 (S105, S106). On the other hand, if it is judged that drawing is impossible, the display destination selection unit 113 selects the display 116 as the display destination, and the control unit 111 displays the image 151 on the display 116 (S107).

[0023] On the other hand, if the acquired information includes information related to security or privacy (S103: Yes), the process transitions to security mode. First, the display destination selection unit 113 displays guidance 152 related to the projection target 115, such as "Please hold your hand over" on the display (S108). If the display destination selection unit 113 detects the projection target 115 based on the measurement result of the sensor 121 (S109: Yes), it selects the specified projection target 115 as the display destination, and the control unit 111 outputs an image 151 to the drawing lamp 117 (S110, S111). If the projection target 115 cannot be detected (S109: No), the image 151 is displayed on the display 116 in security mode (S112).

[0024] According to the vehicle information display system 101 having the above-described configuration, the display destination is selected based on multiple conditions, namely, the content of the information to be displayed to the user U and the environment in which it is displayed. This has the effect of enabling the information to be displayed in a more suitable environment while taking into consideration the privacy and security of the user U. EXAMPLES

[0025] 9 and 10, when the vehicle information display device 201 recognizes a user U using the shared car 2, it displays welcoming information such as "Welcome!" on the display 216 and outputs an image 251 including usage information such as a destination and a usage schedule from a drawing light 217. In addition, an AD marker (automatic driving marker) 4 indicating an automatic driving state is provided on the periphery of the vehicle information display device 3. Note that while the vehicle information display device 201 is traveling with the user U on board, it is capable of receiving advertisements, news, and the like from an external server 224 and displaying them one after another on the display 216.

[0026] As shown in FIGS. 9 to 11, the vehicle information display device 201 includes a display 216 that displays predetermined information toward the user U, a drawing light 217, a screen 218, a camera 220 for detecting the user U who uses the shared car 2, a sensor 221 that measures the environment in which the display unit 214 displays information, a storage unit 225 that stores information to be presented to the user U, an external server 224 that distributes information to the user U by cloud communication or wired communication, a control unit 211 that controls the vehicle information display device 201, an actuator 222 that adjusts the image drawing position and output direction of the drawing light 217, and an interface 223 that inputs information distributed from the external server 224. At this time, the sensor 221 also functions as a sensor that detects the user U. As the sensor 221, LiDAR, millimeter wave radar, audio sensor, etc. can be adopted.

[0027] The display unit 214 includes a display 216, a drawing light 217 that draws an image generated by the image generation unit 212, and a projection target 215 onto which the drawing light 217 projects an image, and the projection target 215 includes a screen 218, a road surface 219, and at least a part of the body of the user U, such as the palm or knee. The screen 218 is normally stored in the vehicle information display device 201, and is extended from the vehicle information display device 201 during projection (see FIG. 14). The drawing light 217 can be a single type that can draw a fixed image, or a generating type that can freely draw using a DMD (Digital Micromirror Device) or the like.

[0028] The control unit 211 includes an image generation unit 212 that generates an image 251 to be output from the display 216 or the drawing light 217 based on information input from the memory unit 225 or the external server 224, and a display destination selection unit 213 that selects the display unit 214 on which to display the information depending on the content of the information.

[0029] The display destination selection unit 213 performs face authentication of the user U based on the image of the user U captured by the camera 220 and the usage information of the shared car 2 acquired from the external server 224. Then, when the user U is detected, the display destination is selected according to the content of the information to be displayed and the display environment.

[0030] For example, when the content of the information to be displayed does not include information related to security or privacy, such as a hospitality image "Welcome!", the display destination selection unit 213 selects either the display 216 or the road surface 219 as the display destination. Furthermore, the display destination selection unit 213 determines whether or not the road surface 219 is suitable as a display environment based on the measurement result input from the sensor 221. Examples of cases in which the road surface 219 is not suitable as a display environment include cases where there is a step on the road surface 219 that may cause the drawing to be distorted, or cases where the road surface 219 is wet with rain or covered with snow, making it difficult to read the drawn information.

[0031] When the display destination selection unit 213 determines that the road surface 219 is suitable as the projection target 215, it selects the drawing light 217 and the road surface 219 as the display destination. At this time, the image generation unit 212 generates an image 251 for display based on information to be displayed toward the user U, and the control unit 211 outputs the image 251 to the drawing light 217. Conversely, when it determines that the road surface 219 is not suitable as the projection target 215, it selects the display 216 as the display destination. In this case, the control unit 211 causes the image 251 to be displayed on the display 216.

[0032] For example, when the content of the information to be displayed includes information related to security or privacy, such as "Mr. / Ms. XX", "Destination is XX", or credit card information, financial institution information, user's address, place of employment, or family information, the display destination selection unit 213 first displays guidance 252 on the display 216. For example, as shown in FIG. 12, it displays "Please hold your hand over." Here, the display destination selection unit 213 detects whether the designated projection target 215, that is, the hand of the user U, is held over a position where projection is possible, based on the measurement result input from the sensor 221.

[0033] Then, when the sensor 221 detects the hand of the user U, which is at least a part of the body of the user U, in the projection range A of the drawing light 217, the hand of the user U is selected as the display destination, and the control unit 211 outputs the image 251 to be displayed on the drawing light 217. The drawing light 217 then starts projection onto the hand of the user U. In this case, the user U can confirm the image 251 by looking at his or her palm. On the other hand, when the hand of the user U cannot be detected, the display destination selection unit 213 selects the display 216 in security mode as the display destination, as shown in FIG. 13. As the display 216 in security mode, for example, a display 216 configured so that the image 251 can be seen only from the front of the display 216 can be used.

[0034] As shown in FIG. 14, it is also possible to select the screen 218 as the display destination, display the message "Please look at the screen" on the display 216, and then roll out the screen 218 from the vehicle information display device 201 and project the image 251.

[0035] However, depending on the user U, it may be difficult for the user U to put out his / her hand or check the screen 218. As shown in FIG. 15, for example, when it is found that the user U is using a wheelchair based on information acquired from the external server 224, guidance 252 such as "Please move forward" and "Projection will be made on the knees" is displayed on the display 216. Then, when the display destination selection unit 213 detects the knees of the user U, which are at least a part of the body of the user U, in the projection range A of the drawing light 217, the display destination selection unit 213 selects the knees of the user U as the display destination, and then the control unit 211 outputs the image 251 to the drawing light 217. Then, the drawing light 217 starts projection. In this way, it is also possible to display the guidance 252 according to the state of the user U, and appropriately select a part of the body of the user U to use as the projection target 215.

[0036] Next, the operation of the vehicle information display device 201 to display information will be described with reference to FIG. 16. First, the display destination selection unit 213 detects the user U based on an image input from the camera 220 (S201), and acquires information to be displayed to the user U (S202). If the acquired information does not include information related to security or privacy (S203: No), the display destination selection unit 213 judges whether drawing on the road surface 219 is possible or not based on the measurement result input from the sensor 221. If it is judged that it is possible (S204: Yes), the display destination selection unit 213 selects the road surface 219 as the display destination, and the control unit 211 outputs the image 251 generated by the image generation unit 212 based on the information to be displayed to the drawing light 217 (S205, S206). On the other hand, if it is judged that drawing is impossible, the display destination selection unit 213 selects the display 216 as the display destination, and the control unit 211 displays the image 251 on the display 216 (S207).

[0037] On the other hand, if the acquired information includes information related to security or privacy (S203: Yes), the process transitions to security mode. First, the display destination selection unit 213 displays guidance 252 related to the projection target 215, such as "Please hold your hand over" on the display (S208). If the display destination selection unit 213 detects the projection target 215 based on the measurement result of the sensor 221 (S209: Yes), it selects the specified projection target 215 as the display destination, and the control unit 211 outputs an image 251 to the drawing lamp 217 (S210, S211). If the projection target 215 cannot be detected (S209: No), the image 251 is displayed on the display 216 in security mode (S212).

[0038] According to the vehicle information display device 201 configured as described above, when the sensor 221 detects at least a part of the user's body as the projection target 215 in the projection range A of the drawing light 217, the drawing light 217 is configured to start projection, so the user U can check information while hiding it from the eyes of others with his or her own body. This has the effect of being able to display information related to the user U's privacy and security in a way that is difficult for others to see. EXAMPLES

[0039] As shown in Figs. 17 to 19, the vehicle control system 301 is composed of a side module 303 including a sensor 321 mounted on an autonomous vehicle 302, a control unit 311 that controls the vehicle 302 based on an input from the sensor 321, a vehicle drive mechanism 331 that drives the vehicle 302 based on a control signal input from the control unit 311, and a second drawing light 32 (see Fig. 22) that projects an image 352 representing a minimum movement unit on a road surface. The vehicle drive mechanism 331 includes a mechanism for moving the vehicle 302, such as a drive wheel. Here, the minimum movement unit indicates a minute movement distance d (see Fig. 22) that the vehicle drive mechanism 331 minutely operates according to a one-pulse control signal generated by the control unit 311, and the vehicle 302 moves as a result of the operation.

[0040] The side module 303 includes display units such as a display 316 for displaying predetermined information toward the user U, a first drawing light 317, and a screen 318, a camera 320 for detecting the user U around the vehicle and performing face authentication, a sensor 321 for detecting the gestures and voice of the user U, a memory unit 325 for storing information to be output to the display 316 and / or the first and second drawing lights 17, 32, and an interface 323 for transmitting control signals from the control unit 311 to the vehicle drive mechanism 331 and the second drawing light 332. The interface 323 also has a function of inputting information distributed from an external server (not shown).

[0041] 19, an AD marker (autonomous driving marker) 4 indicating an autonomous driving state is provided on the periphery of the side module 303. As the sensor 321, LiDAR, millimeter wave radar, audio sensor, etc. can be adopted, and it is also possible to measure the driving environment such as road surface conditions, brightness around the vehicle, and distance between other vehicles using the sensor 321. On the other hand, it is also possible to perform face authentication of the user U using the camera 320, and input the gesture of the user U from the sensor 321 again when the authentication is successful.

[0042] The control unit 311 includes an image generation unit 312 that generates images 351, 52 to be output from the display 316 and the first and second drawing lights 17, 32 based on information input from a storage unit 325 or an external server, and a recognition unit 313 that recognizes a gesture of the user U detected by the sensor 321 as an instruction for moving the vehicle. At this time, the control unit 311 also performs a process of transmitting a control signal to a vehicle drive mechanism 331 based on the recognized instruction.

[0043] The image generating unit 312 generates images 351, 52 to be output to the display 316 and the first and second drawing lights 17, 32. The image 351 output to the drawing light 17 can be projected onto a screen 318, the road surface around the vehicle, or a part of the body of the user U, such as the palm or knee of the user U. The screen 318 is usually stored in the side module 303, and is extended from the side module 303 during projection. The drawing light 17 can be a single type capable of drawing a fixed image, or a generating type capable of freely drawing using a DMD (Digital Micromirror Device) or the like. As shown in FIG. 19, it is also possible to display an autonomous driving mode on the display 316 and display guidance on the road surface using the first drawing light 317.

[0044] The recognition unit 313 performs lip reading processing based on the user U's motion, voice recognition, and lip movement based on information such as images, videos, and distances input from the sensor 321, and recognizes instructions for moving the vehicle. As a recognition method, pattern matching based on predetermined image / video information and sound information, AI that has deep-learned gestures and voices for moving the vehicle, and the like can be selected. Examples of gestures include waving a hand or arm in the direction in which the vehicle 302 is to be moved, pointing with a finger, and the like. In addition, the user U's facial expression may be used as a gesture. Examples of voice include "go ahead" and "back." Examples of lip movement include making the mouth shape to issue voice instructions such as "go ahead" and "back."

[0045] Further, the recognition unit 313 determines the direction of movement and the number of movements of the vehicle 302 based on the recognized instructions for moving the vehicle. For example, the direction of the gesture movement may be determined as the direction of movement, and the number of times the movement is repeated may be determined as the number of movements. Alternatively, the direction of movement may be determined based on the voice recognition result, the lip reading result, the positional relationship between the user U and the vehicle 302, and the number of times the voice or lip movement is repeated may be determined as the number of movements. In this case, for example, when the voice is recognized as "please, please," the number of movements may be determined as two. In addition, a method of determining the direction of movement and the number of movements by using instructions based on the gesture, the voice recognition result, and the lip reading result in a composite manner may also be adopted.

[0046] The control unit 311 generates a control signal including information on the direction of movement and the number of movements determined by the recognition unit 313. At this time, the number of movements is transmitted by the number of pulses of the control signal. For example, when the user U gives an instruction only once, one pulse of the control signal is transmitted. Then, the vehicle drive mechanism 331 performs an operation corresponding to one pulse, and the vehicle 302 moves by the distance d, which is the minimum movement unit (see FIG. 22).

[0047] The second drawing light draws an image 352 indicating a distance d, which is the minimum unit of movement, on the road surface around the vehicle 302 to assist the user U in pulling over. The drawn image 352 may be lines drawn in parallel at intervals d as long as the distance d can be determined. In addition, the second drawing light can draw on the road surface in the moving direction of the vehicle 302 for a predetermined period of time after an instruction from the user U is recognized.

[0048] Next, the movement of the vehicle control system 301 will be described with reference to Figs. 20 to 22. As shown in Fig. 20, when the user U makes a gesture of waving his / her arm, the sensor 321 detects the gesture, and the recognition unit 313 of the control unit 311 recognizes an instruction for moving the vehicle based on the information input from the sensor 321. Also, as shown in Fig. 21, when the user U makes a sound such as "please" or "back", the sensor 321 detects the sound or the deformation of the user U's lips, and the recognition unit 313 of the control unit 311 recognizes an instruction for moving the vehicle based on the information input from the sensor 321. At this time, the direction approaching the user U may be recognized as the forward direction, and the direction moving away from the user U as the backward direction. The instruction for moving the vehicle includes the moving direction and the number of movements of the vehicle, and the control unit 311 generates a control signal based on these instructions and transmits it to the vehicle driving mechanism 331. The vehicle driving mechanism 331 operates for each pulse, and moves the vehicle 302 for each minimum movement unit.

[0049] The control unit 311 also transmits a control signal to the second drawing light 332. As shown in Fig. 22, the second drawing light 332 projects an image 352 indicating a distance d, which is a minimum movement unit, onto the road surface along the moving direction of the vehicle 302. At this time, if there is an obstacle W such as a wall in the traveling direction of the vehicle 302, a part of the image 352 is projected onto the obstacle W. By checking the image 352 projected onto the road surface and the obstacle W, the user U can grasp the number of times the car park can be pulled over and the movement limit position B of the car park.

[0050] According to the vehicle control system 301 configured as above, gestures of the user U outside the vehicle are input from the sensor 321, and instructions for moving the vehicle are recognized by the recognition unit 313, so that the user U does not need to operate any special device and can easily move the vehicle 302. In addition, there is an effect that the position of the vehicle 302 can be confirmed by human eyes, and each person can pull the vehicle over to a desired position. Furthermore, there is an effect that the number of gesture instructions corresponds to the number of control pulses, so that the vehicle can be gradually pulled over little by little.

[0051] The present invention is not limited to the above embodiment, and the shape and configuration of each part can be appropriately changed without departing from the spirit of the present invention. For example, the sensor 321 can be installed at the front and / or rear of the vehicle 302 to detect gestures, voice, and lip movements of the user U in front or rear. [Explanation of symbols]

[0052] 101 Vehicle information display system 102 Shared Car 103 Side Module 104 AD Marker 111 Control section 112 Image Generation Unit 113 Display destination selection section 114 Display section 115 Projected object 116 Display 117 Drawing light 118 screens 119 Road surface 120 Camera 121 Sensors 122 Actuator 123 Interface 124 External Server 125 Storage section 151 images 152 Guidance 201 Vehicle information display device 204 AD Marker 211 Control Unit 212 Image Generation Unit 213 Display destination selection section 214 Display section 215 Projected object 216 Display 217 Drawing light 218 screens 219 Road surface 220 Camera 221 Sensor 222 Actuator 223 Interface 224 External Server 225 Storage section 251 images 252 Guidance 301 Vehicle Control System 302 vehicles 303 Side Module 304 AD Marker 311 Control Unit 312 Image Generation Unit 313 Recognition part 316 Display 317 1st drawing light 318 screens 320 Camera 321 Sensors 323 Interface 325 Storage section 331 Vehicle Drive Mechanism 332 2nd drawing light 351,352 images A Projection Range B Travel limit position W Obstacle U User

Claims

1. A vehicle driving system comprising: a sensor mounted on an autonomous vehicle; a control means for controlling the vehicle based on an input from the sensor; and a vehicle driving means for driving the vehicle based on a control signal input from the control means; The sensor detects gestures of a person around the vehicle; the control means includes recognition means for recognizing the gesture as an instruction for moving the vehicle; The vehicle control system is characterized in that the vehicle driving means moves the vehicle based on the instruction.

2. The control means outputs a control signal to the vehicle drive means based on the instruction, 2. The vehicle control system according to claim 1, wherein the vehicle driving means moves a minimum movement unit for each unit pulse of the control signal.

3. Equipped with a drawing light that projects an image onto the road surface around the vehicle, 3. The vehicle control system according to claim 1, wherein the image lamp projects an image indicating a movement limit position of the vehicle onto a road surface.

4. The sensor detects voice from a person around the vehicle; 4. The vehicle control system according to claim 1, wherein the control means includes a voice recognition means for recognizing a detected voice as the instruction.

5. The sensor detects lip movements of a person around the vehicle; The control means includes lip reading means for recognizing detected lip movements as the instruction. A vehicle control system according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Parking support method and parking support device

    JP2008174192A

  • Vehicle device, vehicle control system, and vehicle control method

    JP2016018413A

  • Vehicle contact position display device

    JP2016069903A

  • Peripheral information determining device and peripheral information determining method

    WO2018078713A1

  • Vehicular illumination device, vehicle system, and vehicle

    WO2017073632A1