System and control method giving operation instruction of remote operation by majority decision

Abstract

To provide a method capable of realizing complete automatic operation of an autonomous drive level SEA level 5, when aiming at the same.SOLUTION: An operation system selects remote control operators composed of multiple people which apply operation / driving not only to a vehicle but also to heavy-construction machinery, etc. by remote control operation which utilizes network communication. The remote control operators issue instructions of remote operation while looking at information of driving and running images. The operation system adopts an operation instruction of safety and ease by majority decision. The operation performance of each remote control operator is accumulated to an experience value as point and, in the case of danger or unsafety, the point is reduced. Further, a client can stop the remote control operation and can stop the vehicle safely by stepping on a brake in the case of unstable operation or sensing danger. When a passenger senses danger and wants to stop the remote control operation of the operation system, the passenger can release the remote control operation by stepping on a brake pedal. Further, the passenger can select whether to continue the driving by intention of the passenger.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] Remote operation using wireless communications such as autonomous driving and 5G

Background Art

[0002] With the development of the network communication environment called 5G, real-time images can reach the operator almost without delay. In modern times, where combat games and the like conducted via the Internet have almost no time lag, it is considered that the environment is becoming effective for remote operation.

[0003] In addition, it is considered that there are people who want to operate vehicles, aircraft, train operation simulation games, etc., such as driving games, flight simulators, and train operation simulation games, to some extent in the network environment. It is expected that it is fully possible to balance the demand to move in the real society and the supply to simulate driving and operation in the virtual society.

[0004] The operation system recruits remote operators connected to the network and registers them in the operation system. The remote operator aims to obtain points according to the operation results and is directed to be careful about safe and secure operation.

[0005] The operation system can exclude malicious remote operators or remote operators with low operation skills by constructing this point system or a charging system. The expected remote operator requires a vehicle with attached equipment that can be remotely operated by a plurality of remote operators who can remotely operate through the network, or a vehicle equipped with advanced technology that enables remote operation. An actual vehicle is equipped with a camera and a device that can distribute images of the front, rear, left, and right by communication. Towards realization, an actual vehicle is equipped with a device that can remotely operate the steering wheel operation, accelerator, brake, blinker, light lighting, and shift lever. In addition, a camera is installed on the actual vehicle so that images of the front, rear, and sides can be transmitted to the remote operator.

Summary of the Invention

Problems to be Solved by the Invention

Means for Solving the Problems

Effects of the Invention

Brief Description of the Drawings

Figure 1

Figure 2

Figure 3

Mode for Carrying Out the Invention

[0006] The scenario of actual remote operation is as follows.

[0007] On the actual vehicle, the passenger sets the boarding destination. Recruit remote operators who will perform remote operations and select multiple individuals. Alternatively, the operation system automatically selects multiple remote operators. If remote operators cannot be gathered, give up on the operation system and drive by oneself, entrust the remote operation to a small number of people, or let the passenger decide at the passenger's own discretion.

[0008] Here, for accident prevention and to achieve safe driving, based on the premise that remote operators are not always good people, for the operation instructions of five or more remote operators, the optimal value of each operation instruction is adopted using the majority decision principle to operate the vehicle.

[0009] The remote operator checks the camera images sent from the vehicle, grasps the road conditions, signals, pedestrians, surrounding vehicles, etc., performs the driving operation of the vehicle, and continuously gives driving instructions towards the destination.

[0010] The driving instructions of the remote operator are constantly monitored, safe and secure operation is carried out, and while continuously indicating the optimal value without accidents, excellent operation points are given every second. If one's own instructions are different from those of others or the passenger feels danger, points will be deducted. Remote operators are evaluated based on the operation time and points.

[0011] In this way, it is possible to suppress the dangerous behaviors and incorrect instructions of malicious remote operators. The cumulative operation time and points are also disclosed to the side that requests remote operation, making it easier to select excellent remote operators and enabling the construction of a win-win relationship.

Claims

1. In a remote driving system for a vehicle to be remotely driven by a plurality of five or more remote operators, a system that adopts an operation instruction at any time by majority vote. Refer to Figure 1.

2. Each remote operator is provided with driving and running video information. Also, operation instructions such as steering wheel operation, accelerator, brake, blinker, headlight lighting, and shift lever can be transmitted. On the actual vehicle, a remote operation device corresponding to the above is installed. Also, a camera, microphone, etc. and a communication device are installed so that video information in the front, rear, and side directions and in-vehicle sound can be transmitted. Refer to Figure 2.

3. Points are given to each remote operator according to the adoption result of the operation instruction. Also, points considering the safety, security, and risk avoidance of the operation are provided as appropriate, and points are deducted when the passengers of the remote vehicle are made uneasy, or when unsafe driving or a sense of danger is felt. Refer to Figure 3.

4. For ensuring the number of remote operators, the system assigns even to beginners of remote operation so that the number is less than half of all remote operators. As a result, beginners of remote operation can improve their driving skills without making the passengers of the remote vehicle uneasy.

Images