Mobile

Abstract

An information processing device that can reduce the cost of a mobile body with an automatic driving function is provided. [Solution] An information processing device installed in a communication network includes a function distribution execution unit that distributes and executes part of the automatic driving functions executed when a mobile body moving along a travel route is automatically driven on behalf of the mobile body, and a communication unit that receives information necessary for the distributed execution of part of the automatic driving functions when the mobile body is automatically driven from the mobile body via the communication network, and transmits the results of the distributed execution of the part of the functions to the mobile body via the communication network.

Description

[Technical field]

[0001] The present invention relates to a mobile object capable of automatic driving, and an information processing device, an automatic system, a method, and a program used for the automatic driving of the mobile object. [Background technology]

[0002] Conventionally, it has been the industry standard to build functions related to the autonomous driving of vehicles, which are moving bodies that move on roads, into the vehicle. Patent Document 1 discloses an autonomous driving system that is mounted on the vehicle together with a navigation system and includes various sensors, a communication unit that communicates with the navigation system, a vehicle control unit that outputs instruction signals to the vehicle's drive system, a storage unit that stores various programs and data, and a CPU that executes autonomous driving control of the vehicle based on route information transmitted from the navigation system and sensing data transmitted from the sensors. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-035217 A Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, as vehicle (automobile) functions become more sophisticated, the manufacturing costs of vehicles are on the rise, and further cost increases are expected with the addition of an automatic driving function in the future, as in the vehicle described in Patent Document 1. Therefore, reducing the cost when an automatic driving function is added to a vehicle is an issue. Note that a similar issue can arise not only for vehicles that move on land, but also for mobile bodies that move underground, on water (e.g., on the sea), underwater (e.g., under the sea), and in the air and have an automatic driving function. [Means for solving the problem]

[0005] An information processing device according to one aspect of the present invention is an information processing device provided in a communication network, the information processing device including: a function distribution execution unit that distributes and executes, on behalf of a moving body, a part of an automatic driving function that is executed during automatic driving of the moving body moving along a movement route, and a communication unit that receives information required for distributed execution of the part of the automatic driving function from the moving body via the communication network during automatic driving of the moving body, and transmits a result of the distributed execution of the part of the function to the moving body via the communication network.

[0006] In the information processing device, the autonomous driving function includes an information acquisition function block that acquires information about the moving body or its surroundings, a judgment function block that judges the content of driving control including at least one of starting, steering, accelerating, decelerating, and stopping of the moving body based on the acquired information, and a driving control function block that controls the driving of the moving body based on the judgment result of the content of the driving control, and the part of the functions that are executed in a distributed manner by the function distribution execution unit is the judgment function block, and the communication unit may receive the acquisition result of information about the moving body or its surroundings from the moving body via the communication network, and transmit the judgment result of the content of the driving control to the moving body via the communication network.

[0007] In the information processing device, a communication method to be used for communication with the mobile body may be determined from a plurality of communication methods having different transmission delay times and communication capacities based on at least one of a predetermined delay request time required by the automatic driving function and a data size of information transmitted to and received from the mobile body during the automatic driving. Here, the plurality of communication methods may include a communication method in a fourth generation mobile communication system, an eMBB (enhanced Mobile BroadBand) communication method in a next generation mobile communication system including a fifth generation, and an URLLC (Ultra-Reliable and Low Latency Communications) communication method in a next generation mobile communication system including a fifth generation.

[0008] In the information processing device, any of the plurality of function blocks constituting the autonomous driving function may be executed in a distributed manner based on at least one of a delay time requirement required by each of the plurality of function blocks and a data size of information transmitted to and received from the mobile body during the autonomous driving. Here, among the plurality of function blocks, a function block having a delay time requirement longer than a total time of an execution time of the function block and a round-trip communication time with the mobile body may be executed in a distributed manner.

[0009] In the information processing device, among the functions included in the automatic driving function, a function of high importance that needs to be executed even when communication with the mobile body is interrupted may be executed by the mobile body without being executed in a distributed manner by the information processing device. Here, the function of high importance may be an automatic stop function of the mobile body when a danger occurs.

[0010] The information processing device may also be provided with an information storage unit that stores, for each type of moving body, autonomous driving assistance information indicating the relationship between the content of the autonomous driving function executed in a distributed manner, the delay request time required by the autonomous driving function, and the content of control when autonomous driving of the moving body is stopped when the delay request time is not met.

[0011] The information processing device may be a base station of a mobile communication network, or a node between the base station and a core network, or a multi-access edge computing (MEC) device provided outside the core network.

[0012] A mobile body according to another aspect of the present invention is a mobile body capable of being automatically driven to move along a travel route, the mobile body transmits information required for performing distributed execution of a part of an automatic driving function on behalf of the mobile body during automatic driving to an information processing device via a communication network, receives a result of the distributed execution of the part of the function from the information processing device via the communication network, and executes the remaining functions of the automatic driving function based on the result of the distributed execution of the part of the function.

[0013] The moving body may be a vehicle that moves on the ground or underground, a ship that moves on water, an underwater moving body that moves underwater, or an aircraft that moves in the air.

[0014] An autonomous driving system according to yet another aspect of the present invention includes any one of the information processing devices described above and any one of the mobile bodies described above.

[0015] In the automatic driving system, when an initial connection is made from the mobile body via the communication network, the information processing device identifies a type of the mobile body based on information received at the initial connection, and based on the type of the mobile body, transmits to the mobile body content of the part of the functions to be executed in a distributed manner corresponding to the type of the mobile body, a predetermined delay request time required by the automatic driving function, and content of control when automatic driving of the mobile body is stopped, and the mobile body receives the content of the control when automatic driving is stopped at the initial connection, transmits mobile body information including position information of the mobile body to the information processing device, estimates a transmission delay time of communication with the information processing device based on a timestamp when the mobile body information is transmitted and a timestamp when a receipt confirmation for the mobile body information is received, and when it is determined that the condition of the delay request time is satisfied based on the estimated result of the transmission delay time, transmits information necessary for the distributed execution of the part of the functions in the information processing device to the information processing device, receives a result of the distributed execution of the part of the functions in the information processing device, and when it is determined that the condition of the delay request time is not satisfied based on the estimated result of the transmission delay time, executes control when automatic driving is stopped.

[0016] In the automatic driving system, the control when the automatic driving is stopped may be a control to automatically stop the moving body at a safe place on the moving path. Here, the moving body may switch to a manual driving mode in which a part or all of the automatic driving functions are manually performed after automatically stopping at a safe place on the moving path. In addition, after automatically stopping at a safe place on the moving path, the moving body may periodically and continuously transmit the moving body information and estimate the transmission delay time, and when it is determined that the delay request time condition is satisfied based on the estimated transmission delay time, the automatic driving of the moving body may be resumed.

[0017] A method according to yet another aspect of the present invention is a method for performing automatic driving of a mobile body moving along a moving path. The method includes: an information processing device provided in a communication network executes, on behalf of the mobile body, a part of an automatic driving function executed during automatic driving of the mobile body moving along the moving path in a distributed manner, the information processing device receives, from the mobile body via the communication network, information required for the distributed execution of the part of the automatic driving function during automatic driving of the mobile body, the information processing device transmits a result of the distributed execution of the part of the function to the mobile body via the communication network, and the mobile body executes the remaining function of the automatic driving function based on the result of the distributed execution of the part of the function.

[0018] A program according to yet another aspect of the present invention is a program executed by a computer or a processor included in an information processing device provided in a communication network, the program including: program code for performing distributed execution of a part of an automatic driving function executed during automatic driving of a moving body moving along a movement path on behalf of the moving body, program code for receiving information required for distributed execution of the part of the automatic driving function during automatic driving of the moving body from the moving body via the communication network, and program code for transmitting a result of the distributed execution of the part of the function to the moving body via the communication network.

[0019] A program according to yet another aspect of the present invention is a program executed on a computer or processor provided in a mobile body capable of automatically driving to move along a travel route, the program including: program code for transmitting information required for distributively executing a part of an automatic driving function on behalf of the mobile body during automatic driving of the mobile body via a communication network to an information processing device; program code for receiving a result of the distributed execution of the part of the function from the information processing device via the communication network; and program code for executing the remaining functions of the automatic driving function based on the result of the distributed execution of the part of the function. Effect of the Invention

[0020] According to the present invention, by distributing multiple functions required for the automatic driving of a mobile body moving along a travel route between the mobile body and a network side device capable of communicating with the communication unit of the mobile body via a communication network, it is possible to reduce the cost of a mobile body having an automatic driving function. [Brief description of the drawings]

[0021] [Figure 1] FIG. 1 is an explanatory diagram showing an example of the overall configuration of an autonomous driving system according to an embodiment. [Diagram 2] FIG. 1 is a block diagram showing an example of a main configuration of an autonomous driving system including an information processing device and an on-board device of a vehicle according to an embodiment. [Diagram 3] FIG. 2 is a sequence flow diagram showing an example of distributed execution of an autonomous driving function of a vehicle in the autonomous driving system according to the embodiment. [Figure 4] 1 is a time chart showing an example of distributed execution of specific target functions of an autonomous driving function. [Diagram 5] 3A to 3C are explanatory diagrams showing an example of automatic driving of a vehicle in the automatic driving system of the present embodiment. [Figure 6] 5A to 5C are explanatory diagrams showing another example of automatic driving of a vehicle in the automatic driving system of the present embodiment. [Figure 7] FIG. 11 is a sequence flow diagram showing another example of distributed execution of the autonomous driving function of a vehicle in the autonomous driving system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is an explanatory diagram showing an example of the overall configuration of an autonomous driving system according to this embodiment. The autonomous driving system of this embodiment includes an information processing device 10 provided in a mobile communication network. The information processing device 10 executes, on behalf of the vehicle 30, a part of the autonomous driving functions executed during autonomous driving of the vehicle 30, which is one or more moving bodies traveling on a road 90 as a vehicle movement route. The vehicle 30 is equipped with an in-vehicle device 31. The autonomous driving system may include the information processing device 10 and the vehicle 30 that is the target of autonomous driving.

[0023] Hereinafter, when multiple vehicles 30 and their on-board devices 31 are described while being distinguished from one another, they will be referred to as vehicles 30(1), 30(2), ... and on-board devices 31(1), 31(2), .... When describing a configuration, control, etc. common to multiple vehicles, they will be referred to as vehicle 30, and when describing a configuration, control, etc. common to multiple on-board devices, they will be referred to as on-board device 31. Note that, although the example of FIG. 1 shows a case in which three vehicles 30(1)-30(3) with autonomous driving functions, each having on-board devices 31(1)-31(3), are traveling, the number of vehicles 30 with autonomous driving functions may be one or two, or may be four or more.

[0024] The vehicle 30 is, for example, a car, a truck, a bus, a motorcycle, etc. that travels on a road 90, which is a ground travel route. In this embodiment, the moving body to be automatically driven may be a ground vehicle, or a moving body such as an aircraft that can fly along a travel route in the air at a predetermined altitude. The moving body to be automatically driven may be an underground moving body that travels along an underground travel route, an above-water moving body such as a ship that can travel along a travel route on water (e.g., on the sea), or an underwater moving body such as a submersible robot that travels along a travel route underwater (e.g., under the sea).

[0025] The in-vehicle device 31 of the vehicle 30 has one or more communication terminal devices as a communication unit that communicates with the outside. The communication terminal device of the in-vehicle device 31 is, for example, a user equipment (hereinafter referred to as "UE") that can be used as a subscriber of a mobile communication service. The UE may be a wireless communication device called a user terminal, terminal, terminal device, mobile station, mobile device, etc. The UE is provided in the in-vehicle device 31 (for example, a device incorporated as a part of a navigation device) that is incorporated and installed in the vehicle 30. The UE may be a device that is used while being carried by a user in the vehicle 30.

[0026] The UE of the in-vehicle device 31 can communicate with the information processing device 10 via a base station 16 of a mobile communication network (cellular network) by a network communication method (for example, 3G, 4G, LTE, or next-generation NR method) which is a first communication method (hereinafter, communication by the network communication method is also referred to as "Uu communication"). The wireless network communication method of the Uu communication may be, for example, a wireless communication method conforming to specifications such as Cat.M, Cat.NB, eMTC (enhanced Machine Type Communication), and NB (Narrow Band)-IoT, which are LPWA (Low Power, Wide Area) or LPWAN (Low-Power Wide-Area Network) of the LTE version provided in the fourth generation mobile communication system of 3GPP. In addition, the wireless network communication method for Uu communication may be a wireless communication method that complies with specifications such as eMBB (enhanced Mobile BroadBand), which is suitable for high-speed, large-capacity communication, URLLC (Ultra-Reliable and Low Latency Communications), which is suitable for ultra-reliable, low-latency communication, and MTC (massive Machine Type Communication), which is suitable for communication with a very large number of terminals, which are provided in next-generation mobile communication systems including the fifth generation.

[0027] The in-vehicle device 31 may have a communication unit that performs direct wireless communication such as short-distance D2D (Device-to-Device), V2V (Vehicle-to-Vehicle), V2X (Vehicle-to-Everything), etc. For example, the in-vehicle device 31 of the vehicle 30 may have an inter-vehicle communication function that performs wireless communication between vehicles using the PC-5 communication method exemplified in Fig. 1, or a road-to-vehicle communication function that performs wireless communication such as Dedicated Short Range Communications (DSRC) with infrastructure equipment such as roadside devices installed on the roadside of the road 90, at intersections, in parking lots, etc.

[0028] For example, the in-vehicle device 31 of the vehicle 30 may perform wireless communication with other vehicles (hereinafter also referred to as "vehicle-to-vehicle communication") by a second communication method not via a base station of a mobile communication network (cellular network). The second communication method is, for example, a Sidelink method (hereinafter also referred to as "PC5 communication method" or "PC-5 Sidelink method") using a PC-5 (hereinafter also referred to as "PC5") interface. The PC-5 interface is a D2D (Device to Device) interface in which UEs communicate with each other, between a UE and another device (e.g., a vehicle), between vehicles, or between a vehicle and another device directly without going through a base station, and has been standardized in 3GPP Release 12 and later. The PC5 communication method (Sidelink method) is a short-distance wireless communication method in which UEs communicate with each other, between a UE and another device (e.g., a vehicle), between vehicles, or between a vehicle and another device directly communicate with each other in a relatively small area without going through a base station, using a PC-5 interface or the like.

[0029] The information processing device 10 is, for example, a multi-access edge computing (MEC) device provided in a base station 16 of a mobile communication network 15. The information processing device 10 made up of an MEC device may be provided in a node between the base station 16 and a core network of the mobile communication network 15 or outside the core network. Moreover, the information processing device 10 may be provided in the core network of the mobile communication network 15 as indicated by the dashed line in the figure.

[0030] The base station 16 forms one or more cells (also called sectors or sector cells). The cells may be formed two-dimensionally on the ground or on the sea, or three-dimensionally from the sky toward the ground or on the sea. The cells may be macrocells, small cells, femtocells, picocells, large cells, etc. The multiple cells may form a cellular structure in which the cells are distributed adjacent to each other in a multi-two-dimensional or three-dimensional manner, or may form a hierarchical cell structure in which the cells are partially or completely overlapped hierarchically. The base station 16 may be a macrocell base station, a small cell base station, a femtocell base station, a picocell base station, a large cell base station, a fixed base station fixedly installed on the ground, etc., a mobile base station that can move on the ground, on the sea, in the sky, etc. The base station 16 may be a wireless communication device called an eNodeB (evolved Node B: eNB), a gNodeB (gNB), an en-gNodeB (en-gNB), an access point, etc.

[0031] FIG. 2 is a block diagram showing an example of a configuration of a main part of an autonomous driving system including the information processing device 10 according to this embodiment and an in-vehicle device 31 of a vehicle 30. The information processing device 10 includes a function distribution execution unit 101, a communication unit 102, and an information storage unit (DB: database) 103.

[0032] The function distribution execution unit 101 executes, on behalf of the vehicle 30, a part of the autonomous driving function executed during autonomous driving of the vehicle 30 moving on the road 90 in a distributed manner. Unlike the control unit 313 provided in the on-board device 31 of the vehicle 30, the function distribution execution unit 101 can be configured using a computer device including a CPU and a GPU with high data processing capabilities for performing judgment processing involving advanced arithmetic processing and analysis processing without being restricted by manufacturing costs and installation space, unlike the control unit 313 provided in the on-board device 31 of the vehicle 30. On the other hand, the on-board device 31 of the vehicle 30 does not need to perform judgment processing involving advanced arithmetic processing and analysis processing, and therefore does not need to be equipped with a CPU or a GPU with high data processing capabilities.

[0033] The communication unit 102 receives information necessary for distributed execution of some of the autonomous driving functions from the vehicle 30 via the base station 16 of the mobile communication network 15, for example by the aforementioned Uu communication, when the vehicle 30 is in autonomous driving mode, and transmits the results of the distributed execution of the some of the functions to the vehicle 30 via the base station 16 of the mobile communication network 15.

[0034] The information storage unit 103 stores information regarding distributed execution of the autonomous driving function of the vehicle 30. For example, the information storage unit 103 stores, for each type (model and year) of the vehicle 30, autonomous driving assistance information (also referred to as "autonomous driving mapping information" or "autonomous driving assistance table information") indicating the relationship between the content of the autonomous driving function to be executed in the distributed manner, the delay request time required by the autonomous driving function, and the content of control to be performed when the autonomous driving of the vehicle 30 is stopped if the delay request time is not satisfied.

[0035] The automatic driving function of the vehicle 30 may have a plurality of functional logics, such as an automatic parking function for automatically parking the vehicle 30 in a predetermined parking space, an automatic driving function for controlling the driving of the vehicle 30 so as to drive the vehicle 30 safely on a road 90 such as an expressway, and an automatic emergency stop function for automatically stopping the vehicle when a danger is detected in front, behind, or to the side. The automatic driving function of the vehicle 30 may include, for each functional logic, an information acquisition function block for acquiring information on the vehicle 30 or its surroundings, a judgment function block for judging the contents of driving control including at least one of starting, steering, accelerating, decelerating, and stopping of the moving body based on the acquired information, and a driving control function block for controlling the driving of the vehicle 30 based on the judgment result of the contents of the driving control. The part of the functions executed in a distributed manner by the function distribution execution unit 101 may be a judgment function block among the plurality of functional blocks.

[0036] When the autonomous driving function of the vehicle 30 has multiple functional logics, the communication unit 102 of the information processing device 10 may receive the results of acquiring information about the vehicle or its surroundings from the vehicle 30 via a base station 16 of the mobile communication network 15, and transmit the judgment result of the content of the driving control to the vehicle 30 via the base station 16 of the mobile communication network 15.

[0037] The communication unit 102 of the information processing device 10 may determine a communication method to be used for communication with the vehicle 30 from among a plurality of communication methods having different transmission delay times and communication capacities based on at least one of a predetermined delay request time required by the autonomous driving function of the vehicle 30 and a data size of information transmitted to and received from the vehicle 30 during autonomous driving. Here, the plurality of communication methods may include a communication method in the fourth generation mobile communication system described above (for example, Cat.M, Cat.NB, eMTC, and NB-IoT, which are LPWA or LPWAN of LTE), an eMBB communication method in a next generation (NR) mobile communication system including the fifth generation, and a URLLC communication method.

[0038] The function distribution execution unit 101 of the information processing device 10 may distribute the execution of any of the multiple function blocks based on at least one of the delay request time required by each of the multiple function blocks constituting the autonomous driving function and the data size of information transmitted to and received from the vehicle 30 during autonomous driving. Here, the information processing device 10 may distribute the execution of, for example, a function block of the multiple function blocks having a delay request time longer than the total time of the execution time of the function block and the round-trip communication time with the vehicle 30.

[0039] In addition, among the multiple functions (functional logic) included in the autonomous driving function, a highly important function that needs to be executed even if communication with the vehicle 30 is cut off (for example, an automatic stop function for the vehicle 30 in the event of a danger) may be executed in its entirety by the vehicle 30 rather than having part of the function executed in a distributed manner by the information processing device 10.

[0040] 2, the in-vehicle device 31 of the vehicle 30 includes a NW communication unit 311 , a vehicle / surrounding information acquisition unit 312 , a control unit 313 , a storage unit 314 , and a proximity direct communication unit 316 . The NW communication unit 311 is configured using, for example, the above-mentioned UE communication module, antenna, etc., and transmits information required for distributed execution of part of the autonomous driving function on behalf of the vehicle 30 during autonomous driving of the vehicle 30 to the information processing device 10 via the base station 16 of the mobile communication network 15 by the above-mentioned Uu communication. In addition, the NW communication unit 311 receives a result of the distributed execution of the part of the function from the information processing device 10 via the base station 16 of the mobile communication network 15.

[0041] The control unit 313 is composed of, for example, a processor such as a CPU or GPU, a RAM, a ROM, an I / O interface, and the like, and controls the driving unit 32 to execute the remaining functions of the autonomous driving function based on the result of the distributed execution of the partial functions by reading and executing a predetermined control program. The driving unit 32 is an engine or motor of the vehicle body, a braking device, a steering device, etc.

[0042] The vehicle and surrounding information acquisition unit 312 includes, for example, a camera device as an imaging means for capturing moving or still images of the surroundings, and a GNSS (Global Navigation Satellite System) receiver as a current position acquisition means for locating the current position of the vehicle. The vehicle and surrounding information acquisition unit 312 also includes a speed sensor for detecting the speed of the vehicle 30, and an acceleration sensor for detecting the acceleration of the vehicle 30. Furthermore, the vehicle and surrounding information acquisition unit 312 may include a radar device, a LIDAR (light detection and ranging) device, or the like that uses infrared light, visible light, ultrasonic waves, or electromagnetic waves to detect objects such as surrounding vehicles and pedestrians.

[0043] The memory unit 314 stores information to be transmitted to the information processing device 10 (for example, information necessary for distributed execution of some of the functions of the autonomous driving function), information received from the information processing device 10 (for example, information on the results of distributed execution of some of the functions of the autonomous driving function), information acquired by the vehicle and surrounding information acquisition unit 312 (for example, image data of still or video images of the surrounding area, speed data, surrounding object detection data), etc.

[0044] The proximity direct communication unit 316 is composed of a predetermined communication module, an antenna, etc., and performs proximity direct communication such as the above-mentioned vehicle-to-vehicle communication and road-to-vehicle communication.

[0045] FIG. 3 is a sequence flow diagram showing an example of distributed execution of the autonomous driving function of the vehicle 30 in the autonomous driving system according to this embodiment. In FIG. 3, when the engine of the drive unit 32 of the vehicle 30 is started (S101), the in-vehicle device 31 executes an initial connection process with the information processing device 10, reads out from the memory unit 314 subscriber information for the mobile communication service that has been pre-registered for the communication terminal device (UE) of the in-vehicle device 31, and transmits it to the information processing device 10 via the base station 16 (S102, S103).

[0046] The information processing device 10 refers to a user database stored in the information storage unit 103 based on the subscriber information received at the time of initial connection from the in-vehicle device 31 of the vehicle 30, and identifies the type (model and year) of the vehicle 30. In the user database, for example, subscriber information registered in advance for the UE of the owner or user of the vehicle 30 and the type (model and year) of the vehicle 30 are stored in association with each other.

[0047] Next, based on the identified type of vehicle 30, the information processing device 10 refers to an autonomous driving assistance table as autonomous driving assistance information stored in the information storage unit 103 (S104), and transmits the contents of some of the functions to be executed in a distributed manner corresponding to the type of vehicle 30, the delay request time, and the contents of control when autonomous driving is stopped to the in-vehicle device 31 of the vehicle 30 via the base station 16 (S105, S106).

[0048] As illustrated in Table 1, the autonomous driving assistance table stores, for each of multiple types (model and year) of vehicle 30, the contents of some of the autonomous driving functions of vehicle 30 that are executed in a distributed manner by the information processing device 10, the delay requirement time required by those functions, and the contents of control when autonomous driving is stopped, in correspondence with each other.

[0049] [Table 1]

[0050] Next, the in-vehicle device 31 of the vehicle 30 periodically executes a process of transmitting vehicle information including the current position information of the vehicle to the information processing device 10 and estimating a transmission delay time between the vehicle 30 and the information processing device 10 (S107 to S111). For example, the in-vehicle device 31 of the vehicle 30 estimates a transmission delay time of communication with the information processing device 10 based on a timestamp when the vehicle information is transmitted and a timestamp when an acknowledgement (ACK) for the vehicle information is received, and stores the estimated transmission delay time.

[0051] Next, when the time arrives to execute a specific function (hereinafter referred to as the "target function") among the multiple functions (functional logics) included in the autonomous driving function, the in-vehicle device 31 refers to the autonomous driving assistance table in Table 1 for the target function and the type of vehicle, and determines whether the estimated transmission delay time is less than or equal to a threshold value corresponding to the delay requirement time required by the target function (for example, 1.0 s if the target function is function A in Table 1) (S112).

[0052] If the estimated transmission delay time is equal to or less than the threshold corresponding to the delay request time required by the target function (YES in S112), the in-vehicle device 31 performs a recognition process to acquire information (hereinafter referred to as "input data") required for distributed execution of the target function in the information processing device 10 as shown in the recognition function block F101 in Fig. 4 (S113), and transmits the acquired input data to the information processing device 10 via the base station 16 (S114, S115). For example, when the target function is function A in Table 1, the input data is a camera image, speed, acceleration, and brake information.

[0053] The information processing device 10 performs a determination process to determine whether or not to execute a target function in the vehicle 30 based on the input data received from the in-vehicle device 31 (S116), as shown in the determination function block F102 in Fig. 4, and transmits the determination result to the in-vehicle device 31 of the vehicle 30 via the base station 16 (S117, S118). Here, the determination result may include vehicle control information such as braking information of the vehicle 30.

[0054] Here, a communication method corresponding to the type of vehicle 30 and the target function (for example, in the case of vehicle type A and target function A in Table 1, the aforementioned LTE communication method or eMBB communication method) is used to send and receive the input data and the judgment results.

[0055] The in-vehicle device 31 of the vehicle 30 executes vehicle control to control the vehicle 30 (for example, the drive unit 32) based on the determination result received from the information processing device 10 as shown in a vehicle control function block F103 in FIG. 4 (S119).

[0056] If the estimated result of the transmission delay time in step S112 is greater than the threshold value corresponding to the delay request time required by the target function (NO in S112), the autonomous driving function cannot be executed, so the in-vehicle device 31 controls the vehicle 30 (e.g., the drive unit 32) to automatically stop the vehicle 30 in a safe place (e.g., a road shoulder) on the road 90 (S120). After the vehicle 30 is automatically stopped in a safe place on the road 90, the in-vehicle device 31 may switch from the autonomous driving mode to a manual driving mode in which some or all of the autonomous driving functions are performed manually. In addition, after the vehicle 30 is automatically stopped in a safe place on the road 90, the in-vehicle device 31 of the vehicle 30 may periodically continue to transmit vehicle information and estimate the transmission delay time, and when it is determined that the condition of the delay request time is satisfied based on the estimated result of the transmission delay time, the autonomous driving of the vehicle 30 may be resumed.

[0057] 4, time n1 is the execution time of the recognition function block F101 in the in-vehicle device 31, time n3-n2 is the execution time of the judgment function block F102 in the information processing device 10, and time n5-n4 is the execution time of the vehicle control function block F103 in the in-vehicle device 31. Time n2-n1 in Fig. 4 is the transmission delay time when input data is transmitted from the in-vehicle device 31 to the information processing device 10, and time n4-n3 is the transmission delay time when a judgment result is transmitted from the information processing device 10 to the in-vehicle device 31. The aforementioned estimated result of the transmission delay time corresponds to the round-trip transmission delay time (n2-n1)+(n4-n3) in Fig. 4.

[0058] 5(a) to (c) are explanatory diagrams showing an example of automatic driving (basic operation during automatic parking) of the vehicle 30 in the automatic driving system of this embodiment. In FIG. 5(a), a vehicle 30(1) to be driven autonomously stops just before a target parking space 95s in a parking lot 95, captures images of the surrounding environment using an omnidirectional camera device in an in-vehicle device 31, and uploads and transmits the image data to an information processing device 10 as input data.

[0059] 5(b), the information processing device 10 judges and determines braking information related to the operation for parking the vehicle 30(1) into the target parking space 95s based on the image data uploaded from the vehicle 30(1). For example, the information processing device 10 calculates the movement route of the vehicle 30(1) until it is parked in the parking space 95s, the movement distance on the timeline, the operation of the steering wheel, and the like to determine the braking information. The information processing device 10 downloads and transmits the braking information as the judgment result to the in-vehicle device 31 of the vehicle 30(1).

[0060] 5(c), the in-vehicle device 31 of the vehicle 30(1) automatically controls the operation of the vehicle 30(1) based on the braking information downloaded from the information processing device 10. This enables the vehicle 30(1) to move to the target parking space 95s and stop in the predetermined correct orientation.

[0061] 6(a) to (c) are explanatory diagrams showing another example of the automatic driving (risk avoidance operation during automatic parking) of the vehicle 30 in the automatic driving system of this embodiment. In FIG. 6(a), a vehicle 30(1) to be driven autonomously stops just before a target parking space 95s in a parking lot 95, and constantly uses a sensor (e.g., a radar device, a lidar device) to detect whether nearby pedestrians or other objects such as other vehicles 30(2) and 30(3) are moving, and uploads and transmits the sensor detection data to the information processing device 10 as input data.

[0062] 6(b), the information processing device 10 judges whether the movements of the surrounding objects are within the expected range based on the sensor detection data uploaded from the vehicle 30(1). If the information processing device 10 detects that the surrounding object (vehicle 30(3) in the illustrated example) is moving outside the expected range, the information processing device 10 downloads and transmits braking information including a brake command for the vehicle 30(1) that has started to move as a judgment result to the in-vehicle device 31 of the vehicle 30(1).

[0063] 6(c), the in-vehicle device 31 of the vehicle 30(1) automatically controls the operation of the vehicle 30(1) to brake the vehicle 30(1) based on the braking information downloaded from the information processing device 10. This allows the vehicle 30(1) to avoid a collision with the vehicle 30(3) that is exiting the parking space when the vehicle 30(1) is attempting to move to the target parking space 95s.

[0064] Fig. 7 is a sequence flow diagram showing another example of distributed execution of the autonomous driving function of the vehicle 30 in the autonomous driving system according to this embodiment. Fig. 7 shows an example in which the in-vehicle device 31 estimates the transmission delay time based on the weak signal area information downloaded from the information processing device 10. Note that S201 to S206 in Fig. 7 are similar to S101 to S106 in Fig. 3, and S212 to S220 in Fig. 7 are similar to S112 to S120 in Fig. 3, so their description will be omitted.

[0065] In the autonomous driving assistance table of the information processing device 10 in the example of Fig. 7, as exemplified in Table 2, in addition to the items in Table 1 described above, a column for specifying whether or not the vehicle 30 downloads weak signal area information from the information processing device 10 is added. If the weak signal area information column is marked "○", the vehicle 30 downloads weak signal area information on the route from the current position to the destination from the information processing device 10. In addition, the information processing device 10 has a map database that includes weak signal area information acquired in advance by surveying areas to be managed, etc.

[0066] [Table 2]

[0067] 7, the in-vehicle device 31 of the vehicle 30 receives the contents of some of the functions to be executed in a distributed manner corresponding to the type of the vehicle, the delay request time, and the contents of the control when the automatic driving is stopped, and then transmits the vehicle information including the current position information of the vehicle and the destination information to the information processing device 10 via the base station 16 (S207, S208). The information processing device 10 refers to the map database based on the current position information and destination information of the vehicle 30 in the automatic driving assistance table, and transmits the weak electric field area information on the route from the current position of the vehicle 30 to the destination to the in-vehicle device 31 of the vehicle 30 via the base station 16 (S209, S210).

[0068] The in-vehicle device 31 periodically estimates a transmission delay time of communication with the information processing device 10 based on the current location information and the weak electric field area information received from the information processing device 10, and stores the estimated transmission delay time (S211).

[0069] In the example of FIG. 7, since the transmission delay time can be estimated without using a timestamp when transmitting and receiving information to and from the information processing device 10, the load of data processing on the in-vehicle device 31 of the vehicle 30 can be further reduced.

[0070] As described above, according to this embodiment, the information processing device 10 executes, on behalf of the vehicle 30, a part of the automatic driving function executed during automatic driving of the vehicle 30 in a distributed manner based on information received from the vehicle 30 via the mobile communication network 15, and transmits the result of the distributed execution of the part of the function to the vehicle 30 via the mobile communication network 15, so that the vehicle 30 can execute the remaining functions of the automatic driving function. In this way, the vehicle 30 and the information processing device 10 can cooperate with each other through communication via the mobile communication network to execute the entire automatic driving function of the vehicle, and the information processing device 10 executes, on behalf of the vehicle 30, a part of the automatic driving function executed during automatic driving of the vehicle 30 in a distributed manner, thereby reducing the configuration of the vehicle 30 for automatic driving, and thus reducing the cost of the vehicle 30 having the automatic driving function.

[0071] The process steps described herein and the components of the communication terminal device (UE), base station, information processing device, server, MEC device, and communication system can be implemented by various means. For example, these processes and components may be implemented in hardware, firmware, software, or a combination thereof.

[0072] For hardware implementation, the processing units and other means used to realize the above steps and components in an entity (e.g., various wireless communication devices, eNode B, terminals, hard disk drive devices, or optical disk drive devices) may be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processors (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described in this specification, computers, or combinations thereof.

[0073] Also, for firmware and / or software implementation, the means such as processing units used to realize the above components may be implemented with programs (e.g., codes such as procedures, functions, modules, instructions, etc.) that execute the functions described herein. In general, any computer / processor readable medium tangibly embodying firmware and / or software codes may be used to implement the means such as processing units used to realize the above steps and components described herein. For example, the firmware and / or software codes may be stored in a memory and executed by a computer or processor, for example in a controller. The memory may be implemented within the computer or processor, or may be implemented externally to the processor. Also, the firmware and / or software codes may be stored in a computer or processor readable medium, such as a random access memory (RAM), a read only memory (ROM), a non-volatile random access memory (NVRAM), a programmable read only memory (PROM), an electrically erasable programmable read only memory (EEPROM), a FLASH memory, a floppy disk, a compact disk (CD), a digital versatile disk (DVD), a magnetic or optical data storage device, etc. The code may be executed by one or more computers or processors and may cause the computers or processors to perform certain aspects of the functionality described herein.

[0074] The medium may be a non-transitory recording medium. The code of the program may be in any format as long as it can be read and executed by a computer, a processor, or another device or machine, and the format is not limited to a specific format. For example, the code of the program may be any of source code, object code, and binary code, or may be a mixture of two or more of these codes.

[0075] Moreover, the description of the embodiments disclosed herein is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to the present disclosure will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the present disclosure. Thus, the present disclosure is not intended to be limited to the examples and designs described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. [Explanation of symbols]

[0076] 10: Information processing device 15: Mobile communication network 16:Base station 30: Vehicle 31:In-vehicle equipment 32: Drive unit 90: Road 95: Parking lot 95s: Parking space 101: Functional distribution execution unit 102: Communications Department 103: Information storage section 311: Network Communications Department 312: Peripheral information acquisition unit 313: Control section 314: Storage section 316: Near Field Direct Communication Unit

Claims

1. A vehicle capable of automatic driving, A means for transmitting information required for a function of determining the content of driving control of the moving body, which is a part of an automatic driving function of the moving body, to an external device via a communication network, on behalf of the moving body, in a distributed manner; receiving a determination result of the content of the driving control of the moving body from the external device via the communication network; A means for executing a driving control function for controlling the driving of the moving body based on the content of the driving control of the moving body; A mobile body comprising:

2. A moving body capable of automatic driving, a means for transmitting information required for executing a function of determining the operation control content of the moving body on behalf of the moving body to an external device via a communication network; a means for receiving a determination result of the operation control content of the moving body from the external device via the communication network; and executing a driving control function for controlling the driving of the moving body based on the received judgment result, A mobile body, wherein a function of determining the driving control content of the mobile body is part of an automatic driving function of the mobile body.

3. The moving object transmits the information to the external device during autonomous driving.

3. A moving body according to claim 1 or 2.

4. In the moving body according to any one of claims 1 to 3, A mobile body that executes, among a plurality of functions included in the autonomous driving function, a function of high importance that needs to be executed even when communication with the external device is interrupted.

5. The moving body according to claim 4, A mobile body, wherein the function with high importance is an automatic stop function when a danger occurs to the mobile body.

6. In the moving body according to any one of claims 1 to 5, The automatic driving function includes an information acquisition function block that acquires information about the moving body or its surroundings, a judgment function block that judges the content of driving control including at least one of starting, steering, accelerating, decelerating, and stopping of the moving body based on the acquired information, and a driving control function block that controls driving of the moving body based on the judgment result of the content of the driving control, the part of the functions executed in a distributed manner by the external device is the determination function block, A mobile body comprising: a means for transmitting the results of acquiring information about the mobile body or its surroundings to the external device via the communication network; and a means for receiving the results of determining the content of the driving control from the external device via the communication network.

7. In the moving body according to any one of claims 1 to 6, A mobile body that distributes execution of any of the multiple functional blocks based on at least one of the delay time required by each of the multiple functional blocks that constitute the autonomous driving function and the data size of information transmitted and received between the mobile body during autonomous driving.

8. The moving body according to claim 7, A mobile body, wherein among the plurality of functional blocks, a functional block whose delay requirement time is longer than the sum of the execution time of the functional block and the round-trip communication time between the functional block and the external device is executed in a distributed manner by the external device, and the remaining functional blocks are executed in a distributed manner by the mobile body.

9. In the moving body according to any one of claims 1 to 8, A means for receiving, from the external device, control details for stopping automatic operation of the mobile body at the time of initial connection from the mobile body to the external device; a means for transmitting moving object information including location information of the moving object to the external device; means for estimating a transmission delay time of communication with the external device based on a timestamp when the mobile object information is transmitted and a timestamp when a receipt confirmation for the mobile object information is received; a means for transmitting, to the external device, information required for the distributed execution of the part of the functions when it is determined that the delay request time condition is satisfied based on the estimated result of the transmission delay time, and receiving, to the external device, a result of the distributed execution of the part of the functions; a means for executing control for stopping the automatic operation when it is determined that the delay request time condition is not satisfied based on the estimated transmission delay time; A mobile body comprising:

10. The moving body according to claim 9, The control when the automatic driving is stopped is a control for automatically stopping the moving body at a safe place on the moving path.

11. The moving body according to claim 10, A moving body comprising a means for switching to a manual driving mode in which some or all of the automatic driving functions are performed manually after the moving body automatically stops at a safe location on the moving path.

12. The moving body according to claim 10, means for periodically and continuously executing transmission of the moving object information and estimation of the transmission delay time after automatically stopping the moving object at a safe place on the moving path; a means for resuming automatic operation of the moving body when it is determined that the delay request time condition is satisfied based on the estimated transmission delay time; A mobile body comprising:

Images