Vehicle remote operation method, information processing device, and vehicle remote operation system
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- NISSAN MOTOR CO LTD
- Filing Date
- 2025-01-27
- Publication Date
- 2026-07-30
Smart Images

Figure JP2025002413_30072026_PF_FP_ABST
Abstract
Description
Vehicle remote operation method, information processing device, and vehicle remote operation system
[0001] The present invention relates to a vehicle remote operation method, an information processing device, and a vehicle remote operation system.
[0002] In Patent Document 1, an information processing device that reduces the response delay of a vehicle to a remote operation from a user terminal is disclosed. When this information processing device detects that a remote operation application program has been started on the user terminal, it transmits a command signal to the vehicle to shift the vehicle control system mounted on the vehicle from the sleep state to the startup state. As a result, when a remote operation instruction is given from the user terminal, the vehicle is in the startup state, and the response to this instruction is made quickly.
[0003] Japanese Patent Application Laid-Open No. 2023-121998
[0004] However, in the method disclosed in Patent Document 1, the vehicle control system mounted on the vehicle is started triggered by the start of a remote operation application program on the user terminal. Therefore, there is a problem that the effect of shortening the response delay cannot be obtained when the time from the start of the application program to the remote operation instruction is short.
[0005] An object of the present invention is to provide a vehicle remote operation method, an information processing device, and a vehicle remote operation system that can shorten the response time of a vehicle to a user's remote operation instruction.
[0006] A vehicle remote operation method according to an aspect of the present invention is executed by an information processing device that remotely operates a vehicle. The vehicle remote operation method detects the state information of a user based on communication with a user terminal carried by the user, detects the state information of the vehicle based on communication with the vehicle, and performs an estimation process of estimating whether a remote operation on the vehicle is to be executed based on the detected state information of the user and the state information of the vehicle. When it is estimated by the estimation process that a remote operation is to be executed, a pre-start process of starting the vehicle to a predetermined start level is performed.
[0007] According to one aspect of the present invention, the response time of the vehicle to the user's remote control instructions can be shortened.
[0008] Figure 1 is a block diagram showing the configuration of the vehicle remote control system according to this embodiment. Figure 2 is an example of a startup level DB pre-stored on the server. Figure 3 is a flowchart showing the pre-startup process for the vehicle.
[0009] Embodiments of the present invention will be described below with reference to the drawings.
[0010] Referring to Figure 1, the configuration of the vehicle remote control system 1 according to this embodiment will be described. The vehicle remote control system 1 according to this embodiment is a system that remotely controls a vehicle 20 in response to remote control instructions from a user terminal 30.
[0011] The vehicle remote control system 1 mainly consists of a server 10, a vehicle 20, and a user terminal 30. The server 10, the vehicle 20, and the user terminal 30 are configured to communicate with each other via a network 40. The network 40 may be, for example, the internet. The network 40 may also utilize mobile communication functions such as 4G / LTE or 5G.
[0012] Server 10 is an information processing device that intervenes between the vehicle 20 and the user terminal 30 and issues various instructions to both the vehicle 20 and the user terminal 30. Server 10 comprises a control device 11, a communication device 12, and a storage device 13.
[0013] The control device 11 is a microcomputer (controller) mainly composed of a CPU, memory, and input / output interface. The CPU reads various computer programs stored in memory and executes various instructions contained in the programs. By executing the programs, the CPU realizes one or more functions of the control device 11.
[0014] The control device 11 includes a detection unit 111, an estimation unit 112, and a remote control unit 113. The detection unit 111 acquires location information of the user terminal 30 based on communication with the user terminal 30 and identifies the state of the vehicle 20 based on communication with the vehicle 20. The estimation unit 112 performs estimation processing to estimate whether or not remote control will be instructed from the user terminal 30, based on the user location information acquired by the detection unit 111 and the identified state of the vehicle 20. If the estimation unit 112 estimates that remote control will be instructed, the remote control unit 113 performs pre-startup processing to start the vehicle 20, which is in a sleep state, up to a predetermined startup level. The remote control unit 113 also performs remote control of the vehicle 20 based on operation information transmitted from the user terminal 30.
[0015] The communication device 12 communicates with the vehicle 20 or the user terminal 30. The communication device 12 is controlled by the control device 11 and receives predetermined data from the vehicle 20 and the user terminal 30, and transmits predetermined data to the vehicle 20 and the user terminal 30. The communication device 12 can also obtain weather information, etc., by communicating with an external device (not shown) via the network 40. For example, the communication device 12 may be a device equipped with mobile communication functions such as 4G / LTE or 5G, or a device equipped with Wi-Fi communication functions.
[0016] The storage device 13 stores a startup level database (DB) containing information on the startup level of the vehicle 20 for each condition that is subject to the pre-startup process of the vehicle 20. Details of the startup level database will be described later.
[0017] Vehicle 20 is a vehicle used by the user. In the example shown in Figure 1, one vehicle 20 is shown, but it is not limited to this. In this embodiment, vehicle 20 is an electric vehicle that drives the wheels with only an electric motor, but it may also be an engine-powered vehicle that drives the wheels with only an engine, or a hybrid vehicle that drives the wheels with both an engine and an electric motor.
[0018] The vehicle 20 includes a communication device 21 for communicating with external devices, an integrated control device 22 for integrated control, and a plurality of vehicle control systems 23a, 23b, ... that work in conjunction with the integrated control device to perform various functions of the vehicle.
[0019] The communication device 21 is an in-vehicle communication device called IVC (In-Vehicle Communication), and communicates with the server 10. The communication device 21 receives predetermined data from the server 10 and transmits predetermined data to the server 10. For example, the communication device 21 may be a device equipped with mobile communication functions such as 4G / LTE or 5G, or a device equipped with short-range wireless communication functions such as Wi-Fi® or Bluetooth®.
[0020] The integrated control unit 22 is composed of an electronic control unit (ECU). The integrated control unit 22 comprehensively controls multiple vehicle control systems 23a, 23b, ...
[0021] Each of the multiple vehicle control systems 23a, 23b, ... works in conjunction with the integrated control unit 22 to execute various functions of the vehicle 20. Each of the multiple vehicle control systems 23a, 23b, ... consists of an electronic control unit (ECU) installed for each function within the vehicle 20. The multiple vehicle control systems 23a, 23b, ... include control systems that control the operation of the powertrain, control systems that manage the battery, etc. They also include navigation systems that provide route guidance, control systems that assist the user while driving, etc. The vehicle control systems 23a, 23b, ... are connected to the integrated control unit 22.
[0022] The vehicle control systems 23a, 23b... are connected to various devices (not shown) mounted on the vehicle 20. These devices include, for example, devices that control the vehicle's motion, such as steering actuators, accelerator position actuators, brake control actuators, and shift actuators; door lock devices; horns; GPS devices; air conditioning systems; power window devices; vehicle lighting; battery systems; and ignition switches (also called start switches). Multiple vehicle control systems 23a, 23b... are connected to one or more of these devices and sensors, and the various devices are controlled based on sensor detection values and the vehicle's status. Hereafter, when it is not specified which of the vehicle control systems 23a, 23b... is being referred to, it will be simply described as "vehicle control system 23".
[0023] Vehicle 20 has three startup levels, 1 to 3, which are set in stages from a sleep state to a fully started state where the entire vehicle 20 is activated. Each of the startup levels 1 to 3 is a level in which only some functions within the vehicle 20 are activated, and the higher the level number, the closer it is to the fully started state. Specifically, startup level 1 is a level in which only the communication device 21 is activated, startup level 2 is a level in which the integrated control device 22 is activated in addition to the communication device 21, and startup level 3 is a level in which the vehicle control system 23 corresponding to the remote operation content estimated by the server 10 is activated in addition to the communication device 21 and the integrated control device 22, among the multiple vehicle control systems 23. Here, vehicle 20 may have multiple startup levels, and is not limited to the three startup levels 1 to 3. Furthermore, the fully started state refers to a state in which the entire vehicle 20, namely the communication device 12, the integrated control device 22, and the multiple vehicle control systems 23a, 23b, etc. are activated.
[0024] The user terminal 30 is a device carried by the user of the vehicle 20 and is a device equipped with communication functions, such as a mobile phone, smartphone, personal digital assistant (PDA), or wearable device. The user terminal 30 transmits remote operation instructions for the vehicle 20 to the server 10 and displays information transmitted from the server 10. The user terminal 30 comprises a control device 31, an input / output device 32, a storage device 33, a position detection device 34, and a communication device 35.
[0025] The control device 31 is a microcomputer (controller) mainly composed of a CPU, memory, and input / output interface. The memory contains a computer program (application) that enables the information terminal to function as the user terminal 30 in the vehicle remote control system 1. By executing the computer program, the control device 31 realizes one or more functions of the user terminal 30.
[0026] The control device 31 receives operation instructions for the vehicle 20 based on the user's operation to the input / output device 32 and transmits them to the server 10. The control device 31 displays the information notified from the server 10 on the input / output device 32.
[0027] The input / output device 32 is, for example, a touch panel that is controlled by the control device 31 to display necessary information and to input the operations performed by the user according to the displayed information.
[0028] The storage device 33 stores information about the user's activity plan, such as the date and time of an event in which the user goes out using the vehicle 20, the planned departure time, the planned return time, the destination, the planned delivery time of a package, and the departure and return times for each day of the week for going to work.
[0029] The position detection device 34 obtains the current location information of the user terminal 30 by, for example, receiving GNSS signals from multiple satellites for the Global Navigation Satellite System (GNSS) and calculating position information. One example of GNSS is GPS (Global Positioning System).
[0030] The communication device 35 communicates with the server 10. The communication device 35 is controlled by the control device 31 and receives predetermined data from the server 10 or transmits predetermined data to the server 10. For example, the communication device 35 may be a device equipped with mobile communication functions such as 4G / LTE or 5G, or a device equipped with short-range wireless communication functions such as Wi-Fi or Bluetooth.
[0031] The pre-startup process performed in the vehicle remote control system 1 according to this embodiment will be described. Figure 2 is an example of a startup level DB that is pre-stored in the storage device 13 of the server 10.
[0032] The startup level database stores information on the expected operation content and the startup level to which the pre-startup process applies for each of the various conditions required to perform the pre-startup process on the vehicle 20. The "expected operation content" refers to the remote operation that the user may instruct when the conditions are met.
[0033] The various conditions stored in the startup level DB are classified into three groups: Group 1, Group 2, and Group 3. Group 1 includes conditions set regarding the location information of the user terminal 30, the location information of the vehicle 20, and the locked state of the vehicle doors by the vehicle door lock device. Group 2 includes conditions set regarding information related to the conditions belonging to Group 1, as well as date and time information, user action plan information, and vehicle 20 charge level information. Group 3 includes conditions set regarding information related to the conditions belonging to Groups 1 and 2, as well as weather information, information on the remote operation status of surrounding vehicles, and information on past operation history. In the startup level DB, for each of the above conditions, one of startup levels 1 to 3 is set so that the longer the response time of the vehicle 20 when executing the expected operation, the closer it gets to a fully started state. Also, if the response time of the vehicle 20 when executing the expected operation is long, one of startup levels 1 to 3 is set so that it gets closer to a fully started state compared to when the response time of the vehicle 20 when executing the expected operation is short.
[0034] Figure 3 is a flowchart showing the pre-startup process that the server 10 executes when the vehicle 20 is in sleep mode. The "sleep mode" of the vehicle 20 means that the integrated control device 22 and all vehicle control systems 23 are completely shut down, and the communication device 21 is activated only for the function of communicating with the server 10, with all other functions shut down.
[0035] The user terminal 30, according to the functions of the installed application, has a location detection device 34 that acquires the location information of the user terminal 30 at predetermined time intervals and transmits it to the server 10. When the detection unit 111 of the server 10 acquires the location information from the user terminal 30, it identifies the current location information and door lock status of the vehicle 20. Here, the vehicle 20 detects its location information and door lock status just before transitioning to sleep mode and transmits it to the server 10. The server 10 stores the information transmitted from the vehicle 20 and identifies the most recent state of the vehicle 20 stored in the server 10 as the current state of the vehicle 20 (S1).
[0036] The detection unit 111 also uses the acquired location information of the user terminal 30 and the location information of the vehicle 20 to determine the distance between the location of the user terminal 30 and the location of the vehicle 20. Furthermore, the detection unit 111 determines the type of vehicle location based on the location information of the vehicle 20 (S2). Here, the detection unit 111 refers to map information to determine the type of vehicle location. Examples of vehicle location types include a home parking lot, a commercial facility parking lot, etc. The type of vehicle location may also include information such as the frequency of the user's visits and the size of the parking lot.
[0037] The estimation unit 112 determines whether the content identified by the detection unit 111 matches the conditions of the first group by referring to the activation level DB (S3). If the estimation unit 112 determines that the content identified by the detection unit 111 matches any of the conditions of the first group (S3: YES), it estimates that a predetermined remote operation will be instructed by the user within a predetermined time. This estimation includes not only that a predetermined remote operation will be instructed by the user within a predetermined time, but also that there is a possibility that a predetermined remote operation will be instructed. If the estimation unit 112 estimates that a predetermined remote operation will be instructed, the remote operation unit 113 determines the activation level of the pre-activation process for the estimated remote operation content by referring to the activation level DB (S4).
[0038] For example, suppose a user parks vehicle 20 in a parking lot, switches the ignition switch to the off position, and gets out of the vehicle, but the vehicle doors remain unlocked and the user moves a predetermined distance or more away from vehicle 20. In this case, the estimation unit 112 determines that the information identified by the detection unit 111 matches the detailed conditions (1-1) of the first group: "the distance between the user terminal and the vehicle is greater than or equal to a predetermined value, the type of vehicle location is a parking lot, and the vehicle doors are unlocked."
[0039] Based on this determination result, the estimation unit 112 estimates that the user will remotely instruct the vehicle to "lock the vehicle door" within a predetermined time. Based on the activation level DB, the remote control unit 113 determines the activation level of the pre-activation process for the estimated "vehicle door lock operation" to be "2".
[0040] Furthermore, suppose the user has parked vehicle 20 in a large parking lot of a facility they do not visit often, such as an amusement park, and the user approaches the exit of the amusement park. In this case, the estimation unit 112 determines that the information identified by the detection unit 111 matches the detailed conditions (1-2) of the first group: "the distance between the user terminal and the vehicle is greater than or equal to a predetermined value, the distance between the user terminal location and the facility exit is less than a predetermined value, and the type of vehicle location is a parking lot where the user's frequency of use is less than a predetermined value and the size is greater than or equal to a predetermined value."
[0041] Based on this determination result, the estimation unit 112 estimates that the user will remotely instruct a "vehicle door unlock operation", a "horn sounding operation", or a "light lighting operation" within a predetermined time. Based on the startup level DB, the remote operation unit 113 determines the startup level of the pre-startup process for the estimated "vehicle door unlock operation", "horn sounding operation", or "light lighting operation" to be "2".
[0042] Also, when the user parks the vehicle 20 in a vast parking lot of a facility with a low frequency of visit such as an amusement park, when the user approaches the vehicle 20, the estimation unit 112 determines that the content identified by the detection unit 111 meets the detailed conditions (1-3) of the first group, "the distance between the user terminal and the vehicle is less than a predetermined value, the type of the vehicle position is a parking lot where the user's usage frequency is less than a predetermined value and the area is greater than or equal to a predetermined value".
[0043] Based on this determination result, the estimation unit 112 estimates that the user will remotely instruct a "vehicle door unlock operation", a "horn sounding operation", or a "light lighting operation" within a predetermined time. Based on the startup level DB, the remote operation unit 113 determines the startup level of the pre-startup process for the estimated "vehicle door unlock operation", "horn sounding operation", or "light lighting operation" to be "2".
[0044] When the remote operation unit 113 determines the startup level of the pre-startup process, it generates a startup signal for starting up to this startup level and transmits it to the vehicle 20 (S5). In the vehicle 20, based on the startup signal transmitted from the server 10, the functions in the vehicle 20 are started up to the determined startup level.
[0045] Also, the information on the content of the remote operation estimated by the estimation unit 112 and the startup level determined by the remote operation unit 113 is notified to the user terminal 30 (S6). In the user terminal 30, the notified information is output to the input / output device 32. Thereby, the user can grasp the content of the remote operation to be instructed and recognize that the vehicle 20 is in a state where the pre-startup process has been performed.
[0046] By performing the pre-startup process in this way, for example, after the user parks the vehicle 20 in a parking lot, turns off the ignition switch, and gets out of the vehicle, when the vehicle door is unlocked and the user is more than a predetermined distance away from the vehicle 20, the vehicle 20 that has shifted to the sleep state due to turning off the ignition switch is started up to the startup level 2 state. At this time, when the remote operation unit 113 of the server 10 receives an instruction to lock the vehicle door from the user terminal 30 and transmits a vehicle door lock instruction to the vehicle 20 based on this, the vehicle 20 quickly executes the vehicle door locking process. In addition, since the content of the remote operation estimated by the estimation unit 112 is notified to the user terminal 30, it is possible to make the user aware that the vehicle door is in the unlocked state and prompt the user to give an instruction for remote operation.
[0047] Also, when the user parks the vehicle 20 in a vast parking lot of a facility such as an amusement park where the user goes infrequently, when the user approaches the exit of this amusement park to return, the vehicle 20 is started up from the sleep state to the startup level 2 state. As a result, when the user performs a horn honking operation or a light lighting operation, these processes are quickly executed, and the user can easily find the vehicle 20 in the vast parking lot. Also, when the user performs an operation to unlock the vehicle door, the vehicle 20 quickly responds and the unlocking process is executed.
[0048] Also, when the user parks the vehicle 20 in a vast parking lot of a facility where the user goes infrequently, when the user approaches the vehicle 20, the vehicle 20 is started up from the sleep state to the startup level 2 state. As a result, when the user performs a horn honking operation or a light lighting operation, these processes are quickly executed, and the user can easily find the vehicle 20 in the vast parking lot. Also, when the user performs an operation to unlock the vehicle door, the vehicle 20 quickly responds and the unlocking process is executed.
[0049] In step S3, if the detection unit 111 determines that the identified information does not match the conditions of the first group (S3: NO), the detection unit 111 further acquires the current date and time information, the user's action plan information, and the vehicle 20's charge level information (S7). The detection unit 111 requests and obtains the user's action plan information from the user terminal 30. In addition to obtaining the user's action plan information by requesting it from the user terminal 30, the information may also be registered as information on the server 10.
[0050] The estimation unit 112 determines, by referring to the activation level DB, whether the information acquired by the detection unit 111 in steps S2 and S7 matches the conditions of the second group (S8). If the estimation unit 112 determines that the information acquired by the detection unit 111 matches any of the conditions of the second group (S8: YES), it estimates that a predetermined remote operation will be instructed by the user within a predetermined time. If the estimation unit 112 estimates that a predetermined remote operation will be instructed, the remote operation unit 113 determines the activation level of the pre-activation process for the estimated remote operation by referring to the activation level DB (S4).
[0051] For example, the estimation unit 112 performs estimation processing in the same way as when the conditions of the first group described above are met, and if it determines that the content identified by the detection unit 111 matches the detailed conditions of the second group (2-1) "the type of vehicle location is a parking lot where the user's frequency of use is less than a predetermined value and the size is greater than or equal to a predetermined value, and the time until the next scheduled departure time is less than a predetermined value", it estimates that the user will remotely instruct the vehicle to "unlock the vehicle door", "sound the horn", or "turn on the lights" within a predetermined time. The remote control unit 113 determines the activation level of the pre-activation processing for the estimated "unlock the vehicle door", "sound the horn", or "turn on the lights" to "2" based on the activation level DB.
[0052] Furthermore, if the estimation unit 112 determines that the information identified by the detection unit 111 matches the detailed conditions (2-2) of the second group, "the distance between the user terminal and the vehicle is greater than or equal to a predetermined value, the type of vehicle location is the home parking lot, and the time until the scheduled delivery time is less than a predetermined value," it estimates that the user will remotely instruct the vehicle to "unlock the vehicle door" within a predetermined time. The remote control unit 113 sets the activation level of the pre-activation process for the estimated "unlock the vehicle door" to "2".
[0053] Furthermore, if the estimation unit 112 determines that the information identified by the detection unit 111 matches the detailed conditions (2-3) of the second group, "the vehicle is near the charger, the charge level is less than a predetermined value, and the time until the scheduled departure time is less than a predetermined value," it estimates that the user will remotely instruct the "start charging operation" within a predetermined time. The remote control unit 113 sets the activation level of the pre-start processing for the estimated "start charging operation" to "3".
[0054] Generally, charging an electric vehicle involves more devices within the vehicle than locking / unlocking the vehicle doors, sounding the horn, or turning on the lights, and therefore requires more time to respond to the operation command. For this reason, in the startup level DB, the startup level for the pre-startup process for the "start charging operation" is set to a higher level (level 3) than the startup level (level 2) for "locking / unlocking the vehicle doors," "sounding the horn," and "turning on the lights," meaning it is closer to the full startup level.
[0055] Furthermore, if the estimation unit 112 determines that the information identified by the detection unit 111 matches the detailed conditions (2-4) of the second group, "the vehicle is near the charger and timer charging is set, but it is determined that timer charging is insufficient," it estimates that the user will remotely instruct the "start charging operation" within a predetermined time. The remote control unit 113 sets the activation level of the pre-start processing for the estimated "start charging operation" to "3".
[0056] Subsequently, in steps S5 and S6, the activation level is determined, and the activation signal is generated and transmitted, similar to the case where the conditions for the first group described above are met.
[0057] By performing this pre-startup process, for example, when the vehicle 20 is parked in a large parking lot of a facility that the user does not visit often, the vehicle 20 will be activated from sleep mode to activation level 2 as the time until the user's next scheduled departure approaches. This allows the user to quickly perform actions such as sounding the horn or turning on the lights, making it easy for the user to find the vehicle 20 in the large parking lot, and also allows the vehicle 20 to respond quickly and perform the unlocking process when the user attempts to unlock the vehicle doors.
[0058] Furthermore, when the user leaves vehicle 20 parked in their home's parking lot and goes shopping with their family, the vehicle 20 is activated from sleep mode to activation level 2 as the scheduled delivery time by the delivery company approaches. This allows the vehicle 20 to respond quickly and execute the unlocking process when the user remotely unlocks the vehicle door to deliver the package to vehicle 20.
[0059] Furthermore, when the user has parked the vehicle 20 near the charger, and the vehicle 20's charge level is low as the next scheduled departure time approaches, the vehicle 20 will be woken up from sleep mode to activation level 3. This allows the system to quickly start processing when the user initiates a charging start operation on the vehicle 20 while the vehicle 20 and charger are connected.
[0060] Furthermore, if the user has parked the vehicle 20 near the charger and set up timer charging, but the amount of charge for the next trip is insufficient with timer charging, the vehicle 20 will be woken up from sleep mode to activation level 3. This allows the system to quickly start processing when the user initiates a charging start operation on the vehicle 20 while the vehicle 20 and charger are connected.
[0061] In step S8, if the detection unit 111 determines that the identified information does not match the conditions of the second group (S8: NO), the detection unit 111 further acquires weather information, information on the remote operation status of surrounding vehicles 20, and information on past operation history related to vehicle 20 (S9). The detection unit 111 obtains weather information by requesting it from an external device via the network 40. The detection unit 111 also obtains information on the remote operation status of other vehicles around vehicle 20 by communicating with those other vehicles.
[0062] The estimation unit 112 determines, by referring to the activation level DB, whether the information acquired by the detection unit 111 in steps S2, S7, and S9 matches the conditions of the third group (S10). If the estimation unit 112 determines that the information acquired by the detection unit 111 matches any of the conditions of the third group (S10: YES), it estimates that a predetermined remote operation will be instructed by the user within a predetermined time. If the estimation unit 112 estimates that a predetermined remote operation will be instructed, the remote operation unit 113 determines the activation level of the pre-activation process for the estimated remote operation by referring to the activation level DB (S4).
[0063] For example, if the estimation unit 112 determines that the information identified by the detection unit 111 matches the detailed conditions of the third group (3-1) "the time until the scheduled departure time is less than a predetermined value, and the temperature is above or below a predetermined value," it estimates that the user will remotely instruct the "air conditioner operation" within a predetermined time. The remote operation unit 113 sets the activation level of the pre-start process for the estimated "air conditioner operation" to "3".
[0064] Generally, operating a vehicle's air conditioning system involves more components within the vehicle than locking / unlocking the doors, sounding the horn, or turning on the lights, and therefore requires more time to respond to the operation command. For this reason, in the activation level DB, the activation level for the pre-activation process for "air conditioning operation" is set to a higher level (level 3) than the activation level (level 2) for "locking / unlocking the vehicle doors," "sounding the horn," and "turning on the lights," meaning it is closer to the full activation level.
[0065] Furthermore, if the estimation unit 112 determines that the information identified by the detection unit 111 matches the detailed condition (3-2) of the third group, "Air conditioning operation is being performed in a nearby vehicle," it estimates that the user will remotely instruct "Air conditioning operation" within a predetermined time. The remote operation unit 113 sets the activation level of the pre-start process for the estimated "Air conditioning operation" to "3".
[0066] Furthermore, if the estimation unit 112 determines that the information identified by the detection unit 111 matches the detailed condition (3-3) of the third group, "Air conditioner operation is predicted from past operation history," it estimates that the user will remotely instruct "Air conditioner operation" within a predetermined time. The remote control unit 113 sets the activation level of the pre-start process for the estimated "Air conditioner operation" to "3".
[0067] Subsequently, in steps S5 and S6, the activation level is determined, and the activation signal is generated and transmitted, similar to the case where the conditions for the first group described above are met.
[0068] By performing this pre-startup process, for example, if the temperature is higher or lower than a predetermined value as the user approaches their next scheduled departure time, the vehicle 20 will be started from sleep mode to startup level 3. As a result, when the user remotely operates the air conditioning system of the vehicle 20, the vehicle 20 will respond quickly and the air conditioning system will start operating.
[0069] Furthermore, when the air conditioning system is being operated in other vehicles near vehicle 20, the temperature in that location may be high or low, increasing the likelihood that the user will operate the air conditioning system in vehicle 20, causing vehicle 20 to wake up from sleep mode to activation level 3. This allows vehicle 20 to respond quickly and start operating the air conditioning system when the user remotely operates it.
[0070] Furthermore, based on past operation history of the vehicle 20, if it is predicted that the air conditioning will be operated in the current state of the vehicle 20, the vehicle 20 will be activated from sleep state to activation level 3. This allows the vehicle 20 to respond quickly and start operating the air conditioning when a user remotely operates the air conditioning of the vehicle 20.
[0071] In step S10, if the detection unit 111 determines that the identified information does not match the conditions of the third group (S10: NO), the process is terminated.
[0072] In the embodiment described above, the remote control unit 113 may decide whether or not to perform the pre-startup process depending on the operation content estimated by the estimation unit 112 and the current status of the user terminal 30 and the vehicle 20. In other words, even if the estimation unit 112 of the server 10 estimates that the user will instruct some kind of remote operation, the remote control unit 113 may determine that the pre-startup process is unnecessary depending on the content of the estimated remote operation and the current status of the user terminal 30 and the vehicle 20.
[0073] Furthermore, the aforementioned pre-startup process may be made executable only for permitted periods based on factors such as the frequency of vehicle 20 use for each time period, the time elapsed since the last time the vehicle 20 was used, the remaining charge level, and user settings. This can reduce the power consumption of vehicle 20.
[0074] According to the embodiment described above, the vehicle remote control method performed by an information processing device that remotely controls a vehicle in response to a remote control instruction from a user terminal includes identifying the state of the vehicle, performing an estimation process to estimate whether or not a remote control instruction will be given from the user terminal based on the state of the vehicle, and, if the estimation process estimates that a remote control instruction will be given, performing a pre-startup process to start the vehicle, which is in a sleep state, up to a predetermined startup level.
[0075] This allows the vehicle to perform a pre-startup process before the user remotely controls it, enabling the vehicle to respond quickly to the user's remote control commands in a short amount of time.
[0076] Furthermore, the estimation process may estimate the remote control operation content instructed from the user terminal based on the vehicle's status, and the pre-startup process may perform the pre-startup process based on the remote control operation content. This allows the pre-startup process to be executed appropriately according to the remote control operation content.
[0077] Furthermore, the estimation process may determine the distance between the user terminal's location and the vehicle's location, and estimate the remote control operation based on the distance, in addition to the vehicle's status. This allows for accurate estimation of the remote control operation based on the distance between the user and the vehicle.
[0078] Furthermore, the vehicle may have multiple startup levels set in stages, ranging from a sleep state to a fully started state where the entire vehicle is activated. The pre-startup process may determine the appropriate startup level from among these multiple levels according to the remote control operation, and then start the vehicle up to the determined startup level. This allows the vehicle to efficiently respond to remote control commands issued by the user.
[0079] Furthermore, the pre-startup process may determine the startup level such that the longer the vehicle's response time when the remote operation is performed, the closer it gets to a fully started state. This allows the vehicle to execute the remote operation-based processing more efficiently when a user performs a remote operation. Also, if the vehicle 20's response time when performing the expected operation is long, one of startup levels 1 to 3 is set so that it is closer to a fully started state compared to when the vehicle 20's response time is short. This allows for adjustment so that the response times are uniform for operations that are expected to have long response times and those that are expected to have short response times, thereby improving user operability.
[0080] Furthermore, information regarding the vehicle's status and the details of remote operation may be notified to the user's terminal. This can prevent users from forgetting to remotely operate the vehicle.
[0081] Furthermore, the vehicle includes a communication device for communicating with external devices, an integrated control unit for integrated control, and multiple vehicle control systems that work in conjunction with the integrated control unit to execute various functions of the vehicle. The multiple activation levels may include an activation level that activates only the communication device, an activation level that activates the integrated control unit in addition to the communication device, and an activation level that activates the communication device and the integrated control unit, as well as a vehicle control system from among the multiple vehicle control systems that corresponds to the remote operation. This allows the vehicle to respond to remote operations more efficiently when a user gives a remote operation command.
[0082] Furthermore, the estimation process may determine that the user has exited the vehicle when the distance exceeds a predetermined value after the vehicle's ignition switch is turned off, and determine that the user will enter the vehicle within a predetermined time when the distance changes from above the predetermined value to below the predetermined value. The results of this determination may then be used to estimate the remote control operations. This allows for a more accurate estimation of the remote control operations performed by the user based on the distance between the user and the vehicle.
[0083] Furthermore, the system may detect information about the user's action plan, and the estimation process may use the detected information about the user's action plan to estimate whether or not remote control will be instructed from the user's terminal. This makes it possible to accurately estimate whether or not remote control will be performed based on the user's future planned actions.
[0084] As described above, embodiments of the present invention have been presented, but the statements and drawings that constitute part of this disclosure should not be understood as limiting the invention. Various alternative embodiments, examples, and operational techniques will become apparent to those skilled in the art from this disclosure.
[0085] 1: Vehicle remote control system, 10: Server, 11: Control device, 12: Communication device, 13: Storage device, 20: Vehicle, 21: Communication device, 22: Integrated control device, 23, 23a, 23b: Vehicle control system, 30: User terminal, 31: Control device, 32: Input / output device, 33: Storage device, 34: Position detection device, 35: Communication device, 40: Network, 111: Detection unit, 112: Estimation unit, 113: Remote control unit
Claims
1. A method for remotely operating a vehicle, which is performed by an information processing device that remotely operates a vehicle in response to a remote operation instruction from a user terminal, comprising: identifying the state of the vehicle; performing an estimation process to estimate whether or not the remote operation instruction will be given from the user terminal based on the state of the vehicle; and, if the estimation process estimates that the remote operation instruction will be given, performing a pre-startup process to start the vehicle, which is in a sleep state, up to a predetermined startup level.
2. The vehicle remote control method according to claim 1, wherein the estimation process estimates the content of the remote control operation instructed from the user terminal based on the state of the vehicle, and the pre-startup process performs the pre-startup process based on the content of the remote control operation.
3. The vehicle remote control method according to claim 2, wherein the estimation process determines the distance between the location of the user terminal and the location of the vehicle, and estimates the content of the remote control operation based on the distance, in addition to the state of the vehicle.
4. The vehicle remote operation method according to claim 2, wherein the vehicle has a plurality of startup levels set in stages from the sleep state to a fully started state in which the entire vehicle is started, and the pre-startup process includes determining a startup level from the plurality of startup levels according to the remote operation content, and starting the vehicle up to the determined startup level.
5. The vehicle remote operation method according to claim 4, further comprising determining the startup level such that the longer the response time of the vehicle when the remote operation content is executed, the closer it gets to the fully started state.
6. The vehicle remote control method according to claim 2 or 3, further comprising notifying the user terminal of the status of the vehicle and the details of the remote control operation.
7. The vehicle remote control method according to claim 4, wherein the vehicle comprises a communication device for communicating with an external device, an integrated control device for performing integrated control, and a plurality of vehicle control systems that perform various functions of the vehicle in cooperation with the integrated control device, and the plurality of activation levels include an activation level that activates only the communication device, an activation level that activates the integrated control device in addition to the communication device, and an activation level that activates the vehicle control system among the plurality of vehicle control systems that corresponds to the remote control operation content, in addition to the communication device and the integrated control device.
8. The vehicle remote control method according to claim 3, further comprising the estimation process, which includes determining that the user carrying the user terminal has disembarked from the vehicle when the distance exceeds a predetermined value after the ignition switch of the vehicle has been switched to the off state, determining that the user will get into the vehicle within a predetermined time when the distance changes from exceeding a predetermined value to falling below a predetermined value, and estimating the content of the remote control operation using the determination result.
9. The vehicle remote control method according to claim 1, comprising detecting information on the action plan of a user carrying the user terminal, and the estimation process using the detected information on the user's action plan to estimate whether or not the remote control will be instructed from the user terminal.
10. An information processing device for remotely controlling a vehicle in response to a remote control instruction from a user terminal, comprising: a communication device for communicating with the vehicle and the user terminal; and a controller, wherein the controller identifies the state of the vehicle, performs an estimation process to estimate whether or not the remote control instruction will be given from the user terminal based on the state of the vehicle, and performs a pre-startup process to start the vehicle, which is in a sleep state, up to a predetermined startup level if the estimation process estimates that the remote control instruction will be given.
11. A vehicle remote control system comprising a vehicle, a user terminal, and an information processing device for remotely controlling the vehicle in response to remote control instructions from the user terminal, wherein the information processing device identifies the state of the vehicle, performs an estimation process to estimate whether or not the user terminal will issue the remote control instruction based on the state of the vehicle, and, if the estimation process estimates that the remote control instruction will be issued, notifies the vehicle of a start signal to start the vehicle, which is in a sleep state, up to a predetermined start level, and the vehicle starts up to the predetermined start level in accordance with the start signal notified by the information processing device.