Vehicle

Abstract

To achieve various functions by directly or indirectly using radio communication between an electronic key and a vehicle.SOLUTION: The vehicle control system includes an electronic key capable of wirelessly communicating with the vehicle, and a communication terminal capable of wirelessly communicating with the electronic key. The communication terminal includes a designation input unit that receives a designation input of a processing item for causing the vehicle to execute specific processing, the processing item indicating a content of the processing to be executed, and a command transmission unit that transmits a processing command indicating the processing item input by the designation input unit to the electronic key. The electronic key includes a command transmission unit that transmits a processing command indicating a processing item corresponding to the processing instruction to the vehicle when the processing instruction is received from the communication terminal.SELECTED DRAWING: Figure 1A-1B

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This international application claims priority based on Japanese Patent Application No. 2014-102321, filed with the Japan Patent Office on May 16, 2014, the entire contents of which are incorporated herein by reference. [Technical Field]

[0002] The present invention relates to a vehicle control system capable of remotely controlling a vehicle. [Background technology]

[0003] Electronic key systems that allow users to lock and unlock doors and start and stop the engine without touching the key via wireless communication between the electronic key carried by the user and the vehicle are becoming widespread (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-341768 Summary of the Invention [Problem to be solved by the invention]

[0005] It would be convenient if a wider variety of functions could be realized by directly or indirectly utilizing wireless communication between the electronic key and the vehicle. In one aspect of the present invention, it is desirable to provide a highly convenient vehicle control system using an electronic key. [Means for solving the problem]

[0006] A vehicle control system according to one aspect of the present invention includes an electronic key capable of wireless communication with a vehicle and a communication terminal capable of wireless communication with the electronic key. The communication terminal includes a designation input unit and a command transmission unit. The designation input unit accepts designation input of a processing item indicating the content of a specific processing to be executed by the vehicle. The command transmission unit transmits a processing command indicating the processing item input by the designation input unit to the electronic key. When the electronic key receives a processing command from the communication terminal, the electronic key includes a command transmission unit that transmits a processing command indicating the processing item corresponding to the processing command to the vehicle.

[0007] According to this configuration, the user of the vehicle can remotely control the vehicle by operating the communication terminal via the electronic key. An electronic key is a portable wireless communication device that can at least communicate wirelessly with a vehicle and transmit various data to the vehicle via wireless communication. When transmitting various data from the electronic key to the vehicle, verification data necessary for verifying the electronic key against the vehicle is also transmitted. When receiving various data from the electronic key, the vehicle references the verification data contained therein. If the verification data is confirmed to be from a legitimate electronic key, the vehicle validates the various data received from the electronic key and performs various processes based on the data.

[0008] The specification input unit is a means for accepting a user's specification of a process item (i.e., the content of a process that the user wants the vehicle to execute). The process item to be executed by the vehicle is accepted by this specification input unit. The command transmission unit is a means for wirelessly transmitting a process command indicating the process item to the electronic key. The process item accepted by the specification input unit is wirelessly transmitted to the electronic key by the command transmission unit. In this way, the electronic key can be configured to receive the user's specification at the communication terminal. The specified processing item can be recognized.

[0009] In the above configuration, the communication terminal may include a terminal-side memory unit that stores predetermined terminal-side unique information, and the command transmission unit may transmit the terminal-side unique information stored in the terminal-side memory unit when transmitting a processing command to the electronic key. In this case, the electronic key may include a key-side memory unit and a unique information determination unit. The key-side memory unit stores the predetermined key-side unique information. When the unique information determination unit receives the processing command and the terminal-side unique information from the communication terminal, it determines whether the received terminal-side unique information and the key-side unique information stored in the key-side memory unit have a specific relationship. Then, the command transmission unit may transmit a processing command when the unique information determination unit determines that the specific relationship exists.

[0010] The terminal-specific information stored in the communication terminal is information used to determine (hereinafter simply referred to as "authentication") whether or not a processing command may be validated when the electronic key receives it from the communication terminal (i.e., whether or not the command may be relayed to the vehicle as a processing command).

[0011] On the other hand, the key-side unique information stored in the electronic key is information for comparison with the terminal-side unique information for the purpose of the authentication. The terminal-side unique information may be, for example, the verification data (data used by the vehicle to verify the electronic key).

[0012] The electronic key's unique information determination unit performs the authentication when it receives a processing command from the communication terminal. That is, when the unique information determination unit receives a processing command from the communication terminal, it compares the terminal-side unique information received with the processing command with the key-side unique information stored in the electronic key. If the two have a specific relationship (e.g., they match), the unit validates the processing command from the communication terminal and transmits a processing command corresponding to the processing command to the vehicle.

[0013] With this configuration, it is possible to prevent the vehicle from being operated fraudulently, and to improve the security performance of the system. In the above configuration, the communication terminal may include at least one of an imaging unit capable of capturing video and an audio input unit capable of inputting audio, and the designation input unit may be capable of accepting designation input of a processing item based on at least one of a user's gesture captured by the imaging unit and the user's audio input to the audio input unit.

[0014] With this configuration, the vehicle user can specify the desired processing items in a variety of ways when controlling the vehicle from the communication terminal, which makes it possible to provide a system that is easy for the user to use.

[0015] In addition to the vehicle control system described above, the present invention can be realized in various forms, such as various devices (communication terminal, electronic key) possessed by the vehicle control system, a vehicle, a program for causing a computer to function as each part of these various devices, and a vehicle control method. [Brief explanation of the drawings]

[0016] [Figure 1A-1B] FIG. 1A is an explanatory diagram showing an image of how the vehicle control system is used, and FIG. 1B is a top view of the vehicle. [Figure 2] FIG. 1 is a block diagram showing a schematic configuration of a smartphone. [Figure 3] FIG. 10 is an explanatory diagram showing specific contents of an operation menu screen. [Figure 4] FIG. 2 is a block diagram showing a schematic configuration of an electronic key. [Figure 5] FIG. 10 is an explanatory diagram illustrating a method of supplying power from a smartphone to an electronic key using a charging cable. [Figure 6] 1 is a block diagram showing a schematic configuration of a vehicle. [Figure 7] 4 is a flowchart showing a vehicle operation application executed by the smartphone of the first embodiment. [Figure 8] 8 is a flowchart showing details of the vehicle operation process in FIG. 7. [Figure 9]4 is a flowchart showing an electronic key control process executed by the electronic key of the first embodiment. [Figure 10] 10 is a flowchart showing details of the relay process in FIG. 9. [Figure 11] 4 is a flowchart showing a remote control process executed by the vehicle of the first embodiment. [Figure 12] 12 is a flowchart showing details of a function restriction confirmation process in the remote control process of FIG. 11. [Figure 13] 10 is a flowchart showing tag correspondence processing. [Figure 14] FIG. 10 is a block diagram showing a schematic configuration of an electronic key according to a second embodiment. [Figure 15] 10 is a flowchart showing an electronic key control process executed by the electronic key of the second embodiment. [Figure 16] 10 is a flowchart showing a vehicle information notification process executed by a vehicle. [Figure 17] 10 is a flowchart illustrating a vehicle information display process executed by the smartphone. [Figure 18] 10 is a flowchart showing a system information transmission process executed by the electronic key. [Figure 19] 10 is a flowchart illustrating a system state notification process executed by the smartphone. [Figure 20] FIG. 10 is a block diagram illustrating another example configuration of the smartphone. [Figure 21] FIG. 10 is a block diagram showing another example of the configuration of a vehicle. [Figure 22] 10 is a flowchart of an information providing process executed by a smartphone. [Figure 23] 10 is a flowchart of a smartphone information notification process executed in a vehicle. [Figure 24] 4 is a flowchart of a surroundings monitoring process executed in a vehicle. [Figure 25] 10 is a flowchart of a surrounding information notification process executed by the smartphone. [Figure 26] 10 is a flowchart of a vehicle position notification process executed by the smartphone. [Figure 27] 10 is a flowchart of an SNS linking process executed in a vehicle. [Figure 28] 10 is a flowchart of an SNS process executed on a smartphone. [Figure 29] 10 is a flowchart of a physical condition management process executed on a smartphone. [Figure 30] 10 is a flowchart of a physical condition information response process executed in a vehicle. [Explanation of symbols]

[0017] 1...vehicle, 2,80...electronic key, 3...smartphone, 4...exterior transmitter, 5...interior transmitter, 6...receiver, 7,35,55...first communication unit, 8,57...second communication unit, 9,37...GPS receiver unit, 10,31,51,81...control unit, 11...engine unit, 12...brake unit, 13...steering unit, 14...air conditioner, 15...door, 16...luggage door, 17...window, 18...door mirror, 19...wiper, 20...headlight, 21...turn signal, 25,32,52,82...memory, 33,85...display unit, 34...touch panel, 34a...fingerprint detection unit, 36,56...BT communication unit, 39...USB receptacle, 40,59...battery, 41,60...regulator, 42,61...contactless power receiving unit, 43...camera, 44...image processing unit, 45,83...microphone, 46,84...audio processing unit, 48...operation menu screen, 53...transmitter, 54...receiver, 58,86...operation input unit, 62...power input jack, 70...charging cable, 400...outside vehicle detection area, 500...inside vehicle detection area. DETAILED DESCRIPTION OF THE INVENTION

[0018] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. [First embodiment] (1) Overall configuration of the vehicle control system As shown in FIG. 1A, the vehicle control system of this embodiment includes a vehicle 1, an electronic key 2, and a smartphone 3, and is a system that can control the vehicle 1 via the smartphone 3 via the electronic key 2.

[0019] The electronic key 2 is a key with wireless communication capabilities that allows the vehicle 1 to unlock and lock its doors and start its driving source (the engine in this embodiment) without directly inserting a mechanical key into the vehicle 1. As described below, the vehicle 1 periodically transmits a request signal. When the electronic key 2 enters an area where the request signal can be received, the electronic key 2 receives the request signal. Upon receiving the request signal from the vehicle 1, the electronic key 2 transmits a response signal and a user ID to the vehicle 1. Upon receiving the response signal and user ID from the electronic key 2, the vehicle 1 compares the received signal with its own user ID. If a match is found, the electronic key 2 enters an operable state, allowing the vehicle 1 to unlock and lock its doors and start its driving source. During the operable state, the door can be unlocked by the user touching, for example, a touch sensor on the door handle. Furthermore, the engine can be started by the user pressing a specific start button inside the vehicle.

[0020] Therefore, the user of vehicle 1 can approach vehicle 1 with electronic key 2 in their pocket or bag and unlock / lock vehicle 1 or start the engine without using a mechanical key as in the past.

[0021] The above-described functions are basic functions that can be realized using the electronic key 2 and are already generally known and put to practical use. In addition to the above-described basic functions, this embodiment further includes a relay function that relays communication between the smartphone 3 and the vehicle 1, as described below. This relay function realizes an advanced control system that allows the vehicle 1 to be remotely controlled from the smartphone 3.

[0022] 1A shows a user 4 carrying an electronic key 2 in a jacket pocket and operating a smartphone 3 next to a vehicle 1. By operating the smartphone 3, the user 4 can operate various parts of the vehicle 1, move the vehicle 1, and obtain information from the vehicle 1.

[0023] 1B is a top view of vehicle 1. Vehicle 1 is equipped with a total of four doors 15 (front, rear, left, and right), a luggage door 16, a total of two door mirrors 18 (left and right), wipers 19, two headlights 20 provided on both the left and right sides of the front end of the vehicle, and four turn signals 21 provided at the four corners. Each door 15 is equipped with a window 17.

[0024] Additionally, a fixed portion 22 and an interior camera 24 are provided in the cabin of the vehicle 1. The fixed portion 22 is provided on the rear ceiling of the cabin. The fixed portion 22 is configured to be able to fix various communication terminals including the smartphone 3. The fixed portion 22 is provided with a USB plug 23.

[0025] The interior camera 24 is provided on the front ceiling of the vehicle interior and is capable of capturing images of almost the entire interior of the vehicle from the front side of the vehicle interior. Furthermore, detection areas are formed in the vehicle 1 that enable the vehicle 1 to detect the presence of the electronic key 2. Specifically, an exterior detection area 400 is formed outside the vehicle 1, and an interior detection area 500 is formed inside the vehicle 1. These detection areas 400, 500 are respectively formed by an exterior transmitter 4 and an interior transmitter 5 (both of which are not shown in FIGS. 1A and 1B; see FIG. 6) which will be described later.

[0026] The interior detection area 500 is an area where the electronic key 2 can receive a request signal transmitted from an interior transmitter 5 installed inside the vehicle 1. The exterior detection area 400 is an area outside the vehicle 1 where the electronic key 2 can receive a request signal transmitted from an exterior transmitter 4 installed on the side of the vehicle 1.

[0027] 1B is merely an example. The specific ranges of the vehicle exterior detection area and the vehicle interior detection area can be set appropriately by adjusting the installation positions and number of transmitters 4 and 5, or by appropriately selecting transmitters 4 and 5 having desired radio wave emission characteristics.

[0028] (2) Description of Smartphone 3 The specific configuration of the smartphone 3 will be described with reference to Fig. 2. The smartphone 3 is a multi-functional portable information terminal equipped with multiple types of communication functions, including a voice call function via a mobile phone network. The smartphone 3 has at least two types of wireless communication functions: wireless communication using a first communication method (hereinafter abbreviated as "first communication") and wireless communication using Bluetooth (registered trademark; the same applies hereinafter) (hereinafter abbreviated as "BT communication").

[0029] The first communication is a communication method that allows wireless communication over long distances, and in this embodiment, is a wireless communication method using, for example, a mobile phone network. Therefore, as long as the smartphone 3 is within the communication range of the mobile phone, the user of the smartphone 3 can make voice calls and data communications using the first communication. BT communication is a well-known short-range wireless communication method that uses radio waves in the 2.4 GHz band.

[0030] As shown in FIG. 2, the smartphone 3 includes a control unit 31, a memory 32, a display unit 33, a touch panel 34, a first communication unit 35, a BT communication unit 36, a GPS receiving unit 37, a USB interface (hereinafter abbreviated as "USB I / F") 38, a USB receptacle 39, a battery 40, a regulator 41, a non-contact power receiving unit 42, a camera 43, an image processing unit 44, a microphone 45, an audio processing unit 46, and a tag reader / writer 47.

[0031] The control unit 31 includes a microcomputer equipped with a CPU, ROM, RAM, I / O, etc. (not shown). The control unit 31 controls various circuits and functional blocks in the smartphone 3, including the units connected to the control unit 31. Various programs, including a vehicle operation application 32a (described later), are executed by the CPU of the control unit 31.

[0032] The memory 32 is a nonvolatile memory whose stored contents can be electrically rewritten, and is a flash memory in this embodiment. Various programs and data are stored in the memory 32. The programs and data stored in the memory 32 include a vehicle operation application 32a, vehicle operation menu data 32b, voice patterns 32c, gesture patterns 32d, ID information 32e, and authentication information 32f.

[0033] The display unit 33 is a display device (for example, a liquid crystal display) capable of displaying various images and information. The touch panel 34 is a well-known input device that allows input operations to be performed by touching it with a pointer such as a fingertip or a dedicated pen. The touch panel 34 is arranged so as to overlap almost the entire image display area of ​​the display unit 33. The touch panel 34 further includes a fingerprint detection unit 34a. When a human finger touches the touch panel 34, the fingerprint detection unit 34a detects the fingerprint of the contacted portion. Fingerprint data detected by the fingerprint detection unit 34a (fingerprint data) is input to the control unit 31. Note that other methods for detecting fingerprints may also be used. Although not shown in the figures, the smartphone 3 also includes at least one switch, which is pressed and operated by the user, as an input device in addition to the touch panel 34. It is prepared.

[0034] The first communication unit 35 is a wireless communication interface for transmitting and receiving radio waves for the first communication. The BT communication unit 36 ​​is a wireless communication interface for realizing BT communication. The GPS receiving unit 37 receives radio waves from multiple GPS (Global Positioning System) satellites and outputs information contained in the received radio waves to the control unit 31. The control unit 31 can detect the current location (e.g., latitude and longitude) of the smartphone 3 based on the information received by the GPS receiving unit 37.

[0035] The USB I / F 38 is an interface for performing serial communication according to the USB (Universal Serial Bus) standard. A USB plug can be inserted into the USB receptacle 39. Note that a data communication interface according to another standard may be provided instead of USB, or a data communication interface according to another standard may be provided in addition to USB.

[0036] The battery 40 is a secondary battery that can be repeatedly recharged. However, the battery 40 may be other storage means (such as a primary battery or a fuel cell) other than a secondary battery. The same applies to the battery 59 (see FIG. 4) of the electronic key 2, which will be described later. The regulator 41 is a power supply circuit that converts the voltage of the battery 40 into a constant voltage of a predetermined value and supplies it to the control unit 31 and other circuits.

[0037] The non-contact power receiving / transmitting unit 42 can supply power to the outside using a non-contact power supply system, and can receive power from the outside. When supplying power to the outside, the non-contact power receiving / transmitting unit 42 discharges DC power from the battery 40 to the outside using, for example, an electromagnetic induction system. When receiving power from the outside, the non-contact power receiving / transmitting unit 42 converts the power received from the outside into DC and outputs it to at least one of the battery 40 and the regulator 41. The operation of the non-contact power receiving / transmitting unit 42 is controlled by the control unit 31.

[0038] Camera 43 is an imaging device capable of capturing still images and videos. Image processing unit 44 processes the still images and videos captured by camera 43 (for example, generates still image and video data) and inputs the processing results to control unit 31. Control unit 31 can recognize the content of the still images and videos captured by camera 43 based on the data input from image processing unit 44.

[0039] The microphone 45 converts external sound into an electrical signal. The audio processing unit 46 processes the audio signal collected by the microphone 45 and converted into an electrical signal into digital audio data and outputs it to the control unit 31. The control unit 31 can recognize the content of the sound collected by the microphone 45 based on the audio data input from the audio processing unit 46.

[0040] The tag reader / writer 47 is a communication module for contactless data communication with an external RF tag of the smartphone 3. By holding the smartphone 3 over an external RF tag, the tag reader / writer 47 is enabled to communicate with the RF tag, and data can be read from or written to the RF tag.

[0041] In this embodiment, as will be described later, the electronic key 2 has a built-in RF tag 63. Therefore, by holding the smartphone 3 over the electronic key 2, the tag reader / writer 47 of the smartphone 3 can communicate data with the RF tag 63 of the electronic key 2.

[0042] The vehicle operation app 32a stored in the memory 32 is application software for controlling the vehicle 1 via the electronic key 2 from the smartphone 3. The vehicle operation app 32a can be provided, for example, by the manufacturer or dealer of the vehicle 1 via a medium or a telecommunications line and installed on the smartphone 3.

[0043] The vehicle operation menu data 32b stored in the memory 32 is a database used when the vehicle operation application 32a is executed, is provided together with the vehicle operation application 32a, and is stored in the memory 32 when the vehicle operation application 32a is installed. However, it is also possible to install or update the data separately from the vehicle operation application 32a. The vehicle operation menu data 32b includes various data for displaying the operation menu screen 48 shown in FIG. 3 on the display unit 33.

[0044] 3 is a screen that lists icons of operation items that can be used to operate the vehicle 1 from the smartphone 3. The icons displayed on the operation menu screen 48 include a "light flashing" icon indicating an operation item for flashing the headlights 20 for a certain period of time, a "blinking blinker" icon indicating an operation item for flashing the blinker 21 for a certain period of time, an "air conditioner on" icon indicating an operation item for turning on (activating) the air conditioner, an "air conditioner off" icon indicating an operation item for turning off (stopping) the air conditioner, an "engine start" icon indicating an operation item for starting the engine, an "engine stop" icon indicating an operation item for stopping the engine, a "door mirror close" icon indicating an operation item for closing the door mirrors 18, an "door mirror open" icon indicating an operation item for opening the door mirrors 18, a "steer left" icon indicating an operation item for turning the steering wheel a certain angle to the left (i.e., steering the steering wheel a certain amount to the left), a "steer right" icon indicating an operation item for turning the steering wheel a certain angle to the right (i.e., steering the steering wheel a certain amount to the right), a "stop" icon indicating an operation item for turning the steering wheel in a neutral position, and a "stop" icon indicating an operation item for turning the steering wheel in a neutral position. icons corresponding to various operation items include a "steering neutral" icon indicating an operation item to return the vehicle to a neutral state, a "slow forward" icon indicating an operation item to drive the vehicle forward a small distance (e.g., 30 cm) at a small speed (e.g., 3 km / h), a "slow reverse" icon indicating an operation item to drive the vehicle backward a small distance (e.g., 20 cm) at a small speed (e.g., 2 km / h), a "mileage" icon indicating an operation item to acquire the cumulative mileage of the vehicle, an "electronic key control" icon indicating an operation item to control the functions of the electronic key 2, a "door lock open / close" icon indicating an operation item to lock and unlock each door 15 of the vehicle, a "maintenance information" icon indicating an operation item to acquire maintenance information of the vehicle (e.g., remaining oil level, remaining battery level, etc.), a "diagnosis information" icon indicating an operation item to acquire diagnostic information of the vehicle, an "interior temperature" icon indicating an operation item to acquire the interior temperature of the vehicle, and an "interior image information" icon indicating an operation item to acquire interior image information of the vehicle.

[0045] It should be noted that there is a limit to the number of icons that can be simultaneously displayed on the display unit 33. Icons that are not displayed on the display unit 33 can be displayed by performing a swipe or flick operation in an up or down direction on the touch panel 34 to scroll the display content up or down.

[0046] When the user selects (e.g., taps) an icon for closing the door mirrors on the operation menu screen 48, the selection information is transmitted to the vehicle 1 via the electronic key 2, and the door mirrors 18 of the vehicle 1 are automatically closed, as described below.

[0047] For example, when a user selects the "door lock open / close" icon, multiple icons are displayed to allow the user to select which door lock to operate and whether to open or close the door, as shown in FIG. 3. When the user selects an icon corresponding to the desired operation from the multiple icons, the selection information is transmitted to the vehicle 1 via the electronic key 2, and the door lock is opened or closed according to the selected operation. Thus, the user can, for example, open or close all doors 15, or selectively open or close only specific doors 15.

[0048] For example, when a user selects the "Electronic Key Control" icon, the selected information (specific In response to the electronic key control command, an electronic key control command (described later) is transmitted to the electronic key 2. Upon receiving the electronic key control command from the smartphone 3, the electronic key 2 executes a command response process (S124 in FIG. 10 described later) corresponding to the electronic key control command.

[0049] For example, when a user selects the "interior image information" icon, the selection information is transmitted to the vehicle 1 via the electronic key 2. That is, an operation command indicating a request to acquire interior images is transmitted to the vehicle 1. Upon receiving the operation command, the vehicle 1 operates the interior camera 24 to acquire still images or video images of the interior of the vehicle. The acquired still images or video images are then transmitted to the smartphone 3, for example, via the first communication. Upon receiving the image data captured by the interior camera 24 from the vehicle 1, the smartphone 3 displays the image data on the display unit 33.

[0050] In this way, in this embodiment, the user can use the vehicle operation app 32a installed on the smartphone 3 to selectively execute multiple operation items set as vehicle operation menu data 32b on the vehicle 1.

[0051] When controlling the vehicle 1 from the smartphone 3 using the vehicle operation app 32a, an operation item can be specified by voice or gesture, in addition to a selection operation on the operation menu screen 48 shown in FIG. 3 . The memory 32 stores voice data corresponding to each operation item as a voice pattern 32c. Therefore, when the user speaks a word indicating a specific operation item into the microphone 45 (one of the voices stored as the voice pattern 32c), the control unit 31 determines that a request for execution of the operation item has been made and executes the processing required to execute the operation item. For example, when the user speaks, "Close the door mirrors," the control unit 31 recognizes that an operation to close the door mirrors 18 has been requested and closes the door mirrors 18. In other words, in this example, the same result can be obtained as when the user taps the door mirror close icon on the operation menu screen 48 shown in FIG. 3 .

[0052] Furthermore, gestures corresponding to the respective operation items are stored as gesture patterns 32d in memory 32. Therefore, when the user makes a gesture indicating a specific operation item toward camera 43 (any of the gestures stored as gesture patterns 32d), control unit 31 determines that a request for execution of that operation item has been made, and executes processing required to execute that operation item.

[0053] The ID information 32e stored in the memory 32 includes a terminal ID unique to the smartphone 3. The ID information 32e also includes a user ID unique to the vehicle 1, which is required to remotely control the vehicle 1 from the smartphone 3. This user ID is also stored in the electronic key 2 and the vehicle 1. The user ID is stored in the vehicle 1 and the electronic key 2, for example, by the vehicle manufacturer or dealer when the vehicle 1 is shipped. The user ID is stored in the smartphone 3 when, for example, the manufacturer or dealer of the vehicle 1 notifies the user of the user ID through a predetermined procedure and the user inputs the information into the smartphone 3. Note that the user ID may be stored in the smartphone 3 by various other methods and at various times. For example, the user may bring the electronic key 2 and the smartphone 3 to the dealer of the vehicle 1 and have the dealer store the user ID.

[0054] The authentication information 32f stored in the memory 32 includes at least one piece of authentication data for authenticating whether the user of the smartphone 3 is a legitimate user. Specifically, the authentication information 32f includes at least one of the following as the authentication data: fingerprint data of the legitimate user (registered fingerprint data), facial image data of the legitimate user (registered facial data), and voice data of the legitimate user (registered voice data). Each of these registered data is stored in the memory 32. It can be registered (stored) at will.

[0055] (3) Description of Electronic Key 2 The specific configuration of the electronic key 2 will be described with reference to FIG. 4. The electronic key 2 is a lightweight, compact, portable communication terminal that can be easily carried by the user. Like the smartphone 3, the electronic key 2 has first communication and BT communication functions as its wireless communication functions. The electronic key 2 also has wireless communication using a second communication method (hereinafter referred to as "second communication") as its wireless communication function. Like the first communication, the second communication is a communication method that allows wireless communication over long distances. The second communication may be, for example, wireless LAN or another wireless communication method. Furthermore, like conventional electronic keys, the electronic key 2 also has a wireless communication function (hereinafter referred to as "smart communication") that sends back a response signal and a user ID in response to a request signal received from the vehicle 1.

[0056] As shown in FIG. 4, the electronic key 2 includes a control unit 51, a memory 52, a transmission unit 53, a reception unit 54, a first communication unit 55, a BT communication unit 56, a second communication unit 57, an operation input unit 58, a battery 59, a regulator 60, a non-contact power receiving unit 61, and a power input jack 62.

[0057] The control unit 51 includes a microcomputer equipped with a CPU, ROM, RAM, I / O, etc. (not shown). The control unit 51 controls various circuits and functional blocks within the electronic key 2, including the various units connected to the control unit 51.

[0058] The memory 52 is a nonvolatile memory whose stored contents can be electrically rewritten, and in this embodiment is a flash memory. Various programs and data are stored in the memory 52. ​​The data stored in the memory 52 includes ID information 52a and BT pairing information 52b.

[0059] The ID information 52a includes a user ID unique to the vehicle 1. This user ID is the same as the user ID stored as one of the ID information 32e in the memory 32 of the smartphone 3 and is also stored in the vehicle 1 as described above. The BT pairing information 52b includes information necessary for connecting the electronic key 2 and another communication device via BT communication, such as unique information (e.g., a link key) generated when pairing for BT communication is performed between the electronic key 2 and another communication device. When unique information is generated through pairing, the generated unique information is associated with user information of the other communication device (i.e., for each other user capable of BT communication) and stored. Therefore, when initiating BT communication with another communication device, the electronic key 2 can identify the user of the other communication device by performing authentication based on the unique information of the other communication device.

[0060] The receiver 54 receives and demodulates a request signal transmitted from the vehicle 1 by radio waves in a predetermined frequency band, and outputs the demodulated signal to the controller 51. When the request signal is input from the receiver 54, the controller 51 generates response data and outputs the response data to the transmitter 53. The response data includes a predetermined response signal and the user ID stored in the memory 52 as ID information 52a. The transmitter 53 modulates the response data input from the controller 51 into radio waves in a predetermined frequency band and transmits the modulated data to the vehicle 1.

[0061] As shown in FIG. 1B, in this embodiment, detection areas 400 and 500 are set up in which a request signal can be received. Therefore, if the electronic key 2 is not within either of the detection areas 400 and 500, the request signal is not received. On the other hand, when the electronic key 2 is within either of the detection areas 400 and 500, the electronic key 2 is able to receive a request signal from the vehicle 1. The request signal from the vehicle 1 is transmitted repeatedly at regular intervals, as will be described later. Therefore, while the electronic key 2 is within either of the detection areas 400 and 500, the electronic key 2 periodically receives the request signal. Each time the electronic key 2 receives a request signal, it transmits a response signal in response to that request signal.

[0062] The first communication unit 55 is a wireless communication interface for transmitting and receiving radio waves for the first communication. The BT communication unit 56 is a wireless communication interface for realizing BT communication. The second communication unit 57 is a wireless communication interface for transmitting and receiving radio waves for the second communication. The operation input unit 58 is an input device capable of accepting input operations by the user. A specific example of the operation input unit 58 is a push button switch. The operation input unit 58 may be provided with a touch panel.

[0063] In this embodiment, the battery 59 is a rechargeable secondary battery. The regulator 60 is a power supply circuit that converts the voltage of the battery 59 to a constant voltage of a predetermined value and supplies the constant voltage to the control unit 51 and other circuits. The contactless power receiving unit 61 has a configuration similar to the contactless power receiving unit 42 of the smartphone 3 and is a module that can supply power to and receive power from an external device using a contactless power supply method. The operation of the contactless power receiving unit 61 is controlled by the control unit 51. The power input jack 62 is a jack into which an external charging adapter plug is inserted and removed. The power input jack 62 can be used to input DC power from an external device to charge the battery 59, or conversely, to supply DC power from the battery 59 to an external device.

[0064] Therefore, if the remaining charge of the battery 59 of the electronic key 2 becomes low and the electronic key 2 can no longer operate normally, the electronic key 2 can operate normally and the battery 59 can be charged by drawing in DC power from the power input jack 62 or receiving power from an external source using the non-contact power receiving unit 61.

[0065] 5 , charging of the battery 59 of the electronic key 2 can be achieved using a charging cable 70. The charging cable 70 includes a USB plug 71, a USB cable 72, a power adapter 73, a pin cable 74, and a power plug 75. When the USB plug 71 is connected to the USB receptacle 39 of the smartphone 3 and the power plug 75 is inserted into the power input jack 62 of the electronic key 2, DC power from the battery 40 of the smartphone 3 is supplied to the electronic key 2 via the power adapter 73.

[0066] Both the smartphone 3 and the electronic key 2 are equipped with a non-contact power supply receiver / transmitter. Therefore, when the non-contact power supply receivers 42 and 61 are placed facing each other within a predetermined distance, power can be supplied from one to the other.

[0067] Therefore, even if the battery 59 of the electronic key 2 runs out of capacity, it is possible to receive power from another device such as a smartphone 3, either contactlessly or via a cable, to charge the battery 59 and operate the regulator 60 to ensure that each part within the electronic key 2 operates normally.

[0068] The electronic key 2 also has a built-in RF tag 63. The RF tag 63 stores a user ID. When the smartphone 3 is held over the RF tag 63 and data communication with the tag reader / writer 47 of the smartphone 3 begins, the RF tag 63 acquires the user ID from the smartphone 3. The RF tag 63 then compares the user ID with its own user ID, and if they match, transmits its own user ID and an application startup request to the smartphone 3.

[0069] (4) Description of Vehicle 1 A specific configuration of the vehicle 1 will be described with reference to FIG. The vehicle 1 has an internal combustion engine as a driving source for traveling. As shown in FIG. 6, the vehicle 1 is equipped with a control unit 10. The control unit 10 includes a microcomputer equipped with a CPU, ROM, RAM, I / O, etc. (not shown). The control unit 10 controls various circuits and functional blocks within the vehicle 1, including the various units connected to the control unit 10.

[0070] In this embodiment, the various circuits and functional blocks controlled by the control unit 10 include at least an engine unit 11, a brake unit 12, a steering unit 13, an air conditioner 14, doors 15, a luggage door 16, windows 17, door mirrors 18, wipers 19, headlights 20, turn signals 21, an in-vehicle camera 24, a display unit 26, and a USB I / F 27. In reality, a plurality of doors 15, windows 17, door mirrors 18, wipers 19, headlights 20, and turn signals 21 are provided, as shown in FIG. 1B .

[0071] The engine section 11 includes an engine and an engine control unit that controls the engine. The control section 10 can control the operation of the engine via the engine control unit in the engine section 11. The brake section 12 includes a brake mechanism provided in the vehicle 1 and a brake control unit that controls the brake mechanism. The steering section 13 includes a steering mechanism that steers the wheels of the vehicle 1 and a steering control unit that controls the steering mechanism. The steering system of this embodiment is a so-called steer-by-wire electric steering system. In other words, the steering wheel operated by the driver and the steering shaft are not directly connected mechanically, and the steering shaft is driven by a motor in accordance with the operation of the steering wheel by the driver. Therefore, the control section 10 can freely move the steered wheels by controlling the steering section 13.

[0072] The control unit 10 executes various functions based on various programs and data stored in the memory 25. The memory 25 is a non-volatile memory whose stored contents can be electrically rewritten, and in this embodiment is a flash memory. The data stored in the memory 25 includes ID information 25a and function restriction information 25b.

[0073] The ID information 25a includes a user ID unique to the vehicle 1. This user ID is the same as the user ID stored in the memory 32 of the smartphone 3 and the memory 52 of the electronic key 2. The function restriction information 25b is information for restricting functions of the vehicle 1 depending on the relative positions of the vehicle 1, the smartphone 3, and the electronic key 2. The function restriction information 25b stores information such as whether functions of the vehicle 1 are restricted or not, and if so, which specific functions are restricted and how, depending on whether the electronic key 2 is located in the vehicle interior detection area 500, the vehicle exterior detection area 400, or outside the detection area of ​​the vehicle 1, and where the smartphone 3 is located (for example, inside or outside the vehicle 1). Some of this function restriction information 25b is stored as default when the vehicle 1 is shipped, but can also be customized by the user of the vehicle 1.

[0074] By customizing the function restriction information 25b as appropriate, it is possible to restrict specific functions, for example, when a child is inside the vehicle 1 with the smartphone 3 while a parent is outside the vehicle 1 with the electronic key 2. It is also possible to restrict specific functions, for example, when the electronic key 2 is within the detection area of ​​the vehicle 1 but the smartphone 3 is located far away from the vehicle 1 (i.e., when the smartphone 3 and electronic key 2 are far apart).

[0075] The vehicle 1 is equipped with first and second communication functions as wireless communication functions. The first communication unit 7 is a wireless communication interface for transmitting and receiving radio waves for the first communication, and the second communication unit 8 is a wireless communication interface for transmitting and receiving radio waves for the second communication.

[0076] The GPS receiver 9 receives radio waves from multiple GPS satellites and outputs information contained in the received radio waves to the control unit 10. The control unit 10 can detect the current position (e.g., latitude and longitude) of the vehicle 1 based on the information received by the GPS receiver 9.

[0077] The vehicle 1 also has a wireless communication (smart communication) function that periodically transmits a request signal to the electronic key 2 and receives a response signal and a user ID from the electronic key 2 in response to the request signal. The vehicle 1 is provided with an exterior transmitter 4, an interior transmitter 5, and a receiver 6 to realize this smart communication.

[0078] The exterior transmitter 4 and the interior transmitter 5 periodically transmit request signals based on commands from the control unit 10. In practice, a plurality of exterior transmitters 4 and a plurality of interior transmitters 5 are provided. That is, the plurality of interior transmitters 5 form an interior detection area 500 (an area in which a request signal from any of the interior transmitters 5 can be received) shown in FIG. 1B. The plurality of exterior transmitters 4 also form an exterior detection area 400 (an area in which a request signal from any of the exterior transmitters 4 can be received) shown in FIG. 1B.

[0079] The receiver 6 can receive various signals transmitted from the electronic key 2. The signals received by the receiver 6 from the electronic key 2 include response signals to request signals transmitted from the transmitters 4 and 5. The request signals contain identification information indicating the transmitter that sent the request signal. When the electronic key 2 receives a request signal, it transmits a response signal to the request signal, adding the identification information contained in the request signal. Therefore, when the receiver 6 receives a response signal, the control unit 10 of the vehicle 1 can determine, at least, whether the electronic key 2 is located inside or outside the vehicle 1 based on the identification information added to the response signal.

[0080] The display unit 26 is a display device (for example, a liquid crystal display) that can display various images and information. The USB I / F 27 is an interface for performing serial communication according to the USB standard. The USB plug 23 can be connected to a USB receptacle.

[0081] When the smartphone 3 is attached to the fixing part 22 of the vehicle 1 (see FIG. 1B), the smartphone 3 is fixed in a state where the camera 43 can capture an image of the area behind the vehicle 1. In other words, the camera 43 is fixed in a state where the lens of the camera 43 faces the rear of the vehicle. Furthermore, when the smartphone 3 is attached to the fixing part 22 of the vehicle 1, the USB receptacle 39 of the smartphone 3 and the USB plug 23 of the vehicle 1 (see FIG. 6) are connected, enabling data communication between the smartphone 3 and the vehicle 1 via USB.

[0082] While data communication with the smartphone 3 via USB is possible, the control unit 10 of the vehicle 1 can acquire various information from the smartphone 3. One type of information that the control unit 10 can acquire from the smartphone 3 is a still image or a video image captured by the camera 43 of the smartphone 3.

[0083] The control unit 10 of the vehicle 1 can acquire image data captured by the camera 43 of the smartphone 3 in real time at a predetermined timing (for example, when the gear is set in reverse) or in response to a user operation, and display the image data on the display unit 26. In other words, by fixing the smartphone 3 to the fixing unit 22 of the vehicle 1, the user of the vehicle 1 can display an image of the rear of the vehicle 1 on the display unit 26 as needed, and check the situation behind the vehicle 1.

[0084] In addition, the control unit 10 of the vehicle 1 is configured to receive the photographed data from the smartphone 3 through a communication interface. The interface is not limited to USB. The photographed data may be acquired using a communication interface other than USB. For example, the photographed data may be acquired from the smartphone 3 via wireless communication such as the first communication.

[0085] The vehicle 1 of this embodiment can perform functions equivalent to those of a conventional electronic key system through smart communication with the electronic key 2. In other words, when a user carrying the electronic key 2 enters each detection area 400, 500 of the vehicle 1, the user can lock and unlock each door 15 and start and stop the engine without touching the key. However, in this case, the user unlocks each door 15 by touching a touch sensor on the door handle. The user locks each door 15 by pressing a door lock switch on the door handle. The user starts and stops the engine by pressing a push switch located near the driver's seat.

[0086] In addition to having these basic electronic key system functions, this embodiment also has a remote control function using a smartphone 3, which allows the user to remotely control the vehicle 1 by relaying the electronic key 2 from the smartphone 3 without having to directly touch the vehicle 1.

[0087] Below, various processes executed in the smartphone 3, the electronic key 2, and the vehicle 1 to realize this remote control function will be explained in order. (5) Explanation of the vehicle operation app on smartphone 3 First, the processing content of the vehicle operation application 32a installed in the smartphone 3 to realize the remote control function will be described with reference to Fig. 7. When a predetermined application startup process is performed by the user, the control unit 31 of the smartphone 3 (more specifically, the CPU in the control unit 31) reads the program of the vehicle operation application 32a from the memory 32 and executes it.

[0088] When the control unit 31 of the smartphone 3 starts executing the vehicle operation application 32a, the control unit 31 performs application user authentication in S10. Application user authentication is a process for determining whether the user executing the vehicle operation application 32a is a user (authorized user) who is authorized to execute the application. Application user authentication is performed using at least one of the user's fingerprint, voice, and face image.

[0089] As described above, registered fingerprint data, registered face data, and registered voice data are stored as authentication information 32f in memory 32 of smartphone 3. Therefore, application user authentication can be performed by, for example, having the user input a fingerprint and determining whether the input fingerprint matches the registered fingerprint data, or by, for example, capturing a face image of the user with camera 43 and determining whether the face image matches the registered face data, or by having the user speak and determining whether the voice image matches the registered voice data.

[0090] In S12, it is determined whether the user executing the vehicle operation application 32a is an authorized user based on the result of the application user authentication in S10. If the user executing the vehicle operation application 32a is not an authorized user (S12: NO), a predetermined user authentication error process is executed in S20, and the process of the vehicle operation application 32a is terminated.

[0091] If the user running the vehicle operation application 32a is an authorized user (S12: YES), an authentication request signal is sent to the electronic key 2 via the first communication in S14. This authentication request signal includes the user ID stored in the smartphone 3. In response to this authentication request signal, the electronic key 2 performs user ID authentication as described below, and determines whether the user ID matches the user ID stored in the electronic key 2. If they match, the electronic key 2 If the two do not match, the electronic key 2 sends an operation refusal signal.

[0092] In S16, it is determined whether an operation permission signal or an operation refusal signal has been received from the electronic key 2 in response to the authentication request signal sent in S14. If an operation refusal signal has been received (S16: NO), the process proceeds to S20, where user authentication error processing is performed. If an operation permission signal has been received (S16: YES), the process proceeds to S18, where vehicle operation processing is performed.

[0093] Details of the vehicle operation processing in S18 are as shown in FIG. 8. As shown in FIG. 8, when the process proceeds to the vehicle operation processing, the selection of a vehicle operation method by the user is accepted in S22. In this embodiment, the user can specify the operation content using one of three instruction methods for the smartphone 3. As described with reference to FIG. 3, one of the three instruction methods is a method in which the operation menu screen 48 is displayed on the display unit 33 and an icon of a desired operation item (operation content) is selected from the screen by tapping. The other two of the three instruction methods are the above-mentioned voice or gesture methods. The user can select which method to use to specify the operation content from among tap operation, voice, and gesture.

[0094] In S24, the selection result of the vehicle operation method accepted in S22 is judged, and if tap operation is selected, the process proceeds to S26, if gesture is selected, the process proceeds to S32, and if voice is selected, the process proceeds to S40. In S26, which is reached when tap operation is selected as the vehicle operation method, an operation menu screen 48 (see FIG. 3) is displayed on the display unit 33. In S28, the selection of any one of the operation items displayed on the operation menu screen 48 is accepted. In S30, an operation command corresponding to the operation item selected in S28 is generated. For example, if "slow forward speed" is selected as the operation item, an operation command corresponding to slow forward speed, for moving the vehicle 1 forward a small distance, is generated. After S30, the process proceeds to S48.

[0095] In S32, which is reached when gesture is selected as the vehicle operation method, the camera 43 is activated and begins capturing video of the user. In S34, it is determined whether the user has made a gesture corresponding to a prescribed gesture pattern based on the video captured by the camera 43. This determination is made by determining whether the gesture made by the user matches any of the prescribed gestures stored as gesture patterns 32d in the memory 32. If the user makes a gesture that matches a prescribed gesture pattern, the gesture is recognized.

[0096] In S36, the operation content corresponding to the specified gesture pattern recognized in S34 is displayed on the display unit 33. This allows the user to confirm whether the gesture he or she made has been correctly recognized. In S38, an operation command corresponding to the specified gesture pattern recognized in S34 is generated. For example, if the user makes a gesture indicating "air conditioner on" (a gesture stored as gesture pattern 32d) and it is correctly recognized, an operation command corresponding to "air conditioner on" is generated to operate the air conditioner of the vehicle 1. After S38, the process proceeds to S48.

[0097] In S40, which is reached when voice is selected as the vehicle operation method, voice input via the microphone 45 is set to a standby state. In other words, a state is established in which voice input and recognition can be executed. In S42, it is determined whether the user has spoken words corresponding to a specified voice pattern based on the user's voice input via the microphone 45. This determination is made by determining whether the words spoken by the user match any of the words stored as voice patterns 32c in the memory 32. Then, if the user has spoken words corresponding to the specified voice pattern, that voice pattern is recognized.

[0098] In S44, the operation content corresponding to the specified voice pattern recognized in S42 is displayed on the display unit 33. This allows the user to check whether the words he or she spoke were correctly recognized. In S46, an operation command corresponding to the specified voice pattern recognized in S42 is generated. For example, if the user speaks words indicating "close door mirrors" (words stored as voice pattern 32c) and these are correctly recognized, an operation command corresponding to closing the door mirrors is generated to close the door mirrors 18 of the vehicle 1. After S46, the process proceeds to S48.

[0099] In S48, the operation command generated in S30, S38, or S46, the user ID, the terminal ID, and the location information of the smartphone 3 are transmitted to the electronic key 2 via the first communication. The location information of the smartphone 3 is location information (GPS information) detected based on information received by the GPS receiver 37. Note that if information indicating the current location of the smartphone 3 can be obtained in addition to the GPS information, that information may be transmitted as the location information.

[0100] In S50, it is determined whether an error notification has been received in the first communication from the electronic key 2. Note that the error notifications that the smartphone 3 may receive from the electronic key 2 include a first error notification (see S120 in FIG. 10), a second error notification (see S136 in FIG. 10), a third error notification (see S140 in FIG. 10), and a fourth error notification (see S144 in FIG. 10), as will be described later.

[0101] If no error notification has been received from the electronic key 2 (S50: NO), the process proceeds to S54. If any error notification has been received from the electronic key 2 (S50: YES), a predetermined error message is displayed on the display unit 33 in S52, and the process proceeds to S58. The error message displayed in S52 may be a common message, or may be different for each of the four types of error notifications.

[0102] In S54, the system determines whether a relay completion signal has been received from the electronic key 2. This relay completion signal is the signal transmitted from the electronic key 2 in S146 of FIG. 10 (described later). If a relay completion signal has been received from the electronic key 2 (S54: YES), the system proceeds to S58. If a relay completion signal has not been received from the electronic key 2 (S54: NO), the system displays communication error information on the display unit 33 in S56.

[0103] If neither an error notification nor a relay completion signal is received from the electronic key 2 in response to the transmission process in S48, this may indicate that normal communication is not possible between the smartphone 3 and the electronic key 2. Therefore, the communication abnormality information in S56 is intended to notify the user that normal communication is not possible between the smartphone 3 and the electronic key 2.

[0104] As another example, for example, BT communication may be used to determine whether the smartphone 3 and the electronic key 2 are close to each other (i.e., whether BT communication is possible between them), and if it is determined that they are close to each other and then they are no longer close to each other, the user may be notified of this (i.e., that the smartphone 3 and the electronic key 2 have been separated) using an image or sound.

[0105] In S58, it is determined whether or not a predetermined termination operation for terminating the vehicle operation application 32a has been performed by the user. If the termination operation has not been performed (S58: NO), the process returns to S22. If the termination operation has been performed (S58: YES), the vehicle operation application 32a is terminated.

[0106] (6) Description of electronic key control process in electronic key 2 Next, the electronic key control process executed by the electronic key 2 to realize the remote control function will be described. This will be explained with reference to FIG. 9. The program for the electronic key control process is stored in the memory 52 of the electronic key 2. The control unit 51 of the electronic key 2 (more specifically, the electronic key control process shown in FIG. 9) repeatedly executes the electronic key control process at a predetermined control cycle.

[0107] When the control unit 51 of the electronic key 2 starts the electronic key control process, it determines in S102 whether a request signal transmitted from the vehicle 1 via smart communication has been received. If a request signal from the vehicle 1 has not been received (S102: NO), the process proceeds to S106. If a request signal from the vehicle 1 has been received (S102: YES), the process executes a response process in S104 and then proceeds to S106. The response process in S104 is a process of transmitting a response signal and a user ID to the vehicle 1 via smart communication (i.e., from the transmission unit 53).

[0108] In S106, it is determined whether an authentication request signal has been received via the first communication from the smartphone 3. If an authentication request signal has not been received (S106: NO), the process proceeds to S114. If an authentication request signal has been received (S106: YES), in S108, it is determined whether the user ID included in the authentication request signal matches the user ID stored in the electronic key 2 (i.e., user ID verification).

[0109] As a result of the user ID comparison, if it is determined that the two user IDs do not match (S108: NO), proceed to S112. In S112, an operation refusal signal is sent to the smartphone 3 via the first communication. After processing S112, proceed to S114. As a result of the user ID comparison, if the two user IDs match (S108: YES), proceed to S110. In S110, an operation permission signal is sent to the smartphone 3 via the first communication. After processing S110, proceed to S114.

[0110] In S114, it is determined whether data has been received from the smartphone 3 via the first communication. Note that the data here refers to the operation command, user ID, terminal ID, and location information of the smartphone 3 transmitted in S48 of FIG. 7. If data has not been received from the smartphone 3 via the first communication (S114: NO), the electronic key control process ends. If data has been received from the smartphone 3 via the first communication (S114: YES), the process proceeds to relay processing in S116.

[0111] Details of the relay process in S116 are as shown in Figure 10. As shown in Figure 10, once the relay process begins, in S118, a determination is made as to whether the user ID included in the data received from the smartphone 3 matches the user ID stored in the electronic key 2 (i.e., user ID verification). If the user ID verification determines that the two user IDs do not match (S118: NO), in S120 a first error notification is sent to the smartphone 3 via the first communication, and the electronic key control process ends. If the user ID verification determines that the two user IDs match (S118: YES), the process proceeds to S122.

[0112] In S122, it is determined whether the operation command in the received data is an electronic key control command. As described above, an electronic key control command is an operation command transmitted when the "electronic key control" icon is selected on the operation menu screen 48 (see FIG. 3). If the operation command is not an electronic key control command (S122: NO), the process proceeds to S126. If the operation command is an electronic key control command (S122: YES), the process executes command response processing in S124.

[0113] The specific content of the command response process can be determined as appropriate. For example, some of the functions of the electronic key 2 (e.g., the response process to a request signal from the vehicle 1) can be stopped, or all of the functions of the electronic key 2 can be stopped. Furthermore, for example, the electronic key 2 can transmit its operating status. Specifically, the electronic key 2 can transmit the remaining charge of the battery 59 of the electronic key 2 (hereinafter also referred to as "remaining battery charge") or information on whether the electronic key 2 is within the detection area of ​​the vehicle 1.

[0114] In S126, an operation command is generated corresponding to the operation instruction included in the data received from the smartphone 3. For example, when an operation instruction to close the door mirrors is received, an operation command to close the door mirrors is generated.

[0115] In S128, the process determines whether the electronic key 2 is present within the detection area of ​​the vehicle 1. Specifically, the process is based on whether the receiver 54 receives a request signal from the vehicle 1. If the signal is not received, the electronic key 2 is determined to be outside the detection area, and if the signal is received, the electronic key 2 is determined to be within the detection area.

[0116] If the electronic key 2 is present within the detection area of ​​the vehicle 1 (S128: YES), the process proceeds to S130. In S130, the operation command generated in S126, along with the user ID, terminal ID, and location information of the smartphone 3 contained in the data received from the smartphone 3, are transmitted to the vehicle 1 via smart communication. After transmission, the process proceeds to S138.

[0117] If the electronic key 2 is not within the detection area of ​​the vehicle 1 (S128: NO), the process proceeds to S132, where it is determined whether remote operation of the vehicle 1 using the smartphone 3 is permitted. Whether remote operation is permitted is determined based on the remote operation permission information stored in the memory 52 of the electronic key 2. The user of the vehicle 1 can decide whether to permit remote operation. For example, a user who does not desire (or will not use) remote operation can have the dealer store remote operation permission information indicating that remote operation is not permitted in the electronic key 2 when purchasing the vehicle 1. However, the remote operation permission information stored in the electronic key 2 can be changed at will from the smartphone 3 having the same user ID as the user ID stored in the electronic key 2.

[0118] The remote control capability information does not necessarily have to be stored in the electronic key 2, but may be stored in the smartphone 3 and transmitted from the smartphone 3. In addition, when the smartphone 3 has the remote control capability information, if the remote control capability information indicates that remote control is not permitted, the smartphone 3 may not transmit an operation command.

[0119] If remote operation is not permitted in S132 (S132: NO), a second error notification is sent to the smartphone 3 via the first communication in S136, and the electronic key control process ends. If remote operation is permitted in S132 (S132: YES), the operation command generated in S126, along with the user ID, terminal ID, and location information of the smartphone 3 contained in the data received from the smartphone 3, are sent to the vehicle 1 via the second communication in S134. After this transmission, the process proceeds to S138.

[0120] In S138, it is determined whether or not an ID mismatch notification has been received from vehicle 1. The ID mismatch notification is sent from vehicle 1 via smart communication or second communication when the user ID sent to vehicle 1 in S130 or S134 does not match the user ID of vehicle 1.

[0121] If an ID mismatch notification is received from the vehicle 1 in S138 (S138: YES), a third error notification is sent to the smartphone 3 via the first communication in S140, and the electronic key control process ends. If an ID mismatch notification is not received from the vehicle 1 in S138 (S138: NO), proceed to S142.

[0122] In S142, it is determined whether a non-permission notice has been received from the vehicle 1. The non-permission notice is transmitted from the vehicle 1 via smart communication or second communication when it is determined that the function of the operation item corresponding to the operation command transmitted to the vehicle 1 in S130 or S134 cannot be executed in the vehicle 1. It will be done.

[0123] If a non-permission notification is received from the vehicle 1 in S142 (S142: YES), a fourth error notification is sent to the smartphone 3 via the first communication in S144, and the electronic key control process ends. If a non-permission notification is not received from the vehicle 1 in S142 (S142: NO), a relay completion signal is sent to the smartphone 3 via the first communication in S146.

[0124] (7) Remote control process in vehicle 1 Next, the remote control processing executed in the vehicle 1 to realize the remote control function will be described with reference to Fig. 11. The program for the remote control processing is stored in the memory 25 of the vehicle 1. After startup, the control unit 10 of the vehicle 1 (more specifically, the CPU in the control unit 10) reads the program for the remote control processing shown in Fig. 11 from the memory 25 and repeatedly executes it at a fixed control period.

[0125] When the control unit 10 of the vehicle 1 starts the remote control process, in S152, the control unit 10 transmits a request signal from each transmitter 4, 5 via smart communication. As described above, the detection areas 400, 500 are formed by transmitting this request signal. In S154, the control unit 10 determines whether data has been received from the electronic key 2. Note that the data here refers to the operation command, user ID, terminal ID, and location information of the smartphone 3 transmitted in S130 or S134 of FIG. 9, or the response signal and user ID transmitted via smart communication in response to the request signal. If data has not been received from the electronic key 2 via smart communication or second communication (S154: NO), the control unit 10 terminates the remote control process. If data has been received from the electronic key 2 via smart communication or second communication (S154: YES), the control unit 10 proceeds to S156.

[0126] In S156, the system determines whether the user ID included in the data received from the electronic key 2 matches the user ID stored in the memory 25 of the vehicle 1 (user ID verification). If the user ID verification determines that the two user IDs do not match (NO in S156), in S158 an ID mismatch notification is sent to the electronic key 2, and the remote control process ends. In S158, if the user ID of the electronic key 2 determined to be a mismatch in S156 was received via smart communication, the system transmits the ID mismatch notification via smart communication. Furthermore, in S158, if the user ID of the electronic key 2 determined to be a mismatch in S156 was received via second communication, the system transmits the ID mismatch notification via second communication.

[0127] If it is determined in S156 that the two user IDs match (S156: YES), the process proceeds to S160. In S160, it is determined whether the data (information) received from the electronic key 2 is an operation command or a response signal to a request signal.

[0128] If the information received from the electronic key 2 includes a response signal to the request signal, a predetermined electronic key processing is executed in S162, and the remote control processing ends. The electronic key processing in S162 is a basic process performed in conventional electronic key systems, such as unlocking each door 15 when the user touches the touch sensor on the door handle.

[0129] If the information received from the electronic key 2 at S160 includes an operation command, the operation item to be executed is identified based on the received operation command at S164. At S166, a function restriction check process is executed. Details of the function restriction check process at S166 are shown in FIG. 12.

[0130] As shown in FIG. 12, when the function restriction confirmation process is started, in S202, the data from the electronic key 2 (the received data that is the basis for the positive determination in S154 in FIG. 11) is transmitted via smart communication. The process determines whether the electronic key 2 was received via smart communication. If the electronic key 2 was not received via smart communication (i.e., if the electronic key 2 was received via second communication) (S202: NO), the process proceeds to S206. If the electronic key 2 was not received via smart communication, it means that the electronic key 2 is outside the detection areas 400 and 500 of the vehicle 1.

[0131] If the data from the electronic key 2 was received via smart communication (S202: YES), the location of the electronic key 2 (whether it is inside or outside the vehicle 1) is confirmed in S204. This confirmation can be made based on the identification signal added to the response signal.

[0132] In S206, the location information of the smartphone 3 is acquired. The location information of the smartphone 3 is received from the electronic key 2 together with the operation command, and therefore can be acquired from the received data. In S208, the vehicle's own location information (location information of the vehicle 1 itself) is acquired. Specifically, this is detected based on the information received by the GPS receiver 9.

[0133] In S210, the terminal ID of the smartphone 3 is obtained. In S212, the system determines whether or not the function of the operation item specified by the operation command (i.e., the operation requested from the smartphone 3) is restricted based on the vehicle's position based on the vehicle's position information acquired in S208, the smartphone's position based on the position information acquired in S206, the terminal ID acquired in S210, and the electronic key 2's position determined in S202 to S204. That is, the system determines whether the function of the specified operation item is executable, restricted (prohibited), or partially restricted, relative to the relative positions of the vehicle 1, smartphone 3, and electronic key 2. This determination can be made based on the function restriction information 25b stored in the memory 25. After S212, the system proceeds to S168 (FIG. 11).

[0134] In addition to the positional relationship between the three parties, it may be determined based on the terminal ID whether the function of the specified operation item is executable, restricted (prohibited), or partially restricted. For example, a certain function may be executed only when specified from a smartphone 3 owned by a certain user, and not executed when specified from another smartphone 3. What kind of restriction is to be imposed on which terminal ID (or whether there is no restriction) may also be stored in advance in the memory 25 as function restriction information 25b.

[0135] In S168, it is determined whether or not execution of the function of the specified operation item is permitted based on the result of the function restriction confirmation process in S166. If execution of the function of the specified operation item is permitted (S168: YES), the function of the specified operation item is executed in S170. Note that if the function is permitted but part of it is restricted, the function is executed within the restricted range.

[0136] At S170, if the specified operation item is a request to acquire information about the vehicle 1, the requested information is transmitted to the smartphone 3 through the first communication. As shown in FIG. 3 , in this embodiment, the smartphone 3 can request various information about the vehicle 1 via the electronic key 2, such as the mileage, maintenance information, diagnostic information, interior temperature, and interior image information of the vehicle 1. In response to the request from the smartphone 3, the vehicle 1 transmits various pieces of information about the vehicle 1 to the smartphone 3 through the first communication.

[0137] If the execution of the specified function is not permitted, i.e., if the execution of the function is restricted (prohibited) (S168: NO), the process proceeds to S172. In S172, a denial notice is sent to the electronic key 2, and the remote control process ends. In S172, the operation command is If the operation command was received via smart communication, a non-permission notification is sent via smart communication, and if the operation command was received via second communication, a non-permission notification is sent via second communication.

[0138] Here, a supplementary explanation will be given of a method for starting the vehicle operation application 32a on the smartphone 3. The vehicle operation application 32a on the smartphone 3 can be started by the user performing a predetermined start-up operation on the smartphone 3, or by holding the smartphone 3 over the electronic key 2.

[0139] That is, the tag-compatible program is stored in the smartphone 3 as a part of the vehicle operation application 32a or as a separate program that operates in cooperation with the vehicle operation application 32a. The control unit 31 of the smartphone 3 repeatedly executes the tag-compatible program at a predetermined interval.

[0140] The tag correspondence process executed by the tag correspondence program is shown in Figure 13. When the control unit 31 of the smartphone 3 starts the tag correspondence process of Figure 13, it determines in S252 whether the RF tag 63 of the electronic key 2 has been detected. That is, it determines whether the tag reader / writer 47 has received a user ID and an application launch request from the RF tag 63 of the electronic key 2. As described above, when data communication between the tag reader / writer 47 and the electronic key 2 is initiated and the user ID matches in the electronic key 2, the RF tag 63 of the electronic key 2 transmits the user ID of the electronic key 2 and an application launch request. Detecting the RF tag 63 in the process of S252 means receiving the user ID and application launch request transmitted from the RF tag 63 of the electronic key 2.

[0141] If the RF tag 63 of the electronic key 2 is not detected (S252: NO), that is, if the tag reader / writer 47 has not received the user ID and application activation request from the RF tag 63, the process proceeds to S256.

[0142] If the RF tag 63 of the electronic key 2 is detected (S252: YES), that is, if the tag reader / writer 47 receives the user ID and the application startup request from the RF tag 63, the smartphone 3 performs user ID verification in S254. Specifically, the smartphone 3 performs user ID verification to determine whether the received user ID matches the user ID stored in the smartphone 3 itself.

[0143] In S256, the result of the user ID verification in S254 is determined. If it is determined that the user IDs match as a result of the user ID verification (S256: YES), the application startup process is executed in S258. Specifically, the vehicle operation application 32a is essentially launched. "Substantially launched" means that the process from S10 shown in FIG. 7 is started. As a result, from the user's perspective, the vehicle operation application 32a has been automatically launched simply by holding the smartphone 3 over the electronic key 2. If it is determined that the user IDs do not match as a result of the user ID verification (S256: NO), the tag correspondence process is terminated.

[0144] (8) Effects of the First Embodiment According to the vehicle control system of the first embodiment described above, the following effects can be obtained. (a) A user can control the vehicle 1 by operating the smartphone 3 via the electronic key 2 as a relay.

[0145] (b) Specifically, as described with reference to FIG. 3, the smartphone 3 can cause the vehicle 1 to perform various operations and obtain various information from the vehicle 1. (c) The user can input operation items for the vehicle 1 into the smartphone 3 in various ways. Specifically, the user can input operation items for the vehicle 1 into the smartphone 3 by displaying the operation menu screen 48 on the display unit 33 and selecting the operation items from the menu screen. An operation item can be specified by tapping from the screen. Alternatively, a desired operation item can be specified by making a gesture corresponding to the desired operation item in front of the camera 43. Alternatively, a desired operation item can be specified by speaking a word corresponding to the desired operation item into the microphone 45.

[0146] Therefore, the user can move the vehicle 1 or operate each part of the vehicle 1 while speaking to the smartphone 3. In addition, the user can move the vehicle 1 or operate each part of the vehicle 1 while making gestures toward the camera 43 of the smartphone 3.

[0147] (d) A user can check the operation of each part of vehicle 1 without getting into vehicle 1. For example, the user can easily check from outside vehicle 1 whether headlights 20 are lit normally. Also, for example, if the user wants to move the position of vehicle 1 after getting out of vehicle 1, the user can move it without getting back into vehicle 1. For example, if the user wants to back up vehicle 1 a little further (several tens of centimeters), the user can control vehicle 1 to move backward (back up at a slow speed) while watching vehicle 1 from outside vehicle 1. Also, for example, the user can obtain the interior temperature of vehicle 1 from a location away from vehicle 1, and if the interior temperature is high, open the window 17 or operate the air conditioner 14.

[0148] (e) When remotely controlling the vehicle 1 from the smartphone 3, user authentication is performed based on fingerprint, voice, or face image, and only authorized users can remotely control the vehicle 1 (S10 to S12 in FIG. 7). This makes it possible to prevent unauthorized remote control.

[0149] (f) When the electronic key 2 receives an operation command from the smartphone 3, if the user ID received with the operation command does not match the user ID of the electronic key 2, the electronic key 2 does not send the operation command to the vehicle 1 and notifies the smartphone 3 of an error. Furthermore, when the vehicle 1 receives an operation command from the electronic key 2, it checks the user ID received with the operation command against the user ID of the vehicle 1. In other words, if the user IDs of the smartphone 3, electronic key 2, and vehicle 1 all match, the vehicle 1 can be remotely controlled from the smartphone 3. This improves the security of remote control by the smartphone 3.

[0150] (g) Depending on the positions of the vehicle 1, the electronic key 2, and the smartphone 3, the functions of the operations requested by the smartphone 3 are prohibited or restricted. How to handle the operations (permit, restrict, or prohibit) in different situations involving the relative positions of the three, and what specific restrictions to apply when restricting operations, can be set in advance for each operation item. This further enhances security performance.

[0151] (h) The electronic key 2 is equipped with various wireless communication methods, including not only smart communication, which is provided in conventional electronic key systems, but also primary communication, secondary communication, and Bluetooth communication. Therefore, even if the electronic key 2 is located outside the detection areas 400 and 500 of the vehicle 1, it can communicate with the vehicle 1 via secondary communication. In other words, even if a user with the electronic key 2 and smartphone 3 is located outside the detection areas 400 and 500 of the vehicle 1, they can remotely control the vehicle 1 from outside the detection areas 400 and 500.

[0152] (j) When the battery 59 of the electronic key 2 runs out, it can receive power from the smartphone 3 in a contactless manner to charge the battery 59 and operate the electronic key 2. The electronic key 2 also has a power input jack 62, and can receive power from this power input jack 62 (see FIG. 5). The electronic key 2 of this embodiment has the above As described above, even if the battery 59 runs out, the electronic key 2 can continue to operate by receiving external power through various means. Therefore, unlike conventional electronic keys, the electronic key 2 of this embodiment does not include a mechanical key. However, the electronic key 2 may include a built-in mechanical key.

[0153] The smartphone 3 corresponds to an example of a communication terminal of the present invention. The processes selectable on the operation menu screen 48 illustrated in FIG. 3 , i.e., processes that can be requested of the vehicle 1 via the electronic key 2, correspond to an example of a specific process of the present invention. The touch panel 34, camera 43, and microphone 45 of the smartphone 3 correspond to an example of a designation input unit of the present invention. The first communication unit 35 of the smartphone 3 corresponds to an example of a command transmission unit of the present invention. The memory 32 of the smartphone 3 corresponds to an example of a terminal-side storage unit of the present invention, and the user ID stored in the memory 32 corresponds to an example of terminal-side unique information of the present invention. The operation command transmitted from the smartphone 3 to the electronic key 2 corresponds to an example of a processing command of the present invention, and the operation command transmitted from the electronic key 2 to the vehicle 1 corresponds to an example of a processing command of the present invention. In FIG. 8 , the processes of S28, S34, and S42 correspond to an example of a designation input unit of the present invention, and the process of S48 corresponds to an example of a command transmission unit of the present invention.

[0154] The memory 52 of the electronic key 2 corresponds to an example of a key-side storage unit of the present invention, and the user ID stored in the memory 52 corresponds to an example of key-side unique information of the present invention. In Fig. 10, the process of S118 corresponds to an example of a unique information determination unit of the present invention, and the processes of S130 and S134 correspond to an example of a command transmission unit of the present invention.

[0155] In this embodiment, the touch panel 34, the camera 43, and the microphone 45 are given as examples of the designation input unit of the present invention, but these are merely examples. As long as the user can designate the process to be executed by the vehicle 1 on the smartphone 3 (and the smartphone 3 can send an operation command indicating the input process to the electronic key 2), the specific method and input interface for designation can be determined as appropriate.

[0156] [Second embodiment] The vehicle control system of the second embodiment will be described with reference to Figures 14 and 15. The vehicle control system of the second embodiment is a system that allows direct control of the vehicle 1 (Figure 6) from an electronic key.

[0157] That is, in the second embodiment, no communication device other than the electronic key is required to remotely control the vehicle 1. On the other hand, in the second embodiment, the configuration of the electronic key is different from that of the electronic key 2 in the first embodiment, because the vehicle 1 is remotely controlled from the electronic key.

[0158] The configuration of the electronic key 2 of the second embodiment will be described using Figure 14. As shown in Figure 14, the electronic key 80 of the second embodiment includes a control unit 81, a memory 82, a microphone 83, a voice processing unit 84, a display unit 85, an operation input unit 86, a transmitter 53, a receiver 54, a battery 59, a regulator 60, a non-contact power receiving unit 61, and a power input jack 62. Of these, the transmitter 53, the receiver 54, the battery 59, the regulator 60, the non-contact power receiving unit 61, and the power input jack 62 are the same as those of the electronic key 2 of the first embodiment, and therefore description thereof will be omitted.

[0159] The microphone 83 and the audio processing unit 84 are mounted on the smartphone 3 in the first embodiment, but are mounted on the electronic key 80 in the second embodiment. The microphone 83 converts external sound into an electrical signal. The audio processing unit 84 processes the audio signal collected by the microphone 83 and converted into an electrical signal into digital audio data and outputs it to the control unit 81. 1 can recognize the content of the voice collected by the microphone 83 based on the voice data input from the voice processing unit 84.

[0160] The display unit 85 is a display device (for example, a liquid crystal display) capable of displaying various images and information. The operation input unit 86 is an input device capable of receiving input operations from the user. A specific example of the operation input unit 86 is a push button switch. The operation input unit 86 may also be provided with a touch panel.

[0161] The control unit 81 includes a microcomputer equipped with a CPU, ROM, RAM, I / O, etc. (not shown). The control unit 81 controls various circuits and functional blocks within the electronic key 80, including the components connected to the control unit 81. The electronic key control process (see FIG. 15), which will be described later, is executed by the CPU of the control unit 81.

[0162] The memory 82 is a nonvolatile memory whose stored contents can be electrically rewritten, and in this embodiment is a flash memory. Various programs and data are stored in the memory 82. The data stored in the memory 82 includes vehicle operation menu data 82a, voice patterns 82b, and ID information 82c.

[0163] The ID information 82c is the same as the ID information 52a in the electronic key 2 of the first embodiment. The vehicle operation menu data 82a is the same as the vehicle operation menu data 32b in the smartphone 3 of the first embodiment. Therefore, in the second embodiment, icons for each operation item are displayed on the display unit 85 of the electronic key 80 in the same manner as the operation menu screen 48 described in FIG. 3, and the user can select the desired operation item from among the icons. The voice pattern 82b is the same as the voice pattern 32c in the smartphone 3 of the first embodiment.

[0164] The display unit 85 of the electronic key 80 of this embodiment has a smaller display area than the display unit 33 of the smartphone 3 of the first embodiment. Therefore, the number of icons that can be simultaneously displayed on the display unit 85 is smaller than the number of icons on the operation menu screen 48 shown in FIG. 3. Furthermore, the information displayed on the display unit 85 (image information for each operation item used to select the operation item) does not necessarily have to be an icon; for example, it may be text indicating the operation item. As long as the user can select the desired operation item, the type of image information to be displayed on the display unit 85 can be determined as appropriate.

[0165] As described above, the electronic key 80 of the second embodiment is capable of wireless communication (i.e., smart communication) with the vehicle 1 via the transmitter 53 and receiver 54, but does not have any other wireless communication functions. Therefore, in the second embodiment, the vehicle 1 can be remotely controlled from the electronic key 80 only when the electronic key 80 and the vehicle 1 can communicate data via smart communication, i.e., when the electronic key 80 is located within each of the detection areas 400, 500 of the vehicle 1.

[0166] The electronic key control process executed by the control unit 81 of the electronic key 80 configured as above will be described with reference to Figure 15. The control unit 81 of the electronic key 80 repeatedly executes the electronic key control process shown in Figure 15 at a predetermined control cycle.

[0167] When the control unit 81 of the electronic key 80 starts the electronic key control process, it determines in S302 whether a request signal has been received from the vehicle 1. If a request signal has not been received (S302: NO), the electronic key control process ends.

[0168] If a request signal is received from the vehicle 1 (S302: YES), in S304, a vehicle operation standby display is displayed on the display unit 85. That is, a display is displayed indicating that the vehicle 1 can be controlled from the electronic key 80. In S306, it is determined whether or not a voice input request operation has been performed by the user. When remotely operating the vehicle 1 using the electronic key 80, the user can choose whether to specify (select) the operation content by operating the operation input unit 86 or by voice. If the user wants to specify the operation content by voice, the user can specify the operation content by voice by performing a predetermined voice input request operation via the operation input unit 86.

[0169] In S306, if a voice input request operation has not been performed (S306: NO), the process proceeds to S308. In S308, an operation menu list is displayed on the display unit 85. The operation menu list is a list of information images (e.g., icons or text) indicating operation items.

[0170] In S310, it is determined whether a specific operation item has been selected from the operation items listed in S308. If no operation item has been selected (S310: NO), the process returns to S306. If an operation item has been selected (S310: YES), the process proceeds to S312. In S312, an operation command corresponding to the selected operation item is generated, and the process proceeds to S314.

[0171] If an operation requesting voice input has been performed in S306 (S306: YES), the process proceeds to S316. In S316, voice input via the microphone 83 is set to a standby state. In other words, a state is established in which voice input and recognition can be executed. In S318, it is determined whether voice has been input from the microphone 83. If voice has not been input (S318: NO), it is determined in S320 whether a certain period of time has elapsed since voice input was set to a standby state in S316. If the certain period of time has not elapsed, the process returns to S318; if the certain period of time has elapsed, the process returns to S302.

[0172] If voice is input in S318 (S318: YES), in S322 it is determined whether the user has spoken words corresponding to a specified voice pattern based on the user's voice input to the microphone 83. This determination is made by determining whether the words spoken by the user match any of the words stored as voice patterns 82b in memory 82. Then, if the user has spoken words corresponding to the specified voice pattern, the voice pattern is recognized.

[0173] In S324, the operation content corresponding to the specified voice pattern recognized in S322 is displayed on the display unit 85. In S326, an operation command corresponding to the specified voice pattern recognized in S322 is generated. After S326, the process proceeds to S314. In S314, the operation command generated in S312 or S326 and the user ID are transmitted to the vehicle 1 via smart communication.

[0174] Meanwhile, in the vehicle 1, the remote control process shown in FIG. 11 is also executed in the second embodiment. Therefore, when the vehicle 1 receives the operation command and user ID transmitted from the electronic key 80, the vehicle 1 executes the remote control process shown in FIG. 11 and executes the operation specified in the operation command. However, as in the first embodiment, if the user ID does not match, the specified operation is not executed. Also, as in the first embodiment, if the specified operation is prohibited or restricted in the function restriction confirmation process (S166 in FIG. 11), the specified operation is not executed or is executed within a limited range. Note that in the function restriction confirmation process in the second embodiment, the function of the operation requested by the electronic key 80 is prohibited or restricted depending on the positional relationship between the electronic key 80 and the vehicle 1.

[0175] According to the vehicle control system of the second embodiment described above, the following effects can be obtained. (a) By operating the electronic key 80, the user can remotely control the vehicle 1 from the electronic key 80. This allows the user to control each part of the vehicle 1 without getting into the vehicle 1. You can check the operation.

[0176] (b) The user can input operation items for the vehicle 1 into the electronic key 80 in a variety of ways. Specifically, the user can display an operation menu list on the display unit 85 and select an operation item from the list. The user can also select a desired operation item by speaking the words corresponding to the desired operation item into the microphone 83. This allows the user to move the vehicle 1 or operate various parts of the vehicle 1 while speaking into the electronic key 80. Note that the electronic key 80 may be equipped with a camera so that operation items can be selected by gestures, as in the first embodiment.

[0177] [Other embodiments] (1) In the first embodiment, a vehicle control system was shown in which the vehicle 1 can be operated from the smartphone 3 via the electronic key 2, but it is also possible to operate the vehicle 1 directly from the smartphone 3 without relaying the electronic key 2.

[0178] Specifically, in the flowchart of the vehicle operation app 32a of the smartphone 3 shown in Fig. 7, an authentication request signal may be sent to the vehicle 1 instead of the electronic key 2 in S14, and a determination may be made in S16 as to whether an operation permission signal has been received from the vehicle 1. If it is determined in S16 that an operation permission signal has been received from the vehicle 1, the smartphone 3 may execute the processing from S304 onwards in Fig. 15. In this case, in S314, the operation command and user ID may be sent to the vehicle 1 using, for example, the first communication or another communication method instead of smart communication.

[0179] When the vehicle 1 receives an operation command and a user ID transmitted from the smartphone 3, the vehicle 1 may first perform user authentication based on the user ID. If the user authentication determines that the operation command is from a legitimate user, the vehicle 1 may execute the operation item indicated by the operation command. If the user authentication fails, the vehicle 1 may transmit an operation rejection signal to the smartphone 3 to notify the smartphone 3 that remote operation from the smartphone 3 cannot be accepted.

[0180] As an example of a configuration that allows the vehicle 1 to be operated directly from a smartphone without relaying the electronic key, for example, a configuration may be adopted in which the smartphone has some or all of the configuration and functions of the electronic key 80 of the second embodiment shown in Figure 14.

[0181] (2) In the second embodiment, the electronic key 80 is configured to have only the smart communication function as a wireless communication function of a conventional electronic key. However, the electronic key 80 may be configured to be capable of wireless communication using a method other than smart communication. For example, in addition to smart communication, the electronic key 80 may have at least one communication function selected from the first communication, second communication, or Bluetooth communication described in the first embodiment, or other wireless communication methods.

[0182] Furthermore, by providing a wireless communication function using a communication method other than smart communication, it may be possible to remotely operate the vehicle 1 from the electronic key 80 even if the electronic key 80 is located outside the detection area of ​​the vehicle 1.

[0183] (3) In the second embodiment, when the vehicle 1 is remotely controlled from the electronic key 80, user authentication may be performed based on a fingerprint, voice, or face image, similar to the smartphone 3 in the first embodiment.

[0184] (4) The contents of the vehicle operation menu data 32b, that is, the contents of the remote controllable operation for the vehicle 1, are merely examples of the plurality of operation items shown in FIG. 3. The contents of the items can be determined as appropriate.

[0185] (5) The wireless communication methods that can be implemented by the smartphone 3, the electronic key 2, and the vehicle 1 can be determined as appropriate. In addition, the communication methods to be used for two-way communication between the smartphone 3 and the electronic key 2 and for two-way communication between the electronic key 2 and the vehicle 1 can also be determined as appropriate.

[0186] (6) In the first embodiment, the vehicle 1 may be configured to recognize the user of the smartphone 3 using pairing information in Bluetooth communication between the electronic key 2 and the smartphone 3. That is, when the electronic key 2 receives an operation command from the smartphone 3, the electronic key 2 attempts Bluetooth communication with the smartphone 3. If Bluetooth communication is possible, the electronic key 2 acquires user information of the smartphone 3 based on the pairing information between the electronic key 2 and the smartphone 3. When transmitting an operation command to the vehicle 1, the electronic key 2 also includes the acquired user information.

[0187] This allows the vehicle 1 to recognize which user has made a remote control request, and to execute different controls for each user. For example, it is possible to restrict functions depending on the user, or conversely, to expand functions depending on the user. Furthermore, even for the same function, the details can be different for each user.

[0188] (7) A camera or a microphone may be installed in the vehicle, and a user may give instructions to operate the vehicle from outside the vehicle by making gestures to the on-board camera or speaking into the on-board microphone.

[0189] In this case, the user first operates the smartphone 3 to send remote control start information indicating that the vehicle will be remotely controlled from outside the vehicle to the vehicle 1, either directly or via the electronic key 2. When the vehicle 1 receives the remote control start information, it may activate the on-board camera or microphone to accept remote control. Alternatively, the remote control start information may be sent from the electronic key 2 to the vehicle 1 by operating the electronic key 2 without using the smartphone 3.

[0190] The electronic key 2 may be configured to transmit the remote control start information to the vehicle 1 only when wireless communication with the vehicle 1 is possible via smart communication, or may be configured to transmit the remote control start information to the vehicle 1 via second communication when smart communication with the vehicle 1 is not possible.

[0191] The vehicle 1 may register gestures and voices corresponding to acceptable operation items in memory in advance, and if the gesture or voice input by the on-board camera or on-board microphone is one stored in memory, the vehicle 1 may execute processing corresponding to the gesture or voice.

[0192] With this configuration, when the user of vehicle 1 finishes driving vehicle 1 and gets out of vehicle 1, for example, wants to move vehicle 1 a little further back (or forward), the user can make a gesture or make a voice call indicating "slow reverse" (or "slow forward") to vehicle 1, thereby moving vehicle 1 without having to re-enter vehicle 1. Moreover, by being able to remotely control vehicle 1 from outside the vehicle, the user can move vehicle 1 appropriately while checking the relative positional relationship between vehicle 1 and its surroundings.

[0193] Furthermore, a function for detecting the relative positional relationship between the electronic key 2 and the vehicle 1 in real time may be provided so that the vehicle 1 can move in accordance with the electronic key 2. For example, if the electronic key 2 is placed in front of the vehicle 1 and a command is issued to move the vehicle 1 forward at a slow speed, the vehicle 1 will automatically start moving toward the electronic key 2. When the distance between the electronic key 2 and the vehicle 1 is within a predetermined distance, The vehicle will then automatically stop. When the user then removes the electronic key 2 from the vehicle 1, the vehicle 1 will start moving again toward the electronic key 2. The same applies when reversing.

[0194] In this configuration, authentication may be performed between the electronic key 2 and the vehicle 1, and if authentication is successful, the vehicle 1 may be remotely controlled. Alternatively, authentication may be performed among the smartphone 3, the electronic key 2, and the vehicle 1, and if authentication is successful, the vehicle 1 may be remotely controlled.

[0195] (8) While the user is driving the vehicle 1, various types of information during the driving may be collected as learning information, and when the user gets off the vehicle, the learning information may be transferred to the user's smartphone 3. Then, when the user gets back into the vehicle 1 or gets into a vehicle 1 other than the vehicle 1, the learning information stored in the smartphone 3 may be sent to the vehicle in question, and the learning information may be reflected in the vehicle.

[0196] Examples of the learning information include the seat position and steering position adjusted by the user, the angle of the rearview mirror, the angle of the door mirrors, and the operation details of the audio device.

[0197] This type of function is useful, for example, when applied to a so-called car sharing service in which a single vehicle is shared by multiple users. The user can import various pieces of information from their own driving experience into the smartphone 3 as learning information, and when driving again, by applying the learning information to the vehicle, the user can automatically and quickly achieve settings that suit their preferences. In other words, even though the vehicle is shared with other users, the user can feel and handle the vehicle as if it were their own vehicle.

[0198] (9) If the smartphone 3 and the vehicle 1 can communicate directly, the vehicle 1 may transmit information to the smartphone 3 as appropriate. For example, if the electronic key 2 leaves the detection area 400, 500 of the vehicle 1 and the vehicle 1 finds that a door is open, all doors are unlocked, a specific electrical component (e.g., headlights, interior lights, etc.) is operating, or abnormal behavior is detected, the vehicle 1 may be notified of this to the smartphone 3. Also, if the vehicle 1 is equipped with a motor as a driving source and the battery for driving the motor can be charged externally, the smartphone 3 may be notified of this when charging is complete.

[0199] A more specific example of transmitting information from the vehicle 1 to the smartphone 3 will be described with reference to Figures 16 and 17. The examples shown in Figures 16 and 17 are examples in which the location information of the vehicle 1 can be notified to the smartphone 3, and if an abnormality is detected in the vehicle 1, the smartphone 3 can be notified of that fact.

[0200] The control unit 10 of the vehicle 1 repeatedly executes the vehicle information notification process of Fig. 16 at a predetermined cycle. The control unit 31 of the smartphone 3 repeatedly executes the vehicle information display process of Fig. 17 at a predetermined cycle.

[0201] First, the vehicle information notification process will be described in Fig. 16. As a premise, similar to the above-described embodiments, request signals are periodically transmitted from the transmitters 4 and 5 of the vehicle 1 by smart communication.

[0202] When the control unit 10 of the vehicle 1 starts the vehicle information notification process of FIG. 16, it determines in S404 whether or not a response signal to the request signal has been received from the electronic key 2. If a response signal has not been received (S404: NO), the process proceeds to S416. If a response signal has been received (S416: NO), the process proceeds to S416. 404:YES), proceed to S406.

[0203] In S406, it is determined whether the door lock has been opened or closed by operating the electronic key 2 or by an operation command from the smartphone 3 via the electronic key 2. If the door lock has not been opened or closed (S406: NO), the process returns to S404. If the door lock has been opened or closed (S406: YES), the process proceeds to S408.

[0204] In S408, similar to S404, it is determined whether a response signal to the request signal has been received from the electronic key 2. This determination is repeated while a response signal is being received. If a response signal is no longer being received (S408: NO), the process proceeds to S410.

[0205] In S410, it is determined whether the doors are fully closed, i.e., whether all the doors 15 are fully closed. If the doors are not fully closed (S410: NO), the process proceeds to S416. If the doors are fully closed (S410: YES), the process proceeds to S412. If it is determined in S410 that the doors are fully closed, this means that the electronic key 2 once entered the detection area of ​​the vehicle 1, the door locks were opened or closed via the electronic key 2, and then the electronic key 2 left the detection area of ​​the vehicle 1 with the doors fully closed. This situation may occur, for example, when the user of the vehicle 1 parks the vehicle 1 in a parking lot and then leaves the vehicle 1.

[0206] In S412, vehicle position information (information indicating the current position of vehicle 1) is acquired based on the information received by the GPS receiver 9. In S414, the vehicle position information acquired in S412 is transmitted to the smartphone 3 via the first communication. As a result, even if the user of the smartphone 3 parks vehicle 1 in a parking lot and then moves away from vehicle 1, the user can easily know where vehicle 1 is parked based on the vehicle position information transmitted from vehicle 1.

[0207] In S416, it is determined whether an abnormality has been detected in the vehicle 1. The vehicle 1 is equipped with a function for detecting various abnormalities. For example, the vehicle 1 is equipped with a sensor, such as an acceleration sensor or a vibration sensor, that can detect an external impact on the vehicle 1. The control unit 10 of the vehicle 1 detects whether an external impact has been detected on the vehicle 1 based on the detection signal from the sensor. If an impact is detected, the control unit 10 determines that an abnormality has occurred by determining that an illegal act, such as vandalism or theft, has been committed on the vehicle 1. In addition, the control unit 10 may periodically operate the interior camera 24 and analyze the captured images. For example, if an intruder in the vehicle cabin is detected or a suspicious person in the vicinity of the vehicle (for example, a person peering into the vehicle cabin) is detected, it may also determine that an abnormality has occurred. In addition, it may be possible to detect functional abnormalities of the vehicle 1, such as a voltage drop in the on-board battery or an oil leak.

[0208] If no abnormality is detected in vehicle 1 at S416 (S416: NO), the vehicle information notification process is terminated. If an abnormality is detected in vehicle 1 (S416: YES), the process proceeds to S418. At S418, abnormality information indicating that an abnormality has been detected in vehicle 1 and the details of the detected abnormality is transmitted to smartphone 3 via the first communication.

[0209] Next, the vehicle information display process of Fig. 17 will be described. When the control unit 31 of the smartphone 3 starts the vehicle information display process of Fig. 17, it determines in S452 whether or not data has been received from the vehicle 1 through the first communication. If data has not been received from the vehicle 1 (S452: NO), it determines in S464 whether or not a predetermined user operation has been performed to display the vehicle position information. If a predetermined user operation has not been performed to display the vehicle position information (S464: NO), the vehicle information display process ends. If a predetermined user operation has been performed to display the vehicle position information (S464: YES), the process proceeds to S466.

[0210] In S466, the vehicle position information stored in the memory 32 is displayed on the display unit 26. This allows the user to confirm the position of the vehicle 1. If data is received from vehicle 1 in S452 (S452: YES), then in S454 it is determined whether vehicle position information has been received (i.e., whether the received data includes vehicle position information). If vehicle position information has been received (S454: YES), then in S456 the received vehicle position information is stored in memory 32.

[0211] If the data received from the vehicle 1 does not include vehicle position information (S454: NO), then in S458 it is determined whether or not abnormality information has been received (i.e., whether or not the received data includes abnormality information). If abnormality information has been received (S458: YES), then in S460 the received abnormality information is displayed on the display unit 26. This allows the user to know that an abnormality has been detected in the vehicle 1 and the details of the abnormality.

[0212] If the data received from the vehicle 1 does not include abnormality information (S458: NO), in S462, a predetermined reception response process is performed based on the received data. (10) The types of information that can be provided from the vehicle 1 to the smartphone 3 are not limited to the information described with reference to Fig. 3. In addition to the information described with reference to Fig. 3, various types of information may be provided to the smartphone 3 as vehicle information, such as the total mileage of the vehicle 1, the remaining battery charge, the remaining fuel level, information on the date when the engine oil or other various oils were changed, and the total mileage of the vehicle 1 at the time of the oil change.

[0213] The vehicle information may then be provided to the smartphone 3 at a specific time from the vehicle 1 directly or via the electronic key 2. If the vehicle information can be provided via the electronic key 2, not only the vehicle information but also information about the electronic key 2 (for example, the remaining battery level of the electronic key 2) may be provided to the smartphone 3.

[0214] A more specific example of the above-mentioned function of providing various information to the smartphone 3 will be described with reference to Fig. 18 and Fig. 9. The control unit 51 of the electronic key 2 repeatedly executes the system information transmission process shown in Fig. 18 at a predetermined cycle. In addition, the control unit 31 of the smartphone 3 repeatedly executes the system status notification process shown in Fig. 19 at a predetermined cycle.

[0215] First, the system information transmission process of Fig. 18 will be described. The vehicle 1 is configured to be able to transmit the above-described vehicle information within the vehicle 1 to the electronic key 2 in response to a vehicle information request from the electronic key 2.

[0216] 18 starts, the control unit 51 of the electronic key 2 determines in S552 whether a request signal has been received from the vehicle 1. If a request signal has been received (S552: YES), the control unit 51 determines in S560 whether an information notification flag has been set. The information notification flag is used to send system information (described in detail below) to the smartphone 3 only once while the request signal is being continuously received. The information notification flag is set in S568 and cleared in S558.

[0217] If the information notification flag is already set at S560 (S560: YES), the system information transmission process ends. If the information notification flag is not set (S560: NO), at S562, vehicle information is requested from vehicle 1 via the first or second communication, and the vehicle information in response to the request is obtained from vehicle 1 via the first or second communication.

[0218] In S564, the remaining battery power is detected in the electronic key 2. The electronic key 2 is configured to periodically monitor the voltage of the battery 40 and the charge / discharge history of the battery 40, and can detect the remaining battery power based on the monitoring results.

[0219] In S566, the vehicle information acquired in S562 and information including the remaining battery level detected in S564 are transmitted to the smartphone 3 via the first communication as system information indicating the status of the vehicle 1 and the electronic key 2. Then, in S568, the information notification flag is set, and the system information transmission process ends.

[0220] If a request signal has not been received from vehicle 1 in S552 (S552: NO), the process proceeds to S554, where it is determined whether the information notification flag has been cleared. If the information notification flag has been cleared (S554: YES), the system information transmission process ends. If the information notification flag has been set (S554: NO), the process proceeds to S556.

[0221] In S556, it is determined whether a request signal has not been received from vehicle 1 for a certain period of time or more. If the certain period of time has not yet passed since the request signal was not received (S556: NO), the system information transmission process is terminated. If the certain period of time has passed since the request signal was not received (S556: YES), the information notification flag is cleared in S558, and the system information transmission process is terminated.

[0222] Next, the system status notification process of Fig. 19 will be described. When the control unit 31 of the smartphone 3 starts the system status notification process of Fig. 19, the control unit 31 determines in S502 whether or not system information has been received from the electronic key 2 in the first communication. If system information has not been received (S502: NO), the process proceeds to S512. If system information has been received (S502: YES), the received system information is stored in the memory 32 in S504.

[0223] In S506, the user is notified that the system information has been received from the electronic key 2. This notification can be made, for example, by voice or by displaying predetermined reception notification information on the display unit 33. If the smartphone 3 has a so-called vibration function, the user may be notified by using the vibration function (i.e., by generating vibrations in the smartphone 3 body).

[0224] In S508, it is determined whether or not a predetermined display request operation for displaying system information has been performed by the user. If a display request operation has not been performed (S508: NO), the process proceeds to S512. If a display request operation has been performed (S508: YES), the process proceeds to S510. In S510, the system information stored in memory 32 in S504 is displayed on display unit 33. This allows the user to check the latest system information.

[0225] In S512, the necessity of maintenance is determined based on the system information stored in the memory 32. For example, if a certain number of days have passed since the most recent oil change, if a certain distance has been traveled since the total distance traveled at the time of the most recent oil change, if the remaining fuel level is a predetermined level or less, or if the remaining battery charge in the electronic key 2 is a predetermined level or less, the system determines that maintenance is necessary.

[0226] In S514, it is determined whether or not there is any maintenance required item based on the determination result of S512. If it is determined in S512 that maintenance is not required, it is determined that there is no maintenance required item (S514: NO), and the system status notification process ends. If it is determined in S512 that maintenance is required, it is determined that there is an item that requires maintenance (S514: YES), and the process proceeds to S516.

[0227] In S516, maintenance information is displayed on the display unit 33. The maintenance information displayed here is information relating to items requiring maintenance. For example, in S512, if it is determined that the total distance traveled since the most recent oil change is equal to or greater than a certain distance, the maintenance information is displayed on the display unit 33. The maintenance requirement is an oil change. Therefore, in this case, information indicating that an oil change is required is displayed on the display unit 33 as maintenance information. At that time, the reason for the coil replacement (that the cumulative mileage since the last oil change has exceeded a certain distance) may also be displayed.

[0228] In S518, it is determined whether or not the user has performed an operation to request the display of guidance on the maintenance method. If the operation to request the display of guidance has not been performed (S518: NO), the system status notification process is terminated. If the operation to request the display of guidance has been performed (S518: YES), guidance processing is performed in S520. The guidance processing is a predetermined process for providing the user with specific maintenance methods for items requiring maintenance.

[0229] The timing of transmitting the system information from the electronic key 2 to the smartphone 3 is not limited to the timing shown in Fig. 18 and can be determined as appropriate. For example, the smartphone 3 may be configured to be able to request system information from the electronic key 2 at any time, and the electronic key 2 may obtain the latest system information each time it receives a request from the smartphone 3 and transmit it to the smartphone 3. The smartphone 3 may then be configured to display the system information stored in the memory 32 on the display unit 33 at any time.

[0230] (11) The electronic key 2 may have both the function of operating the vehicle 1 and obtaining information from the vehicle 1 from the smartphone 3 via the electronic key 2, as in the first embodiment, and the function of operating the vehicle 1 and obtaining information from the vehicle 1 directly from the electronic key 2, as in the second embodiment.

[0231] In this case, the functions that can be operated, etc. from the smartphone 3 and the functions that can be operated, etc. directly from the electronic key 2 do not necessarily have to be completely identical. For example, the number of functions that can be operated, etc. from the smartphone 3 may be fewer than the number of functions that can be operated, etc. directly from the electronic key 2. Also, for example, certain types of functions (e.g., relatively important functions such as unlocking the doors or starting the vehicle 1) may be disabled from the smartphone 3 and only available from the electronic key 2. Furthermore, for example, the electronic key 2 may periodically notify the smartphone 3 of whether or not the electronic key 2 is within the detection area of ​​the vehicle 1, and the functions that can be operated, etc. from the smartphone 3 via the electronic key 2 may be changed depending on the notification content (i.e., the distance between the electronic key 2 and the vehicle 1).

[0232] (12) The smartphone 3 described in the above embodiment is merely an example of a communication terminal capable of wireless communication with the electronic key 2. In addition to the smartphone 3, any type of communication terminal capable of wireless communication, such as a mobile phone, a tablet terminal, or a personal computer, can be used.

[0233] (13) The smartphone and the vehicle may be configured to be able to directly communicate with each other. In this case, various services may be provided to the user using the data communication between the two.

[0234] For example, it may be possible to provide an information provision service that allows weather forecasts, road traffic information, and other various information to be obtained on a smartphone, and then transmits some or all of the obtained information to a vehicle as appropriate to notify the driver of the vehicle.

[0235] Furthermore, for example, a vehicle surroundings monitoring service may be provided that can acquire information about the vehicle's surroundings in the vehicle and transmit the acquired information to a smartphone as needed. stomach.

[0236] For example, a vehicle location notification service may be provided that can acquire location information of a vehicle from the vehicle on a smartphone and notify the smartphone user of information regarding the vehicle's location based on the acquired location information.

[0237] Also, for example, the face of the driver may be photographed in the vehicle, and information corresponding to the content of the photographed facial image (i.e., the driver's facial expression, and ultimately the driver's emotions (joy, anger, sadness, happiness, etc.)) may be stored. It may also be possible to provide an SNS (Social Networking Service) linkage service that can pass information to a smartphone SNS app.

[0238] For example, it may be possible to provide a driving suitability determination service that can directly or indirectly grasp the driver's physical condition from various angles and allow or prohibit the driver from driving a vehicle depending on the information obtained (i.e., depending on the driver's physical condition).

[0239] The various services mentioned above will now be described in more detail. (13-1) Smartphone configuration First, the configuration of a smartphone 110 capable of implementing the various services described above will be described with reference to FIG. 20. The smartphone 110 shown in FIG. 20 further includes a motion sensor group 50 in addition to the hardware configuration of the smartphone 3 of the first embodiment shown in FIG. 2. The control unit 31 also includes a built-in RTC (real-time clock) 31a. The control unit 31 can acquire information such as the current time, date and time based on the RTC 31a. The RTC 31a is also built-in in the smartphone 3 of the first embodiment shown in FIG. 2.

[0240] The motion sensor group 50 includes at least one of various sensors capable of detecting the movement, orientation, etc. of an object. These various sensors include, for example, a geomagnetic sensor, an acceleration sensor, a gyro sensor, etc. Here, the description will be given assuming that the motion sensor group 50 includes at least a geomagnetic sensor and an acceleration sensor.

[0241] The geomagnetic sensor is a sensor also known as an electronic compass, and is a sensor capable of detecting orientation. The control unit 31 of the smartphone 110 can detect the orientation of a specific direction centered on the smartphone 110 based on a detection signal from the geomagnetic sensor. The specific direction can be determined as appropriate. The smartphone 110 has a thin, approximately rectangular plate shape. Therefore, here, as an example, an axis that is parallel to the rectangular plate surface and the long side direction of the smartphone 110 and passes through a specific position within the housing of the smartphone 110 is defined as a specific axis, and one axial direction of the specific axis as viewed from the specific position is defined as a specific direction.

[0242] The acceleration sensor can detect acceleration in at least three axes. The control unit 31 of the smartphone 110 can detect the movement of the smartphone 110 (movement in three-dimensional space) based on the detection signal from the acceleration sensor. The control unit 31 can also detect the number of steps taken by the person carrying the smartphone 110 based on the detection signal from the acceleration sensor.

[0243] In addition to the storage contents in the first embodiment (see FIG. 2), the memory 32 of the smartphone 110 further stores an information provision application 32g, a surrounding information notification application 32h, a vehicle position notification application 32j, an SNS application 32k, and a health management application 32m. When the surrounding information notification application is executed, forward video data 32n and stolen vehicle data 32p are stored in the memory 32.

[0244] (13-2) Vehicle configuration Next, the configuration of a vehicle 120 capable of implementing the various services described above will be described with reference to Fig. 21. The vehicle 120 shown in Fig. 21 further includes a HUD (head-up display) 27, a front camera 28, and a Bluetooth communication unit 30 in addition to the hardware configuration of the vehicle 1 of the first embodiment shown in Fig. 6.

[0245] The front camera 28 is a camera capable of capturing images ahead of the vehicle 120. The front camera 28 is attached to the vehicle 120 at a specific position (for example, the front edge of the ceiling of the vehicle interior) from which it can capture images ahead. The front camera 28 operates to capture images when preset capture conditions are met. Here, it is assumed that the front camera 28 is constantly capturing video images at least while the vehicle 120 is traveling. Video data captured by the front camera 28 (front video data 25h) is stored in the memory 25. The front video data 25h stored in the memory 25 is video data from the most recent several hours. The period and timing (i.e., the capture conditions) for capturing images by the front camera 28 can be determined as appropriate. Furthermore, it can also be determined as appropriate how long video data captured in the past is to be stored in the memory 25 (i.e., whether it is to be stored as front video data 25h).

[0246] In addition to the storage contents in the first embodiment (see FIG. 6), the memory 25 of the vehicle 120 further stores a smartphone information notification program 25d, a surroundings monitoring program 25e, an SNS linking program 25f, and a physical condition information response program 25g. When the surroundings monitoring program 25e is executed, forward video data 25h is stored in the memory 25.

[0247] (13-3) Information provision services Next, the information provision service among the various services described above will be described with reference to Fig. 22 and Fig. 23. The information provision service is basically realized by executing the information provision application 32g on the smartphone 110 and executing the smartphone information notification program 25d on the vehicle 120. The information provision service is mainly assumed to be used in a situation where a user carrying the smartphone 110 gets into the vehicle 120 (i.e., the smartphone 110 is present inside the vehicle 120).

[0248] After startup, the control unit 31 of the smartphone 110 reads the information provision application 32g from the memory 32 and periodically executes an information provision process in accordance with the information provision application 32g. The information provision process acquires various pieces of information from various servers (e.g., various websites) and transmits some or all of the information to the vehicle as needed. Figure 22 shows an example of the information provision process.

[0249] When the control unit 31 of the smartphone 110 starts the information provision process of FIG. 22, the control unit 31 detects the current location of the smartphone 110 based on the information received by the GPS receiving unit 37 in S602.

[0250] In S604, the weather information provider site is accessed in the first communication, and current location information indicating the current location of the smartphone 110 is transmitted to the weather information provider site to request weather information about the area around the current location. In response to the request, the weather information about the area around the current location transmitted from the weather information provider site is acquired.

[0251] In S606, the first communication is used to access a traffic information site and request traffic information about the area around the current location by transmitting current location information indicating the current location of smartphone 110 to the traffic information site. In response to the request, traffic information about the area around the current location transmitted from the traffic information site is acquired. Note that the traffic information that can be acquired includes various types of information, such as information about accidents, congestion, and traffic restrictions around the current location.

[0252] In S608, the alert information providing site is accessed through the first communication, and predetermined search conditions are transmitted to the alert information providing site, thereby requesting various pieces of information corresponding to the search conditions. Then, various pieces of information transmitted from the alert information providing site in response to the request are acquired. The search conditions include the current location of the smartphone 110, the current location of the vehicle 120, the current time, information related to the driver (e.g., the driver's preferences, schedule, etc.), and information related to the vehicle 120 (e.g., the vehicle model). When at least one of these conditions is transmitted as a search condition to the alert information providing site, information corresponding to the search conditions is searched for and transmitted to the smartphone 110. Examples of information corresponding to the search conditions include information on facilities and events in the vicinity of the current location, information on various events to be held within a certain time, and information on facilities that may interest the driver.

[0253] In S610, it is determined whether the information acquired in S604, S606, and S608 includes information that has been updated from the information acquired previously. Specifically, it is determined based on the information stored in memory 32 whether the information acquired in S604, S606, and S608 has already been acquired and stored in the previous information provision process. If the currently acquired information has already been stored, the information provision process is terminated. On the other hand, if the currently acquired information includes information that is not stored in memory 32 (i.e., updated information), in S612, the updated information is transmitted to vehicle 120 via Bluetooth communication.

[0254] Meanwhile, after startup, the control unit 10 of the vehicle 120 reads the smartphone information notification program 25d from the memory 25 and repeatedly executes a smartphone information notification process, which is a process according to the smartphone information notification program 25d, at a predetermined interval. The smartphone information notification process is a process for notifying the driver of various information received from the smartphone 110. Figure 23 shows an example of the smartphone information notification process.

[0255] When the control unit 10 of the vehicle 120 starts the smartphone information notification process of FIG. 23, it determines in S652 whether or not update information (information transmitted in S612 of FIG. 22) has been received from the smartphone 110 via Bluetooth communication. If update information has not been received, the control unit 10 ends the smartphone information notification process. If update information has been received, the control unit 10 notifies the driver of the received update information in S654. Specifically, for example, the update information may be output as audio from a speaker (not shown), or the update information may be displayed on the display unit 26 or the HUD 27.

[0256] In the information provision process in Fig. 22, it is not essential to transmit updated information among the various information acquired from each site to the vehicle, and some or all of the various information acquired from each site may be transmitted to the vehicle as appropriate. When transmitting some of the various information, it is possible to determine as appropriate what specific information should be transmitted.

[0257] Furthermore, the data communication method between the smartphone 110 and the vehicle 120 is Bluetooth communication, which is merely an example, and data communication may be performed using other communication methods. (13-4) Vehicle Surroundings Monitoring Service Next, of the various services described above, the vehicle surroundings monitoring service will be described with reference to Figures 24 and 25. The vehicle surroundings monitoring service is basically realized by executing a surroundings information notification application 32h on the smartphone 110 and executing a surroundings monitoring program 25e on the vehicle 120. As with the information provision service described above, the vehicle surroundings monitoring service is mainly assumed to be used when a user carrying the smartphone 110 is aboard the vehicle 120.

[0258] After the control unit 10 of the vehicle 120 is started, it reads the surroundings monitoring program 25e from the memory 25. The surroundings monitoring program 25e is loaded into the smartphone 110, and the surroundings monitoring program 25e is executed repeatedly at a predetermined interval. The surroundings monitoring program 25e is executed to realize the following functions: when the license plate number of a surrounding vehicle is recognized from an image (still image) captured by the front camera 28, the license plate number information is transmitted to the smartphone 110; when the license plate number of a surrounding vehicle is recognized from an image (still image) captured by the front camera 28, the license plate number information is transmitted to the smartphone 110; and when the license plate number of a surrounding vehicle is recognized from an image (still image) captured by the front camera 28, the license plate number information is transmitted to the smartphone 110; and when the license plate number of a surrounding vehicle is recognized from an image (still image) captured by the front camera 28, the license plate number information is transmitted to the smartphone 110; and when the license plate number of a surrounding vehicle is recognized from the image (still image) captured by the front camera 28, the license plate number information is transmitted to the smartphone 110; and when the license plate number of a surrounding vehicle is recognized from the smartphone 110 ...

[0259] When the control unit 10 of the vehicle 120 starts the surroundings monitoring process of FIG. 24, in S702 it acquires an image (still image) captured by the front camera 28. In S704, it performs a recognition process for an image of a surrounding vehicle from the still image acquired in S702. In S706, it determines whether or not the license plate number of the surrounding image has been recognized from the still image. If the license plate number has not been recognized, the process proceeds to S710. If the license plate number has been recognized, in S708 it transmits license plate number information indicating the recognized license plate number to the smartphone 110 via BT communication.

[0260] In S710, the front video data 32n is transmitted to the smartphone 110 via Bluetooth communication. The transmitted front video data 32n is an updated version of the front video data 32n transmitted in the previous processing of S710, i.e., the data newly stored after the previous processing of S710 until the current processing of S710 is executed. However, transmitting only the updated version in this manner is not essential.

[0261] In S712, it is determined whether stolen vehicle detection information has been received from smartphone 110 via Bluetooth communication. If stolen vehicle detection information has not been received, the surroundings monitoring process is terminated. If stolen vehicle detection information has been received, the presence of a stolen vehicle is notified to the driver in S714. The stolen vehicle detection information transmitted from smartphone 110 includes information that the license plate information transmitted in S708 includes a license plate number that may be a stolen vehicle, and includes that license plate number. Therefore, in S714, the driver is notified at least that a vehicle that may be a stolen vehicle is traveling ahead of the vehicle, and the license plate number. Various specific notification methods are possible, and for example, as described in S654 of FIG. 23, the notification may be by voice, or by the display unit 26 or HUD 27.

[0262] Meanwhile, after startup, the control unit 31 of the smartphone 110 reads the surrounding information notification application 32h from the memory 32 and periodically executes a surrounding information notification process, which is a process according to the surrounding information notification application 32h. The surrounding information notification process is a process for realizing a function of determining whether or not a stolen vehicle is present based on the license plate number information transmitted from the vehicle and transmitting the determination result to the vehicle, and a function of storing the forward video data 32n transmitted from the vehicle. Figure 25 shows an example of the surrounding information notification process.

[0263] 25, the control unit 31 of the smartphone 110 accesses a specific website that stores information about stolen vehicles through a first communication in S752, acquires stolen vehicle data 32p, which is data on the number of the stolen vehicle, and stores the data in the memory 32. If the data has already been stored, the stored data is updated based on the newly acquired data.

[0264] In S754, it is determined whether number information has been received from vehicle 120 via Bluetooth communication. If number information has not been received, the process proceeds to S760. If number information has been received, the stolen vehicle data 32p is referenced in S756 to determine whether the received number information includes a number corresponding to a stolen vehicle. If a number corresponding to a stolen vehicle is not included, the process proceeds to S760. If a number corresponding to a stolen vehicle is included, stolen vehicle detection information is sent to vehicle 120 via Bluetooth communication in S758.

[0265] In S760, it is determined whether or not forward video data has been received via BT communication from the vehicle 120. If forward video data has been received, in S762, the forward video data 32n stored in the memory 32 is updated based on the received forward video data. The forward video data 32n stored in the memory 32 can be played back on the display unit 33 by performing a predetermined video playback operation.

[0266] The acquisition of stolen vehicle data (S752) and the determination of whether or not a license plate number corresponding to the stolen vehicle exists (S756) performed by smartphone 110 may be performed by vehicle 120 itself. In this case, stolen vehicle detection information may be transmitted from vehicle 120 to smartphone 110, and the smartphone 110 may store the information or notify the information.

[0267] (13-5) Vehicle location notification service Next, of the various services described above, a vehicle position notification service will be described with reference to Fig. 26. The vehicle position notification service is basically realized by executing a vehicle position notification application 32j on the smartphone 110. The vehicle position notification service is mainly assumed to be used when the user carrying the smartphone 110 is away from the vehicle 120.

[0268] After startup, the control unit 31 of the smartphone 110 reads the vehicle position notification application 32j from the memory 32 and repeatedly executes a vehicle position notification process, which is a process according to the vehicle position notification application 32j, at a predetermined interval. The vehicle position notification process is a process for realizing a function of notifying the user of the smartphone 110 of the current position of the vehicle 120 and various information related to the current position. Fig. 26 shows an example of the vehicle position notification process.

[0269] 26 , the control unit 31 of the smartphone 110 acquires the position information of the vehicle 120 (current vehicle position) through the first communication from the vehicle 120 in S552. Specifically, when the control unit 31 requests the position information from the vehicle 120 through the first communication, the information on the current position detected by the vehicle 120 is transmitted from the vehicle 120. In S552, the current vehicle position is acquired by receiving the current position information transmitted from the vehicle 120.

[0270] In S554, the current position of the smartphone 110 (current smartphone position) is detected based on the information received by the GPS receiver 37. In S556, a map image of a predetermined range including the current vehicle position acquired in S552 and the current smartphone position acquired in S554 is displayed on the display unit 33. In S558, a vehicle mark indicating the vehicle 120 is displayed at a position corresponding to the current vehicle position in the map image, and a smartphone mark indicating the smartphone 110 is displayed at a position corresponding to the current smartphone position. This allows the user of the smartphone 110 to know not only his or her own position (i.e., the position of the smartphone 110) but also the position of the vehicle 120.

[0271] In S560, vehicle position-related information is calculated based on the current vehicle position and the current smartphone position, and is displayed on the display unit 33. The vehicle position-related information is information that directly or indirectly indicates the relative position of the vehicle 120 with respect to the current smartphone position. Examples of vehicle position-related information include the straight-line distance from the current smartphone position to the current vehicle position, the distance along a predetermined route from the current smartphone position to the current vehicle position, the number of steps required to walk from the current smartphone position to the current vehicle position along a predetermined route, and the direction of the current vehicle position as viewed from the current smartphone position.

[0272] In step S562, the smartphone 1 is In step S564, the direction of the smartphone 110 detected in step S562 is detected as being approximately the same as the direction of the vehicle 120 (i.e., the direction of the vehicle's current location as seen from the smartphone's current location). For example, if the difference between the directions (orientations) of the two is within a predetermined angle, it is determined that they are approximately the same.

[0273] If the orientation of the smartphone 110 substantially matches the direction of the vehicle 120, in S566, the user of the smartphone 110 is notified that the smartphone 110 is facing the direction of the vehicle 120. This notification may be made, for example, by voice, by activating a vibration mechanism (not shown) to mechanically vibrate the smartphone 110, or by displaying predetermined information on the display unit 33.

[0274] This vehicle position notification process allows the user of the smartphone 110 to obtain various information regarding the position of the vehicle 120. In particular, the processes of S546 and S566 allow the user of the smartphone 110 to find the direction of the vehicle 120 by changing the orientation of the smartphone 110 in various ways.

[0275] (13-6) SNS Linkage Services Next, of the various services described above, the SNS linking service will be described with reference to Figures 27 and 28. The SNS linking service is basically realized by executing SNS application 32k on smartphone 110 and SNS linking program 25f on vehicle 120. The SNS linking service is mainly assumed to be used when a user who owns smartphone 110 is driving vehicle 120 (in other words, when the driver's smartphone 110 is inside vehicle 120).

[0276] After startup, the control unit 10 of the vehicle 120 reads the SNS linking program 25f from the memory 25 and repeatedly executes the SNS linking process, which is a process according to the SNS linking program 25f, at a predetermined interval. The SNS linking process is a process of determining the driver's mood from an image of the driver's face and transmitting the determination result to the smartphone 110. Figure 27 shows an example of the SNS linking process.

[0277] 27, the control unit 10 of the vehicle 120 acquires an image (still image) captured by the front camera 28 in S802. In S804, the control unit 10 acquires an image (still image) captured by the interior camera 24.

[0278] In S806, a process of recognizing an image of the driver's face from the still image acquired in S804 is performed. In S808, the driver's mood (e.g., emotions such as joy, anger, sadness, and happiness) is determined based on the image of the driver's face recognized in S806. In S810, mood information indicating the determination result of S808 (driver's mood) is transmitted to smartphone 110 via BT communication.

[0279] Meanwhile, after startup, the control unit 31 of the smartphone 110 loads the SNS application 32k from the memory 32 and repeatedly executes SNS processing, which is processing according to the SNS application 32k, at a predetermined interval. The SNS application 32k is an application that can realize functions equivalent to known applications that enable users to enjoy SNS services, such as LINE (registered trademark) and TWITTER (registered trademark). In particular, the SNS application 32k has the function of automatically sending various images and messages according to mood information transmitted from the vehicle 120, in addition to the functions of known similar applications. FIG. 28 shows an example of the SNS processing.

[0280] When the control unit 31 of the smartphone 110 starts the SNS processing of FIG. 28, it determines in S852 whether mood information has been received from the vehicle 120. If mood information has not been received, in S854 it executes other prescribed processing. The prescribed processing is, for example, This process is equivalent to the various processes executed in known SNS applications, such as receiving messages from a server and sending messages to an external device or server.

[0281] If mood information is received from vehicle 120 in S852, a notification image indicating the mood of the user of smartphone 110 (i.e., the driver of vehicle 120) is determined in S856. The notification image may be any image that reflects the driver's mood. For example, if the driver is feeling angry, text saying "I'm angry!" may be generated and determined as the notification image, or an illustration image of an angry expression may be extracted from pre-stored illustration images of faces and determined as the notification image. Furthermore, for example, if the driver is feeling surprised or moved, text saying "I saw something amazing!" may be generated and determined as the notification image, or an illustration image of a surprised expression may be extracted from pre-stored illustration images of faces and determined as the notification image.

[0282] In S858, the notification image determined in S856 is transmitted to a specific external terminal or server via the first communication. As a result, the notification image is transmitted to, for example, the terminal of another user registered as a transmission target, and the notification image is displayed on the other user's terminal. The other user can see the displayed notification image and know the driver's current situation (mood, etc.). When transmitting the notification image, an image of the surroundings of vehicle 120 (an image captured by front camera 28) or an image of the driver (an image captured by interior camera 24) may also be transmitted.

[0283] Note that notification image data may be transmitted to vehicle 120, and the notification image may be displayed in a predetermined manner in vehicle 120. For example, a device may be provided that irradiates a window glass with laser light, and the device may be activated to display a notification image on the window glass using the laser light, allowing people outside vehicle 120 to know the feelings of the driver of vehicle 120. In this case, the notification image may be visible from outside for a certain period of time by placing a phosphorescent material on the window glass that can store light with the wavelength of the laser light for a certain period of time.

[0284] (13-7) Driving fitness assessment service Next, the driving fitness determination service, one of the various services described above, will be described using Figures 29 and 30. The driving fitness determination service is basically realized by executing a physical condition management application 32m on the smartphone 110 and executing a physical condition information response program 25g on the vehicle 120. The driving fitness determination service is mainly assumed to be used when a user who owns the smartphone 110 is driving the vehicle 120.

[0285] After startup, the control unit 31 of the smartphone 110 reads the health management application 32m from the memory 32 and repeatedly executes a health management process, which is a process in accordance with the health management application 32m, at a predetermined interval. The health management process is a process for acquiring information related to the health of the user of the smartphone 110 and transmitting it to the vehicle 120. Figure 29 shows an example of the health management process.

[0286] 29 starts, the control unit 31 of the smartphone 110 determines in S902 whether or not there has been a request for health-related information from the vehicle 120. Health-related information is various information directly or indirectly related to the health of the user of the smartphone 110, such as the number of steps taken per specific period (e.g., per day), pulse rate, heart rate, body temperature, etc.

[0287] If health-related information is not requested in S902, the health management process ends. If health-related information is requested, health-related information is acquired in S904. For example, the number of steps can be acquired based on detection signals from the motion sensor group 50, as described above. Furthermore, for example, pulse rate, heart rate, and other information may be acquired based on detection signals from a sensor that can detect these, provided in the smartphone 110 itself. Alternatively, the information may be acquired through data communication from another terminal (for example, a wristwatch-type information processing terminal) that has the function of detecting these.

[0288] In S906, the health-related information acquired in S904 is transmitted to the vehicle 120 via Bluetooth communication. Meanwhile, when the driver performs a specific start-up operation after startup, the control unit 10 of the vehicle 120 reads the physical condition information response program 25g from the memory 25 and repeatedly executes a physical condition information response process, which is a process according to the physical condition information response program 25g, at a predetermined interval. Examples of the start-up operation include turning on the ignition switch. In the case of an electric vehicle or a hybrid vehicle, another example is turning on the so-called power switch to put the vehicle into a standby state where it can be driven.

[0289] The physical condition information response process is a process of acquiring physical condition-related information of the user (i.e., the driver) of the smartphone 110 from the smartphone 110, and permitting or prohibiting the driver from driving the vehicle 120 according to the physical condition-related information. Figure 30 shows an example of the physical condition information response process.

[0290] 30, the control unit 10 of the vehicle 120 requests health-related information from the smartphone 110 via BT communication in S952. Then, the control unit 10 acquires the health-related information by receiving the health-related information transmitted from the smartphone 110 via BT communication in response to the request.

[0291] In S954, it is determined whether the driver is permitted to drive the vehicle 120 based on the health-related information acquired in S952 (i.e., information related to the driver's health condition). For example, if the driver's pulse or heart rate is outside the normal range, it is determined that the driver is not permitted to drive. Also, for example, if the total number of steps taken over the past day is below a predetermined lower limit, it is determined that the driver is not permitted to drive, as this indicates a lack of exercise, and a means of transportation other than the vehicle 120 (for example, walking or cycling) is recommended. Conversely, if both the pulse and heart rate are within the normal range, or if the total number of steps taken over the past day exceeds the lower limit, and there are no particular circumstances that would make the driver hesitant to drive the vehicle 120, it is determined that the driver is permitted to drive.

[0292] In S956, based on the determination result in S954, it is determined whether the driver is capable of driving the vehicle 120 (whether it is determined that the driver is capable of driving). If it is determined that the driver is capable of driving, in S958 the operating state of the vehicle 120 is transitioned to a driving standby state. In the driving standby state, the driver can drive the vehicle 120. If it is not determined that the driver is capable of driving in S956 (i.e., if it is determined that the driver is not capable of driving in S954), a driving prohibition process is executed in S960. Specifically, even if the driver depresses the accelerator pedal, this is invalidated, and the vehicle 120 is forcibly prevented from driving.

[0293] (14) A portable communication terminal (e.g., a wristwatch-type terminal) with a built-in motion sensor may be worn on the arm of a traffic attendant deployed in a parking lot, or on the arm of a traffic attendant or police officer directing traffic. The arm movement (i.e., hand gestures) may be detected, and the meaning of the hand gesture (the instruction given by the traffic attendant, etc.) may be recognized. The hand gesture recognition may be performed by the portable communication terminal worn on the arm, or the detection signal of the motion sensor may be transmitted to another communication terminal (e.g., the aforementioned smartphone) or a vehicle, and the signal may be transmitted to the destination. Examples of recognizable hand gestures include a stop instruction, a no-entry instruction, and a go-away instruction. The recognition result may then be notified to the user via a smartphone, or to the driver of the vehicle.

[0294] For example, a smartphone receives a detection signal from a motion sensor on a portable communication terminal worn by a guide, recognizes hand gestures on the smartphone, and displays the recognition results on the smartphone. The notification may be made by smartphone or transmitted to a vehicle and made in the vehicle.

[0295] (15) The vehicle to which the present invention can be applied is not limited to the vehicle 1 of the above embodiment that uses an engine as a driving source for running, but may also be a hybrid vehicle, an electric vehicle, or any other vehicle with a variety of drive systems. Furthermore, the present invention is not limited to passenger cars, but can also be applied to commercial vehicles, trucks, buses, railroad cars, and any other type of vehicle.

[0296] (16) In addition, the present invention is not limited to the specific means and structures shown in the above embodiments, and various forms may be adopted within the scope of the gist of the present invention. For example, the function of one component in the above embodiments may be distributed among multiple components, or the functions of multiple components may be integrated into one component. Furthermore, at least a portion of the configuration of the above embodiments may be replaced with a known configuration having a similar function. Furthermore, a portion of the configuration of the above embodiments may be omitted as long as the problem can be solved. Furthermore, at least a portion of the configuration of the above embodiments may be added to, substituted for, or the like with the configuration of another of the above embodiments. All aspects included in the technical idea identified by the wording of the claims are embodiments of the present invention.

[0297] [Technical concept understood from the embodiment] At least the following technical ideas can be understood from the various embodiments described above in detail. (A) an electronic key capable of wirelessly communicating with a vehicle using two different wireless communication methods; a communication terminal capable of wirelessly communicating with the electronic key; Equipped with One of the two wireless communication methods has a shorter communication distance than the other wireless communication method, The communication terminal a designation input unit that accepts designation input of a processing item indicating the content of a specific processing to be executed by the vehicle; a command transmission unit that transmits a processing command indicating the processing item input by the designation input unit to the electronic key; Equipped with The electronic key is a processing command generating unit that, when receiving the processing command from the communication terminal, generates a processing command indicating the processing item corresponding to the processing command; a communication system determination unit that determines whether wireless communication with the vehicle is possible using the one wireless communication system; a command transmitting unit that transmits the processing command to the vehicle using the one wireless communication system when the communication system determination unit determines that wireless communication is possible using the one wireless communication system, and that transmits the processing command to the vehicle using the other wireless communication system when the communication system determination unit determines that wireless communication is not possible using the one wireless communication system; A vehicle control system comprising:

[0298] With this configuration, wireless communication between the electronic key and the vehicle is performed in an appropriate manner depending on the relative distance between them, thereby enabling efficient wireless communication between the electronic key and the vehicle.

[0299] (B) In (A) above, The electronic key is a permission determination unit that, when the communication system determination unit determines that wireless communication is not possible using one of the wireless communication systems, determines whether transmission of the processing command using the other wireless communication system is permitted; When the communication system determination unit determines that wireless communication is not possible using one of the wireless communication systems, and when the permission determination unit determines that transmission of the processing command using the other wireless communication system is permitted, the command transmission unit transmits the processing command to the vehicle using the other wireless communication system. A vehicle control system comprising:

[0300] With this configuration, when the electronic key cannot communicate with the vehicle wirelessly using one wireless communication method (for example, when the electronic key is far away from the vehicle), it is possible to arbitrarily determine whether or not to transmit processing commands to the vehicle using the other wireless communication method. If transmission using the other wireless communication method is permitted, the vehicle can be remotely controlled even when the electronic key is far away from the vehicle. Conversely, if transmission using the other wireless communication method is not permitted, the vehicle cannot be remotely controlled when the electronic key is farther away from the vehicle than a certain distance (the distance at which wireless communication using one wireless communication method is possible), thereby improving security performance. (C) an electronic key capable of wirelessly communicating with the vehicle; a communication terminal capable of wirelessly communicating with the electronic key; Equipped with The communication terminal A display unit; a display control unit that causes a process item image, which is an image indicating a process item that can be executed on the vehicle, to be displayed on the display unit; a designation input unit that receives a designation input for designating at least one of the process item images displayed on the display unit by the display control unit; a command transmission unit that transmits to the electronic key a process command corresponding to the process item indicated by the process item image specified by the designation input unit; Equipped with The electronic key is a command transmission unit that, when receiving the processing command from the communication terminal, transmits to the vehicle a processing command indicating the processing item corresponding to the processing command; A vehicle control system comprising:

[0301] With this configuration, the user can easily find and specify a desired process item image (a process item image corresponding to a process that the user wants the vehicle to execute) from among the process item images displayed on the communication terminal. Note that each icon shown in FIG. 3 corresponds to an example of the process item image. (D) an electronic key capable of wirelessly communicating with the vehicle; a communication terminal capable of wirelessly communicating with the electronic key; Equipped with The communication terminal At least one of an imaging unit capable of capturing video and an audio input unit capable of inputting audio; a processing reception unit that receives, as processing specification information, at least one of a user's gesture captured by the imaging unit and a user's voice input to the voice input unit; a transmitter that transmits the processing instruction information to the electronic key; Equipped with The electronic key is a command transmission unit that, when receiving the process specification information from the communication terminal, transmits to the vehicle a process command corresponding to the process item indicated by the received process specification information, among the process items that can be executed by the vehicle; A vehicle control system comprising:

[0302] With this configuration, the communication terminal only needs to have the function of transmitting process specification information indicating the user's gesture or voice to the electronic key, and does not need to recognize the meaning of the process specification information entered by the user. The process of recognizing the meaning of the process specification information entered by the user is performed by the electronic key. This reduces the processing load on the communication terminal.

[0303] 8 correspond to an example of the processing by the processing receiving unit. The gesture pattern recognized in S34 or the corresponding operation content, and the voice pattern recognized in S42 or the corresponding operation content correspond to an example of the processing designation information.

[0304] (E) a vehicle; an electronic key capable of wirelessly communicating with the vehicle; a communication terminal capable of wirelessly communicating with the electronic key; Equipped with The communication terminal At least one of an imaging unit capable of capturing video and an audio input unit capable of inputting audio; a processing reception unit that receives, as processing specification information, at least one of a user's gesture captured by the imaging unit and a user's voice input to the voice input unit; a terminal-side transmitter that transmits the processing instruction information to the electronic key; Equipped with the electronic key includes a relay transmitter that, when receiving the processing instruction information transmitted from the communication terminal, relays the received processing instruction information and transmits it to the vehicle; The vehicle is a process execution unit that executes the process item indicated by the process specification information when the process specification information is received from the electronic key; A vehicle control system comprising:

[0305] With this configuration, both the communication terminal and the electronic key only need to have the function of transmitting process specification information indicating the user's gesture or voice; there is no need to recognize the meaning of the process specification information entered by the user. The process of recognizing the meaning of the process specification information entered by the user is performed by the vehicle. This reduces the processing load on the communication terminal and the electronic key.

[0306] (F) An electronic key capable of wireless communication with a vehicle, a designation input unit that accepts designation input of a processing item indicating the content of a specific processing to be executed by the vehicle; a command transmission unit that transmits to the vehicle a processing command indicating the processing item input by the designation input unit; An electronic key comprising:

Claims

1. A vehicle control system, comprising: an electronic key configured to be capable of wirelessly communicating with a vehicle; a communication terminal configured to be able to wirelessly communicate with the electronic key; Equipped with The communication terminal a designation input unit configured to receive designation input of a processing item indicating the content of a specific processing to be executed by the vehicle; a command sending unit configured to send a processing command indicating the processing item input by the designation input unit to the electronic key; Equipped with The electronic key is A vehicle control system comprising: a command transmission unit configured, when receiving the processing command from the communication terminal, to transmit to the vehicle a processing command indicating the processing item corresponding to the processing command.

2. 2. The vehicle control system according to claim 1, The communication terminal a terminal-side storage unit in which predetermined terminal-side specific information is stored; the command transmission unit is configured to transmit the terminal-side unique information stored in the terminal-side storage unit when transmitting the processing command to the electronic key; The electronic key is a key-side storage unit in which predetermined key-side unique information is stored; a unique information determination unit configured to, when receiving the processing command and the terminal-side unique information from the communication terminal, determine whether or not the received terminal-side unique information and the key-side unique information stored in the key-side storage unit have a specific relationship; Equipped with The command transmission unit is configured to transmit the processing command when the unique information determination unit determines that the specific relationship exists.

3. 3. The vehicle control system according to claim 1, The communication terminal The device includes at least one of an imaging unit configured to be able to capture moving images and an audio input unit configured to be able to input audio, The designation input unit is configured to be able to accept designation input of the processing item based on at least one of a user's gesture captured by the imaging unit and a user's voice input to the voice input unit.

Images