Vehicle

Abstract

To provide a user-friendly system that allows a user of a vehicle to specify desired processing items in a variety of ways when controlling the vehicle from a communication terminal.SOLUTION: A vehicle control system comprises an electronic key capable of communicating wirelessly with a vehicle 1, and a communication terminal 3 capable of communicating wirelessly with the electronic key. The communication terminal 3 comprises a specification input unit that accepts a specification input of a processing item indicating the contents of the processing to be performed, in order to cause the vehicle 1 to perform a specific processing, and an instruction transmission unit that transmits a processing instruction indicating the processing item inputted by the specification input unit to the electronic key. The electronic key comprises a command transmitting unit that, upon receiving a processing instruction from the communication terminal 3, transmits a processing command indicating the processing item corresponding to the processing instruction to the vehicle 1.SELECTED DRAWING: Figure 1A-1B

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This international application claims priority based on Japanese Patent Application No. 2014-102321, filed with the Japan Patent Office on May 16, 2014, the entire contents of which are incorporated herein by reference. [Technical field]

[0002] The present invention relates to a vehicle control system capable of remotely controlling a vehicle. [Background technology]

[0003] Electronic key systems that enable users to lock and unlock doors and start and stop the engine without touching the key through wireless communication between the electronic key carried by the user and the vehicle are now in widespread use (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2006-341768 A Summary of the Invention [Problem to be solved by the invention]

[0005] It would be convenient if more diverse functions could be realized by directly or indirectly utilizing wireless communication between the electronic key and the vehicle. In one aspect of the present invention, it is desirable to provide a highly convenient vehicle control system that uses an electronic key. [Means for solving the problem]

[0006] A vehicle control system according to one aspect of the present invention includes an electronic key capable of wireless communication with a vehicle, and a communication terminal capable of wireless communication with the electronic key. The communication terminal includes a designation input unit and a command transmission unit. The designation input unit accepts designation input of a processing item indicating the content of a specific processing to be executed on the vehicle. The command transmission unit transmits a processing command indicating the processing item input by the designation input unit to the electronic key. The electronic key includes a command transmission unit that, when receiving a processing command from the communication terminal, transmits a processing command indicating the processing item corresponding to the processing command to the vehicle.

[0007] According to this configuration, a user of the vehicle can remotely control the vehicle by operating the communication terminal via the electronic key. An electronic key is a portable wireless communication device that is at least capable of wireless communication with a vehicle and transmitting various data to the vehicle via wireless communication. When transmitting various data from the electronic key to the vehicle, matching data required to match the electronic key with the vehicle is also transmitted. When the vehicle receives various data from the electronic key, it refers to the matching data contained therein, and if it confirms that the matching data is from a genuine electronic key, it validates the various data received from the electronic key and performs various processes based on the various data.

[0008] The designation input unit is a means for accepting designation of a processing item (i.e., the content of the processing to be executed by the vehicle) by the user. The processing item to be executed by the vehicle is accepted by this designation input unit. The command transmission unit is a means for wirelessly transmitting a processing command indicating the processing item to the electronic key. The processing item accepted by the designation input unit is wirelessly transmitted by the command transmission unit to the electronic key. In this way, the electronic key is able to transmit to the user at the communication terminal. The processing item specified can be recognized.

[0009] Furthermore, in the above configuration, the communication terminal may include a terminal-side memory unit in which predetermined terminal-side unique information is stored, and the command transmission unit may transmit the terminal-side unique information stored in the terminal-side memory unit when transmitting a processing command to the electronic key. In this case, the electronic key may include a key-side memory unit and a unique information determination unit. The key-side memory unit stores predetermined key-side unique information. When the unique information determination unit receives a processing command and terminal-side unique information from the communication terminal, it determines whether the received terminal-side unique information and the key-side unique information stored in the key-side memory unit have a specific relationship. Then, the command transmission unit may transmit a processing command when the unique information determination unit determines that the specific relationship exists.

[0010] The terminal-side specific information stored in the communication terminal is information used to determine (hereinafter simply referred to as "authentication") whether or not a processing command may be validated when the electronic key receives the processing command from the communication terminal (i.e., whether or not the processing command may be relayed to the vehicle as a processing command).

[0011] On the other hand, the key-side unique information stored in the electronic key is information for comparison with the terminal-side unique information for the purpose of performing the authentication. The terminal-side unique information may be, for example, the verification data (data used by the vehicle to verify the electronic key).

[0012] The unique information determination unit of the electronic key is a means for performing the above authentication when a processing command is received from the communication terminal. That is, when the unique information determination unit receives a processing command from the communication terminal, it compares the terminal-side unique information received along with the processing command with the key-side unique information stored in the electronic key. If there is a specific relationship between the two (for example, the two match), it validates the processing command from the communication terminal and transmits a processing command corresponding to the processing command to the vehicle.

[0013] With this configuration, unauthorized operation of the vehicle can be prevented, and the security performance of the system can be improved. In the above configuration, the communication terminal may include at least one of an imaging unit capable of capturing video and a voice input unit capable of inputting voice, and the designation input unit may be capable of accepting designation input of a processing item based on at least one of a gesture of a user captured by the imaging unit and a voice of the user input to the voice input unit.

[0014] According to this configuration, the user of the vehicle can specify a desired processing item in a variety of ways when controlling the vehicle from the communication terminal, which makes it possible to provide a system that is easy for the user to use.

[0015] In addition, the present invention can be realized in various forms, such as the vehicle control system described above, various devices (communication terminal, electronic key) that the vehicle control system has, a vehicle, a program for causing a computer to function as each part of these various devices, and a vehicle control method. [Brief description of the drawings]

[0016] [Figure 1A-1B] FIG. 1A is an explanatory diagram showing an image of how the vehicle control system is used, and FIG. 1B is a top view of the vehicle. [Diagram 2] FIG. 1 is a block diagram showing a schematic configuration of a smartphone. [Diagram 3] FIG. 11 is an explanatory diagram showing the specific contents of an operation menu screen. [Figure 4] 1 is a block diagram showing a schematic configuration of an electronic key; [Diagram 5] 10 is an explanatory diagram illustrating a method of powering an electronic key from a smartphone using a charging cable. FIG. [Figure 6] 1 is a block diagram showing a schematic configuration of a vehicle. [Figure 7] 5 is a flowchart showing a vehicle operation application executed by the smartphone of the first embodiment. [Figure 8] 8 is a flowchart showing details of the vehicle operation process in FIG. 7. [Figure 9]4 is a flowchart showing an electronic key control process executed by the electronic key of the first embodiment. [Figure 10] 10 is a flowchart showing details of the relay process in FIG. 9. [Figure 11] 4 is a flowchart showing a remote control process executed by the vehicle of the first embodiment. [Figure 12] 12 is a flowchart showing details of a function restriction confirmation process in the remote control process of FIG. 11. [Figure 13] 13 is a flowchart showing a tag correspondence process. [Figure 14] FIG. 11 is a block diagram showing a schematic configuration of an electronic key according to a second embodiment. [Figure 15] 10 is a flowchart showing an electronic key control process executed by an electronic key according to a second embodiment. [Figure 16] 4 is a flowchart showing a vehicle information notification process executed by a vehicle. [Figure 17] 10 is a flowchart showing a vehicle information display process executed by the smartphone. [Figure 18] 5 is a flowchart showing a system information transmission process executed by the electronic key. [Figure 19] 11 is a flowchart showing a system state notification process executed by the smartphone. [Figure 20] FIG. 13 is a block diagram showing another example configuration of the smartphone. [Figure 21] FIG. 11 is a block diagram showing another example of the configuration of a vehicle. [Figure 22] 13 is a flowchart of an information providing process executed by the smartphone. [Figure 23] 4 is a flowchart of a smartphone information notification process executed in a vehicle. [Figure 24] 4 is a flowchart of a surroundings monitoring process executed in a vehicle. [Diagram 25] 11 is a flowchart of a surrounding information reporting process executed by the smartphone. [Figure 26] 11 is a flowchart of a vehicle position notification process executed by the smartphone. [Figure 27] 11 is a flowchart of an SNS linking process executed in a vehicle. [Figure 28] 1 is a flowchart of an SNS process executed on a smartphone. [Figure 29] 13 is a flowchart of a physical condition management process executed on a smartphone. [Diagram 30] 4 is a flowchart of a physical condition information response process executed in a vehicle. [Explanation of symbols]

[0017] 1...vehicle, 2,80...electronic key, 3...smartphone, 4...exterior transmitter, 5...interior transmitter, 6...receiver, 7,35,55...first communication unit, 8,57...second communication unit, 9,37...GPS receiver, 10,31,51,81...control unit, 11...engine unit, 12...brake unit, 13...steering unit, 14...air conditioner, 15...door, 16...luggage door, 17...window, 18...door mirror, 19...wiper, 20...headlight, 21...blinker, 25,32,52,82...memory, 33,85...display unit, 34...touch panel, 34a...fingerprint detection unit, 36,56...BT communication unit, 39...USB receptacle, 40,59...battery, 41,60...regulator, 42,61...non-contact power receiving unit, 43...camera, 44...image processing unit, 45,83...microphone, 46,84...audio processing unit, 48...operation menu screen, 53...transmitter, 54...receiver, 58,86...operation input unit, 62...power input jack, 70...charging cable, 400...outside vehicle detection area, 500...inside vehicle detection area. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. [First embodiment] (1) Overall configuration of vehicle control system As shown in FIG. 1A, the vehicle control system of this embodiment has a vehicle 1, an electronic key 2, and a smartphone 3, and is a system that is capable of controlling the vehicle 1 from the smartphone 3 via the electronic key 2.

[0019] The electronic key 2 is a key with a wireless communication function that is used to unlock and lock the doors of the vehicle 1 and start the driving source for driving the vehicle 1 (the engine in this embodiment) without directly inserting a mechanical key into the vehicle 1. As described later, a request signal is periodically transmitted from the vehicle 1, and when the electronic key 2 enters an area in which the request signal can be received, the request signal is received by the electronic key 2. When the electronic key 2 receives the request signal from the vehicle 1, it transmits a response signal and a user ID to the vehicle 1. When the vehicle 1 receives the response signal and the user ID from the electronic key 2, it checks the user ID of the vehicle 1 against its own user ID, and if they match, the vehicle 1 is in an operable state in which the doors can be unlocked and locked, the driving source for driving the vehicle can be started, and so on. During the operable state, the door is unlocked when the user touches, for example, a touch sensor on the door handle. In addition, the engine is started when the user presses a specific start button inside the vehicle.

[0020] Therefore, a user of vehicle 1 can approach vehicle 1 while carrying electronic key 2 in a pocket, bag, etc., and can unlock / lock vehicle 1 and start the engine without using a mechanical key as in the past.

[0021] The functions described above are basic functions that can be realized using the electronic key 2 and are already generally known and in practical use. In this embodiment, in addition to the basic functions described above, a relay function for relaying communication between the smartphone 3 and the vehicle 1 is further provided, as described below. This relay function realizes an advanced control system that allows the vehicle 1 to be remotely operated from the smartphone 3.

[0022] 1A shows a user 4 carrying an electronic key 2 in a jacket pocket operating a smartphone 3 near a vehicle 1. By operating the smartphone 3, the user 4 can operate various parts of the vehicle 1, move the vehicle 1, and obtain information from the vehicle 1.

[0023] 1B is a top view of the vehicle 1. The vehicle 1 is equipped with a total of four doors 15 (front, rear, left and right), a luggage door 16, a total of two door mirrors 18 (left and right), wipers 19, two headlights 20 provided on both the left and right sides of the front end of the vehicle, and four turn signals 21 provided at the four corners. Each door 15 is equipped with a window 17.

[0024] In addition, a fixed part 22 and an interior camera 24 are provided in the cabin of the vehicle 1. The fixed part 22 is provided on the rear ceiling in the cabin. The fixed part 22 is configured to be able to fix various communication terminals including the smartphone 3. The fixed part 22 is provided with a USB plug 23.

[0025] The vehicle interior camera 24 is provided on the front ceiling of the vehicle interior so as to be able to capture images of almost the entire interior of the vehicle from the front side of the vehicle interior. Furthermore, detection areas are formed in the vehicle 1 in which the vehicle 1 can detect the presence of the electronic key 2. Specifically, an exterior detection area 400 is formed outside the vehicle 1, and an interior detection area 500 is formed inside the vehicle 1. These detection areas 400, 500 are respectively formed by an exterior transmitter 4 and an interior transmitter 5 (both of which are not shown in Figs. 1A and 1B; see Fig. 6), which will be described later.

[0026] The interior detection area 500 is an area in which the electronic key 2 can receive a request signal transmitted from an interior transmitter 5 provided inside the vehicle 1. The exterior detection area 400 is an area outside the vehicle 1 in which the electronic key 2 can receive a request signal transmitted from an exterior transmitter 4 provided on a side of the vehicle 1.

[0027] 1B is merely an example. The specific ranges of the outside detection area and the inside detection area can be set appropriately by adjusting the installation positions and the number of the transmitters 4 and 5, or by appropriately selecting transmitters having desired radio wave radiation characteristics as the transmitters 4 and 5.

[0028] (2) Description of Smartphone 3 A specific configuration of the smartphone 3 will be described with reference to Fig. 2. The smartphone 3 is a multi-function portable information terminal equipped with multiple types of communication functions including a voice call function via a mobile phone network. The smartphone 3 has at least two types of wireless communication functions: wireless communication using a first communication method (hereinafter abbreviated as "first communication") and wireless communication using Bluetooth (registered trademark; the same applies below) (hereinafter abbreviated as "BT communication").

[0029] The first communication is a communication method that allows wireless communication over long distances, and in this embodiment, is a wireless communication method using, for example, a mobile phone network. Therefore, as long as the smartphone 3 is within the communication range of the mobile phone, the user of the smartphone 3 can make voice calls and data communications using the first communication. The BT communication is a well-known short-distance wireless communication method that uses radio waves in the 2.4 GHz band.

[0030] As shown in FIG. 2, the smartphone 3 includes a control unit 31, a memory 32, a display unit 33, a touch panel 34, a first communication unit 35, a BT communication unit 36, a GPS receiver unit 37, a USB interface (hereinafter abbreviated as "USB I / F") 38, a USB receptacle 39, a battery 40, a regulator 41, a non-contact power receiving unit 42, a camera 43, an image processing unit 44, a microphone 45, an audio processing unit 46, and a tag reader / writer 47.

[0031] The control unit 31 includes a microcomputer equipped with a CPU, a ROM, a RAM, an I / O, etc. (not shown). The control unit 31 controls various circuits and functional blocks in the smartphone 3, including the various units connected to the control unit 31. Various programs including a vehicle operation application 32a (described later) are executed by the CPU of the control unit 31.

[0032] The memory 32 is a non-volatile memory whose stored contents can be electrically rewritten, and is a flash memory in this embodiment. Various programs and data are stored in the memory 32. The programs and data stored in the memory 32 include a vehicle operation application 32a, vehicle operation menu data 32b, a voice pattern 32c, a gesture pattern 32d, ID information 32e, and authentication information 32f.

[0033] The display unit 33 is a display device (e.g., a liquid crystal display) capable of displaying various images and information. The touch panel 34 is a well-known input device that allows input operations to be performed by touching it with a pointing object such as a fingertip or a dedicated pen. The touch panel 34 is arranged so as to overlap almost the entire image display area of ​​the display unit 33. The touch panel 34 further includes a fingerprint detection unit 34a. When a human finger touches the touch panel 34, the fingerprint detection unit 34a detects the fingerprint of the part that is touched. Fingerprint data detected by the fingerprint detection unit 34a (fingerprint data) is input to the control unit 31. Note that other methods for detecting fingerprints may be used. Although not shown in the figure, the smartphone 3 also includes at least one switch that is pressed by the user as an input device in addition to the touch panel 34. It is prepared.

[0034] The first communication unit 35 is a wireless communication interface for transmitting and receiving radio waves for the first communication. The BT communication unit 36 ​​is a wireless communication interface for realizing BT communication. The GPS receiver unit 37 receives radio waves from multiple GPS (Global Positioning System) satellites and outputs information contained in the received radio waves to the control unit 31. The control unit 31 can detect the current position (e.g., latitude and longitude) of the smartphone 3 based on the information received by the GPS receiver unit 37.

[0035] The USB I / F 38 is an interface for performing serial communication according to the USB (Universal Serial Bus) standard. A USB plug can be inserted into the USB receptacle 39. Note that a data communication interface according to another standard may be provided instead of the USB, or a data communication interface according to another standard may be provided in addition to the USB.

[0036] The battery 40 is a secondary battery that can be repeatedly charged. However, the battery 40 may be another power storage means (such as a primary battery or a fuel cell) other than a secondary battery. The same applies to a battery 59 (see FIG. 4) of the electronic key 2, which will be described later. The regulator 41 is a power supply circuit that converts the voltage of the battery 40 into a constant voltage of a predetermined voltage value and supplies it to the control unit 31 and other circuits, etc.

[0037] The non-contact power receiving / transmitting unit 42 can supply power to the outside by a non-contact power supply method and receive power from the outside. When supplying power to the outside, the non-contact power receiving / transmitting unit 42 discharges DC power of the battery 40 to the outside by, for example, an electromagnetic induction method. When receiving power from the outside, the non-contact power receiving / transmitting unit 42 converts the power received from the outside into DC and outputs it to at least one of the battery 40 and the regulator 41. The operation of the non-contact power receiving / transmitting unit 42 is controlled by the control unit 31.

[0038] Camera 43 is an imaging device capable of capturing still images and videos. Image processing unit 44 processes the still images and videos captured by camera 43 (e.g., generates still image and video data) and inputs the processing results to control unit 31. Control unit 31 can recognize the contents of the still images and videos captured by camera 43 based on the data input from image processing unit 44.

[0039] The microphone 45 converts external sound into an electrical signal. The audio processor 46 processes the audio signal collected by the microphone 45 and converted into an electrical signal into digital audio data and outputs it to the control unit 31. The control unit 31 can recognize the content of the sound collected by the microphone 45 based on the audio data input from the audio processor 46.

[0040] The tag reader / writer 47 is a communication module for performing contactless data communication with an external RF tag of the smartphone 3. By holding the smartphone 3 over an external RF tag, the tag reader / writer 47 becomes capable of data communication with the RF tag, and can read data from the RF tag and write data to the RF tag.

[0041] In this embodiment, as described below, an RF tag 63 is built into the electronic key 2. Therefore, by holding the smartphone 3 over the electronic key 2, the tag reader / writer 47 of the smartphone 3 can communicate data with the RF tag 63 of the electronic key 2.

[0042] The vehicle operation application 32a stored in the memory 32 is application software for controlling the vehicle 1 by relaying the electronic key 2 from the smartphone 3. The vehicle operation application 32a can be provided, for example, from the manufacturer or dealer of the vehicle 1 via a medium or a telecommunication line and installed on the smartphone 3.

[0043] The vehicle operation menu data 32b stored in the memory 32 is a database used when the vehicle operation application 32a is executed, is provided together with the vehicle operation application 32a, and is stored in the memory 32 when the vehicle operation application 32a is installed. However, it is also possible to install or update the data separately from the vehicle operation application 32a. The vehicle operation menu data 32b includes various data for displaying the operation menu screen 48 shown in FIG. 3 on the display unit 33.

[0044] 3 is a screen that lists icons of operation items that can be used to operate the vehicle 1 from the smartphone 3. The icons displayed on the operation menu screen 48 include a "light flashing" icon indicating an operation item for flashing the headlights 20 for a certain period of time, a "blinking blinker" icon indicating an operation item for flashing the blinker 21 for a certain period of time, an "air conditioner on" icon indicating an operation item for turning on (starting) the air conditioner, an "air conditioner off" icon indicating an operation item for turning off (stopping) the air conditioner, an "engine start" icon indicating an operation item for starting the engine, an "engine stop" icon indicating an operation item for stopping the engine, a "door mirror close" icon indicating an operation item for closing the door mirrors 18, an "door mirror open" icon indicating an operation item for opening the door mirrors 18, a "steer left" icon indicating an operation item for rotating the steering wheel a certain angle to the left (i.e., steering the steering wheel a certain amount to the left), a "steer right" icon indicating an operation item for rotating the steering wheel a certain angle to the right (i.e., steering the steering wheel a certain amount to the right), a "steer right" icon indicating an operation item for turning the steering wheel to a neutral position, and a "steer right" icon indicating an operation item for turning the steering wheel to a neutral position. icons corresponding to various operation items include a "steer neutral" icon indicating an operation item to return the vehicle to a neutral state, a "slow forward" icon indicating an operation item to drive the vehicle forward a small distance (e.g., 30 cm) at a small speed (e.g., 3 km / h), a "slow reverse" icon indicating an operation item to drive the vehicle backward a small distance (e.g., 20 cm) at a small speed (e.g., 2 km / h), a "mileage" icon indicating an operation item to acquire the accumulated mileage of the vehicle, an "electronic key control" icon indicating an operation item to control the functions of the electronic key 2, a "door lock open / close" icon indicating an operation item to open and close the locks of each door 15 of the vehicle, a "maintenance information" icon indicating an operation item to acquire maintenance information about the vehicle (e.g., remaining oil level, remaining battery level, etc.), a "diagnosis information" icon indicating an operation item to acquire diagnostic information about the vehicle, an "interior temperature" icon indicating an operation item to acquire the interior temperature of the vehicle, and an "interior image information" icon indicating an operation item to acquire interior image information.

[0045] Note that there is a limit to the number of icons that can be simultaneously displayed on the display unit 33. Icons that are not displayed on the display unit 33 can be displayed by performing a swipe or flick operation in an up or down direction on the touch panel 34 to scroll the display content in an up or down direction.

[0046] When the user selects (e.g., taps) an icon for closing the door mirrors on the operation menu screen 48, the selection information is transmitted to the vehicle 1 via the electronic key 2, and the door mirrors 18 of the vehicle 1 are automatically closed, as described below.

[0047] For example, when the user selects the "door lock open / close" icon, multiple icons are displayed to allow the user to select which door lock is to be operated and whether to open or close the lock of the door to be operated, as shown in Fig. 3. When the user selects an icon corresponding to the desired operation from the multiple icons, the selection information is transmitted to the vehicle 1 via the electronic key 2, and the door lock is opened or closed according to the selected operation. Thus, the user can, for example, open and close all the doors 15, or selectively open and close only a specific door 15.

[0048] For example, when the user selects the "electronic key control" icon, the selection information (specific In response to the electronic key control command, an electronic key control command (described later) is transmitted to the electronic key 2. Upon receiving the electronic key control command from the smartphone 3, the electronic key 2 executes a command response process (S124 in FIG. 10 described later) corresponding to the electronic key control command.

[0049] For example, when a user selects the “in-vehicle image information” icon, the selection information is transmitted to the vehicle 1 via the electronic key 2. That is, an operation command indicating a request to acquire an interior image is transmitted to the vehicle 1. Upon receiving the operation command, the vehicle 1 operates the interior camera 24 to acquire still images or moving images of the interior of the vehicle. The acquired still images or moving images are then transmitted to the smartphone 3, for example, by the first communication. Upon receiving image data captured by the interior camera 24 from the vehicle 1, the smartphone 3 displays the image data on the display unit 33.

[0050] Thus, in this embodiment, the user can use the vehicle operation app 32a installed on the smartphone 3 to selectively execute multiple operation items set as vehicle operation menu data 32b on the vehicle 1.

[0051] In the present embodiment, when controlling the vehicle 1 from the smartphone 3 using the vehicle operation application 32a, the operation item can be specified by voice or gesture in addition to the selection operation on the operation menu screen 48 shown in FIG. 3. The memory 32 stores voice data corresponding to each operation item as the voice pattern 32c. Therefore, when the user utters a word indicating a specific operation item (any of the voices stored as the voice pattern 32c) into the microphone 45, the control unit 31 determines that a request for execution of the operation item has been made, and executes a process required for executing the operation item. For example, when the user speaks "close the door mirrors," the control unit 31 recognizes that an operation to close the door mirrors 18 has been requested, and closes the door mirrors 18. That is, in this example, a result equivalent to that obtained when the door mirror close icon on the operation menu screen 48 shown in FIG. 3 is tapped can be obtained.

[0052] Furthermore, gestures corresponding to the respective operation items are stored as gesture patterns 32d in memory 32. Therefore, when the user makes a gesture indicating a specific operation item toward camera 43 (any of the gestures stored as gesture patterns 32d), control unit 31 determines that a request for execution of the operation item has been made, and executes a process required for executing the operation item.

[0053] The ID information 32e stored in the memory 32 includes a terminal ID unique to the smartphone 3. The ID information 32e also includes a user ID unique to the vehicle 1, which is necessary to remotely operate the vehicle 1 from the smartphone 3. This user ID is also stored in the electronic key 2 and the vehicle 1. The user ID is stored in the vehicle 1 and the electronic key 2 by, for example, a vehicle manufacturer or a dealer when the vehicle 1 is shipped. The user ID is stored in the smartphone 3 by, for example, being notified by the manufacturer or dealer of the vehicle 1 through a predetermined procedure and input by the user into the smartphone 3. Note that the user ID may be stored in the smartphone 3 by various other methods and timings. For example, the user may bring the electronic key 2 and the smartphone 3 to the dealer of the vehicle 1 and have the dealer store the user ID.

[0054] The authentication information 32f stored in the memory 32 includes at least one piece of authentication data for authenticating whether the user of the smartphone 3 is a legitimate user. Specifically, the authentication information 32f includes at least one of the following authentication data: fingerprint data of a legitimate user (registered fingerprint data), face image data of a legitimate user (registered face data), and voice data of a legitimate user (registered voice data). Each of these registered data is stored in the memory 32. It can be registered (stored) at will.

[0055] (3) Description of Electronic Key 2 The specific configuration of the electronic key 2 will be described with reference to FIG. 4. The electronic key 2 is a lightweight, compact, portable communication terminal that can be easily carried by a user. The electronic key 2 has a first communication and a BT communication as a wireless communication function, similar to the smartphone 3. The electronic key 2 also has wireless communication by a second communication method (hereinafter abbreviated as "second communication") as a wireless communication function. Like the first communication, the second communication is a communication method that allows wireless communication over long distances. The second communication may be, for example, a wireless LAN or another wireless communication method. Furthermore, like a conventional electronic key, the electronic key 2 also has a wireless communication function (hereinafter referred to as "smart communication") that sends back a response signal and a user ID in response to a request signal received from the vehicle 1.

[0056] As shown in FIG. 4, the electronic key 2 includes a control unit 51, a memory 52, a transmission unit 53, a reception unit 54, a first communication unit 55, a BT communication unit 56, a second communication unit 57, an operation input unit 58, a battery 59, a regulator 60, a non-contact power supply / reception unit 61, and a power input jack 62.

[0057] The control unit 51 includes a microcomputer equipped with a CPU, ROM, RAM, I / O, etc. (not shown). The control unit 51 controls various circuits and functional blocks in the electronic key 2, including the various units connected to the control unit 51.

[0058] The memory 52 is a non-volatile memory whose stored contents can be electrically rewritten, and is a flash memory in this embodiment. Various programs and data are stored in the memory 52. ​​The data stored in the memory 52 includes ID information 52a and BT pairing information 52b.

[0059] The ID information 52a includes a user ID unique to the vehicle 1. This user ID is the same as the user ID stored as one of the ID information 32e in the memory 32 of the smartphone 3, and is also stored in the vehicle 1 as described above. The BT pairing information 52b includes information required for connecting the electronic key 2 and another communication device through BT communication, such as unique information (e.g., a link key) generated when pairing for BT communication is performed between the electronic key 2 and another communication device. When pairing is performed and unique information is generated, the generated unique information is associated with user information of the other communication device (i.e., for each other user capable of BT communication) and stored. Therefore, when starting BT communication with another communication device, the electronic key 2 can identify the user of the other communication device by performing authentication based on the unique information of the other communication device.

[0060] The receiver 54 receives a request signal transmitted from the vehicle 1 by radio waves in a predetermined frequency band, demodulates the signal, and outputs the signal to the controller 51. When the controller 51 receives a request signal from the receiver 54, the controller 51 generates response data and outputs the response data to the transmitter 53. The response data includes a predetermined response signal and the user ID stored in the memory 52 as ID information 52a. The transmitter 53 modulates the response data input from the controller 51 into radio waves in a predetermined frequency band and transmits the modulated data to the vehicle 1.

[0061] As shown in Fig. 1B, in this embodiment, detection areas 400, 500 are set in which a request signal can be received. Therefore, when the electronic key 2 is not in any of the detection areas 400, 500, the request signal is not received. On the other hand, when the electronic key 2 is in any of the detection areas 400, 500, the electronic key 2 is able to receive a request signal from the vehicle 1. The request signal from the vehicle 1 is transmitted repeatedly at regular intervals, as will be described later. Therefore, while the electronic key 2 is within either of the detection areas 400, 500, the request signal is periodically received by the electronic key 2. Each time the electronic key 2 receives a request signal, it transmits a response signal in response to that request signal.

[0062] The first communication unit 55 is a wireless communication interface for transmitting and receiving radio waves of the first communication. The BT communication unit 56 is a wireless communication interface for realizing the BT communication. The second communication unit 57 is a wireless communication interface for transmitting and receiving radio waves of the second communication. The operation input unit 58 is an input device capable of accepting an input operation by a user. A specific example of the configuration of the operation input unit 58 is a push button switch. The operation input unit 58 may be provided with a touch panel.

[0063] In this embodiment, the battery 59 is a secondary battery that can be repeatedly charged. The regulator 60 is a power supply circuit for converting the voltage of the battery 59 into a constant voltage of a predetermined voltage value and supplying it to the control unit 51 and other circuits. The non-contact power receiving unit 61 has a configuration similar to that of the non-contact power receiving unit 42 of the smartphone 3, and is a module capable of supplying power to the outside and receiving power from the outside by a non-contact power supply method. The operation of the non-contact power receiving unit 61 is controlled by the control unit 51. The power input jack 62 is a jack into which the plug of an external charging adapter is inserted and removed. Through the power input jack 62, DC power can be input from the outside to charge the battery 59, or conversely, the DC power of the battery 59 can be supplied to the outside.

[0064] Therefore, when the remaining charge of the battery 59 of the electronic key 2 becomes low and the electronic key 2 can no longer operate normally, it is possible to operate the electronic key 2 normally and charge the battery 59 by taking in DC power from the power input jack 62 or by receiving power from the outside via the non-contact power receiving unit 61.

[0065] When it is desired to charge the battery 59 of the electronic key 2 using the smartphone 3, charging is possible by using a charging cable 70, for example, as shown in Fig. 5. The charging cable 70 includes a USB plug 71, a USB side cable 72, a power supply adapter 73, a pin side cable 74, and a power supply plug 75. When the USB plug 71 is connected to the USB receptacle 39 of the smartphone 3 and the power supply plug 75 is inserted into the power input jack 62 of the electronic key 2, DC power from the battery 40 of the smartphone 3 is supplied to the electronic key 2 via the power supply adapter 73.

[0066] Both the smartphone 3 and the electronic key 2 are equipped with a non-contact power supply / reception unit. Therefore, when the non-contact power supply / reception units 42, 61 of the two devices are placed facing each other within a predetermined distance, power can be supplied from one device to the other.

[0067] Therefore, even if the battery 59 of the electronic key 2 runs out of capacity, it is possible to receive power from another device such as a smartphone 3, either contactlessly or via a cable, to charge the battery 59 and to operate the regulator 60 to ensure that each part within the electronic key 2 operates normally.

[0068] The electronic key 2 also has a built-in RF tag 63. A user ID is stored in the RF tag 63. When the smartphone 3 is held over the RF tag 63 to start data communication with the tag reader / writer 47 of the smartphone 3, the RF tag 63 acquires the user ID from the smartphone 3. The RF tag 63 then compares it with its own user ID, and if they match, transmits its own user ID and a request to start an app to the smartphone 3.

[0069] (4) Description of Vehicle 1 A specific configuration of the vehicle 1 will be described with reference to FIG. The vehicle 1 has an internal combustion engine as a driving source for running. As shown in Fig. 6, the vehicle 1 is equipped with a control unit 10. The control unit 10 includes a microcomputer equipped with a CPU, ROM, RAM, I / O, etc. (not shown). The control unit 10 controls various circuits and functional blocks in the vehicle 1, including the various units connected to the control unit 10.

[0070] In this embodiment, the various circuits and functional blocks controlled by the control unit 10 include at least an engine unit 11, a brake unit 12, a steering unit 13, an air conditioner 14, a door 15, a luggage door 16, a window 17, a door mirror 18, a wiper 19, a headlight 20, a turn signal 21, an in-vehicle camera 24, a display unit 26, and a USB I / F 27. Note that in reality, a plurality of doors 15, windows 17, door mirrors 18, wipers 19, headlights 20, and turn signals 21 are provided, as shown in FIG. 1B.

[0071] The engine section 11 includes an engine and an engine control unit that controls the engine. The control section 10 can control the operation of the engine via the engine control unit in the engine section 11. The brake section 12 includes a brake mechanism provided in the vehicle 1 and a brake control unit that controls the brake mechanism. The steering section 13 includes a steering mechanism that steers the wheels of the vehicle 1 and a steering control unit that controls the steering mechanism. The steering system of this embodiment is a so-called steer-by-wire type electric steering system. In other words, the steering wheel operated by the driver and the steering shaft are not directly connected mechanically, and the steering shaft is driven by a motor according to the operation of the steering wheel by the driver. Therefore, the control section 10 can freely move the steered wheels by controlling the steering section 13.

[0072] The control unit 10 executes various functions based on various programs and data stored in the memory 25. The memory 25 is a non-volatile memory whose stored contents can be electrically rewritten, and is a flash memory in this embodiment. The data stored in the memory 25 includes ID information 25a and function restriction information 25b.

[0073] The ID information 25a includes a user ID unique to the vehicle 1. This user ID is the same as the user ID stored in the memory 32 of the smartphone 3 and the memory 52 of the electronic key 2. The function restriction information 25b is information for restricting functions of the vehicle 1 according to the relative positions of the vehicle 1, the smartphone 3, and the electronic key 2. Information on whether or not to restrict functions of the vehicle 1, and if so, how to restrict them, depending on whether the electronic key 2 is located in the vehicle interior detection area 500, the vehicle exterior detection area 400, or outside the detection area of ​​the vehicle 1, and where the smartphone 3 is located (e.g., inside or outside the vehicle 1), is stored as the function restriction information 25b. Some of this function restriction information 25b is stored as default beforehand when the vehicle 1 is shipped, but the user of the vehicle 1 can also customize it.

[0074] By appropriately customizing the function restriction information 25b, it is possible to restrict a specific function, for example, when a child is inside the vehicle 1 with the smartphone 3 while a parent is outside the vehicle 1 with the electronic key 2. It is also possible to restrict a specific function, for example, when the electronic key 2 is within the detection area of ​​the vehicle 1 but the smartphone 3 is located far away from the vehicle 1 (i.e., when the smartphone 3 and the electronic key 2 are far apart).

[0075] The vehicle 1 has a first communication and a second communication as wireless communication functions. The first communication unit 7 is a wireless communication interface for transmitting and receiving radio waves of the first communication, and the second communication unit 8 is a wireless communication interface for transmitting and receiving radio waves of the second communication.

[0076] The GPS receiver 9 receives radio waves from a plurality of GPS satellites and outputs information contained in the received radio waves to the control unit 10. The control unit 10 can detect the current position (e.g., latitude and longitude) of the vehicle 1 based on the information received by the GPS receiver 9.

[0077] The vehicle 1 also has a wireless communication (smart communication) function for periodically transmitting a request signal to the electronic key 2 and receiving a response signal and a user ID from the electronic key 2 in response to the request signal. An exterior transmitter 4, an interior transmitter 5, and a receiver 6 are provided to realize this smart communication.

[0078] The exterior transmitter 4 and the interior transmitter 5 periodically transmit a request signal based on a command from the control unit 10. In reality, a plurality of exterior transmitters 4 and a plurality of interior transmitters 5 are provided. That is, the plurality of interior transmitters 5 form an interior detection area 500 (an area in which a request signal can be received from any of the interior transmitters 5) shown in FIG. 1B. The plurality of exterior transmitters 4 form an exterior detection area 400 (an area in which a request signal can be received from any of the exterior transmitters 4) shown in FIG. 1B.

[0079] The receiver 6 is capable of receiving various signals transmitted from the electronic key 2. The signals that the receiver 6 receives from the electronic key 2 include response signals to request signals transmitted from each of the transmitters 4 and 5. The request signal includes identification information that indicates the transmitter that sent the request signal, and when the electronic key 2 receives a request signal, it transmits a response signal to which the identification information included in the request signal is added. Therefore, when the receiver 6 receives a response signal, the control unit 10 of the vehicle 1 can at least determine whether the electronic key 2 is located inside or outside the vehicle 1, based on the identification information added to the response signal.

[0080] The display unit 26 is a display device (for example, a liquid crystal display) capable of displaying various images and information. The USB I / F 27 is an interface for performing serial communication according to the USB standard. The USB plug 23 is capable of connecting to a USB receptacle.

[0081] When the smartphone 3 is attached to the fixing part 22 of the vehicle 1 (see FIG. 1B), the smartphone 3 is fixed in a state in which the rear of the vehicle 1 can be photographed with the camera 43. That is, the lens of the camera 43 is fixed in a state facing the rear of the vehicle. Furthermore, when the smartphone 3 is attached to the fixing part 22 of the vehicle 1, the USB receptacle 39 of the smartphone 3 and the USB plug 23 of the vehicle 1 (see FIG. 6) are connected, and data communication between the smartphone 3 and the vehicle 1 via USB becomes possible.

[0082] While data communication with the smartphone 3 via USB is possible, the control unit 10 of the vehicle 1 can acquire various information from the smartphone 3. One of the pieces of information that the control unit 10 can acquire from the smartphone 3 is a still image or a video image captured by the camera 43 of the smartphone 3.

[0083] The control unit 10 of the vehicle 1 can obtain photographed data of the camera 43 of the smartphone 3 in real time at a predetermined timing (for example, when the gear is set in reverse) or in response to a user operation, and display the photographed data on the display unit 26. In other words, by fixing the smartphone 3 to the fixing unit 22 of the vehicle 1, the user of the vehicle 1 can display an image of the rear of the vehicle 1 on the display unit 26 as necessary, and check the situation behind the vehicle 1.

[0084] In addition, the control unit 10 of the vehicle 1 has a communication interface for acquiring photographic data from the smartphone 3. The interface is not limited to USB. The photographed data may be acquired using a communication interface other than USB. For example, the photographed data may be acquired from the smartphone 3 through wireless communication such as the first communication.

[0085] The vehicle 1 of this embodiment can achieve the same functions as a conventional electronic key system by smart communication with the electronic key 2. In other words, when a user carrying the electronic key 2 enters each detection area 400, 500 of the vehicle 1, the user can lock / unlock each door 15 and start / stop the engine without touching the key. In this case, however, each door 15 is unlocked by the user touching a touch sensor on the door handle. Each door 15 is locked by the user pressing a door lock switch on the door handle. The engine is started / stopped by the user pressing a push switch provided near the driver's seat.

[0086] In addition to having these basic electronic key system functions, this embodiment also has a remote control function via smartphone 3, which allows the user to remotely operate vehicle 1 by relaying the electronic key 2 from the smartphone 3 without having to directly touch the vehicle 1.

[0087] Below, various processes executed in the smartphone 3, the electronic key 2, and the vehicle 1 to realize this remote control function will be described in order. (5) Description of vehicle operation app on smartphone 3 First, the processing contents of the vehicle operation application 32a installed in the smartphone 3 to realize the remote control function will be described with reference to Fig. 7. When a user performs a predetermined application startup process, the control unit 31 (more specifically, the CPU in the control unit 31) of the smartphone 3 reads the program of the vehicle operation application 32a from the memory 32 and executes it.

[0088] When the control unit 31 of the smartphone 3 starts executing the vehicle operation application 32a, the control unit 31 performs application user authentication in S10. Application user authentication is a process for determining whether or not the user executing the vehicle operation application 32a is a user (authorized user) authorized to execute the application. The application user authentication is performed using at least one of the user's fingerprint, voice, and face image.

[0089] As described above, registered fingerprint data, registered face data, and registered voice data are stored as authentication information 32f in the memory 32 of the smartphone 3. Therefore, for example, application user authentication can be performed by having the user input a fingerprint and determining whether the input fingerprint matches the registered fingerprint data, for example, by taking a face image of the user with the camera 43 and determining whether the face image matches the registered face data, or by having the user speak and determining whether the voice image matches the registered voice data.

[0090] In S12, it is determined whether or not the user executing the vehicle operation application 32a is an authorized user based on the result of the application user authentication in S10. If the user executing the vehicle operation application 32a is not an authorized user (S12: NO), a predetermined user authentication error process is executed in S20, and the process of the vehicle operation application 32a is terminated.

[0091] If the user executing the vehicle operation application 32a is an authorized user (S12: YES), an authentication request signal is transmitted to the electronic key 2 via the first communication in S14. This authentication request signal includes the user ID stored in the smartphone 3. In response to this authentication request signal, the electronic key 2 performs user ID authentication as described below, and determines whether the user ID matches the user ID stored in the electronic key 2. If they match, the electronic key 2 If the two do not match, an operation refusal signal is sent from the electronic key 2.

[0092] In S16, it is determined whether an operation permission signal or an operation refusal signal has been received from the electronic key 2 in response to the authentication request signal transmitted in S14. If an operation refusal signal has been received (S16: NO), the process proceeds to S20, where user authentication error processing is performed. If an operation permission signal has been received (S16: YES), the process proceeds to S18, where vehicle operation processing is performed.

[0093] Details of the vehicle operation process in S18 are as shown in FIG. 8. As shown in FIG. 8, when the process proceeds to the vehicle operation process, the selection of the vehicle operation method by the user is accepted in S22. In this embodiment, the user can specify the operation content to the smartphone 3 using one of three instruction methods. As described with reference to FIG. 3, one of the three instruction methods is a method in which the operation menu screen 48 is displayed on the display unit 33 and an icon of a desired operation item (operation content) is selected from the screen by tapping. The other two of the three instruction methods are the above-mentioned voice or gesture methods. The user can select which method to use to specify the operation content from among tap operation, voice, and gesture.

[0094] In S24, the selection result of the vehicle operation method accepted in S22 is judged, and if a tap operation is selected, the process proceeds to S26, if a gesture is selected, the process proceeds to S32, and if a voice is selected, the process proceeds to S40. In S26, which is reached when a tap operation is selected as the vehicle operation method, an operation menu screen 48 (see FIG. 3) is displayed on the display unit 33. In S28, the selection of any one of the operation items listed on the operation menu screen 48 is accepted. In S30, an operation command corresponding to the operation item selected in S28 is generated. For example, when "slow forward speed" is selected as the operation item, an operation command corresponding to slow forward speed for moving the vehicle 1 forward a small distance is generated. After S30, the process proceeds to S48.

[0095] In S32, which is reached when gesture is selected as the vehicle operation method, the camera 43 is started and capture of a moving image of the user is started. In S34, it is determined whether the user has made a gesture corresponding to a prescribed gesture pattern based on the moving image captured by the camera 43. This determination is made by determining whether the gesture made by the user matches any of the prescribed gestures stored as gesture patterns 32d in the memory 32. Then, when the user makes a gesture that matches a prescribed gesture pattern, the gesture is recognized.

[0096] In S36, the operation content corresponding to the specified gesture pattern recognized in S34 is displayed on the display unit 33. This allows the user to check whether the gesture he or she made has been correctly recognized. In S38, an operation command corresponding to the specified gesture pattern recognized in S34 is generated. For example, if the user makes a gesture indicating "air conditioner on" (a gesture stored as gesture pattern 32d) and it is correctly recognized, an operation command corresponding to air conditioner on is generated to operate the air conditioner of the vehicle 1. After S38, the process proceeds to S48.

[0097] In S40, which is entered when voice is selected as the vehicle operation method, voice input via the microphone 45 is set to a standby state. In other words, a state in which voice input and recognition can be executed is set. In S42, it is determined whether the user has spoken a word corresponding to a specified voice pattern based on the user's voice input to the microphone 45. This determination is made by determining whether the words spoken by the user match any of the words stored as voice patterns 32c in the memory 32. Then, when the user has spoken a word corresponding to the specified voice pattern, the voice pattern is recognized.

[0098] In S44, the operation content corresponding to the specified voice pattern recognized in S42 is displayed on the display unit 33. This allows the user to check whether the words he or she spoke were correctly recognized. In S46, an operation command corresponding to the specified voice pattern recognized in S42 is generated. For example, if the user speaks words indicating "close the door mirrors" (words stored as voice pattern 32c) and these are correctly recognized, an operation command corresponding to closing the door mirrors is generated to close the door mirrors 18 of the vehicle 1. After S46, the process proceeds to S48.

[0099] In S48, the operation command generated in S30, S38, or S46, the user ID, the terminal ID, and location information of the smartphone 3 are transmitted to the electronic key 2 in the first communication. The location information of the smartphone 3 is location information (GPS information) detected based on information received by the GPS receiver 37. Note that, if information indicating the current location of the smartphone 3 can be obtained in addition to the GPS information, that information may be transmitted as the location information.

[0100] In S50, it is determined whether or not an error notification has been received in the first communication from the electronic key 2. Note that error notifications that the smartphone 3 may receive from the electronic key 2 include a first error notification (see S120 in FIG. 10), a second error notification (see S136 in FIG. 10), a third error notification (see S140 in FIG. 10), and a fourth error notification (see S144 in FIG. 10), as will be described later.

[0101] If no error notification has been received from the electronic key 2 (S50: NO), the process proceeds to S54. If any error notification has been received from the electronic key 2 (S50: YES), a predetermined error message is displayed on the display unit 33 in S52, and the process proceeds to S58. The error message displayed in S52 may be a common message, or may be different for each of the four types of error notifications.

[0102] In S54, it is determined whether or not a relay completion signal has been received from the electronic key 2. This relay completion signal is a signal transmitted from the electronic key 2 in S146 of FIG. 10, which will be described later. If a relay completion signal has been received from the electronic key 2 (S54: YES), the process proceeds to S58. If a relay completion signal has not been received from the electronic key 2 (S54: NO), the process causes the display unit 33 to display communication anomaly information in S56.

[0103] If neither an error notification nor a relay completion signal is received from the electronic key 2 in response to the transmission process of S48, it is possible that normal communication is not possible between the smartphone 3 and the electronic key 2. Therefore, the communication abnormality information of S56 is provided to notify the user that normal communication is not possible between the smartphone 3 and the electronic key 2.

[0104] As another example, for example, BT communication may be used to determine whether the smartphone 3 and the electronic key 2 are close to each other (i.e., whether BT communication is possible between them), and if it is determined that they are close to each other and then they are no longer close to each other, the user may be notified of this (i.e., that the smartphone 3 and the electronic key 2 have been separated) by image or sound.

[0105] In S58, it is determined whether or not a predetermined end operation for ending the vehicle operation application 32a has been performed by the user. If the end operation has not been performed (S58: NO), the process returns to S22. If the end operation has been performed (S58: YES), the vehicle operation application 32a is ended.

[0106] (6) Description of electronic key control process in electronic key 2 Next, the electronic key control process executed by the electronic key 2 to realize the remote control function will be described. The electronic key control process will be described with reference to Fig. 9. A program for the electronic key control process is stored in the memory 52 of the electronic key 2. The control unit 51 of the electronic key 2 (more specifically, the electronic key control process shown in Fig. 9) repeatedly executes the electronic key control process at a predetermined control cycle.

[0107] When the control unit 51 of the electronic key 2 starts the electronic key control process, in S102, it determines whether or not a request signal transmitted from the vehicle 1 via smart communication has been received. If a request signal has not been received from the vehicle 1 (S102: NO), the process proceeds to S106. If a request signal has been received from the vehicle 1 (S102: YES), the process executes a response process in S104 and proceeds to S106. The response process in S104 is a process of transmitting a response signal and the user ID to the vehicle 1 via smart communication (i.e., from the transmission unit 53).

[0108] In S106, it is determined whether or not an authentication request signal has been received in the first communication from the smartphone 3. If an authentication request signal has not been received (S106: NO), the process proceeds to S114. If an authentication request signal has been received (S106: YES), in S108, it is determined whether or not the user ID included in the authentication request signal matches the user ID stored in the electronic key 2 (i.e., user ID verification).

[0109] If it is determined that the user IDs do not match as a result of the user ID comparison (S108: NO), the process proceeds to S112. In S112, an operation refusal signal is transmitted to the smartphone 3 via the first communication. After processing of S112, the process proceeds to S114. If it is determined that the user IDs match as a result of the user ID comparison (S108: YES), the process proceeds to S110. In S110, an operation permission signal is transmitted to the smartphone 3 via the first communication. After processing of S110, the process proceeds to S114.

[0110] In S114, it is determined whether or not data has been received from the smartphone 3 through the first communication. Note that the data here refers to the operation command, user ID, terminal ID, and location information of the smartphone 3 transmitted in S48 of Fig. 7. If no data has been received from the smartphone 3 through the first communication (S114: NO), the electronic key control process ends. If data has been received from the smartphone 3 through the first communication (S114: YES), the process proceeds to relay process in S116.

[0111] Details of the relay process in S116 are as shown in Fig. 10. As shown in Fig. 10, when the relay process is started, in S118, it is determined whether the user ID included in the data received from the smartphone 3 matches the user ID stored in the electronic key 2 (i.e., user ID matching). If it is determined that the two user IDs do not match as a result of the user ID matching (S118: NO), in S120, a first error notification is sent to the smartphone 3 via the first communication, and the electronic key control process is terminated. If it is determined that the two user IDs match as a result of the user ID matching (S118: YES), the process proceeds to S122.

[0112] In S122, it is determined whether the operation command in the received data is an electronic key control command. As described above, an electronic key control command is an operation command transmitted when the "electronic key control" icon is selected on the operation menu screen 48 (see FIG. 3). If the operation command is not an electronic key control command (S122: NO), the process proceeds to S126. If the operation command is an electronic key control command (S122: YES), the process executes command response processing in S124.

[0113] The specific content of the command response process can be determined as appropriate. For example, some of the functions of the electronic key 2 (e.g., the response process to a request signal from the vehicle 1) can be stopped, or all of the functions of the electronic key 2 can be stopped. In addition, for example, the electronic key 2 can transmit its operating status. Specifically, the electronic key 2 can transmit the remaining charge of the battery 59 of the electronic key 2 (hereinafter also referred to as "battery charge") or information on whether the electronic key 2 is within the detection area of ​​the vehicle 1.

[0114] In S126, an operation command is generated corresponding to the operation command included in the data received from the smartphone 3. For example, when an operation command instructing to close the door mirrors is received, an operation command instructing to close the door mirrors is generated.

[0115] In S128, a determination is made as to whether or not the electronic key 2 is present within the detection area of ​​the vehicle 1. Specifically, based on whether or not the receiver 54 receives a request signal from the vehicle 1, if the request signal has not been received it is determined that the electronic key 2 is present outside the detection area, and if the request signal has been received it is determined that the electronic key 2 is present within the detection area.

[0116] If the electronic key 2 is present within the detection area of ​​the vehicle 1 (S128: YES), the process proceeds to S130. In S130, the operation command generated in S126 and the user ID, terminal ID, and location information of the smartphone 3 contained in the data received from the smartphone 3 are transmitted to the vehicle 1 via smart communication. After transmission, the process proceeds to S138.

[0117] If the electronic key 2 is not present within the detection area of ​​the vehicle 1 (S128: NO), in S132, it is determined whether remote operation of the vehicle 1 by the smartphone 3 is permitted. Whether remote operation is permitted is determined based on remote operation permission information stored in the memory 52 of the electronic key 2. The user of the vehicle 1 can freely decide whether to permit remote operation. For example, a user who does not wish to (or does not use) remote operation can have the dealer store remote operation permission information indicating that remote operation is not permitted in the electronic key 2 when purchasing the vehicle 1. However, the remote operation permission information stored in the electronic key 2 can be freely changed by the smartphone 3 having the same user ID as the user ID stored in the electronic key 2.

[0118] The remote operation capability information does not necessarily have to be held by the electronic key 2, and may be held by the smartphone 3 and transmitted from the smartphone 3. In addition, when the smartphone 3 holds the remote operation capability information, if the remote operation capability information indicates that remote operation is not permitted, the smartphone 3 may not transmit an operation command.

[0119] If remote operation is not permitted in S132 (S132: NO), a second error notification is sent to the smartphone 3 via the first communication in S136, and the electronic key control process ends. If remote operation is permitted in S132 (S132: YES), the operation command generated in S126 and the user ID, terminal ID, and location information of the smartphone 3 contained in the data received from the smartphone 3 are sent to the vehicle 1 via the second communication in S134. After this transmission, the process proceeds to S138.

[0120] In S138, it is determined whether or not an ID mismatch notification has been received from vehicle 1. The ID mismatch notification is transmitted from vehicle 1 via smart communication or second communication when the user ID transmitted to vehicle 1 in S130 or S134 does not match the user ID of vehicle 1.

[0121] If an ID mismatch notification is received from the vehicle 1 in S138 (S138: YES), then in S140, a third error notification is sent to the smartphone 3 via the first communication, and the electronic key control process ends. If an ID mismatch notification is not received from the vehicle 1 in S138 (S138: NO), then proceed to S142.

[0122] In S142, it is determined whether or not a non-permission notification has been received from the vehicle 1. The non-permission notification is transmitted from the vehicle 1 via smart communication or second communication when it is determined that the function of the operation item corresponding to the operation command transmitted to the vehicle 1 in S130 or S134 cannot be executed in the vehicle 1. It will be done.

[0123] If a non-permission notification is received from the vehicle 1 in S142 (S142: YES), a fourth error notification is sent to the smartphone 3 via the first communication in S144, and the electronic key control process ends. If a non-permission notification is not received from the vehicle 1 in S142 (S142: NO), a relay completion signal is sent to the smartphone 3 via the first communication in S146.

[0124] (7) Description of remote control process in vehicle 1 Next, the remote control processing executed in the vehicle 1 to realize the remote control function will be described with reference to Fig. 11. The program for the remote control processing is stored in the memory 25 of the vehicle 1. After being started, the control unit 10 of the vehicle 1 (more specifically, the CPU in the control unit 10) reads the program for the remote control processing shown in Fig. 11 from the memory 25 and executes it repeatedly at a fixed control period.

[0125] When the control unit 10 of the vehicle 1 starts the remote control process, in S152, the control unit 10 transmits a request signal from each of the transmitters 4 and 5 via smart communication. As described above, the detection areas 400 and 500 are formed by transmitting this request signal. In S154, it is determined whether or not data has been received from the electronic key 2. Note that the data referred to here means the operation command, user ID, terminal ID, and location information of the smartphone 3 transmitted in S130 or S134 of FIG. 9, or the response signal and user ID transmitted via smart communication in response to the request signal. If no data has been received from the electronic key 2 via smart communication or second communication (S154: NO), the control unit 10 ends the remote control process. If data has been received from the electronic key 2 via smart communication or second communication (S154: YES), the control unit 10 proceeds to S156.

[0126] In S156, it is determined whether the user ID included in the data received from the electronic key 2 matches the user ID stored in the memory 25 of the vehicle 1 (user ID verification). If it is determined that the two user IDs do not match as a result of the user ID verification (S156: NO), in S158, an ID mismatch notification is sent to the electronic key 2, and the remote control process is terminated. In S158, if the user ID of the electronic key 2 determined to be a mismatch in S156 was received via smart communication, an ID mismatch notification is sent via smart communication. Also, in S158, if the user ID of the electronic key 2 determined to be a mismatch in S156 was received via second communication, an ID mismatch notification is sent via second communication.

[0127] If it is determined in S156 that the two user IDs match (S156: YES), the process proceeds to S160. In S160, it is determined whether the data (information) received from the electronic key 2 is an operation command or a response signal to a request signal.

[0128] If the information received from the electronic key 2 includes a response signal to the request signal, a predetermined electronic key corresponding process is executed in S162, and the remote control process is terminated. The electronic key corresponding process in S162 is a basic process performed in conventional electronic key systems, such as unlocking each door 15 when the user touches a touch sensor on the door handle.

[0129] If an operation command is included in the information received from the electronic key 2 at S160, then at S164 the operation item to be executed is identified based on the received operation command. At S166, a function restriction check process is executed. Details of the function restriction check process at S166 are shown in FIG.

[0130] As shown in FIG. 12, when the function restriction confirmation process is started, in S202, the data from the electronic key 2 (the received data that is the basis for the positive determination in S154 in FIG. 11) is transmitted via smart communication. It is determined whether the electronic key 2 was received via smart communication. If the electronic key 2 was not received via smart communication (i.e., if the electronic key 2 was received via the second communication) (S202: N0), the process proceeds to S206. If the electronic key 2 was not received via smart communication, this means that the electronic key 2 is outside the detection areas 400, 500 of the vehicle 1.

[0131] If the data from the electronic key 2 has been received via smart communication (S202: YES), the location of the electronic key 2 (whether it is inside or outside the vehicle 1) is confirmed in S204. This confirmation can be made based on the above-mentioned identification signal added to the response signal.

[0132] In S206, the location information of the smartphone 3 is acquired. The location information of the smartphone 3 is received from the electronic key 2 together with the operation command, and therefore can be acquired from the received data. In S208, vehicle location information (location information of the vehicle 1 itself) is acquired. Specifically, this is detected based on information received by the GPS receiver 9.

[0133] In S210, the terminal ID of the smartphone 3 is obtained. In S212, the presence or absence of restriction on the function of the operation item specified by the operation command (i.e., the operation content requested from the smartphone 3) is determined based on the vehicle position based on the vehicle position information acquired in S208, the position of the smartphone 3 based on the position information acquired in S206, the terminal ID acquired in S210, and the position of the electronic key 2 determined in the processes of S202 to S204. In other words, it is determined whether the function of the specified operation item is executable, restricted (prohibited), or partially restricted, based on the relative positions of the vehicle 1, the smartphone 3, and the electronic key 2. This determination can be made based on the function restriction information 25b stored in the memory 25. After the process of S212, the process proceeds to S168 (FIG. 11).

[0134] In addition to the positional relationship between the three parties, it may be determined whether the function of the specified operation item is executable, restricted (prohibited), or partially restricted based on the terminal ID. For example, a certain function may be executed only when specified from a smartphone 3 owned by a certain user, and may not be executed when specified from another smartphone 3. What kind of restriction is to be applied to which terminal ID (or whether there is no restriction) may also be stored in advance in the memory 25 as function restriction information 25b.

[0135] In S168, it is determined whether or not execution of the function of the specified operation item is permitted based on the result of the function restriction confirmation process in S166. If execution of the function of the specified operation item is permitted (S168: YES), the function of the specified operation item is executed in S170. Note that if the function is permitted but part of it is restricted, the function is executed within the restricted range.

[0136] At S170, if the specified operation item is a request to acquire information about the vehicle 1, the requested information is transmitted to the smartphone 3 through the first communication. As shown in Fig. 3, in this embodiment, the smartphone 3 can request various information about the vehicle 1, such as the mileage, maintenance information, diagnostic information, interior temperature, and interior image information, from the vehicle 1 via the electronic key 2. In response to a request from the smartphone 3, the vehicle 1 transmits various pieces of information about the vehicle 1 to the smartphone 3 through the first communication.

[0137] If execution of the function of the specified operation item is not permitted, that is, if execution of the function is restricted (prohibited) (S168: NO), the process proceeds to S172. In S172, a non-permission notice is sent to the electronic key 2, and the remote control process ends. In S172, If the operation command was received via smart communication, a non-permission notification is transmitted via smart communication, and if the operation command was received via second communication, a non-permission notification is transmitted via second communication.

[0138] Here, a supplementary explanation is given regarding a method for starting the vehicle operation application 32a on the smartphone 3. The vehicle operation application 32a on the smartphone 3 can be started by the user performing a predetermined start-up operation on the smartphone 3, or by holding the smartphone 3 over the electronic key 2.

[0139] That is, the tag-compatible program is stored in the smartphone 3 as a part of the vehicle operation application 32a or as a separate program that operates in cooperation with the vehicle operation application 32a. The control unit 31 of the smartphone 3 repeatedly executes the tag-compatible program at a predetermined period.

[0140] The tag correspondence process executed by the tag correspondence program is shown in Fig. 13. When the control unit 31 of the smartphone 3 starts the tag correspondence process of Fig. 13, the control unit 31 determines in S252 whether or not the RF tag 63 of the electronic key 2 has been detected. That is, the control unit 31 determines whether or not a user ID and an application startup request have been received from the RF tag 63 of the electronic key 2 by the tag reader / writer 47. As described above, when data communication between the tag reader / writer 47 and the electronic key 2 is started and a user ID match is found in the electronic key 2, the user ID of the electronic key 2 and an application startup request are transmitted from the RF tag 63 of the electronic key 2. The detection of the RF tag 63 in the process of S252 means, in other words, the reception of the user ID and an application startup request transmitted from the RF tag 63 of the electronic key 2.

[0141] If the RF tag 63 of the electronic key 2 is not detected (S252: NO), that is, if the tag reader / writer 47 has not received the user ID and application startup request from the RF tag 63, the process proceeds to S256.

[0142] If the RF tag 63 of the electronic key 2 is detected (S252: YES), that is, if the tag reader / writer 47 receives the user ID and the application startup request from the RF tag 63, then in S254, user ID verification is performed. Specifically, user ID verification is performed to determine whether the received user ID matches the user ID stored in the smartphone 3 itself.

[0143] In S256, the result of the user ID matching in S254 is determined. If it is determined that the user IDs match as a result of the user ID matching (S256: YES), the application startup process is executed in S258. Specifically, the vehicle operation application 32a is substantially started. "Substantially started" means that the process from S10 shown in FIG. 7 is started. As a result, from the user's perspective, the vehicle operation application 32a has been automatically started simply by holding the smartphone 3 over the electronic key 2. If it is determined that the user IDs do not match as a result of the user ID matching (S256: NO), the tag correspondence process is terminated.

[0144] (8) Effects of the First Embodiment According to the vehicle control system of the first embodiment described above, the following effects can be obtained. (a) A user can control a vehicle 1 by operating a smartphone 3 via an electronic key 2 .

[0145] (b) Specifically, as described with reference to FIG. 3, the smartphone 3 can be used to cause the vehicle 1 to perform various operations and obtain various information from the vehicle 1. (c) The user can input operation items for the vehicle 1 to the smartphone 3 in various ways. Specifically, the user can input the operation items for the vehicle 1 to the smartphone 3 by displaying the operation menu screen 48 on the display unit 33 and selecting the operation items from the menu screen 48. An operation item can be specified by tapping from the touch panel 41. A desired operation item can also be specified by making a gesture corresponding to the desired operation item in front of the camera 43. A desired operation item can also be specified by speaking a word corresponding to the desired operation item into the microphone 45.

[0146] Therefore, the user can move the vehicle 1 or operate each part of the vehicle 1 while speaking to the smartphone 3. In addition, the user can move the vehicle 1 or operate each part of the vehicle 1 while making gestures toward the camera 43 of the smartphone 3.

[0147] (d) A user can check the operation of each part of the vehicle 1 without getting into the vehicle 1. For example, the user can easily check from outside the vehicle 1 whether the headlights 20 are turned on normally. Also, for example, if the user wants to move the position of the vehicle 1 after getting off the vehicle 1, the user can move the vehicle 1 without getting back into the vehicle 1. For example, if the user wants to back up the vehicle 1 a little more (several tens of centimeters), the user can control the vehicle 1 to move backward (back up at a slow speed) while watching the vehicle 1 from outside the vehicle 1. Also, for example, the user can obtain the temperature inside the vehicle 1 from a location away from the vehicle 1, and if the temperature inside the vehicle is high, the window 17 can be opened or the air conditioner 14 can be operated.

[0148] (e) When remotely controlling the vehicle 1 from the smartphone 3, user authentication is performed based on a fingerprint, voice, or face image, and only authorized users can remotely control the vehicle 1 (S10 to S12 in FIG. 7). This makes it possible to prevent unauthorized remote control.

[0149] (f) When the electronic key 2 receives an operation command from the smartphone 3 and the user ID received together with the operation command does not match the user ID of the electronic key 2, the electronic key 2 does not send the operation command to the vehicle 1 and notifies the smartphone 3 of an error. Furthermore, when the vehicle 1 receives an operation command from the electronic key 2, it checks the user ID received together with the operation command against the user ID of the vehicle 1. In other words, the vehicle 1 can be remotely operated from the smartphone 3 only if the user IDs of the smartphone 3, electronic key 2, and vehicle 1 all match. This improves the security of remote control by the smartphone 3.

[0150] (g) Depending on the positions of the vehicle 1, the electronic key 2, and the smartphone 3, the function of the operation requested by the smartphone 3 is prohibited or restricted. How to handle the operation (permit, restrict, or prohibit) in different cases depending on the relative positions of the three, and what to specifically restrict if there is a restriction, can be set in advance for each operation item as desired. This can further improve security performance.

[0151] (h) The electronic key 2 is equipped with various communication methods, such as first communication, second communication, and BT communication, in addition to the smart communication provided in conventional electronic key systems, as a wireless communication method. Therefore, even if the electronic key 2 is outside each detection area 400, 500 of the vehicle 1, it can communicate with the vehicle 1 via the second communication. In other words, even if a user with the electronic key 2 and the smartphone 3 is outside each detection area 400, 500 of the vehicle 1, he or she can remotely control the vehicle 1 from outside the detection area.

[0152] (j) When the battery 59 of the electronic key 2 runs out, the electronic key 2 can receive power from the smartphone 3 in a non-contact manner to charge the battery 59 and operate the electronic key 2. The electronic key 2 also includes a power input jack 62, and can receive power from this power input jack 62 (see FIG. 5). As described above, even if the battery 59 runs out, the electronic key 2 can be operated by receiving power from an external source through various means. Therefore, unlike conventional electronic keys, the electronic key 2 of this embodiment does not include a mechanical key. However, the electronic key 2 may include a built-in mechanical key.

[0153] The smartphone 3 corresponds to an example of a communication terminal of the present invention. The processes selectable on the operation menu screen 48 illustrated in FIG. 3, i.e., the processes that can be requested to the vehicle 1 by relaying the electronic key 2, correspond to an example of a specific process of the present invention. The touch panel 34, the camera 43, and the microphone 45 of the smartphone 3 correspond to an example of a designated input unit of the present invention. The first communication unit 35 of the smartphone 3 corresponds to an example of a command transmission unit of the present invention. The memory 32 of the smartphone 3 corresponds to an example of a terminal side storage unit of the present invention, and the user ID stored in the memory 32 corresponds to an example of terminal side specific information of the present invention. The operation command transmitted from the smartphone 3 to the electronic key 2 corresponds to an example of a processing command of the present invention, and the operation command transmitted from the electronic key 2 to the vehicle 1 corresponds to an example of a processing command of the present invention. In FIG. 8, the processes of S28, S34, and S42 correspond to an example of a designated input unit of the present invention, and the process of S48 corresponds to an example of a command transmission unit of the present invention.

[0154] 10, the process of S118 corresponds to an example of the process of a unique information determination unit of the present invention, and the processes of S130 and S134 correspond to an example of the process of a command transmission unit of the present invention.

[0155] In the present embodiment, the touch panel 34, the camera 43, and the microphone 45 are illustrated as examples of the designation input unit of the present invention, but these are merely examples. As long as the user can designate to the smartphone 3 the process to be executed by the vehicle 1 (and thus the smartphone 3 can transmit an operation command indicating the input process to the electronic key 2), the specific method and input interface to be used for designation can be appropriately determined.

[0156] [Second embodiment] The vehicle control system of the second embodiment will be described with reference to Figures 14 and 15. The vehicle control system of the second embodiment is a system that can directly control the vehicle 1 (Figure 6) from an electronic key.

[0157] That is, in the second embodiment, no communication device other than the electronic key is required to remotely control the vehicle 1. On the other hand, in the second embodiment, the configuration of the electronic key is different from that of the electronic key 2 in the first embodiment, in order to remotely control the vehicle 1 from the electronic key.

[0158] The configuration of the electronic key 2 of the second embodiment will be described with reference to Fig. 14. As shown in Fig. 14, the electronic key 80 of the second embodiment includes a control unit 81, a memory 82, a microphone 83, a voice processing unit 84, a display unit 85, an operation input unit 86, a transmission unit 53, a reception unit 54, a battery 59, a regulator 60, a non-contact power receiving unit 61, and a power input jack 62. Of these, the transmission unit 53, the reception unit 54, the battery 59, the regulator 60, the non-contact power receiving unit 61, and the power input jack 62 are the same as those of the electronic key 2 of the first embodiment, and therefore description thereof will be omitted.

[0159] The microphone 83 and the audio processing unit 84 are mounted on the smartphone 3 in the first embodiment, but are mounted on the electronic key 80 in the second embodiment. The microphone 83 converts external sound into an electrical signal. The audio processing unit 84 processes the audio signal, which is collected by the microphone 83 and converted into an electrical signal, into digital audio data and outputs it to the control unit 81. The control unit 8 1 can recognize the content of the voice collected by the microphone 83 based on the voice data input from the voice processing unit 84.

[0160] The display unit 85 is a display device (e.g., a liquid crystal display) capable of displaying various images and information. The operation input unit 86 is an input device capable of receiving input operations by a user. A specific example of the operation input unit 86 is a push button switch. The operation input unit 86 may be equipped with a touch panel.

[0161] The control unit 81 includes a microcomputer equipped with a CPU, ROM, RAM, I / O, etc. (not shown). The control unit 81 controls various circuits and functional blocks in the electronic key 80, including the various units connected to the control unit 81. The electronic key control process (see FIG. 15), which will be described later, is executed by the CPU of the control unit 81.

[0162] The memory 82 is a non-volatile memory whose stored contents can be electrically rewritten, and is a flash memory in this embodiment. Various programs and data are stored in the memory 82. The data stored in the memory 82 includes vehicle operation menu data 82a, voice patterns 82b, and ID information 82c.

[0163] The ID information 82c is the same as the ID information 52a in the electronic key 2 of the first embodiment. The vehicle operation menu data 82a is the same as the vehicle operation menu data 32b in the smartphone 3 of the first embodiment. Therefore, in the second embodiment, icons for each operation item are displayed on the display unit 85 of the electronic key 80 in the same manner as the operation menu screen 48 described in FIG. 3, and the user can select a desired operation item from among them. The voice pattern 82b is the same as the voice pattern 32c in the smartphone 3 of the first embodiment.

[0164] The display unit 85 of the electronic key 80 of this embodiment has a display area smaller than that of the display unit 33 of the smartphone 3 of the first embodiment. Therefore, the number of icons that can be simultaneously displayed on the display unit 85 is smaller than the number of icons on the operation menu screen 48 shown in FIG. 3. Furthermore, the information displayed on the display unit 85 (image information for each operation item for selecting an operation item) does not necessarily have to be an icon, and may be, for example, text indicating the operation item. As long as the user can select a desired operation item, it is possible to appropriately determine what image information is displayed on the display unit 85.

[0165] As described above, the electronic key 80 of the second embodiment is capable of wireless communication (i.e., smart communication) with the vehicle 1 via the transmitter 53 and receiver 54, but is not equipped with any other wireless communication functions. Therefore, in the second embodiment, the vehicle 1 can be remotely operated from the electronic key 80 only when the electronic key 80 and vehicle 1 can communicate data via smart communication, i.e., when the electronic key 80 is present within each of the detection areas 400, 500 of the vehicle 1.

[0166] The electronic key control process executed by the control unit 81 in the electronic key 80 configured as above will be described with reference to Fig. 15. The control unit 81 of the electronic key 80 repeatedly executes the electronic key control process shown in Fig. 15 at a predetermined control period.

[0167] When the control unit 81 of the electronic key 80 starts the electronic key control process, the control unit 81 determines in S302 whether or not a request signal has been received from the vehicle 1. If a request signal has not been received (S302: NO), the electronic key control process ends.

[0168] If a request signal is received from the vehicle 1 (S302: YES), in S304, a vehicle operation standby display is made on the display unit 85. That is, a display is made to indicate that the vehicle 1 can be controlled from the electronic key 80. In S306, it is determined whether or not a voice input request operation has been made by the user. When remotely operating the vehicle 1 using the electronic key 80, the user can select whether to specify (select) the operation content by operating the operation input unit 86 or by voice. If the user wants to specify the operation content by voice, the user can specify the operation content by voice by performing a predetermined voice input request operation via the operation input unit 86.

[0169] In S306, if a voice input request operation has not been performed (S306: NO), the process proceeds to S308. In S308, an operation menu list is displayed on the display unit 85. The operation menu list is a list of information images (e.g., icons or text) indicating operation items.

[0170] In S310, it is determined whether or not a specific operation item has been selected from among the operation items listed in S308. If no operation item has been selected (S310: NO), the process returns to S306. If an operation item has been selected (S310: YES), the process proceeds to S312. In S312, an operation command corresponding to the selected operation item is generated, and the process proceeds to S314.

[0171] If an operation requesting voice input has been performed in S306 (S306: YES), the process proceeds to S316. In S316, voice input via the microphone 83 is set to a standby state. In other words, a state is established in which voice input and recognition can be executed. In S318, it is determined whether or not voice has been input from the microphone 83. If no voice has been input (S318: NO), it is determined in S320 whether or not a fixed time has elapsed since the voice input was set to the standby state in S316. If the fixed time has not elapsed, the process returns to S318, and if the fixed time has elapsed, the process returns to S302.

[0172] If voice is input in S318 (S318: YES), in S322, it is determined whether the user has spoken words corresponding to a specified voice pattern based on the user's voice input to the microphone 83. This determination is made by determining whether the words spoken by the user match any of the words stored as voice patterns 82b in the memory 82. Then, if the user has spoken words corresponding to the specified voice pattern, the voice pattern is recognized.

[0173] In S324, the operation content corresponding to the specified voice pattern recognized in S322 is displayed on the display unit 85. In S326, an operation command corresponding to the specified voice pattern recognized in S322 is generated. After S326, the process proceeds to S314. In S314, the operation command generated in S312 or S326 and the user ID are transmitted to the vehicle 1 via smart communication.

[0174] Meanwhile, in the vehicle 1, the remote control process shown in FIG. 11 is also executed in the second embodiment. Therefore, when the vehicle 1 receives the operation command and user ID transmitted from the electronic key 80, the vehicle 1 executes the process according to the remote control process shown in FIG. 11, and executes the operation content specified in the operation command. However, similar to the first embodiment, if the user ID does not match, the specified operation is not executed. Also, similar to the first embodiment, if the specified operation is prohibited or restricted in the function restriction confirmation process (S166 in FIG. 11), the specified operation is not executed or is executed within a limited range. Note that, in the function restriction confirmation process in the second embodiment, the function of the operation content requested by the electronic key 80 is prohibited or restricted depending on the positional relationship between the electronic key 80 and the vehicle 1.

[0175] According to the vehicle control system of the second embodiment described above, the following effects can be obtained. (a) By operating the electronic key 80, the user can remotely control the vehicle 1 from the electronic key 80. This allows the user to control each part of the vehicle 1 without getting into the vehicle 1. You can check the operation.

[0176] (b) The user can input operation items for the vehicle 1 into the electronic key 80 in a variety of ways. Specifically, an operation menu list can be displayed on the display unit 85 and an operation item can be selected from the list. A desired operation item can also be specified by speaking a word corresponding to the desired operation item into the microphone 83. This allows the user to move the vehicle 1 and operate various parts of the vehicle 1 while speaking to the electronic key 80. Note that a camera may be mounted on the electronic key 80 so that operation items can be specified by gestures, as in the first embodiment.

[0177] [Other embodiments] (1) In the first embodiment, a vehicle control system is shown in which the vehicle 1 can be operated from the smartphone 3 via the electronic key 2. However, the vehicle 1 may be operated directly from the smartphone 3 without being relayed through the electronic key 2.

[0178] Specifically, in the flowchart of the vehicle operation application 32a of the smartphone 3 shown in Fig. 7, an authentication request signal may be transmitted to the vehicle 1 instead of the electronic key 2 in S14, and a determination may be made as to whether or not an operation permission signal has been received from the vehicle 1 in S16. If it is determined in S16 that an operation permission signal has been received from the vehicle 1, the smartphone 3 may execute the processing from S304 onwards in Fig. 15. In this case, in S314, an operation command and a user ID may be transmitted to the vehicle 1 by, for example, the first communication or another communication method rather than smart communication.

[0179] When the vehicle 1 receives the operation command and the user ID transmitted from the smartphone 3, the vehicle 1 may first perform user authentication based on the user ID. If the operation command is determined to be from a legitimate user as a result of the user authentication, the vehicle 1 may execute the operation item indicated by the operation command. If the user authentication fails, the vehicle 1 may transmit an operation rejection signal to the smartphone 3 to notify the smartphone 3 that remote operation from the smartphone 3 cannot be accepted.

[0180] As an example of a configuration that allows the vehicle 1 to be operated directly from a smartphone without relaying the electronic key, for example, a configuration in which the smartphone has some or all of the configuration and functions of the electronic key 80 of the second embodiment shown in Figure 14 may be adopted.

[0181] (2) In the second embodiment, the electronic key 80 has only the smart communication function as a wireless communication function of a conventional electronic key, but may have a configuration capable of wireless communication of a method other than smart communication. For example, in addition to smart communication, the electronic key 80 may have at least one communication function selected from the first communication, second communication, or BT communication described in the first embodiment, or wireless communication of another communication method.

[0182] Furthermore, by providing a wireless communication function using a communication method other than smart communication, it may be possible to remotely operate the vehicle 1 from the electronic key 80 even if the electronic key 80 is outside the detection area of ​​the vehicle 1.

[0183] (3) In the second embodiment, when the vehicle 1 is remotely controlled from the electronic key 80, authentication of the user may be performed based on a fingerprint, voice, or face image, similar to the smartphone 3 in the first embodiment.

[0184] (4) The vehicle operation menu data 32b, i.e., the vehicle 1 can be remotely controlled as shown in FIG. 3, but the vehicle operation menu data 32b includes only a few examples. The contents of the items can be determined appropriately.

[0185] (5) It is possible to determine as appropriate which wireless communication method can be implemented by each of the smartphone 3, the electronic key 2, and the vehicle 1. It is also possible to determine as appropriate which communication method should be used for two-way communication between the smartphone 3 and the electronic key 2, and for two-way communication between the electronic key 2 and the vehicle 1.

[0186] (6) In the first embodiment, the vehicle 1 may be configured to recognize the user of the smartphone 3 by using pairing information in BT communication between the electronic key 2 and the smartphone 3. That is, when the electronic key 2 receives an operation command from the smartphone 3, the electronic key 2 attempts BT communication with the smartphone 3, and if BT communication is possible, obtains user information of the smartphone 3 based on the pairing information between the two. Then, when transmitting an operation command to the vehicle 1, the electronic key 2 also transmits the obtained user information.

[0187] This allows the vehicle 1 to recognize which user has made a remote operation request, and to execute different controls for each user. For example, it is possible to impose function restrictions depending on the user, or conversely, to expand functions depending on the user. In addition, even for the same function, the details can be different for each user.

[0188] (7) A vehicle may be equipped with a camera or a microphone so that a user can give instructions for operating the vehicle from outside the vehicle by making gestures toward the vehicle-mounted camera or speaking into the vehicle-mounted microphone.

[0189] In this case, the user may first operate the smartphone 3 to transmit remote operation start information, indicating that the vehicle will be remotely operated from outside the vehicle, to the vehicle 1 directly or via the electronic key 2, and when the vehicle 1 receives the remote operation start information, it may activate the on-board camera or microphone to accept remote operation. Alternatively, the remote operation start information may be transmitted from the electronic key 2 to the vehicle 1 by operating the electronic key 2 without using the smartphone 3.

[0190] The electronic key 2 may be configured to transmit remote operation start information to the vehicle 1 only when wireless communication with the vehicle 1 is possible via smart communication, or may transmit the remote operation start information to the vehicle 1 via a second communication method when smart communication with the vehicle 1 is not possible.

[0191] The vehicle 1 may register gestures and voices corresponding to acceptable operation items in memory in advance, and if a gesture or voice input via an on-board camera or on-board microphone is one stored in memory, the vehicle 1 may execute processing corresponding to the gesture or voice.

[0192] With this configuration, when the user of the vehicle 1 finishes driving the vehicle 1 and gets out of the vehicle 1, for example, wants to move the vehicle 1 a little further back (or forward), the user can move the vehicle 1 without getting back in the vehicle 1 by making a gesture or uttering a voice indicating "slow reverse" (or "slow forward") to the vehicle 1. Moreover, by being able to remotely control the vehicle from outside the vehicle, the user can move the vehicle 1 appropriately while checking the relative positional relationship between the vehicle 1 and its surroundings.

[0193] Furthermore, a function for detecting the relative positional relationship between the electronic key 2 and the vehicle 1 in real time may be provided so that the vehicle 1 can move following the electronic key 2. For example, if the electronic key 2 is placed in front of the vehicle 1 and a command is issued to move the vehicle 1 forward at a slow speed, the vehicle 1 will automatically start moving towards the electronic key 2. Then, when the distance between the vehicle 1 and the electronic key 2 is within a predetermined distance, The vehicle will automatically stop. When the user then removes the electronic key 2 from the vehicle 1, the vehicle 1 will start moving again toward the electronic key 2. The same applies when moving in reverse.

[0194] In this configuration, authentication may also be performed between the electronic key 2 and the vehicle 1, and if the authentication is successful, the vehicle 1 may be remotely operated. Alternatively, authentication may be performed among the smartphone 3, the electronic key 2, and the vehicle 1, and if the authentication is successful, the vehicle 1 may be remotely operated.

[0195] (8) While the user is driving the vehicle 1, various information during the driving may be collected as learning information, and when the user gets off the vehicle, the learning information may be transferred to the user's smartphone 3. Then, when the user gets back into the vehicle 1 or gets into a vehicle 1 other than the vehicle 1, the learning information stored in the smartphone 3 may be transmitted to the vehicle in which the user got in, so that the learning information is reflected.

[0196] Examples of the learned information include the seat position and steering position adjusted by the user, the angle of the rearview mirror, the angle of the door mirrors, and the operation details of the audio device.

[0197] This function is useful, for example, when applied to a so-called car sharing service in which one vehicle is shared by many users. The user can import various information obtained while driving into the smartphone 3 as learning information, and when driving again, can automatically and quickly realize settings that suit the user's preferences by deploying the learning information to the vehicle. In other words, even though the vehicle is shared with other users, the user can feel and handle the vehicle as if it were the vehicle that he or she is using only.

[0198] (9) When the smartphone 3 and the vehicle 1 are capable of direct communication, the vehicle 1 may transmit information to the smartphone 3 as appropriate. For example, when the electronic key 2 leaves the detection areas 400, 500 of the vehicle 1, if the doors of the vehicle 1 are open, all doors are unlocked, a specific electrical component (e.g., headlights, interior lights, etc.) is operating, or abnormal behavior is detected, the smartphone 3 may be notified of the fact. Also, for example, when the vehicle 1 is a vehicle equipped with a motor as a driving source for driving the vehicle and the battery for driving the motor can be charged externally, the smartphone 3 may be notified of the fact when charging is completed.

[0199] A more specific example of information transmission from the vehicle 1 to the smartphone 3 will be described with reference to Fig. 16 and Fig. 17. The examples shown in Fig. 16 and Fig. 17 are examples in which the position information of the vehicle 1 can be notified to the smartphone 3, and when an abnormality is detected in the vehicle 1, the smartphone 3 can be notified of that fact.

[0200] The control unit 10 of the vehicle 1 repeatedly executes the vehicle information notification process of Fig. 16 at a predetermined cycle. Moreover, the control unit 31 of the smartphone 3 repeatedly executes the vehicle information display process of Fig. 17 at a predetermined cycle.

[0201] First, a description will be given of the vehicle information notification process in Fig. 16. Note that, as a premise, similar to each of the above-mentioned embodiments, each of the transmitters 4 and 5 of the vehicle 1 periodically transmits a request signal by smart communication.

[0202] When the control unit 10 of the vehicle 1 starts the vehicle information notification process of FIG. 16, the control unit 10 determines in S404 whether or not a response signal to the request signal has been received from the electronic key 2. If a response signal has not been received (S404: NO), the process proceeds to S416. If a response signal has been received (S416: NO), the process proceeds to S417. 404:YES), proceed to S406.

[0203] In S406, it is determined whether the door has been opened or closed by operating the electronic key 2 or by an operation command from the smartphone 3 via the electronic key 2. If the door has not been opened or closed (S406: NO), the process returns to S404. If the door has been opened or closed (S406: YES), the process proceeds to S408.

[0204] In S408, similar to S404, it is determined whether a response signal to the request signal has been received from the electronic key 2. This determination is repeated while a response signal is being received. If a response signal is no longer being received (S408: NO), the process proceeds to S410.

[0205] In S410, it is determined whether the doors are fully closed, i.e., whether all the doors 15 are fully locked. If the doors are not fully locked (S410: NO), the process proceeds to S416. If the doors are fully locked (S410: YES), the process proceeds to S412. If it is determined in S410 that the doors are fully locked, that is, the electronic key 2 once entered the detection area of ​​the vehicle 1 and the door locks were opened or closed via the electronic key 2, and then the electronic key 2 left the detection area of ​​the vehicle 1 with the doors fully locked. Such a situation may occur, for example, when the user of the vehicle 1 parks the vehicle 1 in a parking lot and leaves the vehicle 1.

[0206] In S412, vehicle position information (information indicating the current position of vehicle 1) is acquired based on the information received by the GPS receiver 9. In S414, the vehicle position information acquired in S412 is transmitted to the smartphone 3 by the first communication. As a result, even if the user of the smartphone 3 parks the vehicle 1 in a parking lot and then moves away from the vehicle 1, the user can easily know where the vehicle 1 is parked based on the vehicle position information transmitted from the vehicle 1.

[0207] In S416, it is determined whether an abnormality has been detected in the vehicle 1. The vehicle 1 is provided with a function for detecting various abnormalities. For example, the vehicle 1 is equipped with a sensor capable of detecting an external impact on the vehicle 1, such as an acceleration sensor or a vibration sensor. The control unit 10 of the vehicle 1 detects the presence or absence of an external impact on the vehicle 1 based on a detection signal from the sensor, and when an impact is detected, it determines that there is a possibility that a fraudulent act such as vandalism or theft has been committed on the vehicle 1, and detects the occurrence of an abnormality. In addition, the vehicle interior camera 24 may be periodically operated to analyze the captured image, and it may be determined that an abnormality has occurred when, for example, an intruder in the vehicle interior or a suspicious person (for example, a person peering into the vehicle interior) is detected around the vehicle. In addition, it may be possible to detect an abnormality in the functions of the vehicle 1, such as a voltage drop or oil leakage in the on-board battery.

[0208] In S416, if an abnormality in the vehicle 1 is not detected (S416: NO), the vehicle information notification process is terminated. If an abnormality in the vehicle 1 is detected (S416: YES), the process proceeds to S418. In S418, abnormality information indicating that an abnormality has been detected in the vehicle 1 and the details of the detected abnormality is transmitted to the smartphone 3 via the first communication.

[0209] Next, the vehicle information display process of Fig. 17 will be described. When the control unit 31 of the smartphone 3 starts the vehicle information display process of Fig. 17, it determines in S452 whether or not data has been received from the vehicle 1 in the first communication. If data has not been received from the vehicle 1 (S452: NO), it determines in S464 whether or not a specific user operation has been performed to display the vehicle position information. If a specific user operation has not been performed to display the vehicle position information (S464: NO), the vehicle information display process ends. If a specific user operation has been performed to display the vehicle position information (S464: YES), the process proceeds to S466.

[0210] In S466, the vehicle position information stored in the memory 32 is displayed on the display unit 26. This allows the user to confirm the position of the vehicle 1. If data has been received from vehicle 1 in S452 (S452: YES), then in S454 it is determined whether vehicle position information has been received (i.e., whether the received data includes vehicle position information). If vehicle position information has been received (S454: YES), then in S456 the received vehicle position information is stored in memory 32.

[0211] If the data received from the vehicle 1 does not include vehicle position information (S454: NO), then in S458 it is determined whether or not abnormality information has been received (i.e., whether or not abnormality information is included in the received data). If abnormality information has been received (S458: YES), then in S460 the received abnormality information is displayed on the display unit 26. This allows the user to know that an abnormality has been detected in the vehicle 1 and the details of the abnormality.

[0212] If the data received from the vehicle 1 does not include abnormality information (S458: NO), then in S462, a predetermined reception response process is carried out based on the received data. (10) The types of information that can be provided from the vehicle 1 to the smartphone 3 are not limited to the information described with reference to Fig. 3. In addition to the information described with reference to Fig. 3, various information such as the total mileage of the vehicle 1, the remaining battery charge, the remaining fuel charge, information on the date when the engine oil or other various oils were changed, and the total mileage of the vehicle 1 at the time of the oil change may be provided to the smartphone 3 as vehicle information.

[0213] The vehicle information may be able to be provided to the smartphone 3 at a specific time from the vehicle 1 directly or via the electronic key 2. When the vehicle information can be provided via the electronic key 2, not only the vehicle information but also information about the electronic key 2 (e.g., the remaining battery level of the electronic key 2) may be able to be provided to the smartphone 3.

[0214] A more specific example of the function of providing various information to the smartphone 3 described above will be described with reference to Fig. 18 and Fig. 9. The control unit 51 of the electronic key 2 repeatedly executes the system information transmission process of Fig. 18 at a predetermined cycle. In addition, the control unit 31 of the smartphone 3 repeatedly executes the system state notification process of Fig. 19 at a predetermined cycle.

[0215] First, a description will be given of the system information transmission process in Fig. 18. The vehicle 1 is configured to be able to transmit the above-mentioned vehicle information within the vehicle 1 to the electronic key 2 in response to a vehicle information request from the electronic key 2.

[0216] 18 , the control unit 51 of the electronic key 2 determines in S552 whether or not a request signal has been received from the vehicle 1. If a request signal has been received (S552: YES), the control unit 51 determines in S560 whether or not an information notification flag has been set. The information notification flag is a flag used to transmit system information (described in detail below) to the smartphone 3 only once while a request signal is being continuously received, and is set in S568 and cleared in S558.

[0217] If the information notification flag is already set in S560 (S560: YES), the system information transmission process is terminated. If the information notification flag is not set (S560: NO), the process proceeds to S562, where a request for vehicle information is made to vehicle 1 through the first or second communication, and the vehicle information in response to the request is obtained from vehicle 1 through the first or second communication.

[0218] In S564, the electronic key 2 detects the remaining battery power of the electronic key 2. The electronic key 2 periodically monitors the voltage of the battery 40 and the charge / discharge history of the battery 40, and is configured to be able to detect the remaining battery power based on the monitoring results.

[0219] In S566, the vehicle information acquired in S562 and the information including the remaining battery level detected in S564 are transmitted to the smartphone 3 through the first communication as system information indicating the status of the vehicle 1 and the electronic key 2. Then, in S568, an information notification flag is set, and the system information transmission process ends.

[0220] If a request signal has not been received from the vehicle 1 in S552 (S552: NO), then in S554 it is determined whether the information notification flag has been cleared. If the information notification flag has been cleared (S554: YES), the system information transmission process ends. If the information notification flag has been set (S554: NO), the process proceeds to S556.

[0221] In S556, it is determined whether or not a request signal has not been received from the vehicle 1 for a certain period of time. If the certain period of time has not yet passed since the request signal was not received (S556: NO), the system information transmission process is terminated. If the certain period of time has passed since the request signal was not received (S556: YES), the information notification flag is cleared in S558, and the system information transmission process is terminated.

[0222] Next, the system state notification process of Fig. 19 will be described. When starting the system state notification process of Fig. 19, the control unit 31 of the smartphone 3 determines in S502 whether or not system information has been received from the electronic key 2 in the first communication. If system information has not been received (S502: NO), the process proceeds to S512. If system information has been received (S502: YES), the received system information is stored in the memory 32 in S504.

[0223] In S506, the user is notified that the system information has been received from the electronic key 2. This notification can be made, for example, by voice or by displaying predetermined reception notification information on the display unit 33. If the smartphone 3 has a so-called vibration function, the user may be notified by using the vibration function (i.e., by generating vibrations in the main body of the smartphone 3).

[0224] In S508, it is determined whether or not a predetermined display request operation for displaying system information has been performed by the user. If a display request operation has not been performed (S508: NO), the process proceeds to S512. If a display request operation has been performed (S508: YES), the process proceeds to S510. In S510, the system information stored in memory 32 in S504 is displayed on display unit 33. This allows the user to check the latest system information.

[0225] In S512, it is determined whether maintenance is required based on the system information stored in the memory 32. For example, it is determined that maintenance is required if a certain number of days have passed since the last oil change, if a certain distance has been traveled since the total distance traveled at the time of the last oil change, if the remaining amount of fuel is a certain amount or less, or if the remaining battery charge in the electronic key 2 is a certain amount or less.

[0226] In S514, it is determined whether or not there is any item requiring maintenance based on the determination result of S512. If it is determined in S512 that maintenance is not required, it is determined that there is no item requiring maintenance (S514: NO) and the system status notification process ends. If it is determined in S512 that maintenance is required, it is determined that there is an item requiring maintenance (S514: YES) and the process proceeds to S516.

[0227] In S516, maintenance information is displayed on the display unit 33. The maintenance information displayed here is information related to items requiring maintenance. For example, in S512, if it is determined that the total mileage since the most recent oil change is greater than a certain distance, the maintenance information is displayed on the display unit 33. The maintenance required item is an oil change. Therefore, in this case, information indicating that an oil change is required is displayed on the display unit 33 as maintenance information. At that time, the reason for the coil replacement (the cumulative mileage since the last oil change has exceeded a certain distance) may also be displayed.

[0228] In S518, it is determined whether or not the user has performed an operation to request the display of guidance on a maintenance method. If the operation to request the display of guidance has not been performed (S518: NO), the system status notification process is terminated. If the operation to request the display of guidance has been performed (S518: YES), guidance processing is performed in S520. The guidance processing is a predetermined process for providing the user with a specific maintenance method for an item requiring maintenance.

[0229] The timing of transmission of the system information from the electronic key 2 to the smartphone 3 is not limited to the timing shown in Fig. 18 and can be determined as appropriate. For example, the smartphone 3 may be configured to be able to request system information from the electronic key 2 at any time, and the electronic key 2 may obtain the latest system information each time it receives a request from the smartphone 3 and transmit it to the smartphone 3. The smartphone 3 may then be configured to display the system information stored in the memory 32 on the display unit 33 at any time.

[0230] (11) As in the first embodiment, the electronic key 2 may be used to operate the vehicle 1 and obtain information from the vehicle 1 from the smartphone 3, and the electronic key 2 may be used to operate the vehicle 1 and obtain information from the vehicle 1 directly from the electronic key 2, as in the second embodiment.

[0231] In this case, the functions operable from the smartphone 3 and the functions operable directly from the electronic key 2 do not necessarily have to be completely the same. For example, the types of functions operable from the smartphone 3 may be fewer than the types of functions operable directly from the electronic key 2. Also, for example, certain types of functions (e.g. functions of relatively high importance such as unlocking the doors or starting the vehicle 1) may be made operable only from the electronic key 2 and not operable from the smartphone 3. Also, for example, the electronic key 2 may periodically notify the smartphone 3 of whether or not the electronic key 2 is within the detection area of ​​the vehicle 1, and the contents operable from the smartphone 3 via the electronic key 2 may be changed depending on the notification (i.e., the distance between the electronic key 2 and the vehicle 1).

[0232] (12) The smartphone 3 described in the above embodiment is merely one example of a communication terminal capable of wireless communication with the electronic key 2. In addition to the smartphone 3, any type of communication terminal capable of wireless communication, such as a mobile phone, a tablet terminal, or a personal computer, can be used.

[0233] (13) A configuration may be adopted in which data communication is possible directly between the smartphone and the vehicle. In this case, various services may be provided to the user by using the data communication between the smartphone and the vehicle.

[0234] For example, it may be possible to provide an information provision service that can obtain weather forecasts, road traffic information, and various other information on a smartphone, and then transmit some or all of the obtained information to a vehicle as appropriate to notify the driver of the vehicle.

[0235] In addition, for example, a vehicle surroundings monitoring service may be provided that can acquire information about the surroundings of the vehicle in the vehicle and transmit the acquired information to a smartphone as appropriate. stomach.

[0236] For example, a vehicle position notification service may be provided in which a smartphone can obtain location information of a vehicle from the vehicle and notify the smartphone user of information related to the vehicle's location based on the obtained location information.

[0237] Also, for example, the face of the driver in the vehicle may be photographed, and information according to the contents of the photographed facial image (i.e., the driver's facial expression, and further the driver's emotions (joy, anger, sadness, happiness, etc.)) may be stored. It may also be possible to provide an SNS (Social Networking Service) linking service that can pass information to a smartphone's SNS app.

[0238] For example, it may be possible to provide a driving suitability determination service that directly or indirectly grasps the driver's physical condition from various angles and allows or prohibits the driver from driving a vehicle depending on the information obtained (i.e., depending on the driver's physical condition).

[0239] The various services mentioned above will now be described in more detail. (13-1) Smartphone configuration First, the configuration of a smartphone 110 capable of implementing the various services described above will be described with reference to FIG. 20. The smartphone 110 shown in FIG. 20 further includes a motion sensor group 50 in addition to the hardware configuration of the smartphone 3 of the first embodiment shown in FIG. 2. The control unit 31 also includes a built-in RTC (real-time clock) 31a. The control unit 31 can obtain information such as the current time, date and time based on the RTC 31a. The RTC 31a is also built into the smartphone 3 of the first embodiment shown in FIG. 2.

[0240] The motion sensor group 50 includes at least one of various sensors capable of detecting the movement, orientation, etc. of an object. Examples of these various sensors include a geomagnetic sensor, an acceleration sensor, a gyro sensor, etc. Here, the motion sensor group 50 will be described as including at least a geomagnetic sensor and an acceleration sensor.

[0241] The geomagnetic sensor is a sensor also called an electronic compass, and is a sensor capable of detecting an orientation. The control unit 31 of the smartphone 110 can detect an orientation in a specific direction centered on the smartphone 110 based on a detection signal from the geomagnetic sensor. The specific direction can be determined appropriately. The smartphone 110 has a substantially rectangular thin plate shape. Therefore, here, as an example, an axis that is parallel to the rectangular plate surface and the long side direction of the smartphone 110 and passes through a specific position in the housing of the smartphone 110 is set as a specific axis, and one axial direction of the specific axis as viewed from the specific position is set as a specific direction.

[0242] The acceleration sensor can detect acceleration in at least three axes. The control unit 31 of the smartphone 110 can detect the movement of the smartphone 110 (movement in three-dimensional space) based on the detection signal from the acceleration sensor. The control unit 31 can also detect the number of steps taken by the person carrying the smartphone 110 based on the detection signal from the acceleration sensor.

[0243] In addition to the storage contents in the first embodiment (see FIG. 2), the memory 32 of the smartphone 110 further stores an information provision application 32g, a surrounding information notification application 32h, a vehicle position notification application 32j, an SNS application 32k, and a health management application 32m. When the surrounding information notification application is executed, the memory 32 stores forward video data 32n and stolen vehicle data 32p.

[0244] (13-2) Vehicle configuration Next, the configuration of a vehicle 120 capable of implementing the various services described above will be described with reference to Fig. 21. The vehicle 120 shown in Fig. 21 further includes a HUD (head-up display) 27, a front camera 28, and a BT communication unit 30 in addition to the hardware configuration of the vehicle 1 of the first embodiment shown in Fig. 6.

[0245] The front camera 28 is a camera capable of capturing images ahead of the vehicle 120. The front camera 28 is attached to the vehicle 120 at a specific position (for example, the front end of the ceiling inside the vehicle) where the front camera 28 can capture images ahead. The front camera 28 operates to capture images when a preset capture condition is met. Here, it is assumed that the camera 28 is always capturing video images at least while the vehicle 120 is traveling. Data of the video images captured by the front camera 28 (front video data 25h) is stored in the memory 25. The front video data 25h stored in the memory 25 is video data for the most recent few hours. The period and timing (i.e., the capture conditions) during which the front camera 28 captures the video images can be determined as appropriate. It can also be determined as appropriate how long the data of the video images captured in the past is to be stored in the memory 25 (i.e., whether it is to be stored as the front video data 25h).

[0246] In addition to the storage contents in the first embodiment (see FIG. 6), the memory 25 of the vehicle 120 further stores a smartphone information notification program 25d, a surroundings monitoring program 25e, an SNS linking program 25f, and a physical condition information response program 25g. When the surroundings monitoring program 25e is executed, forward video data 25h is stored in the memory 25.

[0247] (13-3) Information provision services Next, the information provision service among the various services described above will be described with reference to Fig. 22 and Fig. 23. The information provision service is basically realized by executing the information provision application 32g in the smartphone 110 and executing the smartphone information notification program 25d in the vehicle 120. As a usage form of the information provision service, it is mainly assumed that a user who owns the smartphone 110 gets into the vehicle 120 (i.e., the smartphone 110 is present in the vehicle 120).

[0248] After being started, the control unit 31 of the smartphone 110 reads the information provision application 32g from the memory 32 and repeatedly executes an information provision process, which is a process according to the information provision application 32g, at a predetermined cycle. The information provision process is a process of acquiring various information from various servers (e.g., various websites, etc.) and transmitting some or all of the information to the vehicle as necessary. Figure 22 shows an example of the information provision process.

[0249] When starting the information provision process of FIG. 22, the control unit 31 of the smartphone 110 detects the current position of the smartphone 110 based on the information received by the GPS receiving unit 37 in S602.

[0250] In S604, the weather information providing site is accessed in the first communication, and current location information indicating the current location of the smartphone 110 is transmitted to the weather information providing site, thereby requesting weather information about the area around the current location. Then, in response to the request, the weather information about the area around the current location transmitted from the weather information providing site is obtained.

[0251] In S606, the traffic information providing site is accessed by the first communication, and current location information indicating the current location of the smartphone 110 is transmitted to the traffic information providing site to request traffic information about the area around the current location. Then, in response to the request, traffic information about the area around the current location transmitted from the traffic information providing site is acquired. Note that the traffic information that can be acquired includes various types of information such as accident information, congestion information, and traffic regulation information about the area around the current location.

[0252] In S608, the first communication accesses an alert information providing site and transmits predetermined search conditions to the alert information providing site, thereby requesting various information corresponding to the search conditions. Then, various information transmitted from the alert information providing site in response to the request is acquired. The search conditions include various conditions such as the current location of the smartphone 110, the current location of the vehicle 120, the current time, information related to the driver (e.g., the driver's preferences, schedule, etc.), and information related to the vehicle 120 (e.g., vehicle type). When at least one of these various conditions is transmitted to the alert information providing site as a search condition, information corresponding to the search conditions is searched for and transmitted to the smartphone 110. Examples of information corresponding to the search conditions include various information such as facility information and event information around the current location, information on various events to be held within a certain time, and information on facilities that may interest the driver.

[0253] In S610, it is determined whether or not the information acquired in S604, S606, and S608 includes information that has been updated from the information acquired previously. Specifically, it is determined based on the information stored in the memory 32 whether or not the information acquired in S604, S606, and S608 has already been acquired and stored in the information provision process up to the previous time. If the currently acquired information has already been stored, the information provision process is terminated. On the other hand, if the currently acquired information includes information that is not stored in the memory 32 (i.e., updated information), in S612, the updated information is transmitted to the vehicle 120 by BT communication.

[0254] On the other hand, after startup, the control unit 10 of the vehicle 120 reads the smartphone information notification program 25d from the memory 25 and repeatedly executes the smartphone information notification process, which is a process according to the smartphone information notification program 25d, at a predetermined cycle. The smartphone information notification process is a process for notifying the driver of various information received from the smartphone 110. FIG. 23 is an example of the smartphone information notification process.

[0255] When the control unit 10 of the vehicle 120 starts the smartphone information notification process of FIG. 23, in S652, it determines whether or not update information (information transmitted in S612 of FIG. 22) has been received from the smartphone 110 via BT communication. If update information has not been received, the smartphone information notification process ends. If update information has been received, in S654, the received update information is notified to the driver. Specifically, for example, the update information may be output as audio from a speaker (not shown), the update information may be displayed on the display unit 26, or the update information may be displayed on the HUD 27.

[0256] In the information provision process in Fig. 22, it is not essential to transmit updated information among the various information acquired from each site to the vehicle, and some or all of the various information acquired from each site may be transmitted to the vehicle as appropriate. When transmitting some of the various information, it is possible to determine as appropriate what information should be transmitted specifically.

[0257] Moreover, the data communication method between the smartphone 110 and the vehicle 120 is Bluetooth communication, which is merely an example, and data communication may be performed using other communication methods. (13-4) Vehicle Surroundings Monitoring Service Next, the vehicle surroundings monitoring service among the various services described above will be described with reference to Fig. 24 and Fig. 25. The vehicle surroundings monitoring service is basically realized by executing a surrounding information notification application 32h in the smartphone 110 and executing a surroundings monitoring program 25e in the vehicle 120. As with the above information provision service, the vehicle surroundings monitoring service is mainly assumed to be used when a user who owns the smartphone 110 is in the vehicle 120.

[0258] After the control unit 10 of the vehicle 120 is started, the control unit 10 reads the surroundings monitoring program 25e from the memory 25. The surroundings monitoring program 25e is loaded into the smartphone 110 and repeatedly executes a surroundings monitoring process, which is a process according to the surroundings monitoring program 25e, at a predetermined cycle. The surroundings monitoring process is a process for realizing a function of transmitting license plate information of a surrounding vehicle to the smartphone 110 when the license plate of the surrounding vehicle is recognized from an image (still image) captured by the front camera 28, a function of transmitting front video data 32n to the smartphone 110, and a function of reporting the presence of a stolen vehicle based on a notification from the smartphone 110. FIG. 24 shows an example of the surroundings monitoring process.

[0259] When the control unit 10 of the vehicle 120 starts the surrounding monitoring process of Fig. 24, in S702, it acquires an image (still image) captured by the front camera 28. In S704, it performs recognition processing of an image of a surrounding vehicle from the still image acquired in S702. In S706, it is determined whether or not the license plate number of the surrounding image has been recognized from the still image. If the license plate number has not been recognized, the process proceeds to S710. If the license plate number has been recognized, in S708, license plate number information indicating the recognized license plate number is transmitted to the smartphone 110 via BT communication.

[0260] In S710, the front image data 32n is transmitted to the smartphone 110 by BT communication. The front image data 32n transmitted here is an updated portion from the front image data 32n transmitted in the previous processing of S710, that is, a portion newly stored after the previous processing of S710 until the current processing of S710 is executed. However, it is not essential to transmit only the updated portion in this manner.

[0261] In S712, it is determined whether stolen vehicle detection information has been received from the smartphone 110 by BT communication. If stolen vehicle detection information has not been received, the surrounding monitoring process is terminated. If stolen vehicle detection information has been received, the presence of a stolen vehicle is notified to the driver in S714. The stolen vehicle detection information transmitted from the smartphone 110 includes information that the number information transmitted in S708 includes a number that may be a stolen vehicle, and includes that number. Therefore, in S714, at least the fact that a vehicle that may be a stolen vehicle is traveling in front of the vehicle and that number are notified to the driver. There are various specific notification methods, and for example, as described in S654 of FIG. 23, notification may be by voice, or may be by the display unit 26 or HUD 27.

[0262] On the other hand, the control unit 31 of the smartphone 110, after being started, reads the surrounding information notification application 32h from the memory 32, and executes the surrounding information notification process, which is the process according to the surrounding information notification application 32h, at a predetermined cycle. The surrounding information notification process is a process for realizing a function of determining the presence or absence of a stolen vehicle based on the number information transmitted from the vehicle and transmitting the determination result to the vehicle, and a function of storing the forward video data 32n transmitted from the vehicle. FIG. 25 shows an example of the surrounding information notification process.

[0263] 25, the control unit 31 of the smartphone 110 accesses a specific website that stores information about stolen vehicles through the first communication in S752, acquires stolen vehicle data 32p, which is data on the number of the stolen vehicle, and stores the data in the memory 32. If the data has already been stored, the stored data is updated based on the newly acquired data.

[0264] In S754, it is determined whether or not number information has been received from vehicle 120 via BT communication. If number information has not been received, the process proceeds to S760. If number information has been received, the process refers to stolen vehicle data 32p in S756 to determine whether the received number information includes a number corresponding to a stolen vehicle. If a number corresponding to a stolen vehicle is not included, the process proceeds to S760. If a number corresponding to a stolen vehicle is included, stolen vehicle detection information is transmitted to vehicle 120 via BT communication in S758.

[0265] In S760, it is determined whether or not forward video data has been received from the vehicle 120 by BT communication. If forward video data has been received, in S762, the forward video data 32n stored in the memory 32 is updated based on the received forward video data. The forward video data 32n stored in the memory 32 can be played back on the display unit 33 by performing a predetermined video playback operation.

[0266] The acquisition of stolen vehicle data (S752) and the determination of the presence or absence of a license plate number corresponding to a stolen vehicle (S756) performed by the smartphone 110 may be performed by the vehicle 120 itself. In this case, stolen vehicle detection information may be transmitted from the vehicle 120 to the smartphone 110, and the smartphone 110 may store the information or notify the information.

[0267] (13-5) Vehicle location notification service Next, the vehicle position notification service among the various services described above will be described with reference to Fig. 26. The vehicle position notification service is basically realized by executing a vehicle position notification application 32j on the smartphone 110. The vehicle position notification service is mainly assumed to be used in a case where the user who owns the smartphone 110 is away from the vehicle 120.

[0268] After being started, the control unit 31 of the smartphone 110 reads the vehicle position notification application 32j from the memory 32, and repeatedly executes a vehicle position notification process, which is a process according to the vehicle position notification application 32j, at a predetermined cycle. The vehicle position notification process is a process for realizing a function of notifying the user of the smartphone 110 of the current position of the vehicle 120 and various information related to the current position. Fig. 26 shows an example of the vehicle position notification process.

[0269] 26, the control unit 31 of the smartphone 110 acquires position information of the vehicle 120 (current vehicle position) from the vehicle 120 through the first communication in S552. Specifically, when position information is requested from the vehicle 120 through the first communication, information on the current position detected by the vehicle 120 is transmitted from the vehicle 120. In S552, the current vehicle position is acquired by receiving the information on the current position transmitted from the vehicle 120.

[0270] In S554, the current position of smartphone 110 (current smartphone position) is detected based on information received by GPS receiver 37. In S556, a map image of a predetermined range including the current vehicle position acquired in S552 and the current smartphone position acquired in S554 is displayed on display 33. In S558, a vehicle mark indicating vehicle 120 is displayed at a position corresponding to the current vehicle position in the map image, and a smartphone mark indicating smartphone 110 is displayed at a position corresponding to the current smartphone position. This allows the user of smartphone 110 to know the position of the vehicle 120 in addition to knowing his / her own position (i.e., the position of smartphone 110).

[0271] In S560, vehicle position related information is calculated based on the vehicle current position and the smartphone current position, and is displayed on the display unit 33. The vehicle position related information is information that directly or indirectly indicates the relative position of the vehicle 120 with respect to the smartphone current position. Examples of the vehicle position related information include the straight-line distance from the smartphone current position to the vehicle current position, the distance along a predetermined route from the smartphone current position to the vehicle current position, the number of steps required to walk from the smartphone current position to the vehicle current position along a predetermined route, and the direction of the vehicle current position as viewed from the smartphone current position.

[0272] In S562, based on the detection signal from the motion sensor group 50, the smartphone 1 In S564, the direction of the smartphone 110 detected in S562 is determined to be approximately the same as the direction of the vehicle 120 (i.e., the direction of the vehicle's current position as seen from the smartphone's current position). For example, if the difference between the directions (directions) of the two is within a predetermined angle, it is determined that they are approximately the same.

[0273] When the orientation of the smartphone 110 is substantially the same as the direction of the vehicle 120, in S566, the user of the smartphone 110 is notified that the smartphone 110 is facing the direction of the vehicle 120. This notification may be performed, for example, by audio, by activating a vibration mechanism (not shown) to mechanically vibrate the smartphone 110, or by displaying predetermined information on the display unit 33.

[0274] This vehicle position notification process allows the user of the smartphone 110 to obtain various pieces of information related to the position of the vehicle 120. In particular, the processes of S546 and S566 allow the user of the smartphone 110 to find the direction of the vehicle 120 while changing the orientation of the smartphone 110 in various ways.

[0275] (13-6) SNS Linkage Services Next, the SNS linking service among the various services described above will be described with reference to Figures 27 and 28. The SNS linking service is basically realized by executing SNS application 32k on smartphone 110 and SNS linking program 25f on vehicle 120. The SNS linking service is mainly assumed to be used in a situation where a user who owns smartphone 110 is driving vehicle 120 (in other words, where the driver's smartphone 110 is present inside vehicle 120).

[0276] After starting up, the control unit 10 of the vehicle 120 reads the SNS linking program 25f from the memory 25 and repeatedly executes the SNS linking process, which is a process according to the SNS linking program 25f, at a predetermined cycle. The SNS linking process is a process of determining the driver's mood from an image of the driver's face and transmitting the determination result to the smartphone 110. Figure 27 shows an example of the SNS linking process.

[0277] 27, the control unit 10 of the vehicle 120 acquires an image (still image) captured by the front camera 28 in S802. In S804, the control unit 10 acquires an image (still image) captured by the interior camera 24.

[0278] In S806, a process of recognizing an image of the driver's face from the still image acquired in S804 is performed. In S808, the driver's mood (e.g., emotions such as joy, anger, sadness, and happiness) is determined based on the image of the driver's face recognized in S806. In S810, mood information indicating the determination result (driver's mood) of S808 is transmitted to smartphone 110 by BT communication.

[0279] Meanwhile, after startup, the control unit 31 of the smartphone 110 reads the SNS application 32k from the memory 32 and repeatedly executes the SNS processing, which is processing according to the SNS application 32k, at a predetermined cycle. The SNS application 32k is an application that can realize functions equivalent to known applications that enable users to enjoy SNS, such as LINE (registered trademark) and TWITTER (registered trademark). In particular, the SNS application 32k has a function of automatically sending various images and messages according to mood information transmitted from the vehicle 120, in addition to the functions of known similar applications. FIG. 28 shows an example of the SNS processing.

[0280] When the control unit 31 of the smartphone 110 starts the SNS processing of FIG. 28, it determines in S852 whether or not mood information has been received from the vehicle 120. If mood information has not been received, in S854, other prescribed processing is executed. The prescribed processing is, for example, This process is equivalent to various processes executed in known SNS applications, such as receiving messages from an external terminal or server and sending messages to an external terminal or server.

[0281] If mood information is received from the vehicle 120 in S852, a notification image showing the mood of the user of the smartphone 110 (i.e., the driver of the vehicle 120) is determined in S856. The notification image may be any image that expresses the driver's mood. For example, if the driver is angry, text "I'm angry!" may be generated and determined as the notification image, or an illustrated image of an angry expression may be extracted from pre-stored illustrated images of faces and determined as the notification image. Also, for example, if the driver is surprised or moved, text "I saw something amazing!" may be generated and determined as the notification image, or an illustrated image of a surprised expression may be extracted from pre-stored illustrated images of faces and determined as the notification image.

[0282] In S858, the notification image determined in S856 is transmitted to a specific external terminal or server in the first communication. As a result, the notification image is transmitted to, for example, the terminal of another user registered as a transmission target, and the notification image is displayed on the terminal of the other user. The other user can see the displayed notification image and know the current situation (mood, etc.) of the driver. When transmitting the notification image, an image of the surroundings of the vehicle 120 (an image captured by the front camera 28) or an image of the driver (an image captured by the interior camera 24) may be transmitted.

[0283] Note that data of the notification image may be transmitted to vehicle 120, and the notification image may be displayed in a predetermined manner in vehicle 120. For example, a device that irradiates a window glass with laser light may be provided, and the device may be operated to display a notification image on the window glass by laser light, so that a person outside vehicle 120 can know the feelings of the driver of vehicle 120. In this case, a phosphorescent material that can store light with the wavelength of laser light for a certain period of time may be placed on the window glass, so that the notification image can be viewed from outside for a certain period of time.

[0284] (13-7) Driving fitness determination service Next, the driving capability determination service among the various services described above will be described with reference to Fig. 29 and Fig. 30. The driving capability determination service is basically realized by executing a physical condition management application 32m in the smartphone 110 and executing a physical condition information response program 25g in the vehicle 120. The driving capability determination service is mainly assumed to be used when a user who owns the smartphone 110 drives the vehicle 120.

[0285] After being started, the control unit 31 of the smartphone 110 reads the health management application 32m from the memory 32 and repeatedly executes a health management process, which is a process according to the health management application 32m, at a predetermined cycle. The health management process is a process of acquiring information related to the health of the user of the smartphone 110 and transmitting it to the vehicle 120. Fig. 29 shows an example of the health management process.

[0286] 29 starts, the control unit 31 of the smartphone 110 determines in S902 whether or not there has been a request for health-related information from the vehicle 120. The health-related information is various information directly or indirectly related to the health of the user of the smartphone 110, such as the number of steps taken for each specific period (for example, each day), pulse rate, heart rate, body temperature, and the like.

[0287] If health-related information has not been requested in S902, the health management process ends. If health-related information has been requested, health-related information is acquired in S904. For example, the number of steps can be acquired based on detection signals from the motion sensor group 50, as described above. Also, for example, pulse rate, heart rate, and other information may be acquired based on detection signals from a sensor that can detect these, provided in the smartphone 110 itself. Alternatively, the information may be obtained through data communication from another terminal (such as a wristwatch-type information processing terminal) that has a function for detecting these.

[0288] In S906, the health-related information acquired in S904 is transmitted to the vehicle 120 via Bluetooth communication. On the other hand, when the driver performs a specific start operation after starting up, the control unit 10 of the vehicle 120 reads the physical condition information response program 25g from the memory 25 and repeatedly executes the physical condition information response process, which is a process according to the physical condition information response program 25g, at a predetermined cycle. The start operation may be, for example, turning on the ignition switch. In addition, in the case of an electric vehicle or a hybrid vehicle, it may be turning on the so-called power switch to put the vehicle into a standby state in which it can run.

[0289] The physical condition information response process is a process of acquiring physical condition related information of the user (i.e., the driver) of the smartphone 110 from the smartphone 110, and permitting or prohibiting the driver from driving the vehicle 120 according to the physical condition related information. Fig. 30 is an example of the physical condition information response process.

[0290] 30, the control unit 10 of the vehicle 120 requests health-related information from the smartphone 110 via BT communication in S952. Then, in response to the request, the control unit 10 acquires the health-related information by receiving the health-related information transmitted from the smartphone 110 via BT communication.

[0291] In S954, it is determined whether the driver is allowed to drive the vehicle 120 based on the health-related information acquired in S952 (i.e., information related to the driver's health condition). For example, if the driver's pulse or heart rate is outside the normal range, it is determined that the driver is not allowed to drive. Also, for example, if the total number of steps taken over the past day is equal to or less than a predetermined lower limit, it is determined that the driver is not allowed to drive because of lack of exercise and a method of transportation other than the vehicle 120 (for example, walking or cycling) is recommended. Conversely, if both the pulse and heart rate are within the normal range or the total number of steps taken over the past day exceeds the lower limit, and there is no particular reason to hesitate to allow the driver to drive the vehicle 120, it is determined that the driver is allowed to drive.

[0292] In S956, it is determined whether or not the driver is capable of driving the vehicle 120 (whether or not it is determined that the driver is capable of driving) based on the determination result in S954. If it is determined that the driver is capable of driving, in S958 the operating state of the vehicle 120 is shifted to a running standby state. In the running standby state, the driver can drive the vehicle 120. If it is not determined in S956 that the driver is capable of driving (i.e., if it is determined in S954 that the driver is not capable of driving), a driving prohibition process is executed in S960. Specifically, even if the driver depresses the accelerator pedal, this is invalidated, and the vehicle 120 is forcibly prevented from running.

[0293] (14) A portable communication terminal (e.g., a wristwatch-type terminal) with a built-in motion sensor may be attached to the arm of a traffic attendant deployed in a parking lot, or to the arm of a traffic attendant or police officer directing traffic, so that the arm movement (i.e., hand gestures) can be detected and the meaning of the hand gesture (what kind of instruction by the traffic attendant, etc.) can be recognized. The hand gesture recognition may be performed by the portable communication terminal attached to the arm, or the detection signal of the motion sensor may be transmitted to another communication terminal (e.g., the above-mentioned smartphone) or a vehicle, and the signal may be recognized at the transmission destination. Examples of recognizable hand gestures include a stop instruction, a no entry instruction, and a start OK instruction. The recognition result may be notified to the user by the smartphone, or to the driver of the vehicle in the vehicle.

[0294] For example, a smartphone receives a detection signal from a motion sensor in a portable communication device worn by a guide on his / her arm, recognizes hand gestures on the smartphone, and displays the recognition result on the smartphone. The notification may be made via a smartphone or may be sent to a vehicle and made available in the vehicle.

[0295] (15) The vehicle to which the present invention can be applied is not limited to the vehicle 1 of the above embodiment that uses an engine as a driving source for running, but may be a hybrid vehicle, an electric vehicle, or any other vehicle with a variety of driving methods. In addition, the present invention can be applied not only to passenger cars, but also to commercial vehicles, trucks, buses, railroad cars, and any other type of vehicle.

[0296] (16) In addition, the present invention is not limited to the specific means and structures shown in the above embodiments, and may take various forms within the scope of the gist of the present invention. For example, the function of one component in the above embodiments may be distributed as multiple components, or the functions of multiple components may be integrated into one component. At least a part of the configuration of the above embodiments may be replaced with a known configuration having a similar function. A part of the configuration of the above embodiments may be omitted as long as the problem can be solved. At least a part of the configuration of the above embodiments may be added to, replaced with, or the like for the configuration of another of the above embodiments. Note that any aspect included in the technical idea specified by the wording described in the claims is an embodiment of the present invention.

[0297] [Technical concept understood from the embodiment] At least the following technical ideas can be understood from the various embodiments described above in detail. (A) an electronic key capable of wirelessly connecting to a vehicle using two different wireless communication methods; a communication terminal capable of wirelessly communicating with the electronic key; Equipped with One of the two wireless communication methods has a shorter communication distance than the other wireless communication method, The communication terminal includes: a designation input unit that accepts designation input of a process item indicating the content of a process to be executed for causing the vehicle to execute the process; a command transmission unit that transmits a process command indicating the process item input by the designation input unit to the electronic key; Equipped with The electronic key is a processing command generating unit that, when receiving the processing command from the communication terminal, generates a processing command indicating the processing item corresponding to the processing command; a communication system determination unit that determines whether wireless communication with the vehicle is possible using the one of the wireless communication systems; a command transmission unit that transmits the processing command to the vehicle in the one wireless communication method when the communication method determination unit determines that wireless communication is possible in the one wireless communication method, and transmits the processing command to the vehicle in the other wireless communication method when the communication method determination unit determines that wireless communication is not possible in the one wireless communication method; A vehicle control system comprising:

[0298] According to this configuration, wireless communication between the electronic key and the vehicle is performed in an appropriate manner according to the relative distance between them, thereby enabling efficient wireless communication between the electronic key and the vehicle.

[0299] (B) In (A) above: The electronic key is a permission determination unit that, when it is determined by the communication system determination unit that wireless communication is not possible in the one wireless communication system, determines whether or not transmission of the processing command in the other wireless communication system is permitted; When the communication method determination unit determines that wireless communication is not possible using the one wireless communication method, and when the permission determination unit determines that transmission of the processing command using the other wireless communication method is permitted, the command transmission unit transmits the processing command to the vehicle using the other wireless communication method. A vehicle control system comprising:

[0300] With this configuration, when the electronic key cannot wirelessly communicate with the vehicle using one wireless communication method (for example, when the electronic key is far away from the vehicle), it can be freely determined whether or not to transmit a processing command to the vehicle using the other wireless communication method. If transmission using the other wireless communication method is permitted, the vehicle can be remotely controlled even when the electronic key is far away from the vehicle. Conversely, if transmission using the other wireless communication method is not permitted, the vehicle cannot be remotely operated when the electronic key is further away from the vehicle than a certain distance (a distance at which wireless communication using one wireless communication method is possible), thereby improving security performance. (C) an electronic key capable of wirelessly communicating with the vehicle; a communication terminal capable of wirelessly communicating with the electronic key; Equipped with The communication terminal includes: A display unit; a display control unit that causes a process item image, which is an image showing a process item that can be executed on the vehicle, to be displayed on the display unit; a designation input unit that receives a designation input for designating at least one of the process item images displayed on the display unit by the display control unit; a command transmission unit that transmits to the electronic key a process command corresponding to the process item indicated by the process item image specified by the designation input unit; Equipped with The electronic key is a command transmission unit that, when receiving the processing command from the communication terminal, transmits to the vehicle a processing command indicating the processing item corresponding to the processing command; A vehicle control system comprising:

[0301] According to this configuration, the user can easily search for and specify a desired process item image (a process item image corresponding to a process to be executed by the vehicle) from among the process item images displayed on the communication terminal. Each icon illustrated in FIG. 3 corresponds to an example of the process item image. (D) an electronic key capable of wirelessly communicating with the vehicle; a communication terminal capable of wirelessly communicating with the electronic key; Equipped with The communication terminal includes: At least one of an imaging unit capable of capturing moving images and an audio input unit capable of inputting audio; a processing reception unit that receives at least one of a user's gesture captured by the imaging unit and a user's voice input to the voice input unit as processing designation information; a transmitter that transmits the process designation information to the electronic key; Equipped with The electronic key is a command transmission unit that, when receiving the process designation information from the communication terminal, transmits to the vehicle a process command corresponding to the process item indicated by the received process designation information among the process items that can be executed by the vehicle; A vehicle control system comprising:

[0302] According to this configuration, the communication terminal only needs to have a function for transmitting process designation information indicating a user's gesture or voice to the electronic key, and does not need to recognize the meaning of the process designation information input by the user. The process of recognizing the meaning of the process designation information input by the user is performed by the electronic key. This reduces the processing load on the communication terminal.

[0303] 8 correspond to an example of the process of the process receiving unit. The gesture pattern recognized in S34 or the operation content corresponding thereto, and the voice pattern recognized in S42 or the operation content corresponding thereto correspond to an example of the process designation information.

[0304] (E) a vehicle; and an electronic key capable of wirelessly communicating with the vehicle; a communication terminal capable of wirelessly communicating with the electronic key; Equipped with The communication terminal includes: At least one of an imaging unit capable of capturing moving images and an audio input unit capable of inputting audio; a processing reception unit that receives at least one of a user's gesture captured by the imaging unit and a user's voice input to the voice input unit as processing designation information; a terminal side transmitting unit that transmits the process designation information to the electronic key; Equipped with the electronic key includes a relay transmission unit that, when receiving the process designation information transmitted from the communication terminal, relays the received process designation information and transmits it to the vehicle; The vehicle is a process execution unit that executes a process item indicated by the process specification information when the process specification information is received from the electronic key; A vehicle control system comprising:

[0305] With this configuration, both the communication terminal and the electronic key only need to have the function of transmitting process specification information indicating the user's gesture or voice, and there is no need to recognize the meaning of the process specification information input by the user. The process of recognizing the meaning of the process specification information input by the user is performed in the vehicle. This reduces the processing load on the communication terminal and the electronic key.

[0306] (F) An electronic key capable of wirelessly communicating with a vehicle, a designation input unit that accepts designation input of a process item indicating the content of a process to be executed for causing the vehicle to execute the process; a command transmission unit that transmits to the vehicle a processing command indicating the processing item input by the designation input unit; An electronic key comprising:

Claims

1. A vehicle control system, comprising: an electronic key configured to be capable of wirelessly communicating with a vehicle; a communication terminal configured to be capable of wirelessly communicating with the electronic key; Equipped with The communication terminal includes: a designation input unit configured to receive a designation input of a process item indicating the content of a process to be executed for causing the vehicle to execute the specific process; a command sending unit configured to send, to the electronic key, a process command indicating the process item input by the designation input unit; Equipped with The electronic key is A vehicle control system comprising: a command transmission unit configured, when receiving the processing command from the communication terminal, to transmit to the vehicle a processing command indicating the processing item corresponding to the processing command.

2. 2. The vehicle control system according to claim 1, The communication terminal includes: A terminal-side storage unit is provided in which predetermined terminal-side specific information is stored, the command transmission unit is configured to transmit the terminal-side unique information stored in the terminal-side storage unit when transmitting the processing command to the electronic key; The electronic key is A key side storage unit in which predetermined key side unique information is stored; a unique information determination unit configured to determine, when the processing command and the terminal-side unique information are received from the communication terminal, whether or not the received terminal-side unique information and the key-side unique information stored in the key-side storage unit have a specific relationship; Equipped with A vehicle control system, wherein the command sending unit is configured to send the processing command when the unique information determining unit determines that the specific relationship exists.

3. 3. A vehicle control system according to claim 1, further comprising: The communication terminal includes: The device includes at least one of an imaging unit configured to be able to capture moving images and an audio input unit configured to be able to input audio, The designation input unit is configured to accept a designation input of the processing item based on at least one of a user's gesture captured by the imaging unit and a user's voice input to the voice input unit.

Images