System for controlling a device in a vehicle using augmented reality and method therefor

DE102010062282B4Active Publication Date: 2024-12-19HYUNDAI MOTOR CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
DE102010062282
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2010-09-13
Filing Date
2010-12-01
Publication Date
2024-12-19
Estimated Expiration
2030-12-01

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A system for controlling a device (400) in a vehicle using augmented reality, the system comprising: a mobile device (100) configured to identify a vehicle object unit (300) as an image and receive a vehicle control command via an augmented reality implementation of the image; and a driving control unit (200) configured to transmit vehicle type information to the mobile device (100) and, upon receiving a command signal from the mobile device (100), control the device (400) in the vehicle corresponding to the command signal; and wherein the mobile device (100) is configured to: Dividing the image of the vehicle object unit (300) into a reference area and a non-reference area according to the vehicle type information; Comparing a previously stored image pattern information of the vehicle type with image pattern information of the reference area of ​​the image; and if the previously stored image pattern information matches the pattern information of the image, entering a vehicle remote control mode, wherein the mobile device (100) comprises: a camera configured to capture an image of the vehicle object unit (300); a storage unit configured to store image pattern information of the vehicle object unit (300) and the vehicle type information; a control unit configured to, when the image pattern information stored in the storage unit matches the pattern information of the captured image, enter the vehicle remote control mode, provide an icon for inputting a command, and, when the vehicle control command is input via the icon, control transmission of the vehicle control command to the driving control unit (200).
Need to check novelty before this filing date? Find Prior Art

Description

BACKGROUND OF THE INVENTIONField of the Invention

[0001] The present invention generally relates to a system for controlling an in-vehicle device using augmented reality, and more particularly to a technique for controlling an in-vehicle device with a mobile device using augmented reality. Description of the state of the art

[0002] Generally, control buttons, for example for an air conditioning unit, an audio device, a navigation system, a radio or for digital multimedia broadcasting (DMB), are positioned in the center of a dashboard inside a vehicle, namely between the driver's seat and the passenger's seat.

[0003] This makes it difficult for a rear-seat passenger to operate a vehicle's controls, such as the air conditioning, audio system, or navigation system. Furthermore, if a rear-seat passenger leans forward to reach a control button in the center of the vehicle's dashboard, this could lead to an accident, for example, if the vehicle suddenly accelerates or comes to a sudden stop.

[0004] WO 2009 / 109231 A1 discloses a communication system for use with a vehicle having a common bus structure for data exchange between components of the vehicle, the system comprising a first wireless communication transceiver connectable to the bus of the vehicle, the communication transceiver being capable of transmitting status messages over a trusted wireless channel.

[0005] US 2009 / 0 273 561 A1 discloses a device control system that allows a user to control the functions of another device with their own terminal. US 2007 / 0 285 809 A1 discloses a vehicle image generating device that generates a vehicle image for identifying a vehicle from an original image, comprising an identification unit that identifies a component of the vehicle in the original image, a definition unit that defines an identification region with an identification component for identifying the vehicle based on the component, and a generation unit that extracts the identification region from the original image and generates the vehicle image based on the extracted identification region. DE 10 2005 041 261 A1 discloses a greeting system for greeting a user of a motor vehicle.The greeting system includes a host communication device provided in the motor vehicle or a device around a parking location of the motor vehicle. The system also includes a distance detection device for detecting a distance between the user and the parked motor vehicle. A greeting control device operates a greeting operation device, such as a headlight of the motor vehicle, such that a content of the greeting operations is selected and changed depending on the detected distance between the user and the motor vehicle. Overview of the invention

[0006] The invention is defined by the independent claims. The dependent claims define advantageous embodiments.

[0007] It is an object of the present invention to allow and provide remote control of a device in the vehicle, and in particular to provide a system and method for remote control of a device in the vehicle using augmented reality of a mobile device.

[0008] The object is achieved by a system for controlling a device in a vehicle having the features of claim 1 and a method for controlling a device in a vehicle having the features of claims 7 or 13. Advantageous further developments can be found in the subclaims.

[0009] According to one aspect of the present invention, there is provided a system for controlling an in-vehicle device using augmented reality, the system including a mobile device configured to identify a vehicle object unit as an image and receive a vehicle control command via implementing augmented reality of the image; and a driving control unit configured to transmit vehicle type information to the mobile device and, upon receiving a command signal from the mobile device, to control the in-vehicle device consistent with the command signal. The mobile device includes a camera configured to capture an image of the vehicle object unit.A storage unit may further be provided and configured to store image pattern information of the vehicle object unit and the vehicle type information. A control unit may further be provided and configured to enter a vehicle remote control mode and control the transmission of the vehicle control command to the leading control unit. For example, in one embodiment, a control unit is configured such that, based on the comparison of the image pattern information stored in the storage unit and pattern information of the captured image, when the patterns match, the control unit enters a vehicle remote control mode, provides an icon or the like for the user to provide an input signal of a command, and when the vehicle control command is input (e.g., via an icon), to control the transmission of the vehicle control command to the driving control unit.

[0010] In certain embodiments, when the image of the vehicle object unit is captured, the control unit may be further configured to divide the captured image of the vehicle object unit into a reference area and a non-reference area according to the vehicle type information. The control unit may then compare the image pattern information stored in the storage unit with the pattern information of the captured image in the reference area.

[0011] In a preferred embodiment, when the vehicle object unit is a center of a dashboard of a vehicle, the control unit may determine that the grille surface of an air conditioner is the reference surface.

[0012] In various embodiments, the device in the vehicle may include, but is not limited to, an air conditioner, an audio unit, a radio, digital multimedia broadcasting (DMB), a navigation unit, an interior lighting device, and a window.

[0013] In various embodiments, when the mobile device is within a predetermined distance from a vehicle, the driving control unit may transmit the vehicle type information to the mobile device.

[0014] In various embodiments, when the mobile device sends a request for the vehicle type information to the vehicle, the driving control unit may transmit the vehicle type information of the vehicle to the mobile device.

[0015] In certain embodiments, the mobile device may include a camera configured to capture an image of the vehicle object unit. A storage unit may further be provided and configured to store the image pattern information corresponding to the vehicle object unit and to store the coordinate information of an operation button positioned on the image. A control unit may further be provided and configured to control the transmission of a vehicle control command from the mobile device to the driving control unit. For example, in certain embodiments, the control unit is configured to compare the image pattern information stored in the storage unit with pattern information of the captured image, and if the patterns match, enter a vehicle remote control mode.In certain embodiments, the control unit may be configured to, when the operation button on the captured image on the mobile device is touched, identify the vehicle control command by comparing coordinate information of a touched position with the coordinate information stored in the storage unit, thereby controlling the transmission of the vehicle control command from the mobile unit to the driving control unit.

[0016] According to another aspect of the present invention, a method of controlling an in-vehicle device using augmented reality is provided. In one embodiment, the method includes pre-storing image pattern information of a dashboard center about a vehicle type in a mobile device; receiving the vehicle type information from a vehicle by the mobile device; capturing an image of a vehicle object unit, the image being displayed on a screen of the mobile device; comparing the pattern information of the image captured by the mobile device (which varies according to the vehicle type information) with the image pattern information pre-stored in the mobile device (for example, in a storage unit of the mobile device);Entering a vehicle remote control mode via the mobile device when the pattern information of the captured image matches the previously stored image pattern information; and displaying a device control command icon of the vehicle by the mobile device on the screen of the mobile device;

[0017] In one embodiment, the step of receiving the vehicle type information may include transmitting the vehicle type information of the vehicle to the mobile device via the vehicle when the mobile device approaches within a predetermined distance of the vehicle.

[0018] In one embodiment, the step of receiving the vehicle type information may include receiving the vehicle type information of the vehicle via the mobile device, due to sending a request to the vehicle for the vehicle type information, e.g., via the mobile device.

[0019] In one embodiment, the step of comparing the patterns may include dividing the captured image into a reference area and a non-reference area based on the vehicle type information and comparing pattern information of the reference area of ​​the captured image with the previously stored image pattern information.

[0020] In certain embodiments, for example, when the vehicle object unit is the center of the dashboard, an air conditioning grille unit may be the reference surface and a central region may be the non-reference surface.

[0021] In some embodiments, the method may further include, when the control command icon of the device of the vehicle is selected, radio transmitting / receiving a command signal corresponding to the icon to the driving control unit and controlling the device in the vehicle according to the command signal received from the driving control unit.

[0022] In various embodiments, the device in the vehicle can be selected from an air conditioner, an audio unit, a radio, digital multimedia broadcasting (DMB), a navigation unit, an internal lighting unit and a window.

[0023] According to yet another aspect of the present invention, a method of controlling a device in a vehicle using augmented reality is provided.In detail, the method includes previously storing image pattern information of a vehicle object unit about a vehicle type in a mobile device and coordinate information of an image of the vehicle object unit; receiving the vehicle type information from a vehicle by the mobile device; capturing an image of the vehicle object unit, the image being provided on a screen of the mobile device; comparing pattern information of the image captured by the mobile device (which varies according to the vehicle type) with the previously stored image pattern information; if the pattern information of the captured image matches the previously stored image pattern information, entering, by the mobile device, a vehicle remote control mode; receiving a control command of the device in the vehicle via the contact or manipulation (e.g.touching the image of the vehicle object unit displayed on the screen of the mobile device; and transmitting the control command of the device in the vehicle to the vehicle.

[0024] In one embodiment, the step of receiving the vehicle type information may include transmitting, by the vehicle, the vehicle type information to the vehicle to the mobile device when the mobile device approaches within a predetermined distance of the vehicle.

[0025] In one embodiment, the step of receiving the vehicle type information may include receiving, by the mobile device, the vehicle type information of the vehicle in response to sending a request for the vehicle type information to the vehicle.

[0026] In one embodiment, the step of comparing the pattern information may include dividing the captured image into a reference area and a non-reference area based on the vehicle type information, and comparing the pattern information of the reference area of ​​the captured image with the previously stored image pattern information.

[0027] In one embodiment, the step of receiving the control command of the device in the vehicle when the image of the vehicle object unit displayed on the screen of the mobile device is touched may include comparing coordinate information of a touched position with the previously stored coordinate information of the image of the vehicle object unit to identify a vehicle control command.

[0028] The present invention thus provides for remotely controlling a device in a vehicle using augmented reality of a mobile device, thereby improving the convenience of the user. Short description of the drawings

[0029] The objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings in which: Fig. 1 is a schematic diagram illustrating a system for controlling a device in a vehicle using augmented reality, according to an embodiment of the present invention; Fig. 2 is a flowchart illustrating a method of controlling a device in a vehicle using augmented reality according to an embodiment of the present invention; Fig. 3 illustrates an embodiment of the present invention wherein an image of a dashboard center is captured on a screen of a mobile device; Fig. 4 illustrates an embodiment of the present invention when the image of the dashboard center is divided into a reference area and a non-reference area; and Fig. 5 and Fig. 6 illustrates an embodiment of the present invention, wherein image pattern information of an air conditioning grille for a vehicle type is stored by the mobile device. Detailed description of the exemplary embodiment

[0030] A system for controlling a device in a vehicle using augmented reality according to the present invention will now be described more fully with reference to the accompanying drawings of Fig. 1 to 6, which illustrate some exemplary embodiments of the present invention.

[0031] Augmented reality is a user interface technology that overlays a virtual, computer-generated image based on a user's perspective onto an image of the real world. By using augmented reality, the user can gain a heightened perception and experience of reality.

[0032] Fig. 1 is a schematic diagram illustrating a system for controlling a device in a vehicle using augmented reality according to an embodiment of the present invention.

[0033] As in Fig. 1, the system may include a mobile device 100, a driving control unit 200, a vehicle object unit 300, and an in-vehicle device 400.

[0034] According to an exemplary embodiment, the mobile device captures an image of the vehicle object unit 300, receives a vehicle control command via the image, and transmits the vehicle control command to the driving control unit 200. Preferably, the mobile device 100 includes a camera 100, a storage unit 120, a radio communication unit 130, a control unit 140, and a display unit 150. In certain embodiments, the mobile device 100 may include a terminal, such as a mobile phone, in which various applications may be implemented.

[0035] The camera 110 captures the image of the vehicle object unit 300. In certain aspects, the camera 110 may not photograph an image, but rather may be in a powered-on state so that the image as viewed by the camera 110 can be displayed on the display unit 150 of the mobile device 100.

[0036] The storage unit 120 may be configured to store vehicle type information received from the driving control unit 200. The storage unit 120 may also be configured to store pattern information and coordinate information of the image of the vehicle object unit 300 about the vehicle type. For example, if the vehicle object unit 300 is the center of a dashboard, the image pattern information of the vehicle object unit 300 may indicate pattern information of an air conditioning grille.

[0037] The radio combination unit 130 is configured to communicate wirelessly with the driving control unit 200, for example via Bluetooth or other known means.

[0038] According to one embodiment of the present invention, the control unit 140 may be configured to divide a captured image (e.g., an image captured by the camera 110) of the vehicle object unit 300 into a reference area 320 and a non-reference area 330 based on the vehicle type information. Further, if it is determined that the image pattern information (about the vehicle type) of the vehicle object unit 300 stored in the storage unit 120 matches the pattern information of the reference area of ​​the image captured by the camera 110, the control unit 140 is configured to enter the vehicle remote control mode, and an icon is provided on the mobile device to allow input of a control command of the in-vehicle device.Further, upon receiving the control command of the in-vehicle device, the control unit 140 may also be configured to transmit the transmission of the in-vehicle control command to the driving control unit 200.

[0039] In certain embodiments, when an operation button positioned on the captured image is touched, the control unit 140 may be configured to detect coordinate information of a touched area and compare the coordinate information of the touched area with previously stored coordinate information of the image to identify a corresponding command of the operation button.For example, in the image of a dashboard center of a vehicle type “Sonata”, when a coordinate of an audio operation knob is stored as (A, B) and a coordinate of the digital multimedia broadcast (DMB) operation knob is stored as (C, D), and a coordinate of an area corresponding to (C, D) is touched by a user on the captured image (on the mobile device), it is determined that the user wishes to operate the DMB operation knob, and a command signal for DMB operation is transmitted to the driving control unit 200.

[0040] In preferred embodiments, when the driving control unit 200 receives a command signal from the mobile device 100, the device 400 in the vehicle is controlled according to the command signal. According to some embodiments, when the mobile device 100 approaches within a predetermined distance of the vehicle, the driving control unit 200 transmits the vehicle type information of the vehicle to the mobile device 100.

[0041] As in Fig. 1, the vehicle object unit 300 may include an object such as the center of a dashboard 310 that is to be controlled remotely.

[0042] According to embodiments of the present invention, the device 400 in the vehicle may include, for example, an air conditioner, an audio unit, a radio, a DMB, an interior lighting device, and a window up and down module, but is not limited to these.

[0043] Hereinafter, with reference to Fig. 2 describes a method of controlling a device in the vehicle using augmented reality in further detail according to an embodiment of the present invention. In detail, Fig. 2 shows an example of controlling the center of the vehicle's dashboard 310. However, it should be noted that the present invention can also be applied to various other vehicle controls, such as, but is not limited to, opening and closing a door or window of the vehicle.

[0044] As in Fig. 2, first, image pattern information of a dashboard center about the vehicle type is stored in the storage unit 120 of the mobile device 100 (S101). For example, the mobile device 100 may previously download and store the image pattern information of the dashboard center about the vehicle type, for example, via a telematics center (not shown) or via a website related to the vehicle.

[0045] In certain embodiments, the dashboard center image may be based on the vehicle type (as is the case, for example, in Fig. 3), as shown for example in Fig. 4, the air conditioning grille units on both sides are determined as the reference surface 320 and a central surface is determined as the non-reference surface 330. Each reference surface 320 can be patterned and stored according to the vehicle type, as shown, for example, in the Fig. 5 and Fig. 6 is shown. Fig. 5 shows an example of a pattern image when the air conditioning grille units are placed at both ends of the dashboard center and Fig. 6 shows an example of a pattern image when the air conditioning grille units are placed side by side in the upper area of ​​the dashboard center.

[0046] Next, the mobile device 100 and the vehicle perform radio communication between them, so that the mobile device 100 receives the vehicle type information from the driving control unit 200 of the vehicle (S102). In some embodiments, a method may be provided wherein the mobile device 100 receives the vehicle type information when the driving control unit 200 detects that the mobile device 100 is within a predetermined distance from the vehicle and then transmits the vehicle type information to the mobile device 100.In some embodiments, the method may be implemented such that when a user is in the vehicle and the mobile device 100 sends a request for the vehicle type information to the vehicle (e.g., by operating a vehicle remote control application), the mobile device 100 sends a request for the vehicle type information to the driving control unit 200, and the driving control unit 200 transmits the vehicle type information to the mobile device 100.

[0047] Next, as in Fig. 2, when the camera 110 of the mobile device 100 is operated by a user to display the dashboard center 310 on the screen of the mobile device 100 (S103), the control unit 140 divides the image of the dashboard center 310 displayed on the screen into the reference area 320 and the non-reference area 330 (S104). For example, when the vehicle type is Sonata, the air conditioning grilles on both sides are positioned as shown in Fig. 5 and therefore, the two side parts of the image of the dashboard center displayed on the screen are referred to as the reference area 320, and a central area is referred to as the non-reference area 330. Next, as shown in Fig.2, the control unit 140 compares the pattern information of the reference area 320 of an image of the dashboard center shown on the screen with the image pattern information of the dashboard center about the vehicle type previously stored in S101 (S105).

[0048] If a comparison result of S105 indicates a mismatch, the height and / or angle of the camera 110 is adjusted to position the dashboard center air conditioning grille on the mobile device screen. If the comparison result of S105 indicates a match, the control unit 140 enters the vehicle remote control mode (S106).

[0049] Next, the control unit 140 controls a dashboard center control icon to appear on the display unit 150 of the mobile device 100 (S107). For example, the dashboard center control icon may include an icon associated with a vehicle control system, such as the air conditioner, navigation unit, audio unit, DMB, interior lighting device of a vehicle, and the like.

[0050] Next, when a user selects the icon displayed on the display unit 150 of the mobile device 100 (S108), the control unit 140 transmits a command signal corresponding to the selected icon to the driving control unit 200 via the wireless communication unit 130 (S109). In certain preferred embodiments, the wireless communication unit 130 performs Bluetooth communication.

[0051] Next, the driving control unit 200 controls the device 400 in the vehicle (for example, the air conditioner, the audio unit, the navigation unit, the DMB, or the interior lighting device of a vehicle) according to the command signal received from the mobile device 100 (S110).

[0052] In the described embodiments of the present invention, it is specified that the pattern image is determined based on the shape of an air conditioning grille, the shape and / or dimension of which generally varies depending on the vehicle type. However, it should be noted that the pattern image may be determined based on the shape and / or dimension of any other control knob of a vehicle, for example, an audio control knob or a radio control knob of the dashboard center.

[0053] In addition, the use of the dashboard center control icon will be described in detail in the specific embodiments of the present invention. However, it should be noted that when setting a touch screen, a user can directly touch the center portion 330 of the dashboard center image information to input a command. Thus, for example, the coordinate information of each operation button of the center portion 330 of the dashboard center image information about the vehicle type may be previously stored in the storage unit 120. Preferably, when the operation button of the center portion 330 of the dashboard center image information is touched by the user, a corresponding command signal is identified by the control unit 140 according to the coordinate information of a position being touched and transmitted to the driving control unit 200. Symbol for each of the elements in the figures 200 Driving control unit 400 Equipment in the vehicle 100 mobile devices 110 Camera 140 control unit 130 radio communication unit 120 storage units 150 display units 310 Dashboard Center 320 reference surface 330 Non-reference surface

Claims

[1] A system for controlling a device (400) in a vehicle using augmented reality, the system comprising: a mobile device (100) configured to identify a vehicle object unit (300) as an image and receive a vehicle control command via an augmented reality implementation of the image; and a driving control unit (200) configured to transmit vehicle type information to the mobile device (100) and, upon receiving a command signal from the mobile device (100), control the device (400) in the vehicle corresponding to the command signal; and wherein the mobile device (100) is configured to: Dividing the image of the vehicle object unit (300) into a reference area and a non-reference area according to the vehicle type information; Comparing a previously stored image pattern information of the vehicle type with image pattern information of the reference area of ​​the image; and if the previously stored image pattern information matches the pattern information of the image, entering a vehicle remote control mode, wherein the mobile device (100) comprises: a camera configured to capture an image of the vehicle object unit (300); a storage unit configured to store image pattern information of the vehicle object unit (300) and the vehicle type information; a control unit configured to, when the image pattern information stored in the storage unit matches the pattern information of the captured image, enter the vehicle remote control mode, provide an icon for inputting a command, and, when the vehicle control command is input via the icon, control transmission of the vehicle control command to the driving control unit (200). [2] The system according to claim 1, wherein, when the vehicle object unit (300) is an instrument panel center of a vehicle, the control unit is configured to determine an area of ​​an air conditioning grille as the reference area. [3] The system of claim 1, wherein the device (400) in the vehicle is an air conditioner, an audio unit, a radio, a digital multimedia transmitter, a navigation unit, an interior lighting device, or a window. [4] The system according to claim 1, wherein, when the mobile device (100) approaches within a predetermined distance of a vehicle, the driving control unit (200) is configured to transmit the vehicle type information of the vehicle to the mobile device (100). [5] The system according to claim 1, wherein, when the mobile device (100) sends a request for the vehicle type information to a vehicle, the driving control device is configured to transmit the vehicle type information of the vehicle to the mobile device (100). [6] The system of claim 1, wherein the mobile device (100) includes: a camera configured to capture an image of the vehicle object unit (300); a storage unit configured to store image pattern information corresponding to the vehicle object unit (300) and coordinate information of an operation button positioned on the image; and a control unit configured to, when the stored image pattern information stored in the storage unit matches the image pattern information of the captured image, enter a remote vehicle mode, and, when the operation button on the captured image is touched, to identify the vehicle control command by comparing the coordinate information of a touched position with the coordinate information stored in the storage unit, so as to control the transmission of the vehicle control command to the driving control unit (200). [7] A method for controlling a device (400) in a vehicle using augmented reality, the method comprising: pre-storing image pattern information of a dashboard center about a vehicle type in a mobile device (100); Receiving the vehicle type information from the vehicle via the mobile device (100); capturing an image of a vehicle object unit (300) placed on a screen of a mobile device (100); Comparing, by the mobile device (100), the pattern information of the captured image which varies according to the vehicle type information with the image pattern information previously stored in the storage unit; Entering a vehicle remote control mode with the mobile device (100) when the pattern information of the captured image matches the previously stored image pattern information; and Displaying a device control command icon of the vehicle on the screen of the mobile device (100); wherein the step of comparing includes: Dividing the captured image into a reference area and a non-reference area based on the vehicle type information; and Comparing pattern information of the reference area of ​​the captured image with the previously stored image pattern information. [8] The method of claim 7, wherein the step of receiving the vehicle type information includes transmitting the vehicle type information of the vehicle to the mobile device (100) via the vehicle when the mobile device (100) is within a predetermined distance from the vehicle. [9] The method of claim 7, wherein the step of receiving the vehicle type information includes receiving the vehicle type information of the vehicle by the mobile device (100) in response to sending a request for the vehicle type information to the vehicle. [10] The method according to claim 7, wherein when the vehicle object unit (300) is the dashboard center, an air conditioning grille unit is the reference surface and a central region is the non-reference surface. [11] The method of claim 7, further comprising: Wirelessly transmitting and receiving, when the vehicle device control command icon is selected, a command signal corresponding to the icon to the driving control unit (200); and Controlling the device in the vehicle (400) according to the command signal received by the driving control unit (200). [12] The method of claim 7, wherein the device (400) in the vehicle is an air conditioning system, an audio unit, a radio, digital multimedia broadcasting, a navigation unit, an interior lighting device, or a window. [13] A method for controlling a device (400) in a vehicle using augmented reality, the method comprising: Pre-storing image pattern information of a vehicle object unit (300) about a vehicle type in a mobile device (100), and coordinate information of an image of the vehicle object unit (300); Receiving the vehicle type information from the vehicle via the mobile device (100); capturing the image of the vehicle object unit (300) which is placed on a screen of the mobile device (100); Comparing the pattern information of the captured image by the mobile device (100), which changes according to the vehicle type, with the previously stored image pattern information; Entering a vehicle remote control mode, via the mobile device (100), when the pattern information of the captured image matches the previously stored image pattern information; Receiving a control command of the device (400) in the vehicle by touching the image displayed on the screen of the mobile device (100); and Transmitting the control command of the device (400) in the vehicle to the vehicle; where the step of comparing the pattern information includes: Dividing the captured image into a reference area and a non-reference area based on the vehicle type information; and Comparing pattern information of the reference area of ​​the captured image with the previously stored image pattern information. [14] The method of claim 13, wherein the step of receiving the vehicle type information includes transmitting the vehicle type information of the vehicle to the mobile device (100) via the vehicle when the mobile device (100) is within a predetermined distance from the vehicle. [15] The method of claim 13, wherein the step of receiving the vehicle type information includes receiving the vehicle type information of the vehicle via the mobile device (100) in response to sending a request for the vehicle type information to the vehicle. [16] The method according to claim 13, wherein the step of receiving the control command of the device (400) in the vehicle when the image of the vehicle object unit (300) displayed on the screen of the mobile device (100) is touched includes comparing the coordinate information of a touched position with the previously stored coordinate information of the image of the vehicle object unit (300) to identify a vehicle control command.

Citation Information

Patent Citations

  • user greeting system for a motor vehicle

    DE102005041261A1

  • Apparatus, method and computer product for generating vehicle image

    US20070285809A1

  • Device control system

    US20090273561A1

  • Communication system for use with a vehicle

    WO2009109231A1