Method for controlling a data flow of a mirror link system
Patent Information
- Application Number
- DE102014217422
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2013-12-04
- Filing Date
- 2014-09-01
- Publication Date
- 2024-12-24
- Estimated Expiration
- 2034-09-01
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
BACKGROUNDTechnical field
[0001] The present invention relates to a method for controlling data of a mirror link system, and more particularly, to a method for controlling a data flow in a mirror link system with which data can be mirrored between a wireless terminal and an audio / video and navigation (AVN) system of a vehicle depending on whether the vehicle is being driven or from a position of a display. Description of the state of the art
[0002] Vehicles are being produced with increasingly sophisticated audio / visual and navigation systems. Audio / visual systems can include various add-on options, including multiple display screens located inside the vehicle and the ability to communicate with other devices. A navigation system can be installed in the vehicle and can obtain various types of information, such as traffic conditions or road information that is frequently changed or updated, while the vehicle is being driven. The navigation system typically provides a guidance map to guide a driver to a destination. A combined audio / video and navigation system (hereinafter referred to as an 'AVN' system) for a vehicle provides devices that can display television (TV) or video as well as provide navigation services.
[0003] A front panel of the AVN is equipped with a monitor, and the interior of the front panel is equipped with a car audio speaker, allowing a car user to listen to music and watch TV and moving images. In addition, a wireless terminal (for example, a smartphone) carried by a vehicle user can be communicatively paired / connected with the vehicle's AVN, and thus the vehicle's AVN can utilize and display information from various applications running in the wireless terminal. Generally, however, only one monitor-equipped AVN is installed in a vehicle, and each AVN displays only one image (for example, a still image or video image) at a time. Accordingly, a driver and a passenger sitting in the front passenger seat must view the same image.Furthermore, according to relevant regulations and rules, a driver cannot watch television or other moving images while driving a vehicle. As a result, a passenger sitting in the front passenger seat of the vehicle is prevented from watching television (TV) while driving a vehicle.
[0004] EP 2 654 276 A1 discloses a method for controlling data flow in a mirror link system in which an AVN system included in a vehicle is coupled to a wireless terminal, comprising: determining whether the vehicle is being driven or not; upon determining that the vehicle is not being driven, coupling the AVN system to the wireless terminal by a first streaming protocol and a first control protocol; and upon determining that the vehicle is being driven, coupling the AVN system to the wireless terminal by a second streaming protocol and a second control protocol that are different from the first streaming protocol and the first control protocol.
[0005] US 2013 / 0 194 163 A1 provides a mobile terminal and a control method therefor. Content displayed in one mobile terminal can be optimized and displayed for another mobile terminal that communicates with it. The method for controlling a mobile terminal comprises: outputting previously stored content to a first mobile terminal; and controlling transmission of the output content based on characteristic information of a second mobile terminal that is to receive at least part of the output content, wherein there is a difference between the content output to the first mobile terminal and the content that the second mobile terminal is to receive and output.
[0006] EP 2 645 752 A1 discloses an input / output limitation information storage unit that stores input / output limitation information in which limitation processing for limiting the operation input to the application and the display output from the application is prescribed by associating the limitation processing with the application. A determination unit detects a vehicle state of a vehicle and determines the limitation processing to be applied to the operation input to the application and the display output from the application based on the application running on the terminal, the vehicle state, and the input / output limitation information.The limiting unit performs the limiting processing determined by the determining unit for the operation input acquired by the input control unit and transmitted to the communication control unit, and the display output received by the communication control unit and transmitted to the communication control unit.
[0007] US 2014 / 0 120 829 A1 also describes a method for transmitting media data from a source device, the method comprising establishing a first communication session between the source device and a sink device comprising a vehicle head unit with the source device, wherein the first communication session conforms to a communication protocol. The method also comprises recognizing the sink device with the source device and through the first communication session. The method further comprises, during operation of the first communication session, establishing a second communication session between the source device and the sink device with the source device, wherein the second communication session conforms to a wireless display protocol.The method also includes transmitting, using the second communication session, media data of the second communication session from the source device to the sink device for output to an interface of the sink device. SUMMARY OF THE INVENTION
[0008] Accordingly, the present invention has been made to solve the above-mentioned problems encountered in the prior art while keeping intact the advantages achieved by the prior art.
[0009] An object to be achieved by the present invention is to provide a method for controlling a data flow in a mirror link system, with which data can be controlled which is transmitted from a wireless terminal to an AVN system depending on whether a vehicle is being driven.
[0010] Another object to be achieved by the present invention is to provide a method for controlling a data flow in a mirror link system, with which data can be controlled which is transmitted from a wireless terminal to an AVN system depending on whether a vehicle is being driven or from a position where a display of an AVN is mounted.
[0011] In one aspect of the present invention, a method for controlling data flow in a mirror link system is provided in which an AVN system included in a vehicle is coupled / connected to a wireless terminal. The method includes determining whether the vehicle is being driven or not. Upon determining that the vehicle is not being driven (e.g., the vehicle is parked), the AVN system is coupled / connected to the wireless terminal through a first streaming protocol and a first control protocol. Upon determining that the vehicle is being driven, the AVN system is coupled / connected to the wireless terminal through a second streaming protocol and a second control protocol that are different from the first streaming protocol and the first control protocol.The first streaming protocol transmits video images and video-related sounds from the wireless terminal to the AVN system, and the first control protocol controls the AVN system to output the video images and sounds transmitted to the AVN system. The second streaming protocol transmits only the video-related sounds from the wireless terminal to the AVN system (and removes / excludes the video images from the video), and the second control protocol controls the AVN system to output a still image and the sounds transmitted to the AVN system.The still image is an image previously downloaded from the wireless terminal and stored in the AVN system of the vehicle, the AVN system generates an image table indicating a plurality of stored images and transmits the generated image table to the wireless terminal, and the second control protocol controls the AVN system to output a still image based on an image index for the still image included in the image table.
[0012] The method for controlling data flow in a mirror link system may further comprise, when a new image is updated or added in the wireless terminal, the wireless terminal informing the AVN system that there is a need to update or add the new image in the image table.
[0013] The AVN system can determine a specific image among the plurality of stored images based on an image index for the specific image in the image table and simultaneously output the determined specific image and sound.
[0014] The AVN system may further continuously monitor whether the vehicle is being driven and may adjust the pairing / connection of the AVN system and the wireless terminal in real time based on the continuous monitoring of whether the vehicle is being driven.
[0015] The wireless device can be a smartphone.
[0016] The pairing / connection between the AVN system and the wireless terminal may enable the AVN system to wirelessly receive audio and / or video data from the smartphone for output on / to one or more display screens or speakers of the AVN system.
[0017] Upon determining that the vehicle is being driven, the AVN system may output sounds associated with a video from the wireless terminal, and the second control protocol may control the AVN system to output a composite image including a still image received by the AVN system from the wireless terminal superimposed with an associated image.
[0018] The still image may be an image previously downloaded from the wireless terminal and stored in the AVN system.
[0019] The AVN system may include a plurality of displays mounted at a plurality of different positions in the vehicle. Upon determining that the vehicle is being driven, the second streaming protocol may transmit only the sounds associated with a video, without the video images from the video, from the wireless terminal to a display screen of the AVN system visible to the driver of the vehicle, and may transmit both the video images and sounds to a display screen of the AVN system visible only to the occupants other than the driver. The second control protocol may control the AVN system to output a still image along with the sound to the driver and may control the AVN system to output both the video images and sounds to the occupants other than the driver.
[0020] The still image may be an image previously downloaded to and stored in the AVN system of the vehicle from the wireless terminal, the AVN system may generate an image table identifying a plurality of stored images and transmit the generated image table to the wireless terminal, and the second control protocol may control the AVN system to output a still image to the driver based on an image index for the still image included in the image table.
[0021] The method for controlling data of a mirror link system may further comprise, when a new image is updated or added in the wireless terminal, the wireless terminal informing the AVN system that there is a need to update or add the new image in the image table. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The above and other objects, features, and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. In the figures: Fig. 1 is a diagram schematically illustrating a data flow between components of a system executing a method for controlling data of a mirror link system according to an embodiment of the present invention; Fig. 2 is a flowchart illustrating a process for controlling data flow in a mirror link system according to the embodiment of the present invention; and Fig. 3 is a diagram illustrating an example in which the method for controlling data flow in a mirror link system for mirroring audio data according to the embodiment of the present invention is implemented. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] Advantages and features of the present invention and methods for achieving them are presented based on embodiments described in detail below with reference to the accompanying drawings. The present invention is not limited to the embodiments set forth herein and may be modified in various forms. These embodiments are provided so that this disclosure will be accurate and complete, and the technical teachings of the invention will be fully conveyed to those of ordinary skill in the art.
[0024] The embodiments of the present invention are not limited to the specific forms shown in the drawings. The embodiments are illustrated to clearly explain and / or simply illustrate the present invention. Embodiments of the present invention may be enlarged or otherwise shown not to scale in the accompanying drawings. Certain terms / expressions have been used herein; however, these are used only for the purpose of describing the present invention and are not used to further define the meaning or limit the scope of the present invention, which is disclosed in the appended claims.
[0025] In this section, the terms / expressions 'and / or' are used to be interpreted as including at least one of the components placed before and after the term / expression. Furthermore, the term / expression 'connected / coupled' is used to include embodiments or situations in which the parts are / will be directly connected to each other and embodiments or situations in which the parts are / will be indirectly connected to each other with other elements interposed therebetween. Unless expressly described to the contrary, a singular form includes a plural form in this specification.Furthermore, components, steps, operations and / or elements mentioned in this specification as “comprising / include” or “having / comprising” do not exclude the presence or addition of one or more other components, steps, operations and / or elements.
[0026] Embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
[0027] Fig. 1 shows a diagram schematically illustrating a data flow between components of a system that implements a method for controlling data of a mirror link system according to an embodiment of the present invention. Referring to Fig. 1, a mirror connection section system includes a client 110, a server 130, and a travel determination device 150.
[0028] The client 110 provides or participates in data communication with the server 130. The client 110 further outputs data received from the server 130 through an output unit, such as a display unit and / or an audio output unit, provided in the client 110, and enables data processed by the server 130 to be output to a user. Specifically, when the server 130 processes moving images such as a movie, a video image and an audio track of the corresponding movie can be provided to the user through the output unit (e.g., a display unit and an audio output unit) provided in the client 110.The video image and the audio track may alternatively be provided to the user by an output unit provided in other devices (e.g., in a client device or in the server 130) instead of from the output unit located in the client 110.
[0029] The following describes in detail an illustrative example relating to a smartphone serving as a wireless terminal. Many smartphones include relatively high-performance central processing units that have more computing power and offer higher performance than central processing units of typical AVN systems equipped in vehicles. Furthermore, a smartphone can provide data communication over a common carrier while operating at a higher speed. However, because the smartphone is a portable device, the size of the display for outputting a video on a smartphone is generally smaller than that of a stationary display screen provided as part of an AVN system in a vehicle. The audio or sound system of a smartphone is also generally not as powerful as that of an AVN system.Accordingly, when a smartphone-owning user enters a vehicle, they may prefer to watch or listen to the corresponding movie using a display screen and audio system of the AVN system provided in the vehicle for an enhanced viewing experience. A representative technology that can realize this is a mirror connection section.
[0030] If we look at the mirror connection section system from the perspective of Fig. 1, the smartphone that processes and outputs the data becomes the server 130. The AVN of the vehicle that receives the data output from the smartphone and outputs the received data to the user through the output unit becomes the client 110.
[0031] With reference to Fig. 1, the client 110 (e.g., the AVN system) and the server 130 (e.g., the smartphone) in the mirror link system transmit and receive data bidirectionally to and from each other. However, a main data flow is unidirectional, from the server 130 to the client 110. Specifically, the method for controlling data of a mirror link system according to the embodiment of the present invention controls the data flow between the server 130 and the client 110 depending on whether a vehicle is being driven. Accordingly, unlike a conventional mirror link system, the mirror link system described herein includes a driving determination device 150 operable to determine whether the vehicle is being driven. The driving determination device 150 can thus determine whether the vehicle is being driven or parked and provides the result of the determination to the server 130.Various methods may be used to determine whether the vehicle is being driven, and accordingly, not all examples thereof are described herein. However, as in the detailed example described below, the determination may be based on determining whether a wheel of the vehicle is in motion, whether a vehicle transmission is in or has entered a drive / drive mode, and the like, but determining whether the vehicle is being driven is not limited to the examples described herein. Further, the driving determination device 150 may be embodied in a configuration in which the driving determination device 150 is included in the AVN system of the vehicle, or embodied as a device separate and distinct from the AVN system.
[0032] Fig. 2 is a flowchart illustrating a process for controlling data flow in a mirror link system according to the embodiment of the present invention.
[0033] The method for controlling data flow in a mirror link system in which a wireless terminal is paired / connected to the AVN system with which a vehicle is equipped begins by determining whether the vehicle is being driven or not being driven (e.g., the vehicle is parked) (S110).
[0034] In step S110, the system may operate in a first mode upon determining that the vehicle is not being driven (e.g., upon determining that the vehicle is parked) based on the result of determining whether the vehicle is being driven. In the first mode, regulations and safety considerations related to the operation of an AVN system in a vehicle that is being driven are not violated, and accordingly, all video images and sounds output from the wireless terminal are transmitted to the AVN system (S130) for display to the vehicle occupants. Specifically, in the first mode, all videos, images, and sounds of the wireless terminal may be coupled to and sent to the AVN system through a first streaming protocol and a first control protocol.Specifically, the method for controlling a data flow in a mirror link system according to the embodiment of the present invention transmits all videos, images, and sounds output from the wireless terminal to the AVN system through the first streaming protocol in the first operation mode, and a first control protocol can control the AVN system to output the videos, images, and sounds transmitted to the AVN system through the display and the audio output unit provided in or coupled / connected to the AVN system.
[0035] In step S110, the system may alternatively operate in a second mode based on the result of determining whether the vehicle is being driven. Watching television and moving images while driving the vehicle may violate related regulations and / or negatively impact vehicle driving safety. As a result, in the second mode, only the sounds output from the wireless terminal are transmitted to the AVN system (S140), and the output of videos and images is stopped. Specifically, in the second mode, the sounds of the wireless terminal are coupled / connected to and sent to the AVN system through a second streaming protocol and a second control protocol.Furthermore, in the second mode, instead of outputting a video received from the wireless terminal, the AVN system outputs a corresponding / appropriate image along with the sound output and received from the wireless terminal. Specifically, the method for controlling a data flow in a mirror link system according to the embodiment of the present invention transmits only the sounds excluding the videos from the videos and the sounds output from the wireless terminal to the AVN system through the second streaming protocol in the second operation mode, and the second control protocol can control the AVN system to output a corresponding / appropriate image through the display of the AVN system while controlling to output the sound transmitted to the AVN system by the audio output unit of the AVN system.
[0036] Next, when the vehicle's running is completed, the process returns to the previous step from step S110 (S150). Furthermore, steps S110 to S150 described above may be repeated depending on the vehicle's running.
[0037] The second operating mode is described in more detail below. As described above, the second operating mode is used in situations where the vehicle is being driven. In the second operating mode, even if the wireless terminal is paired / connected to the AVN system, only the video and audio output from the wireless terminal are transmitted to the vehicle's AVN system.
[0038] As a result, viewing moving images such as movies or television while driving is restricted for safety reasons. Instead of outputting a video image, the AVN system outputs a corresponding / appropriate image along with the received audio, depending on the control of the second control protocol.
[0039] According to the method for controlling data flow in a mirror link system according to the embodiment of the present invention, the image output in the second mode may include one or more of a plurality of images corresponding to the applications executed by the wireless terminal. The plurality of images may be previously downloaded to and stored in the AVN system of the vehicle from the wireless terminal. Specifically, the downloaded image may be stored in a memory included in the AVN system of the vehicle, but the embodiment of the present invention is not limited thereto.
[0040] Further, the AVN system may generate an image table including each of the plurality of stored images. The image table may include an image index that may specify each image stored in the memory. The image table (and image indexes) generated in the AVN system may be transmitted to the wireless terminal, and the second control protocol may perform control to selectively specify and output an identification / label for the image to be output along with the audio output from the AVN system during the second mode. The identification / label for the image to be output or displayed by the AVN system identifies the image index included in the image table for the specified image.Specifically, upon receiving the second control protocol, the AVN system may determine the specific image to display from the images previously stored in the vehicle's memory based on the received image indexes, and may simultaneously output the determined specific image along with the sound received through the second streaming protocol.
[0041] Fig. 3 is a diagram illustrating an example in which the data flow control method is implemented in a mirror link system for mirroring audio data according to the embodiment of the present invention. An image table 210 stored in the vehicle's memory includes a plurality of images A to N, and each image has an image index 1 to n corresponding to the image.
[0042] In detail, the process for generating and outputting the output of the display of the AVN system in the second mode comprises receiving audio (e.g., voice or another sound track) data and an image index (e.g., image index 2) from the server (e.g., the wireless terminal such as a smartphone). The image table 210 specifies an image (e.g., image B) corresponding to the received image index (e.g., image index 2), and the AVN system outputs the specified image B (220). A composite image 230 obtained by combining (e.g.,A composite image 250 obtained by (i.e., superimposing) the output image B with an associated image (for example, a rewind image depicting backward-pointing arrows, a temporary pause image, a fast-forward image depicting forward-pointing arrows, or an arrow image for play depicting a single forward-pointing arrow) may be displayed (240) at the same time as the audio is output from the AVN system. That is, the corresponding composite image 250 is output on the display of the vehicle's AVN system while the audio corresponding to the specific image B is output. In this case, the corresponding composite image 250 is a still image and, in particular, is not a moving image, and accordingly, has no influence on the safety of driving the vehicle.Furthermore, fewer resources are used in the second mode compared to the resources used to simultaneously stream the video and audio in real time, and therefore it is possible to reduce the power consumption and communication bandwidth usage by the vehicle's AVN system.
[0043] Furthermore, according to the method for controlling a data flow in a mirror link system according to the embodiment of the present invention, when the images included in the applications executed by the wireless terminal are updated or a new image is added (e.g., in response to update of the application or to installation of a new application), the wireless terminal may inform the AVN system of the update and transmit the updated or newly added image to the AVN system so that the AVN system can update the new image and add it to a memory and to the image table.
[0044] Furthermore, even when an AVN system includes a plurality of display screens provided at different positions in the vehicle, including display screens for viewing by only the front passengers, the method for controlling data flow in a mirror link system according to the embodiment of the present invention can perform mirror link services that do not adversely affect vehicle driving safety. Specifically, the AVN system can output different specialized video / image output on different display screens depending on whether a display screen is visible only to the driver or visible only to the front passengers. In this case, the data is controlled depending on a first mode and a second mode by determining whether the vehicle is being driven.Here, the first mode is the same as the first mode mentioned above, and therefore its detailed description is omitted.
[0045] When describing the second mode, the display screens visible to passengers other than the driver can simultaneously receive video and audio through the AVN system. In contrast, the display screen(s) visible to the driver only receive audio through the AVN system, even if video and audio are simultaneously output from the wireless terminal, and the corresponding still image is provided to the driver along with the audio.
[0046] Described in detail, in the second mode, the second streaming protocol transmits only the sounds (except the video images) from the video output from the wireless terminal to the driver of the vehicle. Further, both the video images and the sounds are output from the wireless terminal and transmitted to the passengers other than the driver. Further, the second control protocol controls the sound transmitted to the driver and simultaneously controls an image to be output to the driver, so that the image appropriately output to the driver by the AVN system is output together with the sound output from the wireless terminal. Further, the second control protocol controls both the video image and the sound to be output to the front passengers other than the driver.
[0047] In the AVN system having the plurality of displays, when the images included in the applications executed by the wireless terminal are updated or when a new image is added, the wireless terminal may inform the AVN system of the updated or added image, and the updated or added image is transmitted to the AVN system for storage in a memory.
[0048] Further, the AVN system may generate the image table including the plurality of stored images and the image indexes, and may transmit the generated image table to the wireless terminal. The second control protocol may perform control to selectively specify and output to the driver the image to be output by the AVN system along with the sound output by the AVN system in the second mode, based on the image indexes included in the image table. Specifically, upon receiving commands in accordance with the second control protocol, the AVN system may determine the specific image to be displayed from the images previously stored in the vehicle based on the received image index. The AVN system may then simultaneously output the determined specific image and sound received by the second streaming protocol to the driver.
[0049] As described above, the method for controlling data flow in a mirror link system according to the embodiment of the present invention determines whether the vehicle is being driven. The method can then couple / connect the video and audio output from the wireless terminal to the AVN system when the vehicle is stopped, but only couple / connect the audio from the wireless terminal to the AVN system of the vehicle when the vehicle is being driven. The method can cause only an appropriate image to be displayed on the display of the AVN system when the vehicle is being driven. As a result, real-time mirroring technology can be applied even to the AVN system of a low-quality vehicle, and moving images are not provided to the driver in situations where the vehicle is being driven.As a result, with the mirror linking section, safety is not compromised because visual distractions for the driver are reduced. Furthermore, if the AVN system's display is provided individually for the front passengers, separate from the driver, the video and audio can be provided in real time to all vehicle occupants except the driver. As such, when there are multiple occupants in the vehicle, the individual mirror linking section service is provided to allow the front passengers to watch a video while simultaneously listening to the output audio, while the driver is provided only with the output audio and a still image.
[0050] According to the method for controlling a data flow in a mirror link system according to the embodiments of the present invention, it is possible to control the data transmitted from the wireless terminal to the AVN depending on whether the vehicle is being driven.
[0051] Furthermore, it is possible to control the data transmitted from the wireless terminal to the AVN depending on whether the vehicle is being driven and the position at which the display of the AVN is mounted.
[0052] As described hereinabove, although the embodiments of the present invention have been described for illustrative purposes, one of ordinary skill in the art will recognize that various modifications, additions, and substitutions are possible without departing from the scope and spirit of the invention as disclosed in the appended claims. Accordingly, the scope of the present invention is not construed as being limited to the described embodiments, but is determined by the appended claims and their equivalents. In consideration of the above contents, if the modifications and changes of the present invention belong to the scope / range of the following claims and equivalents, the present invention is construed as including the changes and modifications of the present invention. REFERENCE NUMERALS OF EACH OF THE ELEMENTS IN THE FIGURES 110 CLIENTS 130 SERVERS 150 DRIVING CONTROL DEVICE 210 PICTURE TABLE 230 COMPOSITE IMAGE 250 COMPOSITE IMAGE
Claims
[1] A method for controlling a data flow in a mirror link system in which an AVN system included in a vehicle is coupled to a wireless terminal, comprising: Determine whether the vehicle is being driven or not; upon determining that the vehicle is not being driven, coupling the AVN system to the wireless terminal through a first streaming protocol and a first control protocol; and upon determining that the vehicle is being driven, coupling the AVN system to the wireless terminal through a second streaming protocol and a second control protocol that are different from the first streaming protocol and the first control protocol, wherein the first streaming protocol transmits video images and video-related sounds from the wireless terminal to the AVN system, and the first control protocol controls the AVN system to output the video images and sounds transmitted to the AVN system; wherein the second streaming protocol transmits only the sounds associated with a video from the wireless terminal to the AVN system, and the second control protocol controls the AVN system to output a still image and the sounds transmitted to the AVN system; and wherein the still image is an image previously downloaded from the wireless terminal and stored in the AVN system, the AVN system generates an image table (210) identifying a plurality of stored images and transmits the generated image table (210) to the wireless terminal, and the second control protocol controls the AVN system to output the still image based on an image index for the still image included in the image table (210). [2] The method of claim 1, further comprising: when a new image is updated or added in the wireless terminal, the wireless terminal informs the AVN system that there is a need to update or add the new image in the image table (210). [3] The method of claim 1, wherein the AVN system determines a specific image among the plurality of stored images based on an image index for the specific image in the image table (210) and simultaneously outputs the determined specific image and sound. [4] The method of claim 1, further comprising: continuously monitoring whether the vehicle is being driven; and Setting the pairing of the AVN system and the wireless terminal in real time based on continuously monitoring whether the vehicle is being driven. [5] The method of claim 1, wherein the wireless terminal is a smartphone. [6] The method of claim 5, wherein the coupling between the AVN system and the wireless terminal enables the AVN system to wirelessly receive audio and / or video data from the smartphone for output on / to one or more display screens or audio speakers of the AVN system. [7] The method of claim 1, wherein upon determining that the vehicle is being driven, the AVN system outputs sounds associated with a video from the wireless terminal, and the second control protocol controls the AVN system to output a composite image (230, 250) including a still image received by the AVN system from the wireless terminal superimposed with an associated image. [8] The method of claim 7, wherein the still image is an image previously downloaded from the wireless terminal and stored in the AVN system. [9] The method of claim 1, wherein the AVN system comprises a plurality of displays mounted at a plurality of different positions in the vehicle, upon determining that the vehicle is being driven, the second streaming protocol transmits only the sounds associated with the video without the video images from the video from the wireless terminal to a display screen of the AVN system visible to one driver of the vehicle, and transmits both the video images and the sounds to a display screen of the AVN system visible only to passengers other than the driver, and the second control protocol controls the AVN system to output still images along with audio to the driver and controls the AVN system to output both video images and audio to the occupants except the driver. [10] The method of claim 9, wherein the still image is the image previously downloaded and stored on the vehicle's AVN system from the wireless terminal, the AVN system generates the image table (210) identifying the plurality of stored images and transmits the generated image table (210) to the wireless terminal, and the second control protocol controls the AVN system to output the still image to the driver based on the image index for the still image included in the image table (210). [11] The method of claim 9, further comprising: when a new image is updated or added in the wireless terminal, the wireless terminal informs the AVN system that there is a need to update or add the new image in the image table (210).
Citation Information
Patent Citations
In-vehicle device, control method thereof, and remote control system
EP2645752A1
Method of controlling interaction between mobile electronic device and in-vehicle electronic system and devices using the same
EP2654276A1
Mobile terminal and control method thereof
US20130194163A1
Establishing a wireless display session between a computing device and a vehicle head unit
US20140120829A1
