Vehicle-mounted device, control method for vehicle-mounted device, and control program for vehicle-mounted device
By establishing a communication connection between the in-car device and the mobile phone, image mirror transmission and shortcut menu operation are realized, and the problem of difficulty in displaying the content of the mobile phone screen on the in-car device and operating the mobile phone in the prior art is solved, and the interaction and convenience of the in-car device and mobile phone are improved.
Patent Information
- Application Number
- JP2021141041
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-08-31
- Publication Date
- 2025-04-22
- Estimated Expiration
- 2041-08-31
AI Technical Summary
The prior art is difficult to facilitate displaying the content of the mobile phone screen on the in-vehicle device and operating the mobile phone.
By establishing a communication connection between the in-car device and the mobile phone, image mirror transmission is realized, and the content of the mobile phone screen is displayed on the in-car device. A shortcut menu is provided, allowing users to operate specific applications in the mobile phone through the in-car device.
It realizes the convenient display of mobile phone screen content on in-car devices, and easily operates applications in the mobile phone through shortcut menus, improving the interaction and convenience of in-car devices and mobile phones.
Smart Images

Figure 0007666245000001 
Figure 0007666245000002 
Figure 0007666245000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an in-vehicle device, a control method for an in-vehicle device, and a control program for an in-vehicle device. [Background technology]
[0002] There are an increasing number of occasions in which mobile terminals such as smartphones are used by connecting them to in-vehicle devices such as car navigation devices or car audio devices (see Patent Document 1). In recent years, a function has been put into practical use in which an image displayed on a display of a mobile terminal is displayed on the display of the in-vehicle device and the mobile terminal is operated via the in-vehicle device. Standards that realize this type of function include CarPlay (registered trademark) provided by Apple Inc. and Android Auto provided by Google LLC. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2013-108851 A Summary of the Invention [Problem to be solved by the invention]
[0004] It is desirable to provide a function that allows images displayed on the display of a mobile terminal to be displayed on the display of the in-vehicle device, even if the in-vehicle device does not comply with the above-mentioned standards, and enables convenient operation of the mobile terminal via the in-vehicle device.
[0005] The present invention aims to provide an in-vehicle device, a control method for the in-vehicle device, and a control program for the in-vehicle device, which can display an image displayed on the display of a mobile terminal on the display of the in-vehicle device and enable convenient operation of the mobile terminal via the in-vehicle device. [Means for solving the problem]
[0006] The present invention relates to a method and apparatus for providing a portable terminal that includes the steps of: a first display; a mirroring communication unit that communicates with a portable terminal in order to display an image displayed on a second display of the portable terminal on the first display; a graphical user interface that displays an image displayed on the second display acquired by the mirroring communication unit on the first display, and displays on the first display a shortcut menu including an application program call button for starting an application program of a predetermined category installed on the portable terminal; and application program registration information managed by the portable terminal, the application program being registered as an application program to be started when the application program call button is operated among a plurality of application programs included in the category. Contains specific information that identifies the application program a storage unit that stores the application program registration information when the mirroring communication unit acquires the application program registration information; a mobile terminal operating system communication unit that communicates with the operating system of the mobile terminal; When the graphical user interface detects that the application program call button in the shortcut menu is operated, the mirroring communication unit The application program registration information stored in the storage unit is used to acquire specific information for identifying an application program to be started, and the mobile terminal operating system communication unit, in response to a request from the mirroring communication unit to start an application program registered in the application program registration information, designates the application program to be started to the operating system of the mobile terminal using the acquired specific information, and starts the specified application program. Provide the required on-board device.
[0007] The present invention relates to a method for connecting an in-vehicle device having a first display and a portable terminal having a second display to communicate with each other, displaying an image displayed on the second display on the first display, displaying a shortcut menu on the first display including an application program call button for starting an application program of a predetermined category installed on the portable terminal, and displaying application program registration information managed by the portable terminal, the application program being registered as an application program to be started when the application program call button is operated among a plurality of application programs included in the category. Contains specific information that identifies the application programThe application program registration information is acquired and stored in a storage unit. When it is detected that the application program call button in the shortcut menu is operated, The method obtains specification information for specifying an application program to be started from the application program registration information stored in the storage unit, and in response to a start request for an application program registered in the application program registration information, specifies the application program to be started using the obtained specification information to an operating system of the mobile terminal, thereby starting the specified application program. A method for controlling the required in-vehicle device is provided.
[0008] The present invention provides a method for connecting an in-vehicle device having a first display and a mobile terminal having a second display to a computer mounted on the in-vehicle device and communicating with each other, and displaying an image displayed on the second display on the first display; displaying on the first display a shortcut menu including an application program call button for starting an application program of a predetermined category installed on the mobile terminal; and application program registration information managed by the mobile terminal, the application program being registered as an application program to be started when the application program call button is operated among a plurality of application programs included in the category. Contains specific information that identifies the application program obtaining application program registration information and storing it in a storage unit; and upon detecting that the application program call button in the shortcut menu has been operated, a step of acquiring specific information for identifying an application program to be started from the application program registration information stored in the storage unit; and, in response to a request to start an application program registered in the application program registration information, designating an application program to be started using the acquired specific information to an operating system of the mobile terminal, thereby starting the specified application program. The present invention provides a control program for an in-vehicle device that executes the steps of: Effect of the Invention
[0010] According to the vehicle-mounted device, the control method for the vehicle-mounted device, and the control program for the vehicle-mounted device of the present invention, an image displayed on the display of the mobile terminal can be displayed on the display of the vehicle-mounted device, and the mobile terminal can be conveniently operated via the vehicle-mounted device. [Brief description of the drawings]
[0011] [Figure 1] 2 is a block diagram showing a state in which the vehicle-mounted device according to the embodiment is connected to a mobile terminal; FIG. [Diagram 2]1 is a block diagram showing a schematic hardware configuration of an in-vehicle device according to an embodiment; [Diagram 3] FIG. 2 is a block diagram showing a schematic hardware configuration of a mobile terminal. [Figure 4] 4A to 4C are diagrams showing transitions of images displayed on a display of the vehicle-mounted device when the vehicle-mounted device of the embodiment is connected to a mobile terminal; [Diagram 5] 11A to 11C are diagrams illustrating an example of an operation for registering a music playback application program, a map display application program, and a video playback application program using a mobile terminal. [Figure 6A] FIG. 5 is a diagram showing an example of a home screen of the portable terminal displayed on the display of the vehicle-mounted device when the user operates the home transition button in (d) of FIG. [Figure 6B] FIG. 4D shows an example of an image displayed on the display of the vehicle-mounted device when the user operates the music playback application program execution button. [Figure 6C] FIG. 4(d) is a diagram showing an example of an image displayed on the display of the vehicle-mounted device when the user operates the map display application program. [Figure 6D] FIG. 4(d) is a diagram showing an example of an image displayed on the display of the vehicle-mounted device when the user operates the video playback application program. [Figure 7] This is a sequence diagram showing the operation of mirroring and executing a specified application program when a mobile terminal equipped with an operating system that requires the operation of the mobile terminal operating system communication unit is connected to an in-vehicle device of one embodiment. [Figure 8] FIG. 11 is a sequence diagram showing the operation of mirroring and executing a specified application program when a mobile terminal equipped with an operating system that does not require the operation of the mobile terminal operating system communication unit is connected to an in-vehicle device of one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, an in-vehicle device, a control method for the in-vehicle device, and a control program for the in-vehicle device according to an embodiment will be described with reference to the accompanying drawings.
[0013] 1, the vehicle-mounted device 1 and the mobile terminal 2 are connected, for example, by a USB (Universal Serial Bus) cable 3. The vehicle-mounted device 1 and the mobile terminal 2 may be connected by short-range wireless communication such as wireless LAN (Wi-Fi).
[0014] 2 and 3 show schematic hardware configurations of the vehicle-mounted device 1 and the mobile terminal 2, respectively. As shown in Fig. 2, the vehicle-mounted device 1 includes a central processing unit (hereinafter, CPU) 101, a storage medium 102, a working memory 103, a display 104 with a touch panel (hereinafter, abbreviated as display 104), a communication unit 105, and a USB terminal 106. The storage medium 102 is a non-transitory recording medium such as a flash memory. The working memory 103 can be composed of a RAM. The CPU 101, the storage medium 102, and the working memory 103 may be composed of a microcomputer.
[0015] As shown in Fig. 3, the mobile terminal 2 includes a central processing unit (hereinafter, CPU) 201, a storage medium 202, a working memory 203, a display 204 with a touch panel (hereinafter, abbreviated as display 204), a communication unit 205, and a USB terminal 206. The storage medium 202 is a non-transitory recording medium such as a flash memory. The working memory 203 can be configured with a RAM. The CPU 201, the storage medium 202, and the working memory 203 may be configured with a microcomputer. If the display 204 is a first display, the display 204 is a second display.
[0016] When the vehicle-mounted device 1 and the portable terminal 2 are connected by short-range wireless communication, the vehicle-mounted device 1 and the portable terminal 2 each include a short-range wireless communication unit.
[0017] Returning to Figure 1, the vehicle-mounted device 1 includes an operating system (hereinafter, OS) 10, a mobile terminal operating system communication unit (hereinafter, mobile terminal OS communication unit) 11, a mirroring application program (hereinafter, mirroring App) 12, a graphical user interface (hereinafter, GUI) 13, and a storage unit 14.
[0018] The in-vehicle device 1 operates when the CPU 101 executes the OS 10 stored in the storage medium 102. The CPU 101 executes the mirroring App 12 on the OS 10, thereby operating the mirroring communication unit 121. The mobile terminal OS communication unit 11 and the GUI 13 also include application programs (hereinafter, Apps) stored in the storage medium 102. The CPU 101 executes these Apps on the OS 10, thereby operating the mobile terminal OS communication unit 11 and the GUI 13.
[0019] The mirroring App 12 and the apps included in the mobile terminal OS communication unit 11 and the GUI 13 constitute a control program of the vehicle-mounted device 1. The mirroring App 12 and the apps included in the GUI 13 may constitute a control program of the vehicle-mounted device 1. The mobile terminal OS communication unit 11 may not need to operate according to the OS installed in the mobile terminal 2.
[0020] The storage unit 14 may be a partial area of the storage medium 102 , or may be a storage medium different from the storage medium 102 .
[0021] The mobile terminal 2 includes an OS 20, a mirroring App 21, a music playback application program (hereinafter, music playback App) 22, a map display application program (hereinafter, map display App) 23, and a video playback application program (hereinafter, video playback App) 24. The OS 20, the mirroring App 21, the music playback App 22, the map display App 23, and the video playback App 24 are stored in a storage medium 202. The mobile terminal 2 operates when the CPU 201 executes the OS 20. When the CPU 201 executes the mirroring App 21 on the OS 20, a mirroring communication unit 211 and an application program management unit (hereinafter, App management unit) 212 operate.
[0022] The CPU 201 executes a music playback App 22, a map display App 23, and a video playback App 24 on the OS 20. The music playback App 22 is an App for receiving a music streaming service, which is one category of Apps. The mobile terminal 2 may be provided with a plurality of music playback Apps 22. The music playback App 22 may be an App for playing music content stored in the storage medium 202. Here, it is assumed that the music playback App 22 is an App for receiving a music streaming service.
[0023] The map display App 23 is an App that displays a map provided by a map providing service, which is one of the App categories, on the display 204. The mobile terminal 2 may be provided with a plurality of map display Apps 23. The video playback App 24 is an App for receiving a video providing service, which is one of the App categories. The mobile terminal 2 may be provided with a plurality of video playback Apps 24. The video playback App 24 may be an App for playing video content stored in the storage medium 202.
[0024] The transition of the screen displayed on the display 104 when the vehicle-mounted device 1 and the mobile terminal 2 are connected will be described with reference to the transition diagram shown in Fig. 4. With the vehicle-mounted device 1 and the mobile terminal 2 connected, the CPUs 101 and 201 execute the mirroring Apps 12 and 21, respectively. Then, the CPU 101 displays on the display 104 a message indicating that it is waiting for a connection with the mobile terminal 2, as shown in Fig. 4(a), and when a session is established, displays a message indicating that the connection between the two devices has been completed, as shown in Fig. 4(b). In Fig. 4(b), a warning message is displayed to warn the user about the precautions to take when connecting the mobile terminal 2 to the vehicle-mounted device 1 and using the mobile terminal 2. If the user agrees to the warning message, the connection between the vehicle-mounted device 1 and the mobile terminal 2 is completed, and a message indicating that the connection has been completed may be displayed.
[0025] When the connection between the vehicle-mounted device 1 and the portable terminal 2 is completed as shown in (b) of Fig. 4, the CPU 101 (mirroring communication unit 121 and GUI 13) displays the image 241 displayed on the display 204 of the portable terminal 2 on the display 104 as shown in (c) of Fig. 4. (c) of Fig. 4 shows a state in which the image 241 displayed on the display 204 is mirrored on the display 104.
[0026] In FIG. 4(c), image 241 is displayed vertically with its left and right sides displayed in black because the mobile terminal 2 is arranged with its longitudinal direction vertical. If the mobile terminal 2 is arranged with its longitudinal direction horizontal, image 241 would be displayed horizontally on display 104. Also, in FIG. 4(c), image 241 is an image displaying an album because display 204 of mobile terminal 2 is in a state where it is displaying an album. The type of image 241 depends on the state of display 204 of mobile terminal 2. If display 204 of mobile terminal 2 is displaying a home screen, image 241H mirroring the home screen of mobile terminal 2 is displayed instead of image 241, as shown in FIG. 6A.
[0027] In (c) of Fig. 4, CPU 101 (GUI 13) superimposes a vertically long menu bar 130, for example, on the right end of display 104. Menu bar 130 includes a shortcut menu call button 131, a left movement button 132, a home transition button 133, and a delete button 134. When the user touches shortcut menu call button 131, CPU 101 transitions to the state shown in (d) of Fig. 4. Note that the action of "touching" indicates "operating".
[0028] 4(b) to (d), the image 241 displayed on the display 204 of the mobile terminal 2 is displayed on the display 104 as shown in Fig. 4(c). In this way, it can be easily recognized that the image 241 displayed on the display 204 has been shifted to a state where it is mirrored on the display 104.
[0029] 4(c), when the user touches left movement button 132, CPU 101 moves menu bar 130 to the left end. When menu bar 130 moves to the left end, CPU 101 displays a right movement button in place of left movement button 132. When the user touches home transition button 133, CPU 101 instructs CPU 201 of mobile terminal 2 to transition to the home screen, and the home screen of mobile terminal 2 is displayed on display 104. When the user touches delete button 134, CPU 101 deletes menu bar 130.
[0030] After the menu bar 130 has been erased, it is possible to display it again on the display 104 by operating a predetermined operation button on the vehicle-mounted device 1, thereby returning to the state shown in FIG. 4(c).
[0031] 4(d) will be described in detail. When the user touches shortcut menu call button 131, CPU 101 grays out image 241 and menu bar 130, and CPU 101 (GUI 13) superimposes shortcut menu 135. Shortcut menu 135 includes a music playback application program call execution button (hereinafter, music playback App call button) 137, a map display application program call button (hereinafter, map display App call button) 138, a video playback application program call button (hereinafter, video playback App call button) 139, and a back button 1310.
[0032] The music playback app call button 137, the map display app call button 138, and the video playback app call button 139 are examples of shortcut buttons associated with apps installed in the mobile terminal 2.
[0033] The GUI 13 functions as a display control unit that generates shortcut buttons associated with one or more application programs installed in the mobile terminal 2 and displays the shortcut buttons on the display 104 by superimposing them on the image output from the mobile terminal 2.
[0034] 4(c) or 4(d), the mobile terminal 2 can register a music playback app that is to be started when the user touches a music playback app call button 137. The mobile terminal 2 can also register a map display app that is to be started when the user touches a map display app call button 138, and can register a video playback app that is to be started when the user touches a video playback app call button 139.
[0035] An example of an operation for registering a music playback App, a map display App, and a video playback App using the mobile terminal 2 will be described with reference to Fig. 5. In Fig. 5(a), when the user touches a shortcut setting button 400 displayed on the display 204 of the mobile terminal 2, the CPU 201 displays a screen for setting a shortcut shown in Fig. 5(b). The screen shown in Fig. 5(b) includes state information 401 indicating that the screen is for setting a shortcut, a back button 402, and App registration transition buttons 407-409 for selecting and registering a music playback App, a map display App, and a video playback App, respectively.
[0036] In (b) of Fig. 5, when the user touches, for example, app registration transition button 407, CPU 201 displays a screen for selecting a music playback app, as shown in (c) of Fig. 5, on display 204. The screen shown in (c) of Fig. 5 includes status information 403 indicating that this is a screen for selecting an app, a back button 404, and app options 417. In the example shown in (c) of Fig. 5, app options 417 include three options: distribution service G, distribution service S, and "no allocation" indicating that no specific music playback app is to be assigned.
[0037] Distribution service G and distribution service S may be music streaming services corresponding to an App installed on the mobile terminal 2 as the music playback App 22. App selection 417 may include as options a plurality of commonly used music streaming services, regardless of whether they are installed on the mobile terminal 2 as the music playback App 22. If, for example, distribution service S is selected by app selection 417, characters indicating the selected distribution service S are displayed on app registration transition button 407.
[0038] Similarly, when the user touches app registration transition button 408, CPU 201 displays a screen for selecting a map display app on display 204. When the user touches app registration transition button 409, CPU 201 displays a screen for selecting a video playback app on display 204. App registration transition button 408 displays text indicating the selected map display app, and app registration transition button 409 displays text indicating the selected video playback app.
[0039] The app management unit 212 manages the music playback app, map display app, and video playback app registered as above. The app management unit 212 manages information indicating whether a specific app has been registered as a music playback app, map display app, or video playback app. The app management unit 212 manages an ID (call ID) for calling a specific app, in addition to information indicating whether a specific app has been registered.
[0040] Information managed by the App management unit 212 is referred to as application program registration information (hereinafter, App registration information). The call ID is specific information that identifies an application program to be started among multiple application programs included in the App category. The call ID may be a character string related to a registered music streaming service, map providing service, or video providing service.
[0041] In (d) of Fig. 4, when the user touches the music playback App call button 137, the CPU 101 instructs the mobile terminal 2 to launch the music playback App 22. The CPU 201 launches the music playback App 22 to receive the music streaming service by the preselected distribution service S. The display 204 of the mobile terminal 2 displays an image of the music streaming service by the distribution service S. Accordingly, as shown in Fig. 6B, the CPU 101 displays an image 247 of the music streaming service by the distribution service S on the display 104.
[0042] In (d) of Fig. 4, when the user touches the map display App call button 138, the CPU 101 instructs the mobile terminal 2 to start the map display App 23. The CPU 201 starts the map display App 23 to display a map provided by a preselected map providing service on the display 204. The display 204 displays the map provided by the map providing service. Accordingly, as shown in Fig. 6C, the CPU 101 displays a map 248 provided by the map providing service on the display 104.
[0043] In (d) of Fig. 4, when the user touches the video playback App call button 139, the CPU 101 instructs the mobile terminal 2 to start the video playback App 24. The CPU 201 starts the video playback App 24 to display an image from a preselected video providing service on the display 204. The display 204 displays the image from the video providing service. Accordingly, as shown in Fig. 6D, the CPU 101 displays an image 249 from the video providing service on the display 104.
[0044] A button that does not specify any one of the music playback app call button 137, the map display app call button 138, and the video playback app call button 139 will be referred to as an application program call button (hereinafter, an app call button). The app call button may include app call buttons other than the music playback app call button 137, the map display app call button 138, and the video playback app call button 139.
[0045] 7 and 8, the operation of mirroring an image displayed on the display 204 on the display 104 and starting a specific App in cooperation with the CPU 101 of the in-vehicle device 1 and the CPU 201 of the mobile terminal 2 described above will be described in detail. Fig. 7 is a sequence diagram when the mobile terminal 2 equipped with the OS 20 that requires the operation of the mobile terminal OS communication unit 11 is connected to the in-vehicle device 1. Fig. 8 is a sequence diagram when the mobile terminal 2 equipped with the OS 20 that does not require the operation of the mobile terminal OS communication unit 11 is connected to the in-vehicle device 1.
[0046] First, the sequence diagram shown in Fig. 7 will be described. The vehicle-mounted device 1 and the mobile terminal 2 are connected, the mirroring communication units 121 and 211 communicate with each other, and the mirroring connection is completed in step S701. In step S702, the mirroring communication unit 121 acquires an image (such as the image 241 or the home screen 241H) displayed on the display 204 of the mobile terminal 2, and instructs the GUI 13 to display the mirrored image on the display 104. In step S703, the GUI 13 displays the mirrored image on the display 104 (corresponding to (c) in Fig. 4).
[0047] In step S704, the mirroring communication unit 211 accesses the app management unit 212 to acquire app registration information. Here, the app registration information acquired by the mirroring communication unit 211 includes information indicating whether a specific app has been registered and a call ID for calling the specific app. In step S705, the mirroring communication unit 211 notifies the mirroring communication unit 121 of the app registration information. As a result, the mirroring communication unit 121 acquires the app registration information.
[0048] In step S706, the mirroring communication unit 121 stores the acquired App registration information in the storage unit 14. The App registration information stored in the storage unit 14 includes information indicating whether a specific App has been registered and a call ID. When the user 5 shown in FIG. 7 executes an operation to call up the shortcut menu 135 in step S707, the GUI 13 accesses the storage unit 14 and acquires the App registration information in step S708. In step S709, the GUI 13 displays the shortcut menu 135 on the display 104 (corresponding to (d) in FIG. 4).
[0049] At this time, the GUI 13 switches between enabling and disabling the app call button depending on the presence or absence of app registration information. An enabled app call button means that the app call button is displayed in an active state, and an disabled app call button means that the app call button is displayed in an inactive state. The GUI 13 may display only enabled app call buttons and hide disabled app call buttons. As described in (c) of FIG. 5, when the mobile terminal 2 selects "unassigned" for any of the registered music playback app, map display app, and video playback app, the app call button corresponding to the app for which "unassigned" was selected is disabled or hidden.
[0050] The App call button (shortcut button) in the shortcut menu 135 is associated with the presence or absence of App registration information. The App registration information is associated with a call ID. Therefore, the call ID stored in the storage unit 14 is associated with the App call button in the shortcut menu 135 displayed on the display 104.
[0051] In step S710, the user 5 operates any one of the app call buttons, the music playback app call button 137, the map display app call button 138, and the video playback app call button 139. Here, it is assumed that app registration information exists for all of the music playback app, the map display app, and the video playback app.
[0052] Then, in step S711, the GUI 13 requests the mirroring communication unit 121 to start a shortcut. Starting a shortcut means starting a registered music playback App when the music playback App call button 137 is operated. Starting a shortcut means starting a registered map display App when the map display App call button 138 is operated, and means starting a registered video playback App when the video playback App call button 139 is operated.
[0053] In step S712, the mirroring communication unit 121 accesses the storage unit 14 to acquire a call ID. In step S713, the mirroring communication unit 121 requests the mobile terminal OS communication unit 11 to start up the App.
[0054] In step S714, the mobile terminal OS communication unit 11 transmits the call ID to the mobile terminal 2, and requests the OS 20 of the mobile terminal 2 to start an app. In step S715, the OS 20 instructs the start of an app corresponding to the call ID. As a result, in step S716, one of the apps corresponding to the call ID, the music playback app 22, the map display app 23, and the video playback app 24, is started.
[0055] 7, steps S712 to S714 are processes in which the mirroring communication unit 121 requests the mobile terminal 2 to start an App registered in the App registration information stored in the storage unit 14. When the GUI 13 detects that the App call button in the shortcut menu 135 has been operated and the mirroring communication unit 121 receives a request from the GUI 13 to start a shortcut in step S711, the mirroring communication unit 121 requests the mobile terminal 2 to start the App in response to the start request. However, in FIG. 7, the mobile terminal OS communication unit 11 that has received the request to start the App from the mirroring communication unit 121 also operates to request the mobile terminal 2 to start the App.
[0056] At this time, in response to the request to start the app, the mirroring communication unit 121 specifies the app to be started using the call ID, which is the acquired specific information. In Fig. 7, the mobile terminal OS communication unit 11 specifies the app to be started to the OS 20 of the mobile terminal 2, and requests the OS 20 to start the specified app.
[0057] The sequence diagram shown in Fig. 8 will be described. Steps S801 to S811 shown in Fig. 8 are similar to steps S701 to S711 shown in Fig. 7 except for the following differences, and description thereof will be omitted. In Fig. 8, the mirroring communication unit 211 accesses the app management unit 212 to acquire app registration information in step S804. Here, the app registration information acquired by the mirroring communication unit 211 need only be information indicating whether or not a specific app has been registered, and need not include a call ID. Therefore, the app registration information stored in the storage unit 14 by the mirroring communication unit 121 in step S806 includes only information indicating whether or not a specific app has been registered, and does not include a call ID.
[0058] 8, in step S812, the mirroring communication unit 121, which has been requested to activate a shortcut, requests the mirroring communication unit 211 to activate a shortcut. In step S813, the mirroring communication unit 211 accesses the App management unit 212 to obtain a call ID.
[0059] In step S814, the mirroring communication unit 211 requests the OS 20 to call an app. In step S815, the OS 20 instructs the OS 20 to start an app corresponding to the call ID. As a result, in step S816, one of the apps corresponding to the call ID, the music playback app 22, the map display app 23, and the video playback app 24, is started.
[0060] 8, step S812 is processing in which the mirroring communication unit 121 requests the portable terminal 2 to start an App registered in the App registration information stored in the storage unit 14. When the GUI 13 detects that the App call button in the shortcut menu 135 has been operated and the mirroring communication unit 121 receives a request from the GUI 13 to start a shortcut in step S811, the mirroring communication unit 121 requests the portable terminal 2 to start the App.
[0061] As described above, in the case of Fig. 7 where the mobile terminal 2 equipped with the OS 20 that requires the operation of the mobile terminal OS communication unit 11 is connected to the vehicle-mounted device 1, the call ID managed by the app management unit 212 is stored in the storage unit 14. When any of the app call buttons in the shortcut menu 135 is operated, the call ID is read out and used when requesting the start of the app.
[0062] 8, in which the mobile terminal 2 equipped with an OS 20 that does not require the operation of the mobile terminal OS communication unit 11 is connected to the vehicle-mounted device 1, the call ID managed by the app management unit 212 is not stored in the storage unit 14. When any of the app call buttons in the shortcut menu 135 is operated, the call ID is read out in the mobile terminal 2 and used when requesting an app call.
[0063] In the present embodiment described above, shortcut menu 135 includes music playback app call button 137, map display app call button 138, and video playback app call button 139 as shown in Fig. 4, but is not limited to the example shown in Fig. 4. In shortcut menu 135, the number of app call buttons for launching apps of a predetermined category installed in mobile terminal 2 is not limited. As the app call buttons, any one or two of music playback app call button 137, map display app call button 138, and video playback app call button 139 may be included.
[0064] Shortcut menu 135 may include an App call button for an App in a category other than music playback, map display, and video playback. The other category may be, for example, any one of sending and receiving a message, a telephone call (including an IP telephone), and sending and receiving an email. The category of the App call button included in shortcut menu 135 is not limited.
[0065] According to the in-vehicle device 1, the control method for the in-vehicle device 1, and the control program for the in-vehicle device 1 of the present embodiment, the user can arbitrarily register an application program to be started when the App call button is operated, among a plurality of application programs included in each category, as described in Fig. 5. Therefore, the screen of the display 204 of the mobile terminal 2 can be displayed as a mirrored image on the display 104 of the in-vehicle device 1, and the mobile terminal 2 can be conveniently operated via the in-vehicle device 1.
[0066] According to the vehicle-mounted device 1, the control method for the vehicle-mounted device 1, and the control program for the vehicle-mounted device 1 of the present embodiment, the shortcut menu 135 is the same regardless of the type of OS 20 of the mobile terminal 2. Therefore, the mobile terminal 2 can be operated with a unified operation regardless of the type of OS 20 of the mobile terminal 2, so that the user is not confused and the usability is good.
[0067] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the gist of the present invention. [Explanation of symbols]
[0068] 1 Onboard equipment 2. Mobile devices 3 USB cable 10,20 Operating Systems 11 Mobile terminal operating system communication part 12,21 Mirroring application program 13 Graphical User Interfaces 14 Storage area 22 Music playback application program 23 Map display application program 24 Video playback application program 101,201 Central Processing Unit 102,202 Storage medium 103,203 Working memory 104,204 Touch panel display 105,205 Communications Department 106,206 USB connector 121,211 Mirroring Communication Department 135 Shortcut Menu 137 Music playback application program call button 138 Map display application program call button 139 Video playback application program call button 212 Application Program Management Department
Claims
1. A first display; a mirroring communication unit that communicates with the mobile terminal to display an image displayed on a second display of the mobile terminal on the first display; a graphical user interface that displays on the first display an image displayed on the second display and that is acquired by the mirroring communication unit, and displays on the first display a shortcut menu including an application program call button for starting an application program of a predetermined category installed on the mobile terminal; a storage unit for storing the application program registration information managed by the mobile terminal, the application program registration information including specification information for specifying an application program registered as an application program to be started when the application program call button is operated among a plurality of application programs included in the category, when the mirroring communication unit acquires the application program registration information; a mobile terminal operating system communication unit that communicates with an operating system of the mobile terminal; Equipped with when the graphical user interface detects that the application program call button in the shortcut menu has been operated, the mirroring communication unit obtains specification information for specifying the application program to be started from the application program registration information stored in the storage unit; The mobile terminal operating system communication unit, in response to a start request by the mirroring communication unit for an application program registered in the application program registration information, requests the operating system of the mobile terminal to start the specified application program by specifying the application program to be started using the acquired specific information. Onboard equipment.
2. A vehicle-mounted device having a first display and a mobile terminal having a second display are connected to communicate with each other, and an image displayed on the second display is displayed on the first display; displaying on the first display a shortcut menu including an application program call button for starting an application program of a predetermined category installed on the mobile terminal; acquiring application program registration information managed by the mobile terminal, the application program registration information including specification information for specifying an application program registered as an application program to be started when the application program call button is operated among a plurality of application programs included in the category, and storing the application program registration information in a storage unit; when it is detected that the application program call button in the shortcut menu has been operated, acquiring specification information for specifying the application program to be started from the application program registration information stored in the storage unit; In response to a request to start an application program registered in the application program registration information, the operating system of the mobile terminal is requested to start the specified application program by specifying the application program to be started using the acquired specific information. A method for controlling an on-board device.
3. A computer mounted on an in-vehicle device having a first display, a step of connecting the vehicle-mounted device and a mobile terminal having a second display to communicate with each other, and displaying an image displayed on the second display on the first display; displaying on the first display a shortcut menu including an application program call button for starting an application program of a predetermined category installed on the mobile terminal; acquiring application program registration information managed by the mobile terminal, the application program registration information including specification information for specifying an application program registered as an application program to be started when the application program call button is operated among a plurality of application programs included in the category, and storing the application program registration information in a storage unit; when it is detected that the application program call button in the shortcut menu is operated, acquiring specification information for specifying the application program to be started from the application program registration information stored in the storage unit; a step of, in response to a request to start an application program registered in the application program registration information, specifying an application program to be started using the acquired specific information to an operating system of the mobile terminal, and requesting the specified application program to be started; A control program for an on-board device that executes the above.
Citation Information
Patent Citations
Allocation method of electronic apparatus and operation key
JP2011259259A
On-vehicle device
JP2012083981A
In-vehicle apparatus system and in-vehicle apparatus used for the same
JP2013108851A
Image display system, image display method, and display device
JP2016031376A
On-vehicle device
JP2020112935A