Display system

Abstract

To provide a display system allowing for a smooth operation.SOLUTION: In a display system 100, a car navigation device 10 includes a display part 1C for displaying a menu image, or the like, and a wired processing part 19 or a wireless processing part 1A communicating with a smartphone 20. The smartphone 20 includes: a wired processing part 2D or a wireless processing part 2E communicating with the car navigation device 10, and a display part 26 for displaying an enlarged image formed by enlarging a designated part of the menu image. The car navigation device 10 then receives coordinate information indicating a range of the enlarged image from the smartphone 20, and displays a range corresponding to the enlarged image, as a frame F, on the display part 1C.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a display system for displaying images and the like. [Background technology]

[0002] 2. Description of the Related Art In electronic devices equipped with a touch panel, such as car navigation devices, images of buttons and the like are displayed on a display unit, and operations are performed by touching the buttons.

[0003] In electronic devices of this type, there is a problem that it is difficult to operate accurately due to factors such as the small size of the buttons displayed on the screen. To solve this problem, a method such as that described in Patent Document 1 has been proposed.

[0004] Patent Document 1 describes how, when the touch panel is touched with a finger, the selection buttons 2 around the area where the finger contacts are enlarged and displayed, and the user can operate the device by moving the selection button that the user intended to touch without removing the finger from the touch panel and then removing the finger. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2008-65504 A Summary of the Invention [Problem to be solved by the invention]

[0006] In the case of the method described in Patent Document 1, the area around the finger contact area is enlarged, so if the button or the like to be operated next is outside the enlarged display range, it is difficult to find its location. For example, when inputting characters from a software keyboard or the like to input a destination or the like into a car navigation device, in the case of Patent Document 1, it is necessary to input the enlarged key, release the finger, return to the normal display, and then search for the next key to be input. This can make it difficult to input smoothly and easily.

[0007] Generally, touch panels used in car navigation devices and the like are often of the resistive film type, with an emphasis on cost. As this resistive film type touch panel detects the touch position from the voltage at the point where two resistive films come into contact, many of them cannot accept so-called multi-touch operations (flicks, swipes, pinch-in / out, etc.). Therefore, it is difficult to improve operability by using a multi-touch function. Furthermore, in the case of electronic devices without a touch panel, unlike buttons displayed on a screen, they cannot be enlarged, so it is physically impossible to change the size of the button.

[0008] In view of the above-mentioned problems, an object of the present invention is to provide a display system that allows for easy operation, for example. [Means for solving the problem]

[0009] In order to solve the above problem, the invention described in claim 1 is a display system consisting of a first terminal and a second terminal, wherein the first terminal has a first display unit that displays a first image including a plurality of images for operating the first terminal, and a first communication unit that communicates with the second terminal, and the second terminal has a second communication unit that communicates with the first terminal, a memory unit that stores a second image for operating the first terminal, the second image having an arrangement of the plurality of images different from that of the first image, and a second display unit that displays the second image corresponding to the first image, wherein the first terminal receives display range information from the second terminal indicating a display range of the second image on the second display unit, and displays the display range of the second image within the first image on the first display unit based on the display range information.

[0010] The invention described in claim 7 comprises a display unit that displays a first image including a plurality of images for operating a display device, and a communication unit that communicates with an external terminal in which a second image for operating the display device, the second image being an image having a different arrangement of the plurality of images from the first image, is stored and the second image is displayed, wherein the communication unit receives display range information indicating a display range of the second image on the external terminal, and the display unit displays the display range of the second image within the first image based on the display range information.

[0011] The invention described in claim 8 is characterized in that a display method executed on a display device that displays an image on a display unit includes a communication step of receiving display range information indicating a display range of the second image in the external terminal from an external terminal in which a second image for operating the display device is stored and the second image is displayed, the second image being an image having a different arrangement of the multiple images from a first image including multiple images for operating the display device, and a display step of displaying the display range of the second image within the first image on the display unit based on the display range information.

[0012] The invention described in claim 9 is a display program for causing a computer to execute the display method described in claim 8.

[0013] The invention described in claim 10 is a computer-readable recording medium storing the display program described in claim 9. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a schematic block diagram of a display system according to a first embodiment of the present invention. [Diagram 2] 2A to 2C are explanatory diagrams showing the display modes of a car navigation device and a smartphone in the display system shown in FIG. 1. [Diagram 3] 2 is a flowchart of the operation of the display system shown in FIG. 1. [Figure 4]13A and 13B are explanatory diagrams showing the display modes of a car navigation device and a smartphone in a display system according to a second embodiment of the present invention. [Diagram 5] 10 is a flowchart of the operation of a display system according to a second embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] A display system according to an embodiment of the present invention will be described below. In the display system according to an embodiment of the present invention, a first terminal includes a first display unit that displays an image and a first communication unit that communicates with a second terminal, and the second terminal includes a second communication unit that communicates with the first terminal and a second display unit that displays an enlarged image obtained by enlarging a specified part of the image. The first terminal receives information indicating the range of the enlarged image from the second terminal and displays information indicating the range of the enlarged image within the image on the first display unit. In this way, it is possible to operate the first terminal from the second terminal by displaying a UI (User Interface) displayed on the first terminal on the second terminal. Therefore, for example, light and smooth operation is possible by operating from the second terminal having an input device or the like that is more operable than the first terminal. In addition, by displaying the range displayed on the second terminal on the first terminal, the area displayed on the second display unit is emphasized and becomes easy to understand, and it becomes easier to perform a scroll operation or the like to display a button or the like to be operated next on the second terminal.

[0016] In addition, in a display system according to another embodiment of the present invention, a first terminal includes a first display unit that displays a first image and a first communication unit that communicates with a second terminal, and a second terminal includes a second communication unit that communicates with the first terminal, a storage unit that stores a second image for operating the first terminal, and a second display unit that displays a second image corresponding to the first image. The first terminal receives display range information of the second image from the second terminal, and displays display range information of the second image in the first image on the first display unit. In this way, an image corresponding to a UI (User Interface) displayed on the first terminal is displayed on the second terminal, and it becomes possible to operate the first terminal from the second terminal. Therefore, for example, light operation is possible by operating from the second terminal having an input device or the like with better operability than the first terminal. In addition, by displaying a range corresponding to the display of the second terminal on the first terminal, it is easy to understand which area is being operated on the second display unit because it is emphasized. Furthermore, since an image is not transmitted from the first terminal, the amount of data during communication can be reduced.

[0017] Furthermore, the first terminal may display a frame surrounding the range on the first display unit based on the information received from the second terminal. In this way, the range of the enlarged image or the range corresponding to the second image can be displayed as a frame on the first terminal to be displayed to the user, etc.

[0018] Furthermore, the first terminal may display the inside of the range on the first display unit in a manner different from the outside of the range, based on information received from the second terminal. In this way, the range of the enlarged image and the range corresponding to the second image can be displayed to the user in a manner such as shading, coloring, or blinking.

[0019] Also, a resistive touch panel may be provided on the first display unit of the first terminal, and a capacitive touch panel may be provided on the second display unit of the second terminal. In this way, even if the first display unit is provided with a resistive touch panel, it is possible to operate the first terminal by performing operations such as flicks, swipes, or pinching in / out from the second terminal.

[0020] The first terminal may be a navigation device, and the second terminal may be a mobile device. This allows the navigation device to be operated from a mobile device such as a smartphone. Therefore, the navigation device can be operated by, for example, operations supported by smartphones, such as flicking, swiping, or pinching in / out.

[0021] Moreover, the display device according to one embodiment of the present invention includes a display unit that displays an image, and a communication unit that communicates with an external terminal on which an enlarged image obtained by enlarging a specified part of the image is displayed. The communication unit transmits the image to the external terminal, receives information indicating the range of the enlarged image from the external terminal, and the display unit displays the information indicating the range of the enlarged image within the image. In this way, for example, light operation is possible by operating from an external terminal having an input device or the like that is more operable than the display device. Also, by displaying the range displayed on the external terminal on the display unit, it is emphasized which area is displayed on the external terminal, making it easier to understand, and it is easier to perform a scroll operation or the like to display the next button to be operated on the external terminal.

[0022] A display device according to another embodiment of the present invention includes a display unit that displays a first image, and a communication unit that stores a second image for operating the display device and communicates with an external terminal on which the second image is displayed. The communication unit receives display range information of the second image, and the display unit displays the display range information of the second image in the first image. In this way, light and smooth operation is possible by operating from an external terminal having an input device or the like that is more user-friendly than the display device. In addition, by displaying a range corresponding to the display of the external terminal on the display unit, it is easy to understand which area is being operated from the external terminal, as it is emphasized. Furthermore, since an image is not transmitted to the external terminal, the amount of data during communication can be reduced.

[0023] Moreover, a display method according to an embodiment of the present invention includes a communication step of transmitting an image to an external terminal, receiving information indicating the range of the enlarged image from the external terminal, which displays an enlarged image obtained by enlarging a specified part of the image, and a display step of displaying information indicating the range within the image corresponding to the enlarged image on the display unit. In this way, for example, light operation is possible by operating from an external terminal that is easier to operate than the image itself. Also, by displaying the range displayed on the external terminal on the display unit, it is easy to see which area is being displayed, and it is easy to perform a scroll operation to display the next button to be operated, etc.

[0024] The above-mentioned display method may be executed by a computer. In this way, a computer can be used to operate the device from an external terminal that is easier to operate than the device itself, making it possible to perform light and easy operations. Also, by displaying the range displayed on the external terminal on the display unit, it becomes easier to see what area is being displayed, and it becomes easier to perform a scroll operation to display the next button to be operated, etc.

[0025] The display program may be stored in a computer-readable recording medium. In this way, the program can be distributed as a standalone program in addition to being incorporated into a device, and version upgrades can be easily performed.

[0026] A display method according to another embodiment of the present invention includes a communication step of receiving display range information of the second image from an external terminal in which a second image for operating the display device is stored and the second image is displayed, and a display step of displaying the display range information of the second image in the first image on the display unit. In this way, for example, light operation is possible by operating from an external terminal that has better operability than the display device. In addition, by displaying the range corresponding to the display of the external terminal on the display unit, it is easy to understand which area is being operated from the external terminal, as it is emphasized. Furthermore, since an image is not transmitted to the external terminal, the amount of data during communication can be reduced.

[0027] The above-mentioned display method may be executed by a computer. In this way, it is possible to use a computer to perform operations from an external terminal that is easier to operate than a display device, for example, and to perform operations smoothly. Also, by displaying the range corresponding to the display of the external terminal on the display unit, it is easy to understand which area is being operated from the external terminal, as this is emphasized. Furthermore, since no image is transmitted to the external terminal, the amount of data during communication can be reduced.

[0028] The display program may be stored in a computer-readable recording medium. In this way, the program can be distributed as a standalone program in addition to being incorporated into a device, and version upgrades can be easily performed. EXAMPLES

[0029] A display system 100 having a display device according to a first embodiment of the present invention will be described with reference to FIGS.

[0030] As shown in FIG. 1, a display system 100 includes a car navigation device 10 as a first terminal, and a smartphone 20 as a second terminal (portable device).

[0031] The car navigation device 10 has a CPU 11, a ROM 12, a RAM 13, an audio signal processing unit 14, a position recognition processing unit 15, an I / F block 16, a memory unit 17, an operation unit 18, a wired processing unit 19, a wireless processing unit 1A, a display control unit 1B, a display unit 1C, a voice synthesis unit 1D, and a speaker 1E.

[0032] The CPU 11 is a central processing unit that operates based on a processing program stored in the ROM 12 and controls the overall operation of the car navigation device 10. In this embodiment, the CPU 11 controls the wired processing unit 19 or the wireless processing unit 1A to transmit an image displayed on the display unit 1C to the smartphone 20, and performs operations such as specifying the range of the image displayed on the display unit 1C that is displayed on the display unit 26 of the smartphone 20 based on coordinate information acquired by the wired processing unit 19 or the wireless processing unit 1A from the smartphone 20.

[0033] The ROM 12 is a non-volatile read only memory in which various processing programs read by the CPU 11 as a car navigation device are stored.

[0034] The RAM 13 is a volatile memory (Random Access Memory) that the CPU 11 uses as a work area when performing various processes.

[0035] The audio signal processing unit 14 plays back music data stored in the storage unit 17, and rips music data stored on an optical disc set in an optical disc device (not shown) and stores it in the storage unit 17.

[0036] The position recognition processing unit 15 calculates (recognizes) its own current position based on signals from a GPS (Global Positioning System) receiver, a gyro sensor, and the like (not shown).

[0037] The I / F block 16 is an interface (I / F) for connecting the storage unit 17 and the operation unit 18 to the CPU 11 .

[0038] The storage unit 17 stores, for example, map data for guidance, the above-mentioned music data, etc. The storage unit 17 is configured with a non-volatile storage medium, for example, a hard disk drive or an SSD (Solid State Drive). The data stored in the storage unit 17 may be stored in an external server or the like and downloaded as necessary.

[0039] The operation unit 18 is configured, for example, by a touch panel that is placed on the surface of the display unit 1 C. The touch panel that constitutes the operation unit 18 of this embodiment is configured by a resistive film type touch panel.

[0040] The wired processing unit 19 as a first communication unit serves as an interface for communicating via a wired connection with the smartphone 20. Standards for wired connections include USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), and MHL (Mobile High-definition Link).

[0041] The wireless processing unit 1A as the first communication unit is an interface for wirelessly connecting to and communicating with the smartphone 20. Standards for wireless connection include Wi-Fi (registered trademark) and Bluetooth (registered trademark). Note that the wired processing unit 19 and the wireless processing unit 1A do not need to have both as long as the smartphone 20, which is the communication partner, has one of the corresponding ones. Even if both are present, communication is only required using one of them.

[0042] The display control unit 1B generates image data to be displayed on the display unit 1C under the control of the CPU 11.

[0043] The display unit 1C as the first display unit is composed of a liquid crystal display, an EL display, or the like, and displays image data generated by the display control unit 1B. For example, a map for guidance, menus and buttons for various operations, or the title of a song being played are displayed on the display unit 1C.

[0044] The voice synthesis unit 1D synthesizes voice for guidance and the like to be output from the speaker 1E under the control of the CPU 11.

[0045] The speaker 1E outputs voice for guidance and the like synthesized by the voice synthesis unit 1D.

[0046] The smartphone 20 has a CPU 21, a ROM 22, a RAM 23, a public line communication unit 24, a display control unit 25, a display unit 26, an audio processing unit 27, a speaker 28, a microphone 29, an I / F block 2A, a memory unit 2B, an operation unit 2C, a wired processing unit 2D, and a wireless processing unit 2E.

[0047] The CPU 21 operates based on processing programs and the like stored in the ROM 22, and controls the overall operation of the smartphone 20. In this embodiment, the CPU 21 controls the display control unit 25 to display on the display unit 26 an image acquired by the wired processing unit 2D or the wireless processing unit 2E from the car navigation device 10, calculates coordinate information indicating the range of the image displayed on the display unit 26, and causes the wired processing unit 2D or the wireless processing unit 2E to transmit the coordinate information to the car navigation device 10, and the like.

[0048] The ROM 22 is a non-volatile memory in which processing programs such as an OS (Operating System) that are read by the CPU 21 are stored.

[0049] The RAM 13 is a volatile memory that is used as a work area when the CPU 21 performs various processes.

[0050] The public line communication unit 24 enables the smartphone 20 to communicate with base stations and the like that constitute public lines such as a mobile phone network.

[0051] The display control unit 25 generates image data to be displayed on the display unit 26 under the control of the CPU 21 .

[0052] Display unit 26 as a second display unit is composed of a liquid crystal display, an EL display, or the like, and displays image data generated by display control unit 25. On display unit 26, for example, an initial screen, a screen of a running application, or the like is displayed.

[0053] When used as a mobile phone, the voice processing unit 27 reproduces the voice of the other party received by the public line communication unit 24 and outputs it to the speaker 28, and converts the contents of the call input by the user to the microphone 29 into voice data. The voice processing unit 27 also outputs to the speaker 28 voice data generated or reproduced by the application.

[0054] The speaker 28 outputs the sound output from the sound processor 27 .

[0055] The microphone 29 converts the contents of a call input by a user or the like into an electrical signal and outputs it to the voice processing unit 27 .

[0056] The I / F block 2A is an interface for connecting the storage unit 2B and the operation unit 2C to the CPU 21.

[0057] The storage unit 2B stores, for example, data of applications, etc. The storage unit 2B is configured with, for example, a non-volatile storage medium such as an SSD.

[0058] The operation unit 2C is configured, for example, by a touch panel that is overlaid on the surface of the display unit 26. The touch panel that constitutes the operation unit 2C in this embodiment is configured by a capacitive touch panel. As is well known, a capacitive touch panel allows multi-touch operation and has superior operability to a resistive touch panel.

[0059] The wired processing unit 2D as a second communication unit becomes an interface for communicating via a wired connection with the car navigation device 10. Standards for wired connection include USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), and MHL (Mobile High-definition Link).

[0060] The wireless processing unit 2E as a second communication unit serves as an interface for wirelessly connecting and communicating with the car navigation device 10. Examples of wireless connection standards include Wi-Fi (registered trademark) and Bluetooth (registered trademark).

[0061] Next, an overview of the operation of the display system 100 configured as described above will be described with reference to Fig. 2. Fig. 2(a) is a front view showing an example of an image displayed on the display unit 1C of the car navigation device 10, and Fig. 2(b) is a front view showing an example of an enlarged image displayed on the smartphone 20. In this embodiment, first, the car navigation device 10 and the smartphone 20 are connected wirelessly or by wire.

[0062] Then, the entire image (image information of the entire screen) displayed on the display unit 1C of the car navigation device 10 is transmitted to the smartphone 20. The smartphone 20 displays the entire image received from the car navigation device 10 on the display unit 26. Note that, in the example of FIG. 2, a software keyboard is described as the image displayed on the display unit 1C, but it may be a menu image or the like, or a form in which an operation button image is displayed together with a map or the like. In short, it is sufficient if the image includes an image used for operating the car navigation device 10.

[0063] Here, the user or the like enlarges and specifies a part of the whole image as shown in Fig. 2(b) by using an operation function such as pinch-in that the smartphone 20 has in advance. That is, the display unit 26 displays an enlarged image obtained by enlarging the whole image or the specified part of the image. Then, the coordinate information of the range of the enlarged image is transmitted to the car navigation device 10 as information indicating the range of the enlarged image.

[0064] Based on the received coordinate information, the car navigation device 10 displays a frame F indicating the range of the enlarged image displayed on the smartphone 20 within the menu image displayed on the display unit 1C. This frame F is information indicating the range of the enlarged image displayed so as to surround the range displayed on the smartphone 20 as shown in Fig. 2(a). In other words, the car navigation device 10 receives coordinate information (information indicating the range of the enlarged image) from the smartphone 20 (second terminal) and displays the information indicating the range of the enlarged image on the display unit 1C (first display unit).

[0065] When the display unit 26 of the smartphone 20 is scrolled by an operation function such as swiping, the coordinate information of the frame F is updated accordingly and the frame F moves accordingly. Also, when the image is further enlarged or reduced, the coordinate information is updated according to the display range and the frame F is deformed.

[0066] In FIG. 2, the range displayed on the display unit 26 of the smartphone 20 is shown by a frame F, but the range may be displayed in a different manner between the inside and outside of the range, for example, by making the range different from the surrounding area by shading or coloring it, or by flashing only within the range.

[0067] Next, a flowchart of the operation of the display system 100 having the above-mentioned configuration will be described with reference to Fig. 3. This flowchart is executed by the CPU 11 on the car navigation device (car navigation) 10 side, and by the CPU 21 on the smartphone 20 side. That is, the car navigation device 10 side is a computer program executed by a computer to execute a display method of a display device that displays an image on the display unit 1C, and the smartphone 20 side is a computer program executed by a computer to execute a display method of a display device that displays an image on the display unit 26.

[0068] First, in step S11, the car navigation device 10 turns on the mobile operation mode. This mobile operation mode is a mode that permits operation on the mobile terminal (smartphone 20) as described above, and may, for example, be displayed on the display unit 1C at startup to allow the user to select whether to turn it on or not, or may be later turned on from a menu screen or the like.

[0069] Next, in step S12, a process for establishing a communication connection with the smartphone 20 is performed. That is, the wired processing unit 19 or the wireless processing unit 1A is caused to perform a process for establishing a connection with the wired processing unit 2D or the wireless processing unit 2E of the smartphone 20 using a predetermined communication standard (USB, Bluetooth (registered trademark), etc.).

[0070] Next, in step S13, the display control unit 1B causes the display unit 1C to display a menu image, etc. Then, the display control unit 1B causes the wired processing unit 19 or the wireless processing unit 1A to transmit the menu image, etc. displayed on the display unit 1C to the smartphone 20.

[0071] Meanwhile, on the smartphone 20 side, a car navigation control UI application is started (ON) in step S21. This application is pre-installed on the smartphone 20, and performs the operations on the smartphone 20 side among the operations explained in the overview.

[0072] Next, in step S22, a process for establishing a communication connection with the car navigation device 10 is performed. That is, the wired processing unit 2D or the wireless processing unit 2E is caused to perform a process for connecting with the wired processing unit 19 or the wireless processing unit 1A of the car navigation device 10 using a predetermined communication standard (USB, Bluetooth (registered trademark), etc.).

[0073] Next, in step S23, the wired processing unit 2D or the wireless processing unit 2E receives the menu image transmitted from the car navigation device 10, and causes the display control unit 25 to display the menu image, etc. on the display unit 1C. Then, the display control unit 25 calculates coordinate information of the display range on the display unit 26 at this time, and causes the wired processing unit 2D or the wireless processing unit 2E to transmit the coordinate information to the wired processing unit 2D or the wireless processing unit 2E.

[0074] These coordinates are added to the menu image etc. received in step S23, and are added appropriately based on the image resolution, the number of pixels on the screen, etc., with the top left corner of the image received from the car navigation device 10 as the origin (0,0). Then, coordinates indicating the display range of the display unit 26 are transmitted to the car navigation device 10 as coordinate information. For example, the coordinates transmitted as coordinate information may be the top left coordinates and bottom right coordinates of the display range in the case of a rectangle (quadrant). Note that in step S23, since it is the initial state and the entire menu image etc. is displayed on the display unit 26, the coordinates of the origin and the bottom right position of the menu image etc. may be transmitted as coordinate information.

[0075] Next, in step S14, the display range of the display unit 26 of the smartphone 20 is displayed in a rectangular frame on the menu image displayed on the display unit 1C based on the coordinate information received from the smartphone 20 on the car navigation device 10 side. The frame can also be displayed in the car navigation device 10 by adding coordinates according to the same rules as those of the smartphone 20. In the case of step S14, since the entire menu image is displayed on the display unit 26, a frame is formed surrounding the entire menu image, etc. In addition, the shape of the frame is not limited to a rectangle, and may be other shapes such as a circle, an ellipse, or a polygon. Alternatively, when the entire menu image, etc. is displayed on the display unit 26, the effect of displaying it in a frame is small, so it is not necessary to transmit the coordinate information.

[0076] Meanwhile, on the smartphone 20 side, an operation such as pinch in / pinch out, swipe / flick, etc. is performed in step S24. Then, as in step S23, coordinates indicating the display range of the display unit 26 are transmitted to the car navigation device 10 as coordinate information. Furthermore, when a button or the like displayed on the display unit 26 of the smartphone 20 is touched, information indicating that the button has been touched (operation information) is also transmitted to the car navigation device 10.

[0077] Next, in step S15, the car navigation device 10 displays a rectangular frame on the menu image or the like displayed on the display unit 1C in an enlarged or reduced size to fit the display range of the display unit 26 of the smartphone 20 based on the coordinate information received from the smartphone 20. Alternatively, when scrolling is performed by a swipe operation on the smartphone 20 side, the frame is moved. Furthermore, when information indicating a touch is received from the smartphone 20, an operation corresponding to the operation indicated by the information is executed.

[0078] For example, when a software keyboard as shown in FIG. 2(a) is displayed as a menu image, if a pinch-in operation is performed to enlarge the "a" portion and the image is displayed on the display unit 26 of the smartphone 20 as shown in FIG. 2(b), coordinate information indicating the display range of FIG. 2(b) is transmitted to the car navigation device 10, and a frame F is displayed on the display unit 1C based on the coordinate information.

[0079] Then, whenever the menu image etc. (image data) is updated on the car navigation device 10 side by an operation, the new menu image etc. is transmitted to the smartphone 20, and the smartphone 20 displays the new menu image etc. on the display unit 26 in step S25. Thereafter, steps S14 to S15 and steps S24 to S25 are repeated.

[0080] As is clear from the above description of the flowchart, steps S13, S14, and S15 function as a communication step, and steps S14 and S15 function as a display step.

[0081] Furthermore, the car navigation device 10 of this embodiment includes a display unit 1C that displays an image, and a wired processing unit 19 or a wireless processing unit 1A (communication unit) that communicates with a smartphone 20 (external terminal) on which an enlarged image of a specified portion of the image is displayed, and functions as a display device characterized in that the wired processing unit 19 or the wireless processing unit 1A (communication unit) transmits an image to the smartphone 20 (external terminal) and receives information indicating the range of the enlarged image from the smartphone 20 (external terminal), and the display unit 1C displays the range corresponding to the enlarged image.

[0082] In addition, the smartphone 20 in this embodiment is equipped with a wired processing unit 2D or a wireless processing unit 2E (communication unit) that communicates with a car navigation device 10 (external device), and a display unit 26 that displays an enlarged image that is an enlarged version of a specified portion of a menu image or the like (image) received from the car navigation device 10 (external device), and the wired processing unit 2D or the wireless processing unit 2E (communication unit) functions as a display device characterized by transmitting coordinate information (information indicating the range of the enlarged image) to the smartphone 20 (external device).

[0083] According to this embodiment, the car navigation device 10 includes a display unit 1C that displays a menu image, etc., and a wired processing unit 19 or a wireless processing unit 1A that communicates with the smartphone 20. The smartphone 20 includes a wired processing unit 2D or a wireless processing unit 2E that communicates with the car navigation device 10, and a display unit 26 that displays an enlarged image of a specified part of the menu image, etc. The car navigation device 10 receives coordinate information from the smartphone 20 and displays the range of the enlarged image of the menu image, etc. as a frame F on the display unit 1C. In this way, it is possible to display a UI (User Interface) displayed on the car navigation device 10 on the smartphone 20 and operate the car navigation device 10 with the smartphone 20. Therefore, for example, light operation is possible by operating the smartphone 20 having a touch panel with better operability than the car navigation device 10.

[0084] In addition, by displaying the range displayed on the smartphone 20 on the car navigation device 10, it is easy to see which area is being displayed on the display unit 26, making it easier to perform scrolling operations, etc. on the smartphone 20 to display the next button to be operated, etc.

[0085] Furthermore, the operation unit 18 of the car navigation device 10 is made up of a resistive touch panel and is overlaid on the display unit 1C, and the operation unit 2C of the smartphone 20 is made up of a capacitive touch panel and is overlaid on the display unit 26. In this way, even if the car navigation device 10 has a display unit 1C provided with a resistive touch panel, it is possible to operate the car navigation device by performing operations such as flicking, swiping, or pinching in / out on the smartphone 20. EXAMPLES

[0086] A display system according to a second embodiment of the present invention will be described with reference to Figures 4 to 5. Note that the same parts as those in the first embodiment described above are given the same reference numerals and the description thereof will be omitted.

[0087] The block configuration of this embodiment is similar to that of FIG. 1, but the difference is that in this embodiment, images such as menu images are not transmitted from the car navigation device 10, and the smartphone 20 already has images corresponding to the menu images of the car navigation device 10.

[0088] An image corresponding to the menu image of the car navigation device 10 (for example, the same image as the menu image of the car navigation device 10) may be installed in the smartphone 20 as an application, for example, and stored in the storage unit 2B. In this case, in step S13 of the flowchart in FIG. 3, instead of transmitting image data of a menu or the like, display image identification information, which is information for identifying a menu image or the like currently displayed on the display unit 1C, is transmitted to the smartphone 20. This display image identification information is composed of, for example, an ID or the like assigned to each menu image to be displayed. The smartphone 20 that has received the display image identification information displays the menu image or the like indicated in the display image identification information on the display unit 26. Thereafter, the operation is the same as that of the flowchart in FIG. 3.

[0089] In addition, in this embodiment, the layout of buttons and the like in the menu image of the application does not have to match the display mode in the car navigation device 10. That is, the image does not have to be the same as the menu image of the car navigation device 10.

[0090] Fig. 4 shows a display example in which the arrangement of buttons and the like in a menu image of an app does not match the display mode on the car navigation device 10. Fig. 4(a) is an example of a menu image and the like (first image) displayed on the display unit 1C of the car navigation device 10. Fig. 4(b) is a display example (second image) on the display unit 26 of an app running on the smartphone 20. Fig. 4(b) shows only some of the menu items shown in Fig. 4(a), and when selecting other items, a scroll operation is required to display them.

[0091] 4, a menu image or the like displayed on the display unit 1C of the car navigation device 10 does not match the image of the app displayed on the smartphone 20. Even in this case, by transmitting information indicating the range of the display image of the app instead of coordinate information to the car navigation device 10 as display range information of the second image from the smartphone 20, the display range of the smartphone 20 can be displayed as the display range information of the second image based on that information, as shown in frame F in FIG.

[0092] The information indicating the range of the display image of the app may be, for example, an ID assigned to each menu button of the app. For example, in the example of FIG. 4(b), the IDs assigned to the "Name / Multiple Search" button, "Free Word Voice Search" button, "Address" button, and "Phone Number" button are transmitted as information indicating the range of the display screen of the app. On the car navigation device 10 side, the received IDs are linked to buttons and the like displayed on the menu image, and a display like the frame F shown in FIG. 4(a) is possible based on the IDs.

[0093] In the example of Figure 4, there is one frame F, but multiple frames F may be displayed depending on the layout of buttons, etc. on the app side.

[0094] In this embodiment, the enlargement operation may also be performed on the smartphone 20 side. In this embodiment, unlike the first embodiment, the images displayed on the car navigation device 10 and the smartphone 20 do not match, so the frame F cannot be displayed correctly even if the coordinate information is transmitted. Therefore, instead of the coordinate information, IDs of buttons or the like in the range enlarged and displayed on the display unit 26 are transmitted to the car navigation device 10 as information indicating the range of the display image of the app, and the frame F is displayed based on that information. In this way, it is possible to display a range substantially equivalent to the range enlarged and displayed on the smartphone 20.

[0095] Next, a flowchart for a case where the arrangement of buttons and the like in a menu image of an application does not match the display mode of the car navigation device 10 will be described with reference to Fig. 5. This flowchart is executed by the CPU 11 on the car navigation device (car navigation) 10 side, and by the CPU 21 on the smartphone (smartphone) 20 side.

[0096] First, on the car navigation device 10 side, steps S11 and S12 are the same as those in Fig. 3. Next, in step S13A, the display control unit 1B is caused to display a menu image or the like on the display unit 1C. Then, the wired processing unit 19 or the wireless processing unit 1A is caused to transmit to the smartphone 20 display image identification information, which is information for identifying the menu image or the like currently displayed on the display unit 1C.

[0097] Meanwhile, on the smartphone 20 side, steps S21 and S22 are the same as those in Fig. 3. Next, in step S23A, the wired processing unit 2D or the wireless processing unit 2E receives the display image identification information transmitted from the car navigation device 10 in step S13A, and causes the display unit 26 to display a menu image or the like in the application corresponding to the ID or the like indicated by the display image identification information. Then, information indicating the range of the display image of the application displayed on the display unit 26 at this time is transmitted to the wired processing unit 2D or the wireless processing unit 2E.

[0098] Next, in step S14A, based on the information indicating the range of the display image of the app received by the car navigation device 10 from the smartphone 20, a frame corresponding to the display range on the display unit 26 of the smartphone 20 is displayed on the menu image displayed on the display unit 1C. Note that the frame does not have to be rectangular as shown in FIG. 4(a).

[0099] Meanwhile, on the smartphone 20 side, an operation such as pinch in / pinch out, swipe / flick, etc. is performed in step S24A. Then, as in step S23A, information indicating the range of the display image of the app is transmitted to the car navigation device 10. Furthermore, when a button or the like displayed on the display unit 26 of the smartphone 20 is touched, information indicating that the button has been touched is also transmitted to the car navigation device 10.

[0100] Next, in step S15A, the car navigation device 10 transforms a frame of a menu image or the like displayed on the display unit 1C to fit the display range of the display unit 26 of the smartphone 20 based on information indicating the range of the display image of the app received from the smartphone 20. Alternatively, when scrolling is performed by a swipe operation on the smartphone 20 side, the frame is moved. Furthermore, when information indicating a touch is received from the smartphone 20, an operation corresponding to the operation indicated by the information is executed.

[0101] Then, whenever the menu image or the like (image data) is updated on the car navigation device 10 side by an operation, new display image identification information is transmitted to the smartphone 20, and in step S25, the smartphone 20 displays the menu image or the like in the application corresponding to the new display image identification information on the display unit 26. Thereafter, steps S14A to S15A and steps S24A to S25A are repeated.

[0102] As is clear from the above description of the flowchart, steps S14A and S15A function as a communication step, and steps S14A and S15A function as a display step.

[0103] Furthermore, the car navigation device 10 in this embodiment includes a display unit 1C that displays a menu image, etc. (first image), and a wired processing unit 19 or a wireless processing unit 1A (communication unit) that communicates with a smartphone 20 (external terminal) that displays an image (second image) of an app that operates the display device, and the wired processing unit 19 or the wireless processing unit 1A (communication unit) receives information indicating the range of the display screen of the app (display range information of the second image), and the display unit 1C functions as a display device that displays the display range of the image of the app (second image) within the menu image, etc. (first image) as a frame F.

[0104] In addition, the smartphone 20 in this embodiment is equipped with a wired processing unit 2D or a wireless processing unit 2E (communication unit) that communicates with a car navigation device 10 (external device), a memory unit 2B that stores images for operating the car navigation device 10 (external device), and a display unit 26 that displays an image of a corresponding app based on display image identification information (information regarding the display content) received from the car navigation device 10 (external device), and the wired processing unit 2D or the wireless processing unit 2E (communication unit) functions as a display device characterized by transmitting information indicating the range of the display screen of the app (display range information of the second image) to the car navigation device 10.

[0105] According to this embodiment, the car navigation device 10 includes a display unit 1C that displays a menu image and the like, and a wired processing unit 19 or a wireless processing unit 1A that communicates with the smartphone 20. The smartphone 20 includes a wired processing unit 2D or a wireless processing unit 2E that communicates with the car navigation device 10, a storage unit 2B that stores an application for operating the car navigation device 10, and a display unit 26 that displays a menu image and the like of the application. The car navigation device 10 receives information indicating the range of the display image of the application from the smartphone 20, and displays the range of the display image of the application within the menu image and the like as a frame F on the display unit 1C. In this way, it is possible to operate the car navigation device 10 by displaying an image corresponding to a UI (User Interface) displayed on the car navigation device 10 on the smartphone 20. Therefore, for example, light operation is possible by operating the smartphone 20 having a touch panel with better operability than the car navigation device 10.

[0106] Also, by displaying the range corresponding to the display of the smartphone 20 on the car navigation device 10, it is easy to see which area is being operated on the smartphone 20. Furthermore, since images are not transmitted from the car navigation device 10, the amount of data transmitted during communication can be reduced.

[0107] In the above two embodiments, the first terminal is described as a car navigation device 10 and the second terminal is described as a smartphone 20, but the present invention is not limited thereto. For example, the second terminal may be an electronic device having a touch panel capable of multi-touch, such as a tablet terminal, instead of the smartphone 20. The first terminal may also be a navigation device for ships or aircraft, or a car audio device, instead of the car navigation device 10. Furthermore, the first terminal may be a device (such as a personal computer) that does not have a touch panel but operates menu buttons, icons, etc. on a screen.

[0108] The touch panel of the second terminal is not limited to the capacitive type, and may be of any other type that allows multi-touch, such as optical type. The touch panel of the first terminal is not limited to the resistive type, and may be of an ultrasonic type, or may not have a touch panel, as described above.

[0109] Furthermore, the present invention is not limited to the above-mentioned embodiments. In other words, a person skilled in the art can implement the present invention by modifying it in various ways in accordance with conventionally known knowledge without departing from the gist of the present invention. As long as such modifications still include the configuration of the display device or display system of the present invention, they are of course included in the scope of the present invention. [Explanation of symbols]

[0110] 10 Car navigation device (first terminal, display device) 18 Operation unit (resistive touch panel) 19 Wired processing unit (first communication unit, communication unit) 1A Wireless processing unit (first communication unit, communication unit) 1C Display section (1st display section, display section) 20 Smartphone (second device) 26 Display section (second display section) 2B Storage section 2C Operation unit (capacitive touch panel) 2D Wired Processing Unit (Second Communication Unit) 2E Wireless processing unit (second communication unit) 100 Display System F Frame (range)

Claims

[Claim 1] A display system including a first terminal and a second terminal, the first terminal includes a first display unit that displays a first image including a plurality of images for operating the first terminal, and a first communication unit that communicates with the second terminal; the second terminal includes a second communication unit that communicates with the first terminal, a storage unit that stores a second image for operating the first terminal, the second image having an arrangement of the plurality of images different from that of the first image, and a second display unit that displays the second image corresponding to the first image; A display system characterized in that the first terminal receives display range information from the second terminal indicating a display range of the second image on a second display unit, and displays the display range of the second image within the first image on the first display unit based on the display range information.

Images