Mobile terminal device, information processing device, cooperative system, and method for controlling display

Abstract

To appropriately use an input unit of another information processing device when operation input to a portable terminal device is performed.SOLUTION: A specification unit 810 specifies an operational state including an operational mode of a mobile terminal device 800, and sends a specified result to a display control unit 820. When an information processing device 700 and the mobile terminal device 800 are performing cooperative operation, if it is discovered by the specification result that the operational mode of the mobile terminal device 800 changes, the display control unit 820 generates, according to change of the operational mode, display designation including icons to be displayed in a first display areas 721 of the information processing device 700 and its shapes. Then, the display control unit 820 transmits the generated display designation to the information processing device 700.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a mobile terminal device, an information processing device, a linkage system, a display control method, and a display control program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, information devices have been provided with input units having hard keys or touch keys, and the information devices are designed to perform various processes in response to input operations made by a user on the input unit.

[0003] As a technology related to such input operations, a technology has been proposed that allows a user to perform a desired input without checking the key layout (see Patent Document 1: hereinafter referred to as the "conventional example"). In this conventional technology, when a predetermined word is included in the recognition result of the input voice, touch keys related to the predetermined word are allocated to a large area within the effective range of the touch panel without changing the image displayed on the display screen on which the touch panel is arranged. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-281572 DISCLOSURE OF THE INVENTION [Problem to be solved by the invention]

[0005] In the conventional technology, the functions of the touch keys are not displayed. Therefore, the user cannot know whether the predetermined word was correctly recognized by voice recognition and whether the appropriate touch key was assigned. As a result, when the user operates the touch key, an unintended process may be executed.

[0006] Mobile terminal devices such as smartphones have become widespread. The input unit of such mobile terminal devices is usually configured with a touch panel. However, the mobile terminal device must be portable, and the area of ​​the touch panel is limited. Furthermore, in recent years, mobile terminal devices, such as smartphones, have become multifunctional, and therefore the number of touch keys tends to increase. Therefore, the area of ​​each touch key tends to become smaller. As a result, when operating a touch key, it has become necessary to pay close attention to the display of the corresponding icon. This trend may hinder users from easily performing operational inputs on mobile terminal devices.

[0007] There are various types of information processing devices equipped with an input unit, and the input unit has been designed in various ways to allow the user to easily and reliably perform operational inputs. For example, an input unit installed in an electrical component mounted on a vehicle has been designed in such a way that the user can easily, safely, and reliably perform operational inputs.

[0008] Therefore, there is a demand for a technology that allows an input unit of another information processing device to be used when inputting operations into a mobile terminal device. Meeting this demand is one of the problems that the present invention aims to solve. [Means for solving the problem]

[0009] The invention described in claim 1 is a mobile terminal device connectable to an information processing device, characterized in that it comprises: a mobile display unit capable of displaying an icon corresponding to an operation mode of the mobile terminal device; and a display control unit that displays the icon corresponding to the operation mode in a first display area arranged in an operation area capable of accepting user operations in an input unit provided in the information processing device, and displays another icon different from the icon displayed in the first display area on the mobile display unit.

[0010] The invention described in claim 5 is an information processing device that can be connected to a mobile terminal device, comprising: an input unit having an operation area that can accept user operations; and an information display unit that is arranged in the operation area and has a first display area that displays an icon corresponding to the operating mode of the mobile terminal device; wherein the icon is displayed in the first display area, and another icon different from the icon is displayed on the mobile display unit of the mobile terminal device.

[0011] The invention described in claim 11 is a collaboration system comprising an information processing device and a mobile terminal device, wherein the information processing device comprises: an input unit having an operation area capable of accepting user operations; and an information display unit arranged in the operation area and having a display area for displaying icons; and the mobile terminal device comprises: a mobile display unit capable of displaying icons corresponding to the operation mode of the mobile terminal device; and a display control unit that displays icons corresponding to the operation mode in the display area and causes other icons different from the icons displayed in the display area to be displayed on the mobile display unit.

[0012] The invention described in claim 12 is a display control method used in a mobile terminal device connectable to an information processing device, comprising: a mobile display unit capable of displaying an icon corresponding to the operation mode of the mobile terminal device; and a display control unit, characterized in that the display control unit acquires the operation mode; and the display control unit displays an icon corresponding to the operation mode in a display area arranged in an operation area capable of accepting user operations in an input unit provided in the information processing device, and displays an icon different from the icon displayed in the display area on the mobile display unit.

[0013] The invention described in claim 13 is a display control program that causes a computer included in a mobile terminal device to execute the display control method described in claim 12. [Brief explanation of the drawings]

[0014] [Figure 1]1 is a block diagram illustrating a configuration of a collaboration system according to an embodiment. [Figure 2] 1 is a diagram illustrating the external appearance of an information processing device and a mobile terminal device in a linkage system according to a first embodiment. [Figure 3] 3 is a diagram for explaining the internal configuration of the information processing device and the mobile terminal device of FIG. 2. FIG. [Figure 4] 4 is a flowchart for explaining the processing of the control unit in FIG. 3. [Figure 5] FIG. 10 is a diagram showing an example of a display change in the first embodiment. [Figure 6] FIG. 10 is a diagram illustrating the internal configuration of an information processing device and a mobile terminal device in a linkage system according to a second embodiment. [Figure 7] 7 is a flowchart for explaining the processing of the control unit in FIG. 6. [Figure 8] FIG. 10 is a diagram illustrating the internal configuration of an information processing device and a mobile terminal device in a linkage system according to a third embodiment. [Figure 9] 9 is a flowchart (part 1) for explaining the processing by the control unit of FIG. 8. [Figure 10] 9 is a second flowchart for explaining the processing by the control unit of FIG. 8. [Figure 11] FIG. 10 is a diagram showing an example of a display change in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0015] An embodiment of the present invention will now be described with reference to Fig. 1. In the following description, the same or equivalent elements will be denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0016] [composition] Fig. 1 shows the configuration of a linkage system 900 according to one embodiment. As shown in Fig. 1, the linkage system 900 includes an information processing device 700 and a mobile terminal device 800. Here, the mobile terminal device 800 can be detachably held by a holding unit (not shown) included in the information processing device 700.

[0017] Furthermore, information processing device 700 and mobile terminal device 800 are capable of communicating with each other. Here, the connection for communication between information processing device 700 and mobile terminal device 800 may be a wired connection using a wired cable, or a wireless connection using short-range wireless communication.

[0018] <Configuration of information processing device 700> The information processing device 700 includes an input unit 710, an information display unit 720, and a display processing unit 730. Here, the information processing device 700 includes elements other than these elements. The information processing device 700 is configured to switch between an operation when linked with the mobile terminal device 800 and an operation when not linked with the mobile terminal device 800.

[0019] The input unit 710 has at least one operation area capable of receiving user operations. In this embodiment, the operation area is an area for a plurality of hard keys that are mechanically pressed down to perform input. In this embodiment, the key tops of the hard keys have a concave shape relative to the surrounding area, making them tactilely distinguishable from the surrounding area.

[0020] The information display unit 720 receives display data sent from the display processing unit 730. Then, the information display unit 720 performs display in accordance with the display data.

[0021] The information display unit 720 has a first display area 721 and a second display area 722. Here, the first display area 721 is arranged in the operation area of ​​the input unit 710. In this embodiment, the first display area 721 is arranged in the key top portion of the above-mentioned hard keys. In other words, the first display area 721 is made up of a plurality of individual areas, one for each hard key. And, an icon can be displayed in each of the individual areas.

[0022] Second display area 722 is disposed at a position different from input section 710. Second display area 722 is capable of displaying text information and the like.

[0023] When the information processing device 700 is operating in cooperation with the mobile terminal device 800, the display processing unit 730 described above receives a display specification transmitted from the mobile terminal device 800. Then, the display processing unit 730 generates display data based on the display specification. The display data generated in this manner is sent to the information display unit 720. As a result, the information display unit 720 performs display in accordance with the display specification transmitted from the mobile terminal device 800.

[0024] When the information processing device 700 is not operating in cooperation with the mobile terminal device 800, the display processing unit 730 generates unique display data and sends the generated display data to the information display unit 720. As a result, the information display unit 720 displays information unique to the information processing device 700.

[0025] <Configuration of mobile terminal device 800> The above-described mobile terminal device 800 includes an identification unit 810, a display control unit 820, and a mobile display unit 830. Here, mobile terminal device 800 includes elements other than these elements, and is capable of performing functions unique to mobile terminal device 800.

[0026] The above-mentioned identification unit 810 identifies the operation state including the operation mode being executed by the mobile terminal device 800. Then, the identification unit 810 sends the identification result to the display control unit 820.

[0027] The display control unit 820 described above internally stores icon allocation information regarding icon display allocation to the first display area 721 and the mobile display unit 830 for each operation mode of the mobile terminal device 800, and display information in the second display area 722 for each operation state of the mobile terminal device 800. Here, the icon allocation information includes information on the shapes of icons to be displayed on the mobile display unit 830 when no linked operation is performed and the shapes of icons to be displayed in the first display area 721 during linked operation. Furthermore, the icon allocation information is configured so that icons to be assigned to the mobile display unit 830 for each operation mode do not include icons that are assigned to the first display area 721 in the same operation mode.

[0028] The display control unit 820 receives the identification result sent from the identification unit 810. Then, when the mobile terminal device 800 is operating in cooperation with the information processing device 700, the display control unit 820 generates, in accordance with the identification result, a display specification to be transmitted to the information processing device 700 (more specifically, the display processing unit 730) and display data corresponding to the display image of the mobile display unit 830. Note that the display specification and display data generation processing executed by the display control unit 820 during the cooperative operation will be described later.

[0029] The generated display specification is transmitted to the information processing device 700. The generated display data is also transmitted to the mobile display unit 830.

[0030] When mobile terminal device 800 is not operating in cooperation with information processing device 700, display control unit 820 generates unique display data and sends the generated display data to mobile display unit 830. As a result, mobile display unit 830 displays a unique display on mobile terminal device 800.

[0031] The mobile display unit 830 receives the display data sent from the display control unit 820. Then, the mobile display unit 830 performs display in accordance with the display data.

[0032] A touch panel (not shown) is arranged on the display screen of the mobile display unit 830, and input operations can be performed using the touch panel.

[0033] [Operation] Next, the operation of the linkage system 900 configured as described above will be described, focusing mainly on the processing of the display control unit 820 during linked operation. It is assumed that the information processing device 700 and the mobile terminal device 800 are operating in linkage.

[0034] Upon receiving the identification result from the identification unit 810 during cooperative operation, the display control unit 820 performs a transition determination as to whether or not an operational state transition has occurred in the mobile terminal device 800. If the result of the transition determination is negative, the transition determination is repeated.

[0035] If the result of the transition determination is affirmative, display control unit 820 performs an operation mode change determination as to whether or not the operation state transition of mobile terminal device 800 is a transition accompanied by a change in operation mode. If the result of the operation mode change determination is negative, display control unit 820 generates display data corresponding to an image to be displayed on mobile display unit 830 after the operation state transition. Then, display control unit 820 sends the generated display data to mobile display unit 830. As a result, the image after the operation state transition is displayed on mobile display unit 830.

[0036] It should be noted that the display data of the image to be displayed on the mobile display unit 830 does not include the display data of the icon displayed in the first display area 721.

[0037] Subsequently, the display control unit 820 performs an information change determination as to whether or not to change the information to be displayed in the second display area 722 in accordance with the transition of the operating state. If the result of the information change determination is negative, the display control unit 820 ends the processing associated with the transition of the operating state and waits for the identification unit 810 to report the next identification result.

[0038] If the result of the information change determination is positive, the display control unit 820 generates new information to be displayed in the second display area 722 as a display specification. Then, the display control unit 820 transmits the generated display specification to the information processing device 700. As a result, information according to the new operation state is displayed in the second display area 722. Then, the display control unit 820 ends the processing associated with the operation state transition and waits for the identification unit 810 to report the next identification result.

[0039] If the result of the above-mentioned operation mode change determination is positive, display control unit 820 first determines, based on the above-mentioned icon allocation information stored therein, an icon corresponding to the new operation mode to be displayed in first display area 721 and an icon corresponding to the new operation mode to be displayed on mobile display unit 830. Next, display control unit 820 generates, based on the above-mentioned display information stored therein, information including the new operation mode to be displayed in second display area 722 in accordance with the change in operation mode.

[0040] Next, display control unit 820 generates display data according to an image to be displayed on mobile display unit 830 after the change in operation mode, including the icon determined as the icon to be displayed on mobile display unit 830. Then, display control unit 820 sends the generated display data to mobile display unit 830. As a result, the image after the change in operation mode is displayed on mobile display unit 830.

[0041] Next, the display control unit 820 generates, as display specification, information including an icon and its shape to be displayed in the first display area 721, and a new operation mode to be displayed in the second display area 722. Then, the display control unit 820 transmits the generated display specification to the information processing device 700. As a result, an icon corresponding to the new operation mode of the mobile terminal device 800 is displayed in the first display area 721, and information corresponding to the new operation mode is displayed in the second display area 722. Then, the display control unit 820 ends processing associated with the operation state transition accompanying the change in the operation mode, and waits for the identification unit 810 to report the next identification result.

[0042] In addition, when the information processing device 700 and the mobile terminal device 800 are not operating in conjunction with each other, as described above, unique displays are displayed on the information display unit 720 and the mobile display unit 830 of the information processing device 700 and the mobile terminal device 800, respectively.

[0043] As described above, in this embodiment, the identification unit 810 identifies the operating state including the operating mode of the mobile terminal device 800, and sends the identification result to the display control unit 820. When the information processing device 700 and the mobile terminal device 800 are operating in cooperation with each other, if the identification result indicates that the operating mode has changed, the display control unit 820 generates a display specification including an icon and its shape to be displayed in the first display area 721 of the information processing device 700 in accordance with the change in the operating mode. Then, the display control unit 820 transmits the generated display specification to the information processing device 700.

[0044] Therefore, according to this embodiment, when inputting an operation to the mobile terminal device 800, the input unit 710 of the information processing device 700 can be appropriately used, thereby improving user convenience.

[0045] Furthermore, in this embodiment, when mobile terminal device 800 and information processing device 700 are not operating in cooperation with each other (including when they are not connected), the shapes of the icons displayed in first display area 721 are the same as the shapes of the icons displayed on mobile display unit 830 for operating the same functions. Therefore, when inputting to mobile terminal device 800 using the operation area in which first display area 721 is arranged, the user can perform the input operation without feeling uncomfortable.

[0046] Furthermore, in this embodiment, second display area 722 displays information about the operating state of mobile terminal device 800. This improves the convenience for the user who performs input using the operation area in which first display area 721 is located.

[0047] In this embodiment, the shape of the operation area in the input unit 710 of the information processing device 700 is concave with respect to the surrounding area of ​​the operation area, making it tactilely identifiable. This allows the user to easily identify the operation area, improving user convenience.

[0048] Furthermore, in this embodiment, the portable terminal device 800 is detachably held by a holding unit included in the information processing device 700. Therefore, for example, when the information processing device 700 is an in-vehicle device, the portable terminal device 800 can be placed in a fixed position for the user, and the portable terminal device 800 is placed in a position where the user can view the information processing device 700 and the portable terminal device 800 at the same time, thereby improving convenience for the user.

[0049] [Modification of the embodiment] The present invention is not limited to the above-described embodiment, and various modifications are possible.

[0050] For example, in the above embodiment, the shape of the operation area in the input unit of the information processing device is concave relative to the surrounding area of ​​the operation area. In contrast, the shape of the operation area in the input unit of the information processing device may be convex relative to the surrounding area of ​​the operation area. In this case, too, the user can easily identify the operation area, thereby improving user convenience.

[0051] In the above embodiment, the input unit of the information processing device is configured to include hard keys. However, the input unit of the information processing device may be configured to include soft keys such as touch keys.

[0052] Furthermore, the icons to be displayed on the mobile display unit may include icons that were displayed in the first display area before the change in the operation mode but are no longer displayed in the first display area after the change in the operation mode, and that are determined to be displayed in the changed operation mode as well. In this case, icons that can be operated in the changed operation mode can be rationally displayed on either the mobile display unit or the first display area.

[0053] Furthermore, the information processing device in the above embodiment may be an in-vehicle device or a device installed in a house.

[0054] In the above embodiment, the icons to be displayed in the first display area and the icons to be displayed on the mobile display unit are determined based on predetermined icon allocation information. However, the icons to be displayed in the first display area may be determined by giving a higher priority to the operation area corresponding to the icon displayed in each operation mode, the more frequently the operation area is used.

[0055] In the above embodiment, the display control unit is configured to internally store information on icon display allocation for each operation mode of the portable terminal device and display information in the second display area for each operation state of the portable terminal device. Alternatively, information on icon display allocation for each operation mode of the portable terminal device and display information in the second display area for each operation state of the portable terminal device may be stored in an external server, and information on icon display allocation and display information in the second display area related to a specified operation state may be acquired from the external server via a communication network.

[0056] In the above embodiment, the mobile terminal device side performs icon display allocation for each operation mode, but the information processing device side may perform the icon display allocation.

[0057] The identification unit 810 and the display control unit 820 in the above-described embodiment may be configured as a computer serving as a computing means including a central processing unit (CPU) or the like, and a pre-prepared program may be executed by the computer to realize some or all of the functions of the identification unit 810 and the display control unit 820 in the above-described embodiment. The program may be recorded on a computer-readable recording medium such as a hard disk, CD-ROM, or DVD, and read from the recording medium and executed by the computer. The program may also be obtained in a form recorded on a portable recording medium such as a CD-ROM or DVD, or may be obtained in a form distributed via a network such as the Internet. [Example]

[0058] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description and drawings, the same or equivalent elements are designated by the same reference numerals, and redundant description will be omitted.

[0059] [First Example] First, a first embodiment of the present invention will be described with reference mainly to FIGS.

[0060] <Configuration> Fig. 2 shows a schematic configuration of a linkage system 300A according to a first example. As shown in Fig. 2, linkage system 300A includes information processing device 100A that performs the functions of information processing device 700 in the above-described embodiment, and mobile terminal device 200A that performs the functions of mobile terminal device 800 in the above-described embodiment. Here, mobile terminal device 200A can be detachably held by holding unit 150 included in information processing device 100A.

[0061] Furthermore, the mobile terminal device 200A and the information processing device 100A are capable of communicating with each other. Here, the connection for communication between the mobile terminal device 200A and the information processing device 100A may be a wired connection using a wired cable, or may be a wireless connection using short-range wireless communication.

[0062] The information processing device 100A described above includes operation keys 1101 to 1104 in addition to the holding unit 150. In the first embodiment, the operation keys 1101 to 1104 are multiple hard keys that are mechanically pressed down to perform input. The operation areas, which are the key top portions of the operation keys 1101 to 1104, have a concave shape relative to the surrounding areas, making them tactilely distinguishable from the surrounding areas.

[0063] Hereinafter, the operation keys 1101 to 1104 will be collectively referred to as the "input section 110." The input section 110 fulfills the function of the input section 710 in the above-described embodiment.

[0064] Furthermore, information processing device 100A includes first display areas 1211-1214 capable of displaying icons, and second display area 122 capable of displaying text information, etc. Hereinafter, first display areas 1211-1214 will be collectively referred to as "first display area 121."

[0065] The first display area 121 is configured to perform the function of the first display area 721 in the above-described embodiment, and the second display area 122 is configured to perform the function of the second display area 722 in the above-described embodiment.

[0066] 1st display area 121 j (j=1 to 4) is the operation key 110 j The second display area 122 is arranged in an area different from the area where the operation keys 1101 to 1104 are arranged.

[0067] The mobile terminal device 200A includes a display unit 230. A touch panel (not shown) is disposed on the display screen of the display unit 230, and input operations can be performed using the touch panel. The display unit 230 functions as the mobile display unit 830 in the above-described embodiment.

[0068] Configuration of information processing device 100A 3, the information processing device 100A includes a display unit 120 and a processing unit 130A in addition to the above-mentioned input unit 110. Here, the information processing device 100A includes elements other than these elements. The information processing device 100A is configured to switch between an operation when linked with the mobile terminal device 200A and an operation when not linked with the mobile terminal device 200A.

[0069] The display unit 120 has the first display area 121 and the second display area 122. The display unit 120 receives display data sent from the processing unit 130A. The display unit 120 then performs display in accordance with the display data. In other words, the display unit 120 fulfills the function of the information display unit 720 in the above-described embodiment.

[0070] The processing unit 130A is configured to include a central processing unit (CPU) and the like. The processing unit 130A executes various programs to realize the functions of the information processing device 100A. Such functions include the functions of the display processing unit 730 in the above-described embodiment.

[0071] That is, when information processing device 100A is operating in cooperation with mobile terminal device 200A, processing unit 130A receives a display specification transmitted from mobile terminal device 200A. Then, processing unit 130A generates display data based on the display specification. The display data generated in this manner is sent to display unit 120. As a result, display unit 120 performs display in accordance with the display specification transmitted from mobile terminal device 200A.

[0072] When information processing device 100A is not operating in cooperation with mobile terminal device 200A, processing unit 130A generates unique display data and sends the generated display data to display unit 120. As a result, display unit 120 displays a display unique to information processing device 100A.

[0073] <Configuration of mobile terminal device 200A> As shown in FIG. 3, the mobile terminal device 200A includes a control unit 220A in addition to the display unit 230 and touch panel described above.

[0074] The control unit 220A is configured to include a central processing unit (CPU) and the like. The control unit 220A executes various programs to realize the functions of the mobile terminal device 200A. These functions include the functions of the identification unit 810 and the display control unit 820 in the above-described embodiment.

[0075] Control unit 220A internally stores icon allocation information regarding icon display allocation to first display area 121 and display unit 230 for each operation mode of mobile terminal device 200A, and display information in second display area 122 for each operation state of mobile terminal device 200A. Here, the icon allocation information includes information on the shapes of icons to be displayed on display unit 230 when no linked operation is being performed and the shapes of icons to be displayed in first display area 121 during linked operation.

[0076] In addition, the icon allocation information is configured so that the icons allocated to display unit 230 in accordance with the operation mode do not include icons allocated to first display area 121. Furthermore, in the icon allocation information, the icons allocated to display unit 230 include, among the icons that were displayed in first display area 121 before the change in operation mode but are no longer displayed in first display area 121 after the change in operation mode, icons that are determined to remain displayed even in the changed operation mode.

[0077] The control unit 220A identifies an operating state including an operating mode of the mobile terminal device 200A. Here, the operating mode refers to the operation of each application executed by the mobile terminal device 200A. Specific examples of the operating mode include a navigation mode that provides guidance to the user, an audio mode that controls music playback, and a home screen mode that is initially displayed when the mobile terminal device 200A and the information processing device 100A are connected. Note that the operating mode is not limited to these examples, and various modes such as a call mode and an email mode may be used, which are not illustrated.

[0078] Examples of functions that can be assigned as icons when the operation mode is navigation mode include a function to display the user's current location, a zoom function to zoom in and out on a map, a voice recognition function to receive user voice, etc. Also, examples of functions that can be assigned as icons when the operation mode is audio mode include music playback, pause, fast forward, rewind, etc.

[0079] Furthermore, examples of functions that can be assigned as icons when the operation mode is the home screen mode include a function to transition to the navigation mode, a function to transition to the audio mode, etc. In addition, when the operation mode is the home screen mode, functions that are frequently used by the user may be assigned as icons.

[0080] The functions assigned to the icons for each operation mode are not limited to the above example.

[0081] The functions assigned to the icons corresponding to the operation modes are stored in association with each operation mode. This association may be set in advance by the manufacturer, or may be changed at will by the user.

[0082] When the mobile terminal device 200A is linked with the information processing device 100A, the control unit 220A, in accordance with the identification result, generates display designation to be transmitted to the information processing device 100A (more specifically, the processing unit 130A) and display data corresponding to the display image of the display unit 230. The display designation and display data generation process executed by the control unit 220A during linked operation will be described later.

[0083] The generated display specification is transmitted to the information processing device 100A. The generated display data is also transmitted to the display unit 230.

[0084] When mobile terminal device 200A is not operating in cooperation with information processing device 100A, control unit 220A generates unique display data and sends the generated display data to display unit 230. As a result, display unit 230 displays a unique display on mobile terminal device 200A.

[0085] The display unit 230 receives display data sent from the control unit 220A. Then, the display unit 230 performs display in accordance with the display data. That is, the display unit 230 fulfills the function of the mobile display unit 830 in the above-described embodiment.

[0086] <Operation> Next, the operation of the linkage system 300A configured as described above will be described, focusing mainly on the display control process of the control unit 220A during linked operation. It is assumed that the information processing device 100A and the mobile terminal device 200A are operating in linkage.

[0087] 4, when the operation state including the operation mode of mobile terminal device 200A is identified during linked operation, control unit 220A determines, based on the identification result, in step S11, whether or not an operation state transition has occurred in mobile terminal device 200A. If the determination result in step S11 is negative (step S11: N), the process proceeds to step S16, which will be described later.

[0088] When a new operating state is identified and the determination result in step S11 becomes positive (step S11: Y), the process proceeds to step S12. In step S12, the control unit 220A determines whether or not the operating mode has changed.

[0089] If the determination result in step S12 is negative (step S12: N), the process proceeds to step S13. In step S13, the control unit 220A generates display instructions for the information processing device 100A and display data to be sent to the display unit 230 when an operating state transition occurs that does not involve a change in the operating mode.

[0090] In the process of step S13, control unit 220A generates display data corresponding to an image to be displayed on display unit 230 after the transition of the operating state. Then, control unit 220A sends the generated display data to display unit 230. As a result, the image after the transition of the operating state is displayed on display unit 230.

[0091] Subsequently, control unit 220A performs an information change determination as to whether or not to change the information displayed in second display area 122 in accordance with the transition of the operating state. If the result of the information change determination is negative, control unit 220A ends the processing of step S13 without specifying display or generating display data. Then, the processing proceeds to step S16.

[0092] If the result of the information change determination is positive, the control unit 220A generates new information to be displayed in the second display area 122 as a display specification based on the above-mentioned display information stored therein. Then, the control unit 220A transmits the generated display specification to the information processing device 100A. As a result, information according to the new operating state is displayed in the second display area 122. Then, the process of step S13 ends, and the process proceeds to step S16.

[0093] If the determination result in the above-mentioned step S12 is affirmative (step S12: Y), the process proceeds to step S14. In step S14, control unit 220A determines icons corresponding to the new operation mode to be displayed in first display area 121 and icons corresponding to the new operation mode to be displayed on display unit 230, based on the above-mentioned icon allocation information stored therein.

[0094] Next, in step S15, control unit 220A generates display data according to an image to be displayed on display unit 230 after the change in operation mode, including the icon determined as the icon to be displayed on display unit 230. Then, control unit 220A sends the generated display data to display unit 230. As a result, an image after the change in operation mode is displayed on display unit 230.

[0095] Next, in response to the change in the operation mode, control unit 220A generates information including a new operation mode to be displayed in second display area 122. Subsequently, control unit 220A generates, as display specification, information including an icon and its shape to be displayed in first display area 121 and the new operation mode to be displayed in second display area 122. Control unit 220A then transmits the generated display specification to information processing device 100A. As a result, an icon corresponding to the new operation mode of mobile terminal device 200A is displayed in first display area 121, and information corresponding to the new operation mode is displayed in second display area 122.

[0096] When the process of step S15 ends in this way, the process proceeds to step S16. In step S16, the control unit 220A determines whether or not a linked operation is in progress. If the determination result in step S16 is positive (step S16: Y), the process returns to step S11. Thereafter, the processes of steps S11 to S16 are repeated until the determination result in step S16 becomes negative. Then, if the determination result in step S16 becomes negative (step S16: N), the display control process of the control unit 220A during linked operation ends.

[0097] 5 shows an example of a display when the operation mode changes from the first operation mode to the second operation mode. In FIG. 5, icons A to K are shown as examples.

[0098] When the information processing device 100A and the mobile terminal device 200A are not operating in cooperation with each other, as described above, the information processing device 100A and the mobile terminal device 200A each display their own unique displays on the display unit 120 and the display unit 230.

[0099] As described above, in the first embodiment, when the operation state including the operation mode of mobile terminal device 200A is identified, control unit 220A determines whether the operation mode has changed based on the identification result when information processing device 100A and mobile terminal device 200A are operating in cooperation with each other. If the operation mode has changed, control unit 220A generates a display specification including an icon and its shape to be displayed in first display area 121 of information processing device 100A in accordance with the change in operation mode. Control unit 220A then transmits the generated display specification to information processing device 100A.

[0100] Therefore, according to the first embodiment, when performing an operation input to the mobile terminal device 200A, the input unit 110 of the information processing device 100A can be appropriately used, thereby improving user convenience.

[0101] Furthermore, in the first embodiment, the control unit 220A includes, among the icons that were displayed in the first display area 121 before the change in the operation mode but are no longer displayed in the first display area 121 after the change in the operation mode, icons that are determined to remain displayed in the changed operation mode as well, in the icons to be displayed on the display unit 230. Then, the control unit 220A generates display data according to images to be displayed on the display unit 230 after the transition in the operation state, including the icons determined as the icons to be displayed on the display unit 230, and sends the generated display data to the display unit 230. This allows the icons to be displayed appropriately, improving user convenience.

[0102] Furthermore, in the first embodiment, when the mobile terminal device 200A and the information processing device 100A are not operating in cooperation with each other (including when they are not connected), the shapes of the icons displayed in the first display area 121 are the same as the shapes of the icons displayed on the display unit 230 for operating the same functions. Therefore, when inputting to the mobile terminal device 200A using the operation area in which the first display area 121 is arranged, the user can perform the input operation without feeling uncomfortable.

[0103] Furthermore, in the first embodiment, information on the operating state of the mobile terminal device 200A is displayed in the second display area 122. This improves the convenience for the user who performs input using the operation area in which the first display area 121 is arranged.

[0104] The information processing device may be an in-vehicle device or a device installed in a house.

[0105] In the first embodiment, the shape of the operation area in the input unit 110 of the information processing device 100A is concave with respect to the surrounding area of ​​the operation area, and is a shape that can be identified by the sense of touch. This allows the user to easily identify the operation area, improving user convenience.

[0106] Furthermore, in the first embodiment, the mobile terminal device 200A is detachably held by the holding unit 150 included in the information processing device 100A. Therefore, for example, when the information processing device 100A is an in-vehicle device, the mobile terminal device 200A can be placed in a fixed position for the user, and the mobile terminal device 200A is placed in a position where the user can view the information processing device 100A and the mobile terminal device 200A at the same time, thereby improving convenience for the user.

[0107] [Second Example] First, a second embodiment of the present invention will be described with reference mainly to FIGS.

[0108] <Configuration> Fig. 6 shows the configuration of collaboration system 300B according to Example 2. As shown in Fig. 6, collaboration system 300B differs from collaboration system 300A (see Fig. 3) described above in that collaboration system 300B includes information processing device 100B instead of information processing device 100A, and mobile terminal device 200B instead of mobile terminal device 200A.

[0109] The information processing device 100B described above differs from the information processing device 100A in that it includes a control unit 130B instead of processing unit 130A. Moreover, the mobile terminal device 200B described above differs from the mobile terminal device 200A in that it includes a processing unit 220B instead of control unit 220A. The following description will mainly focus on these differences.

[0110] When the mobile terminal device 200B and the information processing device 100B are operating in cooperation with each other, the processing unit 220B identifies the operating state of the mobile terminal device 200B and transmits the identification result to the information processing device 100B (more specifically, the control unit 130B).

[0111] When the mobile terminal device 200B and the information processing device 100B are operating in cooperation with each other, the processing unit 220B receives a display specification transmitted from the information processing device 100B. Then, the processing unit 220B generates display data of an image to be displayed on the display unit 230, taking into consideration the icon allocation in the display specification. The display data generated in this manner is sent to the display unit 230. As a result, the display unit 230 performs display in accordance with the display specification transmitted from the information processing device 100B.

[0112] The control unit 130B described above internally holds icon allocation information and display information, similar to the case of the control unit 220A described above. The control unit 130B receives the identification result transmitted from the processing unit 220B. Then, in accordance with the identification result, the control unit 130B generates display designation to be transmitted to the mobile terminal device 200B (more specifically, the processing unit 220B) and display data corresponding to the display image of the display unit 120. The display designation and display data generation process executed by the control unit 130B during cooperative operation will be described later.

[0113] The generated display specification is transmitted to the mobile terminal device 200B. The generated display data is also transmitted to the display unit 120.

[0114] When the mobile terminal device 200B is not operating in cooperation with the information processing device 100B, the control unit 130B generates unique display data and sends the generated display data to the display unit 120. As a result, the display unit 120 displays a display unique to the information processing device 100B.

[0115] <Operation> Next, the operation of linkage system 300B configured as described above will be described, focusing mainly on the processing of control unit 130B during linked operation. It is assumed that information processing device 100B and mobile terminal device 200B are operating in linkage.

[0116] 7, when the control unit 130B receives the result of identifying the operation state of the mobile terminal device 200B identified by the processing unit 220B during the linked operation, the control unit 130B determines in step S21 whether or not an operation state transition has occurred in the mobile terminal device 200B. If the determination result in step S21 is negative (step S21: N), the process proceeds to step S26, which will be described later.

[0117] When a new operating state is identified and the determination result in step S21 becomes positive (step S21: Y), the process proceeds to step S22. In step S22, the control unit 130B determines whether or not the operating mode has changed.

[0118] If the determination result in step S22 is negative (step S22: N), the process proceeds to step S23. In step S23, control unit 130B generates display data to be sent to display unit 120.

[0119] In step S23, control unit 130B performs an information change determination as to whether or not to change the information displayed in second display area 122 in accordance with the transition of the operating state. If the result of the information change determination is negative, control unit 130B ends the processing of step S23 without generating display data. Then, the processing proceeds to step S26.

[0120] If the result of the information change determination is positive, control unit 130B generates display data to be sent to display unit 120 based on the above-mentioned display information stored therein. Then, control unit 130B sends the generated display data to display unit 120. As a result, information according to the new operating state is displayed in second display area 122. Then, the processing of step S23 ends, and the processing proceeds to step S26.

[0121] If the determination result in step S22 is affirmative (step S22: Y), the process proceeds to step S24. In step S24, control unit 130B determines icons corresponding to the new operation mode to be displayed in first display area 121 and icons corresponding to the new operation mode to be displayed on display unit 230, based on the icon allocation information stored therein.

[0122] Next, in step S25, control unit 130B generates a display specification for the icon determined as the icon to be displayed on display unit 230. Then, control unit 130B sends the generated display specification to processing unit 220B. As a result, an image after the change in operation mode is displayed on display unit 230.

[0123] Next, in response to the change in the operation mode, control unit 130B generates information including the new operation mode to be displayed in second display area 122. Subsequently, control unit 130B generates display data including an icon to be displayed in first display area 121 and information corresponding to the new operation mode to be displayed in second display area 122. Then, control unit 130B sends the generated display data to display unit 120. As a result, an icon corresponding to the new operation mode of mobile terminal device 200B is displayed in first display area 121, and information corresponding to the new operation mode is displayed in second display area 122.

[0124] When the process of step S25 ends in this way, the process proceeds to step S26. In step S26, control unit 130B determines whether or not coordinated operation is in progress. If the determination result in step S26 is positive (step S26: Y), the process returns to step S21. Thereafter, the processes of steps S21 to S26 are repeated until the determination result in step S26 becomes negative. Then, if the determination result in step S26 becomes negative (step S26: N), the display control process of control unit 130B during coordinated operation ends.

[0125] When the information processing device 100B and the mobile terminal device 200B are not operating in cooperation with each other, as described above, the information processing device 100B and the mobile terminal device 200B each display their own unique displays on the display unit 120 and the display unit 230.

[0126] As described above, according to the second embodiment, when an operation input is made to the mobile terminal device 200B, the same effects as those of the first embodiment can be achieved.

[0127] [Third Example] Next, a third embodiment of the present invention will be described with reference mainly to FIGS.

[0128] <Configuration> Fig. 8 shows the configuration of a linkage system 300C according to the third embodiment. As shown in Fig. 8, linkage system 300C differs from linkage system 300A (see Fig. 3) described above in that linkage system 300C includes information processing device 100C instead of information processing device 100A, and mobile terminal device 200C instead of mobile terminal device 200A. The following description will mainly focus on these differences.

[0129] Configuration of information processing device 100C 8, the information processing device 100C differs from the information processing device 100A in that it includes a processing unit 130C instead of the processing unit 130A. The information processing device 100C is configured to switch between an operation when linked with the mobile terminal device 200C and an operation when not linked with the mobile terminal device 200C.

[0130] The processing unit 130C is configured to include a central processing unit (CPU), etc. The processing unit 130C executes various programs to realize the functions of the information processing device 100C.

[0131] When the information processing device 100C is operating in cooperation with the mobile terminal device 200C, the processing unit 130C receives a display specification transmitted from the mobile terminal device 200C. Then, the processing unit 130C generates display data of icons to be displayed in the first display area 121, taking into account the icon allocation in the display specification. The display data generated in this manner is sent to the display unit 120. As a result, icons are displayed in the first display area 121 in accordance with the display specification transmitted from the information processing device 100C. Here, when the information processing device 100C is operating in cooperation with the mobile terminal device 200C, the processing unit 130C causes the second display area 122 to display icons in accordance with the operation mode of the mobile terminal device 200C.

[0132] When the information processing device 100C is not operating in cooperation with the mobile terminal device 200C, the processing unit 130C generates unique display data and sends the generated display data to the display unit 120. As a result, the display unit 120 displays an image unique to the information processing device 100C.

[0133] <Configuration of mobile terminal device 200C> 8, the mobile terminal device 200C includes a sensor 211, a wireless communication unit 212, and a control unit 220C in addition to the display unit 230 and touch panel described above. Note that, as in the first embodiment described above, a touch panel capable of receiving user operations is arranged on the display screen of the display unit 230.

[0134] In the third embodiment, the sensor 211 includes an acceleration sensor. The detection result by the sensor 211 is sent to the control unit 220C. Upon receiving the acceleration detection result by the sensor 211, the control unit 220C performs a time integration process on the acceleration to obtain the moving speed of the mobile terminal device 200C (the moving speed of a moving body moving together with the mobile terminal device 200C).

[0135] The wireless communication unit 212 receives urgency information such as disaster information via a communication network, and then transmits the acquired urgency information to the control unit 220C. Upon receiving the urgency information transmitted from the wireless communication unit 212, the control unit 220C acquires the urgency corresponding to the urgency information.

[0136] The control unit 220C is configured to include a central processing unit (CPU), etc. The control unit 220C executes various programs to realize the functions of the mobile terminal device 200C.

[0137] The control unit 220C internally stores icons and their shapes to be displayed on the display unit 230 when no linked operation is performed. The control unit 220C also internally stores layout information of the operation area in the input unit 110 of the information processing device 100C.

[0138] Furthermore, control unit 220C internally stores importance information for each icon, which is determined in a manner that the importance increases as the frequency of use of the touch keys corresponding to the icons displayed on display unit 230 and the keys corresponding to the icons displayed in first display area 121 increases. Control unit 220C also internally stores risk information that indicates the risk of operating the corresponding touch keys for each icon displayed on display unit 230.

[0139] The risk level is determined in advance based on the degree to which the user needs to gaze at the icon. For example, if the icon is a seek bar icon, the risk level is set high because the user needs to gaze at the icon to adjust the position of the seek bar. If the icon is a track-up icon for music playback, the risk level is set low because the user needs to gaze at the icon less. If the icon is an icon for setting a repeat mode for music playback, the repeat mode display changes with each operation, and the user does not need to gaze at the icon less. Therefore, the risk level is set lower than that for a seek bar icon and higher than that for a track-up icon.

[0140] The control unit 220C acquires the moving speed and the urgency information as described above. Then, when the information processing device 100C is operating in cooperation with the mobile terminal device 200C, the control unit 220C switches between the first display mode and the second display mode based on the acquired moving speed and urgency information.

[0141] The control unit 220C generates display data corresponding to an image to be displayed on the display unit 230 for both the first and second display modes, and sends the generated display data to the display unit 230. In addition, in the second display mode, the control unit 220C sends a display instruction to the processing unit 130C to the information processing device 100C.

[0142] Here, the first display mode is a display mode in which display unit 120 of information processing device 100C displays icons corresponding to the operation mode of information processing device 100C. Also, the second display mode is a display mode in which at least some of the icons displayed on display unit 230 in the first display mode are displayed in first display area 121, and icons including the icons displayed in first display area 121 are not displayed on display unit 230. Here, in the second display mode, second display area 122 displays according to the operation mode of information processing device 100C.

[0143] The process executed by the control unit 220C will be described later.

[0144] The display unit 230 receives the display data sent from the control unit 220C, and then performs display in accordance with the display data.

[0145] A touch panel capable of receiving user operations is arranged on the display screen of display unit 230. Control unit 220C internally stores importance information for each touch key corresponding to an icon displayed on display unit 230 and for each icon displayed in first display area 121, the importance information being determined in a manner that increases as the frequency of use of the key corresponding to the icon increases. Control unit 220C also internally stores risk information indicating the risk of operating the corresponding touch key for each icon displayed on display unit 230.

[0146] <Operation> Next, the operation of the linked system 300C configured as described above will be described, focusing mainly on the display control process of the control unit 220C during linked operation. Here, the display control process includes a display mode determination process and a display execution process.

[0147] It is assumed that the information processing device 100C and the mobile terminal device 200C operate in cooperation with each other, and that the initial display mode is the first display mode.

[0148] <<Display Mode Determination Process>> First, the display mode determination process will be described.

[0149] 9, in the display mode determination process, the control unit 220C, which has newly acquired the moving speed or the urgency level, determines whether the moving speed is lower than a threshold speed in step S31. Note that the threshold speed is determined in advance based on experiments, simulations, and experience from the viewpoint of ensuring safety.

[0150] If the result of the determination in step S31 is affirmative (step S31: Y), the process proceeds to step S32. In step S32, the control unit 220C determines whether the urgency level is lower than a threshold urgency level. Note that the threshold urgency level is predetermined based on experiments, simulations, and experience from the viewpoint of ensuring safety.

[0151] If the result of the determination in step S32 is affirmative (step S32: Y), the process proceeds to step S33. In step S33, the control unit 220C determines the display mode to be the first display mode. Then, the process proceeds to step S35, which will be described later.

[0152] If the determination result in step S31 or step S32 is negative (step S31: N or step S32: N), the process proceeds to step S34. In step S34, the control unit 220C determines the display mode to be the second display mode. Then, the process proceeds to step S35.

[0153] In step S35, the control unit 220C determines whether or not a coordinated operation is in progress. If the determination result in step S35 is positive (step S35: Y), the process returns to step S31. Thereafter, steps S31 to S35 are repeated until the determination result in step S35 becomes negative. Then, when the determination result in step S35 becomes negative (step S35: N), the display mode determination process ends.

[0154] <<Display execution process>> Next, the display execution process will be described.

[0155] In the display mode determination process, the control unit 220C determines whether the display mode is the first display mode in step S41, as shown in Fig. 10. If the determination result in step S41 is positive (step S41: Y), the process proceeds to step S42.

[0156] In step S42, the control unit 220C generates display data corresponding to an image similar to the image displayed on the display unit 230 when the mobile terminal device 200C is not operating in cooperation with the information processing device 100C. The control unit 220C then sends the generated display data to the display unit 230. As a result, the display unit 230 displays an image in the first display mode similar to the image displayed when the mobile terminal device 200C is not operating in cooperation with the information processing device 100C. Then, the process proceeds to step S45.

[0157] If the result of the determination in the above-mentioned step S41 is negative (step S41: N), the process proceeds to step S43. In step S43, control unit 220C determines an icon to be displayed in first display area 121 based on the importance information, risk information, and placement information stored therein, to the extent that safety for operation can be ensured.

[0158] Next, in step S44, the control unit 220C generates a display specification to be sent to the information processing device 100C and display data to be sent to the display unit 230.

[0159] In the process of step S44, control unit 220C generates a display specification including the shape and arrangement of the icons to be displayed in first display area 121, as determined in step S43. Then, control unit 220C transmits the generated display specification to information processing device 100C. As a result, icons are displayed in first display area 121 in accordance with the display specification.

[0160] Next, control unit 220C determines the icons to be displayed on display unit 230. The icons determined in this way exclude the icons to be displayed in first display area 121 and icons that pose safety issues during operation. In other words, icons that are high in importance but have a sufficiently low level of risk are determined as the icons to be displayed on display unit 230 in the second display mode.

[0161] Next, if the first display mode is selected, control unit 220C determines an image that is a part of the image displayed on display unit 230 and that enlarges and displays important information in the current operating state. Control unit 220C then generates display data according to the determined image and images corresponding to the icons determined to be displayed on display unit 230, and sends the generated display data to display unit 230. As a result, display on display unit 230 in the second display mode is performed.

[0162] When the process of step S44 ends in this way, the process proceeds to step S45. In step S45, the control unit 220C determines whether or not a cooperative operation is in progress.

[0163] If the determination result in step S45 is positive (step S45: Y), the process returns to step S41. Thereafter, steps S41 to S45 are repeated until the determination result in step S45 becomes negative. Then, if the determination result in step S45 becomes negative (step S45: N), the display execution process ends.

[0164] When the information processing device 100C and the mobile terminal device 200C are not operating in cooperation with each other, the display unit 230 displays the same information as in the first display mode, and the display unit 120 displays nothing.

[0165] 11 shows a display example when the display mode changes from the first display mode to the second display mode, where Fig. 11(A) shows a display example in the first display mode, and Fig. 11(B) shows a display example in the second display mode.

[0166] As described above, in the third embodiment, when the movement speed and the urgency level are acquired, the control unit 220C determines, based on the movement speed and the urgency level, whether it is appropriate for the user to perform an operation using the icon displayed on the display unit 230 in the first display mode. If the result of this determination is negative, the control unit 220C determines the display mode to be the second display mode. Next, the control unit 220C determines the icon to be displayed in the first display area 121 and displays the determined icon in the first display area 121. Furthermore, the control unit 220C displays, on the display unit 230, the icons to be displayed in the first display area 121 and icons for which it is not appropriate to perform an operation according to the icon displayed on the display unit 230.

[0167] Therefore, according to the third embodiment, when inputting an operation to the mobile terminal device 200C, the input unit 110 of the information processing device 100C can be used as appropriate depending on the external situation of the mobile terminal device 200C.

[0168] In the third embodiment, the control unit 220C selects the icons to be displayed in the first display area 121 in the second display mode according to the importance of the input using the operation area corresponding to each icon. This allows the icons to be appropriately selected to be displayed in the first display area 121 in the second display mode.

[0169] Furthermore, in the third embodiment, the control unit 220C determines the importance of each icon according to the frequency of inputs using the operation area corresponding to each icon, which makes it possible to determine the importance of each icon rationally.

[0170] In the third embodiment, the control unit 220C selects the icons to be displayed in the first display area 121 in the second display mode according to the risk of input using the operation area corresponding to each icon. This allows the appropriate selection of icons to be displayed in the first display area 121 in the second display mode.

[0171] [Modification of the embodiment] The present invention is not limited to the above-described first to third embodiments, and various modifications are possible.

[0172] For example, in the first to third embodiments described above, the shape of the operation area in the input unit of the information processing device is concave relative to the surrounding area of ​​the operation area. In contrast, the shape of the operation area in the input unit of the information processing device may be convex relative to the surrounding area of ​​the operation area. In this case, too, the user can easily identify the operation area, improving user convenience.

[0173] Furthermore, the information processing devices in the first to third embodiments may be vehicle-mounted devices or devices installed in a house.

[0174] In the first to third embodiments, the input unit of the information processing device is configured to include hard keys. Alternatively, the input unit of the information processing device may be configured to include soft keys such as touch keys.

[0175] In the first and second embodiments, the icons to be displayed in the first display area and the icons to be displayed on the mobile display unit are determined based on predetermined icon allocation information. However, the icons to be displayed in the first display area may be determined by giving a higher priority to the operation area corresponding to the icon displayed in each operation mode, the more frequently the operation area is used.

[0176] In the first and second embodiments described above, the control unit is configured to internally store icon allocation information and display information in the second display area for each operating state of the mobile terminal device. Alternatively, the icon display allocation information and display information in the second display area for each operating state of the mobile terminal device may be stored in an external server, and the icon display allocation information and display information in the second display area for a specified operating state may be acquired from the external server via a communication network.

[0177] In the first to third embodiments, the display objects for which the display destination is switched are icons, but the display destination of display objects other than icons may be switched.

[0178] In the third embodiment, the external conditions of the mobile terminal device that are taken into consideration when switching the display mode are a combination of the speed of the moving object traveling with the mobile terminal device and the urgency level. However, the display mode may be switched depending on any external conditions.

[0179] In addition, in the third embodiment described above, the display mode is switched from a safety perspective, but the display mode may be switched from another perspective, such as user convenience.

[0180] In the third embodiment, in the second display mode, information corresponding to the operation mode of the mobile terminal device is displayed in the second display area. However, in the second display mode, information corresponding to the external situation, such as information on the moving speed or urgency level, may be displayed in the second display area.

[0181] In the third embodiment, in the first display mode, the display unit of the information processing device displays an icon corresponding to the operation mode of the mobile terminal device. However, in the first display mode, nothing may be displayed on the display unit of the information processing device. [Explanation of symbols]

[0182] 100A ... Information processing equipment 110 ... Input section 120...Display section (information display section) 121 … 1st display area 122…Second display area 150 … Holding part 200A ... Portable terminal equipment 220A ... Control unit (display control unit and identification unit) 230 ... Display unit (mobile display unit) 300A... Linked system 700 ... Information processing equipment 710 ... Input section 720 … Information display section 721 … 1st display area 722…Second display area 800 ... Mobile terminal device 810…Specific part 820 ... Display control unit 830 ... Mobile display 900 … Collaboration system

Claims

[Claim 1] A mobile terminal device connectable to an information processing device, a mobile display unit capable of displaying an icon corresponding to an operation mode of the mobile terminal device; a display control unit that displays an icon corresponding to the operation mode in a first display area arranged in an operation area that can accept a user operation in an input unit included in the information processing device, and displays another icon different from the icon displayed in the first display area on the mobile display unit; A mobile terminal device comprising:

Images