Information processing method, information processing apparatus, and computer program

Abstract

To prevent a reduction in the visibility of a screen displayed on an external display that is a display of an external terminal, even when an event occurs in which the vertical width and / or the lateral width of the screen displayed on the external display need to be changed.SOLUTION: An information processing apparatus receives information on the vertical width and the lateral width of an external display, and generates screen data of a screen displayed on the external display on the basis of the information. When an event occurs in which the vertical width and / or the lateral width of the screen displayed on the external display need to be changed, the information processing apparatus transmits, to an external terminal, screen data including screen data of first content and screen data of second content, which are obtained by changing a screen displayed on the external display at the occurrence of the event to have a size according to the vertical width and the lateral width after the change. The second content is displayed in an area that is generated in the external display due to the difference between the vertical width and the lateral width before the change of the external display and the vertical width and the lateral width after the change of the external display.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a technique for displaying a screen on an external terminal communicably connected to an information processing device. [Background technology]

[0002] Patent Document 1 discloses a technique for displaying the screen of a user terminal on the screen of a meter unit or the like of a vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] US10,923,073 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the technology disclosed in Patent Document 1, the screen of a user terminal is displayed on the screen of a vehicle meter unit, etc. An in-vehicle device such as a vehicle meter unit is an example of an information processing device, and the user terminal is an example of an external terminal communicably connected to the information processing device.

[0005] It is technically possible for an information processing device to transmit screen data to an external terminal, and for the external terminal to display a screen represented by the screen data.

[0006] An event may occur that requires changing the vertical and / or horizontal width of the screen displayed on the external display unit, which is the display unit of the external terminal. When such an event occurs, it is considered that the external terminal reconstructs the screen represented by the screen data from the information processing device and displays it on the external display unit.

[0007] However, the screen that is reconstructed and displayed on the external display unit may be a screen that is poorly visible to the user of the external terminal (for example, a screen that is stretched vertically or horizontally to the point where visibility is reduced).

[0008] The object of the present invention is to prevent a decrease in the visibility of the screen displayed on the external display unit even when an event occurs that requires a change in the vertical and / or horizontal width of the screen displayed on the external display unit. [Means for solving the problem]

[0009] An information processing device receives information regarding the vertical and horizontal widths of an external display unit (a display unit of an external terminal) and generates screen data for a screen to be displayed on the external display unit based on the information. When an event occurs that requires changing the vertical and / or horizontal widths of the screen displayed on the external display unit, the information processing device transmits screen data to the external terminal, including screen data for a first content, the screen being displayed on the external display unit at that time, resized to correspond to the changed vertical and horizontal widths, and screen data for a second content. The second content is displayed in an area on the external display unit that is created due to the difference between the vertical and horizontal widths of the external display unit before the change and the changed vertical and horizontal widths of the external display unit. [Effects of the Invention]

[0010] According to the present invention, even if an event occurs that requires changing the vertical and / or horizontal width of the screen displayed on the external display unit, it is possible to prevent a decrease in the visibility of the screen displayed on the external display unit. Problems, configurations, and effects other than those described above will become clear from the description of the following embodiments. [Brief explanation of the drawings]

[0011] [Figure 1] 1 shows the overall configuration of a system according to an embodiment of the present invention. [Figure 2] An example of a display in Mirroring mode is shown below. [Figure 3] An example of the display in Extension mode is shown below. [Figure 4] 10 shows an example of the flow of processing performed by the in-vehicle device in the Mirroring mode. [Figure 5]10 shows an example of the flow of processing performed by an external terminal in the mirroring mode. [Figure 6] 10 shows an example of the flow of processing performed by the in-vehicle device in the Extension mode. [Figure 7] 10 shows an example of the flow of processing performed by an external terminal in Extension mode. DETAILED DESCRIPTION OF THE INVENTION

[0012] An embodiment of the present invention will be described below with reference to the drawings. In the embodiment, an in-vehicle device is used as an example of an information processing device, but the information processing device may be a device other than an in-vehicle device.

[0013] FIG. 1 shows the overall configuration of a system according to one embodiment of the present invention.

[0014] The in-vehicle device 100 can wirelessly communicate with the external terminal 120 according to Wi-Fi (registered trademark) or Ethernet (registered trademark). For example, the in-vehicle device 100 can function as an access point. The external terminal 120 is an information processing terminal such as a smartphone or tablet terminal of a user in the driver's seat or another seat. The external terminal 120 may be a mobile terminal, or an information processing terminal such as a monitor that is detachably or non-detachably attached to a location in the vehicle other than the driver's seat (for example, the passenger seat or the left or right rear seats).

[0015] Although not shown, the in-vehicle device 100 includes an interface device, an input / output device, a storage device, and a processor connected to these. The in-vehicle device 100 communicates with an external terminal 120 via the interface device. The input / output device is a first display unit 102 (for example, a screen as hardware). The first display unit 102 may be a touch panel.

[0016] The storage device stores data and computer programs. The processor executes the computer programs to realize functions such as a screen definition unit 103, a first display control unit 105, a first video control unit 106, and a first information control unit 107.

[0017] The screen definition unit 103 acquires first display unit information, which is information about the vertical and horizontal widths of the first display unit 102, from the first display unit 102 or a storage device in the in-vehicle device 100. The first display unit information includes, for example, information indicating at least one of the aspect ratio, resolution, and vertical and horizontal sizes of the first display unit 102.

[0018] The first display control unit 105 is an example of a screen generation unit. The first display control unit 105 generates screen data for a screen to be displayed on the first display unit 102 and / or screen data for a screen to be displayed on the second display unit 122. Here, the "screen" represented by the screen data does not refer to a screen as hardware such as the first display unit 102 or the second display unit 122, but rather to screen information (e.g., characters, images, or videos) displayed on a hardware screen, such as a so-called screen image.

[0019] The first information control unit 107 is an example of a receiving unit. The first information control unit 107 acquires second display unit information (an example of external display unit information) that is information regarding the vertical and horizontal widths of the second display unit 122 included in the external terminal 120. The second display unit information includes, for example, information indicating at least one of the aspect ratio, resolution, and vertical and horizontal sizes of the second display unit 122. The first display control unit 105 generates screen data for a screen to be displayed on the second display unit 122 based on the second display unit information received by the first information control unit 107. The screen data for the screen to be displayed on the second display unit 122 is generated based on the first display unit information in addition to the second display unit information. The first information control unit 107 includes functions such as a mode determination unit 104, an information transmission / reception unit 111, and an operation reception unit 112. The mode determination unit 104 determines the mode of the screen to be displayed on the second display unit 122 from among multiple modes. The information transmission / reception unit 111 receives the second display unit information from the information transmission / reception unit 131 of the external terminal 120. The operation receiving unit 112 receives operation information representing the operation content of the external terminal 120 (for example, a change in the orientation or shape of the external terminal 120, or the content of a touch operation on the second display unit 122 or the touched position) from the operation transmitting unit 132 of the external terminal 120.

[0020] The first video control unit 106 is an example of a transmission unit. The first video control unit 106 transmits screen data of a screen to be displayed on the second display unit 122 (screen data generated by the first display control unit 105) to the external terminal 120. The screen data is, for example, encoded and transmitted to the external terminal 120 using RTP (Real-time Transport Protocol).

[0021] Although not shown, the external terminal 120 includes an interface device, an input / output device, a storage device, and a processor connected to these devices. The external terminal 120 communicates with the in-vehicle device 100 via the interface device. The input / output device may be a second display unit 122. The second display unit 122 is typically a touch panel.

[0022] The storage device stores data and computer programs. The processor executes the computer programs to realize functions such as second information control unit 127, second video control unit 126, and second display control unit 125.

[0023] The second information control unit 127 transmits and receives information relating to the screen data received by the second video control unit 126 or other information to and from the in-vehicle device 100. The second information control unit 127 includes functions such as an information transmission / reception unit 131 and an operation transmission unit 132. The information transmission / reception unit 131 acquires second display unit information from the second display unit 122 (or a storage device in the external terminal 120) and transmits the second display unit information to the information transmission / reception unit 111 of the in-vehicle device 100. The operation transmission unit 132 transmits operation information indicating the content of an operation on the external terminal 120 to the operation reception unit 112 of the in-vehicle device 100.

[0024] The second video control unit 126 receives screen data of a screen to be displayed on the second display unit 122 from the in-car device 100. The second display control unit 125 displays, on the second display unit 122, a screen represented by the decoded screen data.

[0025] An example of the processing performed in this embodiment will be described below.

[0026] The first information control unit 107 in the in-vehicle device 100 receives the second display unit information. Specifically, for example, the information transmitting / receiving unit 111 of the first information control unit 107 receives the second display unit information from the information transmitting / receiving unit 131 of the second information control unit 127.

[0027] The first display control unit 105 generates screen data for a screen to be displayed on the second display unit 122 based on the second display unit information received by the first information control unit 107. The first video control unit 106 transmits the screen data generated by the first display control unit 105 to the external terminal 120.

[0028] The second video control unit 126 in the external terminal 120 receives the screen data transmitted from the in-car device 100. The second display control unit 125 displays, on the second display unit 122, a screen represented by the screen data received by the second video control unit 126.

[0029] Here, the screen data transmitted to the external terminal 120 is any one of the following screen data. First screen data of the same screen as that displayed on the first display unit 102. Second screen data of a screen (which may be called an extended screen) that is displayed only on the second display unit 122 out of the first display unit 102 and the second display unit 122. Third screen data including screen data of the first content, which is the screen displayed on the second display unit 122 resized to correspond to the changed vertical and horizontal widths of the second display unit 122, and screen data of the second content.

[0030] When a target event occurs that requires a change in the vertical and / or horizontal width of the screen displayed on second display unit 122, the transmission unit transmits third screen data to external terminal 120. The "transmission unit" referred to in this paragraph may include at least a part of first information control unit 107 in addition to first video control unit 106.

[0031] By transmitting the third screen data, even if a target event occurs, the screen displayed on the second display unit 122 will not be stretched vertically or horizontally to the point that visibility is reduced, and the screen can be maintained with high visibility for the user.

[0032] An example of when a target event occurs is when the requirement that the difference between the first display information and the second display information is large is met. Hereinafter, such a requirement will be referred to as the "target requirement."

[0033] "There is a large difference between the first display unit information and the second display unit information" means that there is such a difference between the relationship between the height and width of the screen according to the first display unit information and the relationship between the height and width of the screen according to the second display unit information that when a screen according to the first display unit information is displayed on second display unit 122 while maintaining the relationship between the height and width of the screen, a large amount of empty space is created on second display unit 122. Therefore, for example, the satisfaction of the target requirement may be any of the following. The orientation of the second display unit 122 is different from the orientation of the first display unit 102. For example, the first display unit 102 may be in a first orientation (e.g., an orientation in which the width is longer than the height) while the second display unit 122 may be in a second orientation (e.g., an orientation in which the width is shorter than the height). Alternatively, a change in the shape of the external terminal 120 (e.g., a part of the external terminal 120 is slid or the external terminal 120 is folded) may be the fulfillment of the target requirement. The difference between the feature quantity of the relationship between the vertical and horizontal widths of the screen according to the first display information and the feature quantity of the relationship between the vertical and horizontal widths of the screen according to the second display information is equal to or greater than a certain value.

[0034] For example, the first information control unit 107 detects that the target requirement has been satisfied as a result of comparing the first display unit information with the second display unit information, and detects that the target requirement has been satisfied from information indicating the state of the external terminal 120, such as the orientation thereof (at least a part of the information received from the external terminal 120), and / or the operation content indicated by the operation information from the second information control unit 127. Specifically, the first information control unit 107 detects that the target requirement has been satisfied in the following cases, for example. When it is determined based on the first display unit information that the width of the first display unit 102 is longer than the height, and when it is determined based on the second display unit information that the height of the second display unit 122 is longer than the width. When it is determined based on the first display unit information that the width of the first display unit 102 is shorter than the height, and when it is determined based on the second display unit information that the height of the second display unit 122 is shorter than the width. Since differences in the orientation of the external terminal 120 affect the relationship between the vertical and horizontal widths of the screen displayed on the second display unit 122, detecting differences in the orientation of the external terminal 120 is an efficient way of detecting target requirements.

[0035] When the target requirements are satisfied, the transmitting unit transmits the third screen data to the external terminal 120. The first content and the second content represented by the third screen data may be displayed on the second display unit 122 in any of the following ways: The second content is displayed in an area on the second display unit 122 that is created due to the difference between the pre-change vertical and horizontal widths of the second display unit 122 and the post-change vertical and horizontal widths of the second display unit 122. When it is detected that the target requirements are satisfied, third screen data is generated by the first display control unit 105. The generated third screen data is transmitted to the external terminal 120 by the first video control unit 106. As a result, the first content and the second content are displayed on the second display unit 122. Before it is detected that the target requirement is satisfied, the first display control unit 105 generates third screen data based on the first display unit information and the second display unit information when the target requirement is satisfied. When it is detected that the target requirement is satisfied, the first video control unit 106 transmits the third screen data generated in advance to the external terminal 120. As a result, the first content and the second content are displayed on the second display unit 122. Before it is detected that the target requirement is satisfied, the first display control unit 105 generates third screen data based on the first display unit information and the second display unit information when the target requirement is satisfied. The generated third screen data is transmitted to the external terminal 120 by the first video control unit 106, and the third screen data is stored in the external terminal 120 (for example, the previous third screen data may be overwritten with the current third screen data). When it is detected that the target requirement is satisfied, information indicating the detection of the target requirement or an instruction to display the third screen data is transmitted from the information transmitting / receiving unit 111 to the information transmitting / receiving unit 131 of the external terminal 120. The transmission of such information or instruction corresponds to the transmission of screen data to the external terminal 120 when a target event occurs. In response to the information or instruction, the second information control unit 127 instructs the second display control unit 125 to display, on the second display unit 122, the first content and the second content represented by the third screen data previously transmitted and stored in the external terminal 120. As a result, the first content and the second content are displayed on the second display unit 122.

[0036] The first display control unit 105 generates screen data based on the second display unit information as well as the mode determined by the mode determination unit 104. As a result, when there is a large difference between the relationship between the vertical width and horizontal width of the first display unit 102 and the relationship between the vertical width and horizontal width of the second display unit 122, the first content and the second content represented by the third screen data according to the determined mode are displayed on the second display unit 122, so that the screen displayed on the external terminal 120 can be made highly visible to the user.

[0037] Specifically, for example, the multiple modes include a Mirroring mode (an example of a first mode) and an Extension mode (an example of a second mode). The Mirroring mode is a mode in which the screen displayed on the second display unit 122 is the same as the screen displayed on the first display unit 102. The Extension mode is a mode in which the screen displayed on the second display unit 122 is different from the screen displayed on the first display unit 102. Setting whether the mode is the Mirroring mode or the Extension mode may be performed on an application-by-application basis, or may be performed on a unit different from the application-by-application basis.

[0038] An example of the display when the mode is Mirroring mode is as shown in FIG.

[0039] That is, in the Mirroring mode, if the target requirements are not satisfied, first screen data of the screen 210 that is the same as the screen 210 displayed on the first display unit 102 of the in-car device 100 is transmitted to the external terminal 120, and the same screen 210 is displayed on the second display unit 122. The screen 210 may be, for example, a screen that is a collection of multiple sub-screens 202A-202C. The multiple sub-screens 202A-202C may all be multiple sub-screens generated by the same application, or multiple sub-screens generated by multiple applications. In the latter case, the screen 210 may be a screen generated by an application that generates and transmits multiple sub-screens generated by multiple applications as a single screen.

[0040] In the Mirroring mode, when the target requirement is met, third screen data is transmitted to the external terminal 120 in place of the first screen data. A screen 230A represented by the third screen data is displayed on the second display unit 122 in place of the screen 210. Specifically, for example, when the first information control unit 107 detects that the target requirement is met, the first display control unit 105 generates third screen data based on the second display unit information. The first video control unit 106 transmits the generated third screen data to the external terminal 120. As a result, the screen 230A is displayed on the second display unit 122 of the external terminal 120 in place of the screen 210.

[0041] The third screen data includes screen data of the first content 210X, which is the screen 210 displayed on the second display unit 122 when the target requirement is satisfied, resized to correspond to the changed height and width of the second display unit 122, and screen data of the second content 203A. Therefore, the screen 230A includes the first content 210X and the second content 203A. For example, the first display control unit 105 determines the relationship between the height and width of the first content 210X, which will be part of the screen 230A (the relationship between the height and width of the screen 210 after the change), based on the first and second display unit information when the target requirement is satisfied (e.g., the magnitude of the difference between the relationship between the first and second heights and widths). The first display control unit 105 generates screen data of the first content 210X according to the determined relationship between the height and width. The "determined relationship between height and width" may be the same as the relationship between height and width (e.g., aspect ratio) before the target requirement is satisfied, or may be the relationship between height and width after the relationship between height and width before the target requirement is satisfied is changed. In this way, the screen 210 is reconstructed (e.g., reduced) into the first content 210X (screen). The first display control unit 105 generates screen data for the second content 203A having a relationship between height and width based on the second display unit information when the target requirement is satisfied. The first display control unit 105 generates third screen data including the screen data for the first content 210X and the screen data for the second content 203A. The relationship between height and width of the screen 230A represented by the third screen data depends on the relationship between the second height and width when the target requirement is satisfied. For example, the aspect ratio of the screen 230A may be the same as the aspect ratio of the second display unit 122, and the screen 230A may be displayed across the entire area of ​​the second display unit 122.

[0042] The screen 210 on the screen 230A that is the same as the first content 210X is also displayed on the in-vehicle device 100 and is a screen shared with a user (e.g., the driver) of the in-vehicle device 100. Therefore, the second content 203A may be content (screen) related to the first content 210X, for example, a UI (User Interface) for accepting an operation on the in-vehicle device 100 for the first content 210X, or may be an auxiliary screen related to the first content 210X (for example, a screen supplementing the screen 210). For example, a case will be described in which the second content 203A on the screen 230A is a UI for operating the first content 210X. When the operation transmission unit 132 identifies that a user operation has been performed on the second content 203A on the screen 230A, the first information control unit 107 of the in-vehicle device 100 receives operation information indicating the details of the user operation from the external terminal 120. In accordance with the operation information, the application displaying screen 210 is controlled (screen 210 is updated by first display control unit 105). In this way, screen 230A with high visibility can be provided to the user, and a highly convenient UI can also be provided to the user because the operability of screen 210 is improved and the amount of information that the user can recognize increases.

[0043] Furthermore, the configuration of the screen 230A is not limited to one, and there may be several patterns. According to the example shown in FIG. 2, there are patterns 1 to 3. Pattern 1 is a pattern in which the first content 210X is arranged above the second content 203A on the screen 230A. Pattern 2 is a pattern in which the first content 210X is arranged below the second content 203A on the screen 230A. Pattern 3 is a pattern in which a plurality of second contents 203 (for example, two second contents 203A and 203B) are arranged on the screen 230A. The arrangement of the plurality of second contents 203 may be continuous, or may be dispersed as shown in the figure. The first display control unit 105 may determine which of a plurality of patterns the configuration of the screen 230A will follow based on operation information (operation information following the operation of the user of the external terminal 120) acquired from the external terminal 120 through the first information control unit 107, or based on the characteristics of the first content 210X or the second content 203 (for example, the format, genre, or other characteristics of the content).

[0044] An example of the display when the mode is Extension mode is as shown in FIG.

[0045] That is, in the Extension mode, if the target requirements are not satisfied, second screen data of a screen (extended screen) 213 different from the screen 210 displayed on the first display unit 102 of the in-vehicle device 100 is transmitted to the external terminal 120, and the screen 213 is displayed on the second display unit 122. Specifically, in the Extension mode, the first display control unit 105 generates the second screen data in the background of the display of the screen 210. The first video control unit 106 transmits the second data to the external terminal 120. As a result, the screen 213 represented by the second data is displayed on the second display unit 122 of the external terminal 120.

[0046] In the Extension mode, when the target requirement is met, a screen 230B is displayed on the second display unit 122 of the external terminal 120 in place of the screen 213. Specifically, for example, when the first information control unit 107 detects that the target requirement is met, the first display control unit 105 generates third screen data based on the second display unit information. The first video control unit 106 transmits the generated third screen data to the external terminal 120. As a result, a screen 230B is displayed on the second display unit 122 of the external terminal 120 in place of the screen 213.

[0047] The third screen data includes screen data of the first content 213X, which is the screen 213 displayed on the second display unit 122 when the target requirement is satisfied, resized to correspond to the changed height and width of the second display unit 122, and screen data of the second content 203. Therefore, the screen 230B includes the first content 213X and the second content 203. For example, the first display control unit 105 determines the relationship between the height and width of the first content 213X, which will be part of the screen 230B, based on the second display unit information when the target requirement is satisfied, and generates screen data of the first content 213X according to the determined relationship between the height and width. Furthermore, the first display control unit 105 generates screen data of the second content 203 whose height and width are related based on the second display unit information when the target requirement is satisfied. The first display control unit 105 generates third screen data including the screen data of the first content 213X and the screen data of the second content 203. The relationship between the height and width of screen 230B represented by the third screen data depends on the relationship between the height and width of the second screen when the target requirement is satisfied. For example, the aspect ratio of screen 230B may be the same as the aspect ratio of second display unit 122, and screen 230B may be displayed across the entire area of ​​second display unit 122.

[0048] The first content 213X may be content related to the screen 210 displayed on the first display unit 102, or may be content unrelated to the screen 210. The second content 203 may be content related to the screen 210 or the first content 213X, or may be content unrelated to either the screen 210 or the first content 213X. For example, the second content 203 may be an auxiliary screen for the UI displayed as the first content 213X, or an auxiliary UI. In this way, it is possible to provide the user with a highly visible screen 230B, and also to provide the user with a highly convenient UI due to improved operability of the first content 213X and increased information that the user can recognize.

[0049] The configuration of the screen 230B is not limited to one, and may have several patterns. According to the example shown in FIG. 3, there are patterns 1 and 2. That is, either the first content 213X or the second content 203 may be arranged on the upper side of the screen 230B. The first display control unit 105 may determine which of the multiple patterns the configuration of the screen 230B should follow, depending on operation information (operation information following an operation by the user of the external terminal 120) acquired from the external terminal 120 via the first information control unit 107, or may determine the pattern depending on at least one feature of the first content 213X and the second content 203 (for example, the format, genre, or other feature of the content).

[0050] As described above, the screen 230 represented by the third screen data may be either the screen 230A or the screen 230B described above. This allows the screen 230 to be displayed according to the mode, improving visibility for the user. Furthermore, the improved operability of each screen and the increased amount of information that the user can recognize make it possible to provide the user with a highly convenient UI according to the mode.

[0051] Below, examples of the processes performed by the in-car device 100 and the external terminal 120 will be described for each of the Mirroring mode and the Extension mode.

[0052] FIG. 4 shows an example of the flow of processing performed by the in-vehicle device 100 in the Mirroring mode.

[0053] The in-vehicle device 100 connects to the external terminal 120 so as to be able to communicate with it (S401). For example, the in-vehicle device 100 receives a connection request from the external terminal 120, and establishes a connection in response to the connection request. The connection request from the external terminal 120 may include the ID of the external terminal 120, second display unit information (for example, the vertical and horizontal sizes of the second display unit 122), and information indicating the orientation of the external terminal 120 (for example, information from a gyro sensor). If the external terminal 120 is a terminal provided inside the vehicle (for example, in a back seat), the connection request from the external terminal 120 may include information indicating the position of the external terminal 120 inside the vehicle.

[0054] Since the mode determined by the mode determination unit 104 is the Mirroring mode, the in-car device 100 generates first screen data of the screen 210 that is the same as the screen 210 displayed on the first display unit 102 .

[0055] The in-vehicle device 100 transmits the generated first screen data to the external terminal 120 (S402).

[0056] If the power of the in-vehicle device 100 is on (S403: No) and it is detected that the target requirement is satisfied (S404: Yes), for example, if the orientation information from the external terminal 120 indicates portrait orientation, the in-vehicle device 100 generates third screen data (S405). Then, the process returns to S402.

[0057] FIG. 5 shows an example of the flow of processing performed by the external terminal 120 in the mirroring mode.

[0058] The external terminal 120 is communicably connected to the in-vehicle device 100 (S501). For example, the external terminal 120 transmits a connection request to the in-vehicle device 100, and connection is established in response to the request.

[0059] When the external terminal 120 receives the screen data from the in-car device 100 (S502: Yes), the external terminal 120 displays the screen represented by the screen data on the second display unit 122 (S503).

[0060] If the connection with the in-vehicle device 100 is to be terminated (S504: Yes), for example, if a disconnection operation is received from the user, the external terminal 120 transmits a disconnection request to the in-vehicle device 100, and the connection is terminated in response to the request (S505).

[0061] If the connection with the in-vehicle device 100 is not released (S504: No) and a change in the orientation of the external terminal 120 is detected (S506: Yes), the external terminal 120 transmits orientation information to the in-vehicle device 100 (S507). If the orientation information indicates portrait orientation, the in-vehicle device 100 detects that the target requirement is satisfied. If the orientation information indicates landscape orientation, the in-vehicle device 100 detects that the target requirement is not satisfied (or that the state in which the target requirement was satisfied has been canceled).

[0062] FIG. 6 shows an example of the flow of processing performed by the in-vehicle device 100 in the Extension mode.

[0063] In response to a connection request from the external terminal 120 (S601: Yes), the in-vehicle device 100 connects to the external terminal 120 so as to be able to communicate with it (S602). The connection request from the external terminal 120 may include the ID of the external terminal 120, information about the second display unit, and information indicating the orientation of the external terminal 120 (for example, information from a gyro sensor). If the external terminal 120 is a terminal provided inside the vehicle (for example, in a back seat), the connection request from the external terminal 120 may include information indicating the position of the external terminal 120 inside the vehicle.

[0064] Since the mode determined by the mode determination unit 104 is the Extension mode, the in-car device 100 generates second screen data of a screen 213 that is different from the screen 210 displayed on the first display unit 102 (S603).

[0065] The in-vehicle device 100 transmits the generated second screen data to the external terminal 120 (S604).

[0066] If the power of the in-vehicle device 100 is on (S605: No) and the screen 210 displayed on the first display unit 102 has been changed (S606: Yes), the process returns to S603 to display the screen 213 corresponding to the changed screen 210 on the external terminal 120. If the in-vehicle device 100 detects that the target requirement has been met (S607: Yes), for example, if the orientation information from the external terminal 120 indicates portrait orientation, the in-vehicle device 100 generates third screen data (S608). Then, the process returns to S604.

[0067] FIG. 7 shows an example of the flow of processing performed by the external terminal 120 in the Extension mode.

[0068] The external terminal 120 starts an association application (S701), transmits a connection request to the in-vehicle device 100 (S702), and establishes a connection in response to the request (S703). The "association application" is an example of an application for association with the in-vehicle device 100, and has a function of displaying an extended screen (a screen different from the screen 210 displayed on the first display unit 102).

[0069] When the external terminal 120 receives the screen data from the in-car device 100 (S704: Yes), the external terminal 120 displays the screen represented by the screen data on the second display unit 122 (S705).

[0070] If the connection with the in-vehicle device 100 is to be released (S706: Yes), the external terminal 120 transmits a connection release request to the in-vehicle device 100, and the connection is released in response to the request (S707).

[0071] If the connection with the in-vehicle device 100 is not released (S706: No) and a change in the orientation of the external terminal 120 is detected (S708: Yes), the external terminal 120 transmits orientation information to the in-vehicle device 100 (S709).

[0072] The present invention is not limited to the above-described embodiment, but includes various modifications. For example, the above-described embodiment has been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, not only can the configurations be deleted, but also replacements and additions of configurations are possible.

[0073] For example, the present invention is applicable not only to in-vehicle devices but also to all information processing devices that are capable of communicating with an external terminal that is equipped with a second display and that are equipped with a first display.

[0074] Furthermore, when generating screen data for the external terminal 120, the screen data may be generated based on location information of the external terminal 120 (e.g., which rear seat the external terminal 120 is located in) in addition to the second display unit information from the external terminal 120.

[0075] Furthermore, the external terminal 120 may be an example of an information processing device, and the in-vehicle device 100 may be an example of an external terminal. [Explanation of symbols]

[0076] 100: In-vehicle device, 120: External terminal

Claims

1. a receiving unit for receiving external display unit information that is information relating to the vertical and horizontal widths of a display unit of an external terminal; a screen generating unit that generates screen data of a screen to be displayed on an external display unit that is a display unit of the external terminal based on the external display unit information; a transmission unit that transmits the screen data generated by the screen generation unit to the external terminal; An information processing device comprising: The transmission unit When a target event occurs that requires a change in the vertical and / or horizontal width of the screen displayed on the external display unit, transmit screen data generated by the screen generation unit to the external terminal, the screen data including screen data of a first content, in which the screen displayed on the external display unit at that time has been changed to a size corresponding to the changed vertical and horizontal width of the external display unit, and screen data of a second content; The second content is displayed in an area on the external display unit that is generated due to a difference between the vertical and horizontal widths of the external display unit before the change and the vertical and horizontal widths of the external display unit after the change.

1. An information processing device comprising:

2. a mode determination unit that determines a mode of a screen to be displayed on the external display unit from among a plurality of modes; Further provided with The screen generation unit generates the screen data based on the mode determined by the mode determination unit.

2. The information processing apparatus according to claim 1, wherein:

3. The plurality of modes include: a first mode in which the screen displayed on the external display unit is the same as the screen displayed on the display unit of the information processing device; a second mode in which a screen displayed on the external display unit is different from a screen displayed on the display unit of the information processing device; Contains 3. The information processing apparatus according to claim 2, wherein:

4. When the mode determined by the mode determination unit when the target event occurs is the first mode, the second content is content related to the first content.

4. The information processing apparatus according to claim 3,

5. When the target event occurs, When it is determined that the width is longer than the height of the display unit of the information processing device and that the height is longer than the width of the external display unit, or When it is determined that the width is shorter than the height of the display unit of the information processing device and that the height is shorter than the width of the external display unit, 2. The information processing apparatus according to claim 1, wherein:

6. receiving external display unit information that is information about the vertical and horizontal widths of the display unit of the external terminal; generating screen data for a screen to be displayed on an external display unit that is a display unit of the external terminal based on the external display unit information; When a target event occurs that requires a change in the vertical and / or horizontal width of the screen displayed on the external display unit, the generated screen data including screen data of a first content, in which the screen displayed on the external display unit at that time has been changed to a size corresponding to the changed vertical and horizontal width of the external display unit, and screen data of a second content, is transmitted to the external terminal. Let the computer do that, The second content is displayed in an area on the external display unit that is generated due to a difference between the vertical and horizontal widths of the external display unit before the change and the vertical and horizontal widths of the external display unit after the change. A computer program characterized by:

7. receiving external display unit information that is information about the vertical and horizontal widths of the display unit of the external terminal; generating screen data for a screen to be displayed on an external display unit that is a display unit of the external terminal based on the external display unit information; When a target event occurs that requires a change in the vertical and / or horizontal width of the screen displayed on the external display unit, the generated screen data including screen data of a first content, in which the screen displayed on the external display unit at that time has been changed to a size corresponding to the changed vertical and horizontal width of the external display unit, and screen data of a second content, is transmitted to the external terminal. This is done by computer, The second content is displayed in an area on the external display unit that is generated due to a difference between the vertical and horizontal widths of the external display unit before the change and the vertical and horizontal widths of the external display unit after the change.

1. An information processing method comprising:

Images