Display method and display system

Abstract

To effectively utilize a display region of a display screen.SOLUTION: A display method includes: acquiring, by a first display device, coordinate information; acquiring, by the first display device, a first content corresponding to the coordinate information; acquiring, by the first display device, a second content corresponding to the coordinate information; displaying, on a first display screen, a first image generated on the basis of a first aspect ratio of the first display screen of the first display device and the first content; and displaying, on a second display screen, a second image generated on the basis of a second aspect ratio of the second display screen of a second display device and the second content.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a display method and a display system. [Background technology]

[0002] The map search device described in Patent Document 1 displays maps and the like on a display device (see Patent Document 1). The technology described in Patent Document 1 includes a map database that stores map data including road maps, and the map data has coordinate information. Furthermore, in the technology described in Patent Document 1, based on the latitude / longitude information of the imaging point, the captured image data is stored in the captured image database with coordinate information that is associated with the coordinate information in the map database through a matching process, and images of marks indicating the imaging point and imaging direction are stored in the imaging point mark database with coordinate information that is associated with the coordinate information in the map database.

[0003] Furthermore, in the technology described in Patent Document 1, a map based on the read map data and image capturing point marks are displayed on a display device. In addition, in the technology described in Patent Document 1, by selecting one of a plurality of image capturing point marks displayed on a display device, an image captured based on captured image data corresponding to the selected image capturing point mark is displayed on the display device. Furthermore, in the technology described in Patent Document 1, the captured image is displayed on the display device in a state where it is superimposed on a map or in a state where it is aligned with the map.

[0004] In this way, the technology described in Patent Document 1 discloses that when map data and captured image data that are associated by coordinate information are displayed on a single display device, the captured image data can be displayed overlaid on the map data, or the map data and captured image data can be displayed side by side. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-70228 Summary of the Invention [Problem to be solved by the invention]

[0006] However, in the technology described in Patent Document 1, sufficient consideration has not been given to the case where display is performed using a plurality of display devices. For example, consider a case where map data and captured image data associated by coordinate information are displayed on a plurality of display devices, each equipped with a display screen. In this case, if the technology described in Patent Document 1 is applied, an image in which the captured image data is displayed superimposed on the map data, or an image in which the map data and the captured image data are displayed side by side, would be displayed on each of the plurality of display devices, making it impossible to effectively utilize the display areas of the plurality of display devices. [Means for solving the problem]

[0007] In order to solve the above problem, one aspect is a display method in which a first display device acquires coordinate information, the first display device acquires first content corresponding to the coordinate information, the first display device acquires second content corresponding to the coordinate information, a first image generated based on a first aspect ratio of a first display screen of the first display device and the first content is displayed on the first display screen, and a second image generated based on a second aspect ratio of a second display screen of a second display device and the second content is displayed on the second display screen.

[0008] In order to solve the above problem, one aspect is a display system comprising a first display device and a second display device, wherein the first display device acquires coordinate information, acquires first content corresponding to the coordinate information, acquires second content corresponding to the coordinate information, and displays a first image generated on the first display screen based on a first aspect ratio of a first display screen of the first display device and the first content, and the first display device or the second display device displays a second image generated on the second display screen based on a second aspect ratio of a second display screen of the second display device and the second content. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating a schematic configuration example of a display system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating a schematic configuration example of a first display device according to the embodiment. [Figure 3] FIG. 2 is a diagram illustrating a schematic configuration example of a second display device according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating a schematic configuration example of a third display device according to an embodiment. [Figure 5] FIG. 2 is a diagram illustrating a schematic configuration example of a server device according to an embodiment. [Figure 6A] FIG. 4 is a diagram showing an example of information on an A-th content stored in a server device according to the embodiment. [Figure 6B] FIG. 10 is a diagram showing an example of information on a Bth content stored in the server device according to the embodiment. [Figure 7A] FIG. 2 is a diagram showing an example of the configuration of a first master layer in the first display device according to the embodiment. [Figure 7B] FIG. 2 is a diagram showing an example of the configuration of a second master layer in the first display device according to the embodiment. [Figure 8A] FIG. 3 is a diagram showing an example of a first image displayed on a first display screen of a first display device according to the embodiment. [Figure 8B] FIG. 10 is a diagram showing an example of a second image displayed on a second display screen of a second display device according to the embodiment. [Figure 9A] FIG. 3 is a diagram showing an example of an image 1a displayed on a first display screen of a first display device according to the embodiment. [Figure 9B] FIG. 10 is a diagram showing an example of a 2a image displayed on a second display screen of a second display device according to the embodiment. [Figure 10] FIG. 4 is a diagram showing an example of a procedure of a process performed when an image is displayed on the first display device according to the embodiment. [Figure 11A] FIG. 10 is a diagram showing an example of an image 1b displayed on a first display screen of a first display device according to the embodiment. [Figure 11B] FIG. 10 is a diagram showing an example of a 2b image displayed on a second display screen of a second display device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described with reference to the drawings. In the following description, the dimensions of areas and the like shown in the drawings are merely examples for the purpose of explanation, and are not necessarily exact dimensions, nor are they necessarily limited to the dimensions shown in the drawings. Furthermore, when two or more overlapping line segments are shown in the drawings, these line segments may be slightly shifted from one another to make them easier to see. In addition, in the following description, the names of components may be given numbers or letters, such as 1st, 2nd, or a combination thereof, but this is for the convenience of explanation and is not intended to unnecessarily limit the contents of the disclosure.

[0011] FIG. 1 is a diagram showing a schematic configuration example of a display system 1 according to an embodiment. The display system 1 includes a first display device A1, a second display device A2, a third display device A3, and a server device D1. FIG. 1 shows a first user E1 who operates a first display device A1, a second user E2 who operates a second display device A2, and a third user E3 who operates a third display device A3.

[0012] In this embodiment, the server device D1 is described as being included in the display system 1, but as another example, the server device D1 may be considered as an external device to the display system 1. Furthermore, in this embodiment, the display system 1 includes three display devices, but as another example, a display system having two display devices may be realized, or a display system having four or more display devices may be realized.

[0013] In this embodiment, the first display device A1 and the server device D1 communicate with each other via wired or wireless communication, or both. In this embodiment, the first display device A1 and the second display device A2 communicate with each other via wired or wireless communication, or both. In this embodiment, the first display device A1 and the third display device A3 communicate with each other via wired or wireless communication, or both.

[0014] In this embodiment, as specific examples, the first display device A1 is a smartphone, the second display device A2 is a projector, and the third display device A3 is a tablet terminal. In this embodiment, a display system 1 including a first display device A1 to a third display device A3 is shown to explain a combination of a first display device A1 which is a smartphone, an example of a mobile terminal, and a second display device A2 which is a projector, and a combination of a first display device A1 which is a smartphone and a third display device A3 which is a tablet terminal.

[0015] As another example, a display system may be implemented that has a first display device A1 that is a smartphone and a second display device A2 that is a projector, with each combination separated, or a display system may be implemented that has a first display device A1 that is a smartphone and a third display device A3 that is a tablet terminal.

[0016] In this embodiment, the case where each display device is operated by a respective user is shown, but as another example, two of the first user E1 to the third user E3 may be the same person, or all three may be the same person. Also, for example, one or more display devices may automatically execute processing according to a predetermined processing procedure without being operated by a user.

[0017] The first display device A1 includes a first display screen B1. In the example of Fig. 1, a first image C1 is displayed on the first display screen B1. The second display device A2 includes a second display screen B2. In the example of Fig. 1, a second image C2 is displayed on the second display screen B2. In this embodiment, the second display device A2 is a projector, the second display screen B2 is a screen, and the second image C2 is an image projected onto the screen. For example, the present invention may be applied to a case where an image projected on the screen is viewed by multiple people in a predetermined room. The third display device A3 includes a third display screen B3. In the example of Fig. 1, a third image C3 is displayed on the third display screen B3.

[0018] In this embodiment, the image displayed on the display screen may be an image of any display content, such as an image representing a map, text, a figure, a still image, a video, or a combination of two or more of these. Instead of an image, it may be called a video or the like.

[0019] Here, the specific examples of the respective display devices are merely examples, and various devices may be used as the respective display devices. For example, a display device of a car navigation system or a display device of an electronic whiteboard system may be used as the second display device A2 or the third display device A3. Furthermore, for example, a display device having a screen and a function of displaying an image input from the outside on the screen may be used as the second display device A2 or the third display device A3. In contrast to the first display screen B1 of the first display device A1, the second display screen B2 of the second display device A2 and the third display screen B3 of the third display device A3 may be considered to be external monitors whose screens can be shared. In this embodiment, for convenience of explanation, the case where images of different contents are displayed synchronously between the sharing source and the sharing destination will also be referred to as screen sharing. The display device may also be called, for example, an information processing device.

[0020] The server device D1 may be, for example, a cloud device. In this embodiment, the first display device A1 communicates with the server device D1, but as another example, the second display device A2 or the third display device A3, or two or more display devices may communicate with the server device D1.

[0021] In this embodiment, a case is shown in which, in screen sharing, the first display device A1 is used as a sharing source device, and the second display device A2 or the third display device A3 is used as a sharing destination device. In general, the first display device A1, which is the sharing source device, acquires image information from the server device D1 and displays an image based on the image information on its own screen. The first display device A1 also transmits an image based on the image information to a sharing destination device as needed. The sharing destination device, the second display device A2 or the third display device A3, displays the image on its own screen.

[0022] FIG. 2 is a diagram showing a schematic configuration example of the first display device A1 according to the embodiment. The first display device A1 includes a first input unit 111, a first output unit 112, a first communication unit 113, a first storage unit 114, a first control unit 115, and a first image processing unit . The first output unit 112 includes a first display unit 117 .

[0023] First input unit 111 inputs information according to an operation performed by first user E1. Furthermore, first input unit 111 may input information output from an external device connected via a connection terminal, for example. The first output unit 112 displays and outputs information on the first display screen B1 using the first display unit 117. The first output unit 112 may also output sound along with the image display. Furthermore, the first output unit 112 may output information to an external device connected using a connection terminal, for example. Here, the first input unit 111 and the first display unit 117 may be configured using, for example, a touch panel.

[0024] The first communication unit 113 communicates with an external device. In this embodiment, the external device is the second display device A2, the third display device A3, or the server device D1. The first storage unit 114 stores various types of information.

[0025] The first control unit 115 performs various processes and controls in the first display device A1. In this embodiment, the first display device A1 is configured using a computer. The first control unit 115 includes a processor such as a CPU (Central Processing Unit), and executes predetermined programs using the processor to perform various processes and controls. The first image processing unit 116 performs various types of image processing. In this embodiment, the first image processing unit 116 is controlled by the first control unit 115, for example, to perform various types of image processing. Here, first display unit 117 displays and outputs, for example, an image processed by first image processing unit .

[0026] FIG. 3 is a diagram showing a schematic configuration example of the second display device A2 according to the embodiment. The second display device A2 includes a second input unit 121, a second output unit 122, a second communication unit 123, a second storage unit 124, a second control unit 125, and a second image processing unit 126. The second output unit 122 includes a second display unit 127 .

[0027] Second input unit 121 inputs information according to an operation performed by second user E2. Here, second input unit 121 may be configured using, for example, keys or a touch panel. The second output unit 122 displays and outputs information on the second display screen B2 using the second display unit 127. The second output unit 122 may output sound along with the image display.

[0028] The second communication unit 123 communicates with an external device, which in this embodiment is the first display device A1. The second storage unit 124 stores various types of information.

[0029] The second control unit 125 performs various processes and controls in the second display device A2. In this embodiment, the second display device A2 is configured to include a control computer. The second control unit 125 includes a processor such as a CPU, and performs various processes and controls by executing predetermined programs using the processor. The second image processing unit 126 performs various types of image processing.

[0030] In this embodiment, the second display device A2 is a projector. The second image processing unit 126 includes, for example, a predetermined optical system, and processes the image to be projected onto the screen. For example, the second display unit 127 outputs the image processed by the second image processing unit 126 so as to be displayed on a screen. In this embodiment, for convenience of explanation, the second image processing unit 126 and the second display unit 127 are described separately, but they may be integrated, for example.

[0031] FIG. 4 is a diagram showing a schematic configuration example of the third display device A3 according to the embodiment. The third display device A3 includes a third input unit 131, a third output unit 132, a third communication unit 133, a third storage unit 134, a third control unit 135, and a third image processing unit 136. The third output unit 132 includes a third display unit 137 .

[0032] The third input unit 131 inputs information according to an operation performed by the third user E3. Furthermore, the third input unit 131 may receive, for example, information output from an external device connected via a connection terminal. The third output unit 132 displays and outputs information on the third display screen B3 using the third display unit 137. The third output unit 132 may output sound along with the image display. Furthermore, the third output unit 132 may output information to an external device connected using a connection terminal, for example. Here, the third input unit 131 and the third display unit 137 may be configured using, for example, a touch panel.

[0033] The third communication unit 133 communicates with an external device, which in this embodiment is the first display device A1. The third storage unit 134 stores various types of information.

[0034] The third control unit 135 performs various processes and controls in the third display device A3. In this embodiment, the third display device A3 is configured using a computer. The third control unit 135 includes a processor such as a CPU, and performs various processes and controls by executing predetermined programs using the processor. The third image processing unit 136 performs various types of image processing. In this embodiment, the third image processing unit 136 is controlled by the third control unit 135, for example, to perform various types of image processing. Here, the third display unit 137 displays and outputs, for example, an image processed by the third image processing unit 136.

[0035] FIG. 5 is a diagram showing an example of a schematic configuration of the server device D1 according to the embodiment. The server device D1 includes an input unit 141, an output unit 142, a communication unit 143, a storage unit 144, a control unit 145, and a service providing processing unit 146.

[0036] The input unit 141 inputs information according to an operation performed by an operator (not shown). The output unit 142 outputs information by display output, audio output, or the like. The communication unit 143 communicates with an external device, which in this embodiment is the first display device A1. The storage unit 144 stores various types of information.

[0037] The control unit 145 performs various processes and controls in the server device D1. In this embodiment, the server device D1 is configured using a computer. The control unit 145 includes a processor such as a CPU, and performs various processes and controls by executing predetermined programs using the processor. The service providing processing unit 146 performs processing for providing a predetermined service. In this embodiment, the service providing processing unit 146 is controlled by the control unit 145, for example, to perform various types of processing.

[0038] In this embodiment, the service providing processing unit 146 of the server device D1 performs a service of providing predetermined information. The information is stored, for example, in the storage unit 144. As another example, the information may be stored in a database or the like (not shown) that is provided externally to the server device D1, and in this case, the server device D1 acquires the information from the database or the like. In this embodiment, the information provided by the server device D1 is map information and aerial photograph information. The information provided by the server device D1 is not particularly limited, and any other information may be used.

[0039] In this embodiment, the server device D1 is operated by an operator, but the server device D1 may be remotely operated by an operator, for example. As another example, the server device D1 may automatically perform a predetermined process without being operated by an operator.

[0040] The map information and aerial photograph information provided by the server device D1 will be described with reference to FIGS. 6A and 6B. In this embodiment, the first display device A1 performs a process of acquiring desired map information from the server device D1 and a process of acquiring desired aerial photograph information from the server device D1. For convenience of explanation, the process of acquiring map information and the process of acquiring aerial photograph information will be explained separately here, but the processes of acquiring these two types of information may be realized by common request information, for example.

[0041] FIG. 6A is a diagram showing an example of information on the A-th content 211A stored in the server device D1 according to the embodiment. The information of the A-th content 211A is, for example, information on a map of a predetermined area. Note that in the example of Fig. 6A, for the sake of explanation, the outline of the map is shown in a schematic manner and is not necessarily precise. For ease of explanation, Fig. 6A shows an αβ Cartesian coordinate system, which is a two-dimensional Cartesian coordinate system. In the αβ Cartesian coordinate system, an origin γ, an α axis, and a β axis are shown. In this embodiment, the α direction parallel to the α axis corresponds to the so-called horizontal direction, and the β direction parallel to the β axis corresponds to the so-called vertical direction.

[0042] FIG. 6A shows an example of the first provision range 221 set for the A-th content 211A. The first provision range 221 represents the range of the information portion of the entire A-th content 211A that is provided to the destination by the service provision processing unit 146. In this embodiment, the destination is the first display device A1.

[0043] In this embodiment, the first display device A1 transmits request information to the server device D1 on a website provided by the server device D1. The service providing processing unit 146 of the server device D1 determines the first provision range 221 based on the request information received from the first display device A1. Then, the service provision processing unit 146 of the server device D1 transmits the information part of the A-th content 211A that is included in the determined first provision range 221 to the first display device A1. Here, the first display device A1 changes the request information as necessary and transmits it to the server device D1. The change in the request information from the first display device A1 changes the first provision range 221 in the server device D1, and changes the information transmitted from the server device D1 to the first display device A1.

[0044] FIG. 6B is a diagram showing an example of information on the Bth content 211B stored in the server device D1 according to the embodiment. The information of the B content 211B is, for example, information on an aerial photograph of a predetermined area. Note that in the example of Fig. 6B, for the sake of explanation, the outline of the aerial photograph is shown in a schematic manner and is not necessarily precise. For convenience of explanation, FIG. 6B shows an αβ orthogonal coordinate system, which is a two-dimensional orthogonal coordinate system. In this embodiment, for convenience of explanation, the same αβ orthogonal coordinate system is shown in Figures 6A and 6B, but as these coordinate systems, for example, different coordinate systems may be used, or a common coordinate system may be used. For example, different orthogonal coordinate systems that have a mutually understood correspondence may be used in Figures 6A and 6B.

[0045] FIG. 6B shows an example of the second provision range 222 set for the B content 211B. The second provision range 222 indicates the range of the information portion of the entire B-th contents 211B that is provided to the destination by the service provision processing unit 146. In this embodiment, the destination is the first display device A1.

[0046] In this embodiment, the first display device A1 transmits request information to the server device D1 on a website provided by the server device D1. The service providing processing unit 146 of the server device D1 determines the second provision range 222 based on the request information received from the first display device A1. Then, the service providing processing unit 146 of the server device D1 transmits the information part of the B-th content 211B that is included in the determined second provision range 222 to the first display device A1. Here, the first display device A1 changes the request information as necessary and transmits it to the server device D1. The change in the request information from the first display device A1 changes the second provision range 222 in the server device D1, and changes the information transmitted from the server device D1 to the first display device A1.

[0047] Screen sharing in a combination of a first display device A1 and a second display device A2 will be described with reference to Figures 7A, 7B, 8A, 8B, 9A, 9B, and 10. In this embodiment, the first display device A1 is the main display device, and the second display device A2 is the sub display device.

[0048] The two master layers in the first display device A1 will be described with reference to FIGS. 7A and 7B. In this embodiment, the first display device A1 constructs a first master layer 311 for storing images of content A to be displayed on the sharing source device, and a second master layer 312 for storing images of content B to be displayed on the sharing destination device.

[0049] FIG. 7A is a diagram showing an example of the configuration of the first master layer 311 in the first display device A1 according to the embodiment. 7A shows an XY Cartesian coordinate system, which is a two-dimensional Cartesian coordinate system, for the sake of convenience of explanation. In the XY Cartesian coordinate system, an origin O, an X axis, and a Y axis are shown. In this embodiment, the X direction parallel to the X axis corresponds to the so-called horizontal direction, with the positive side corresponding to the right side and the negative side corresponding to the left side. In this embodiment, the Y direction parallel to the Y axis corresponds to the so-called vertical direction, with the positive side corresponding to the top side and the negative side corresponding to the bottom side. The horizontal and vertical directions may be interpreted in reverse.

[0050] In this embodiment, the X direction and the Y direction in the XY Cartesian coordinate system are parallel to the α direction and the β direction in the αβ Cartesian coordinate system shown in FIGS. 6A and 6B, respectively. However, as another example, the X direction and the Y direction in the XY Cartesian coordinate system may correspond to the α direction and the β direction in the αβ Cartesian coordinate system shown in FIGS. 6A and 6B in another manner.

[0051] In the first display device A1, the first image processing unit 116 draws the master image of the Ath content on the first master layer 311. In this embodiment, the area of ​​the master image is called a master area.

[0052] In the example of FIG. 7A, a first master image G1 is shown as the master image drawn on the first master layer 311. In the example of FIG. 7A, a first master region F1 is shown as the master region of the first master image G1.

[0053] Here, the first master layer 311 may be, for example, a predetermined area provided in the recording area of ​​the first storage unit 114. In this case, the process of drawing the first master image G1 on the first master layer 311 may be a process of storing data of the first master image G1 in the first master layer 311 and memorizing the first master image G1. In this case, for example, the first master layer 311 and the first master area F1 may be considered to be substantially the same. 7A, the first master area F1 is a rectangular area surrounded by two line segments in the X direction parallel to the X axis and two line segments in the Y direction parallel to the Y axis. Note that a square may also be included as a type of rectangle.

[0054] In this example, the first image processing unit 116 of the first display device A1 transmits request information for the A-th content to the server device D1, and thereby acquires from the server device D1 an information portion of the first provision range 221 based on the request information. The information portion corresponds to map information of the first provision range 221. Then, the first image processing unit 116 of the first display device A1 draws the acquired map information as a first master image G1 on the first master layer 311.

[0055] In this embodiment, the request information includes information indicating the reference point and information indicating the aspect ratio. The reference point is a point that serves as a reference for setting the first provision range 221 in the A content 211A in the server device D1, and may be, for example, a point that is set as the center position of the first provision range 221 in the A content 211A. The aspect ratio is used as a value for setting the frame of the first provided range 221 with the reference point as the reference. Such information indicating the reference point may be considered to be coordinate information indicating the coordinates of the content. Furthermore, the combination of such a reference point and aspect ratio may also be considered to be coordinate information indicating the coordinates and range of the content. In other words, the request information may be considered to be information including the coordinate information of the content.

[0056] The service providing processing unit 146 of the server device D1 determines and sets the first providing range 221 suitable for the reference point and aspect ratio specified by the request information for the A-th content from the first display device A1. In this example, if one or both of the reference point and the aspect ratio specified by the request information of the A-th content change, the first provision range 221 may change.

[0057] In this embodiment, the first image processor 116 of the first display device A1 determines the aspect ratio to be included in the request information for the content A based on the aspect ratio of the first display screen B1 of the first display device A1. These aspect ratios may be the same, for example.

[0058] In the first display device A1, for example, the aspect ratio of the first display screen B1 is stored in the first storage unit 114 in advance.

[0059] 7A, the first image processing unit 116 of the first display device A1 sets a first region H1 in the first master region F1 that matches the aspect ratio of the first display screen B1 of the first display device A1. The first image processing unit 116 of the first display device A1 then crops the image portion included in the first region H1 and displays it on the first display screen B1. Here, the first region H1 is, for example, the same as the first master region F1, but may be different. Trimming may also be called, for example, cutting out. The first area H1 may be associated with the first master layer 311 or the first master area F1, for example, using coordinates in an XY Cartesian coordinate system.

[0060] FIG. 7B is a diagram showing an example of the configuration of the second master layer 312 in the first display device A1 according to the embodiment. For convenience of explanation, FIG. 7B shows an XY Cartesian coordinate system, which is a two-dimensional Cartesian coordinate system. 7A and 7B show the same XY Cartesian coordinate system for the sake of convenience, but different coordinate systems may be used as these coordinate systems, or a common coordinate system may be used. For example, different Cartesian coordinate systems that have a mutually understood correspondence may be used in FIGS. 7A and 7B.

[0061] In the first display device A1, the first image processing unit 116 draws the master image of the B content on the second master layer 312. In the example of FIG. 7B, a second master image G2 is shown as the master image drawn on the second master layer 312. In the example of FIG. 7B, a second master region F2 is shown as the master region of the second master image G2.

[0062] Here, the second master layer 312 may be, for example, a predetermined area provided in the recording area of ​​the first storage unit 114. In this case, the process of drawing the second master image G2 on the second master layer 312 may be a process of storing data of the second master image G2 in the second master layer 312 and memorizing the second master image G2. In this case, for example, the second master layer 312 and the second master area F2 may be considered to be substantially the same. 7B, the second master area F2 is a rectangular area surrounded by two line segments in the X direction parallel to the X axis and two line segments in the Y direction parallel to the Y axis. Note that a square may also be included as a type of rectangle.

[0063] In this example, the first image processing unit 116 of the first display device A1 transmits request information for the B content to the server device D1, and thereby acquires from the server device D1 an information portion of the second provision range 222 based on the request information. The information portion corresponds to aerial photograph information of the second provision range 222. Then, the first image processing unit 116 of the first display device A1 renders the acquired aerial photograph information as a second master image G2 on the second master layer 312.

[0064] In this embodiment, the request information includes information indicating the reference point and information indicating the aspect ratio. The reference point is a point that serves as a reference for setting the second provision range 222 in the B content 211B in the server device D1, and may be, for example, a point that is set as the center position of the second provision range 222 in the B content 211B. The aspect ratio is used as a value for setting the frame of the second provided range 222 with the reference point as the reference.

[0065] The service providing processing unit 146 of the server device D1 determines and sets the second providing range 222 suited to the reference point and aspect ratio specified by the request information for the B-th content from the first display device A1. In this example, if one or both of the reference point and the aspect ratio specified by the request information of the B-th content change, the second provision range 222 may change.

[0066] In this embodiment, the first image processor 116 of the first display device A1 determines the aspect ratio to be included in the request information for the Bth content based on the aspect ratio of the second display screen B2 of the second display device A2. These aspect ratios may be the same, for example.

[0067] In this embodiment, for example, the first display device A1 may have the aspect ratio of the second display screen B2 of the second display device A2 stored in advance in the first storage unit 114, or may obtain information specifying the aspect ratio of the second display screen B2 of the second display device A2 from the second display device A2 or another device. The other device may be the server device D1. For example, the first display device A1 may obtain the aspect ratio of the second display screen B2 of the second display device A2 from the second display device A2 or another device in real time during screen sharing or the like.

[0068] In the example of Figure 7B, the first image processing unit 116 of the first display device A1 sets a second region H2 in the second master region F2 that matches the aspect ratio of the second display screen B2 of the second display device A2. The first image processing unit 116 of the first display device A1 then crops the image portion included in the second region H2 and transmits it to the second display device A2. The second image processing unit 126 of the second display device A2 then displays and outputs the image portion on the second display screen B2. Here, the second region H2 is, for example, the same as the second master region F2, but may be different. The second area H2 may be associated with the second master layer 312 or the second master area F2, for example, using coordinates in an XY Cartesian coordinate system.

[0069] In this embodiment, the aspect ratio of the first display screen B1 of the first display device A1 is (16:9) in the Y direction:X direction, and the resolution is (1920:1080). In this embodiment, the aspect ratio of the second display screen B2 of the second display device A2 is (9:16) in the Y direction:X direction, and the resolution is (1080:1920). In this way, the aspect ratio of the first display screen B1 and the aspect ratio of the second display screen B2 are different.

[0070] Here, in the first display device A1, the first master image G1 of the A content and the second master image G2 of the B content are associated with each other using coordinates. For example, the first region H1 and the second region H2 may be associated with each other using coordinates in an XY Cartesian coordinate system, or may be associated with each other using a relative positional relationship. In this embodiment, the map information, which is content A, and the aerial photograph information, which is content B, represent information on the same location at the same coordinate values, but as another example, content A and content B may each be any content.

[0071] FIG. 8A is a diagram showing an example of a first image C1 displayed on a first display screen B1 of a first display device A1 according to the embodiment. In the example of FIG. 8A, the first icon 411 is displayed overlapping the first image C1. The first icon 411 may be displayed, for example, at the center of the first display screen B1, or may be displayed at another position.

[0072] FIG. 8B is a diagram showing an example of a second image C2 displayed on the second display screen B2 of the second display device A2 according to the embodiment. In the example of FIG. 8B, the second icon 412 is displayed overlapping the second image C2. For example, the second icon 412 may indicate the same position on an aerial photograph as the position on a map indicated by the first icon 411. The first icon 411 may be displayed at the center of the first display screen B1, and the second icon 412 may be displayed at the center of the second display screen B2.

[0073] In this example, the first image C1 and the second image C2 are synchronized with each other based on coordinates, which may be, for example, latitude and longitude. In this example, when the display content of the first image C1 displayed on the first display screen B1 of the first display device A1 changes, the first image processing unit 116 of the first display device A1 performs image processing so that the display content of the second image C2 displayed on the second display screen B2 of the second display device A2 also changes in response to the change. As a result, the coordinates of the second image C2 also move in response to the movement of the coordinates of the first image C1.

[0074] FIG. 9A is a diagram showing an example of an image 1a C1a displayed on the first display screen B1 of the first display device A1 according to the embodiment. In the example of FIG. 9A, the 1a icon 411a is displayed overlapping the 1a image C1a. The 1ath icon 411a is the same as the first icon 411.

[0075] FIG. 9B is a diagram showing an example of a 2a image C2a displayed on the second display screen B2 of the second display device A2 according to the embodiment. In the example of FIG. 9B, the 2a icon 412a is displayed overlapping the 2a image C2a. The second icon 412a is the same as the second icon 412.

[0076] 9A shows a state in which the first display screen B1 of the first display device A1 is swiped in a first direction Dr1 by a finger 431 of the first user E1. In this example, the first display screen B1 is a touch panel, but the operation in the first direction Dr1 may be performed by operating a button, a key, or the like instead of swiping. In the example of Fig. 9A, a 1a image C1a is displayed, which is an image in which the first image C1 shown in Fig. 8A is being moved in the second direction Dr2 by the coordinates of the swipe. Note that in the example of Fig. 9A, for the sake of simplicity, an image similar to the first image C1 is shown as the 1a image C1a, but in reality, the displayed content gradually shifts as the user swipes. Here, the second direction Dr2 is the opposite direction to the first direction Dr1. In the example of Fig. 9A, the first direction Dr1 is the right direction, and the second direction Dr2 is the left direction. Note that instead of the left-right direction, the first direction Dr1 may be the up-down direction or a diagonal direction.

[0077] Fig. 9B shows a 2a image C2a, which is an image in which the second image C2 shown in Fig. 8B is being moved in the third direction Dr3 by the same coordinates as the change in the first image C1. Note that in the example of Fig. 9B, for the sake of simplicity, an image similar to the second image C2 is shown as the 2a image C2a, but in reality, the displayed content gradually shifts as the user swipes. Here, the third direction Dr3 is the same direction as the second direction Dr2. In this way, when the image displayed on the first display screen B1 of the sharing source moves, the image displayed on the second display screen B2 of the sharing destination also moves in synchronization with the movement.

[0078] It should be noted that the finger 431, the arrow indicating the first direction Dr1, and the arrow indicating the second direction Dr2 shown in FIG. 9A are shown for the purpose of explanation, and are not displayed on the first display screen B1. Moreover, the arrow indicating the third direction Dr3 shown in FIG. 9B is shown for the purpose of explanation and is not displayed on the second display screen B2.

[0079] For example, it is possible to share a video by network streaming from the first display device A1 to the second display device A2. The first display device A1, which is the source of sharing, prepares a first master layer 311, which is a display layer for displaying video on its own display, and also prepares a second master layer 312, which is an external display layer for screen sharing on an external display. The first display device A1, which is the sharing source, then draws different content on each of these two master layers based on the same coordinate information, and controls the display for each display.

[0080] In this example, an application utilizing such a mechanism can be used to perform display control such as the examples shown in FIGS. 8A, 8B, 9A, and 9B. The application handles map information and aerial photograph information. The application displays and outputs the display content of content A on the sharing source display and the display content of content B on the sharing destination display, and synchronizes these display contents based on, for example, latitude and longitude coordinates.

[0081] This means that, for example, when a map is displayed on the device from which the data is shared and an aerial photograph of the area corresponding to the map is displayed on the device to which the data is shared, if a coordinate shift is instructed by a first user E1 viewing the map on the device from which the data is shared, the coordinate shift of the aerial photograph on the device to which the data is shared can be synchronized with the coordinate shift of the map and displayed. In this example, coordinate movement by a swipe operation is illustrated, but as other examples, the screens of the sharing source and sharing destination may be linked to each other for image reduction by a pinch-in operation, image enlargement by a pinch-out operation, and image rotation by a rotation operation. The content displayed on the sharing source device and the content displayed on the sharing destination device may be reversed.

[0082] Here, in the examples of Figures 8A, 8B, 9A and 9B, when the display content of the first display screen B1 of the first display device A1 is moved, the display content of the first display screen B1 of the first display device A1 and the display content of the second display screen B2 of the second display device A2 are moved in conjunction with each other, and the first icon 411 displayed on the first display screen B1 and the second icon 412 displayed on the second display screen B2 remain in the center position of their respective display screens. As another example, in such a case, a mode may be used in which the first icon 411 displayed on the first display screen B1 and the second icon 412 displayed on the second display screen B2 move in conjunction with each other within the frame of each display screen.

[0083] In addition, the examples of Figures 8A, 8B, 9A and 9B show a mode in which icons are displayed on each of the first display screen B1 of the first display device A1 and the second display screen B2 of the second display device A2. As another example, an embodiment may be used in which icons are displayed on only one of the first display screen B1 of the first display device A1 and the second display screen B2 of the second display device A2. Here, whether or not to display an icon may be determined depending on the device, for example, the first display screen B1 of the first display device A1 or the second display screen B2 of the second display device A2, or may be determined depending on the type of display content, such as content A or content B.

[0084] FIG. 10 is a diagram showing an example of a procedure of processing performed when an image is displayed on the first display device A1 according to the embodiment. In this example, the sharing source device is the first display device A1, and the sharing destination device is the second display device A2. In this example, the first display device A1 switches screen sharing on and off. This switching may be performed, for example, by the first user E1 operating the first display device A1, or may be performed automatically according to a predetermined switching condition.

[0085] In step S1, in the first display device A1, which is the sharing source device, the first image processing unit 116 prepares the first master layer 311 and the second master layer 312 as preparations for the master layers. Next, in step S2, in the first display device A1, the first image processing unit 116 draws the display content on the master layer. In this example, the first image processing unit 116 draws a first master image G1 of the A content on the first master layer 311, and draws a second master image G2 of the B content on the second master layer 312.

[0086] Next, in step S3, in the first display device A1, the first image processing unit 116 cuts out an appropriate portion from the first master layer 311, and displays the image of that portion on the first display screen B1. In this example, this appropriate portion is the first region H1. Furthermore, this appropriate portion is cut out by trimming.

[0087] Next, in step S4, the first image processing unit 116 of the first display device A1 determines whether or not to start screen sharing. In this example, the first image processing unit 116 determines to start screen sharing if screen sharing is already set to on or if screen sharing is switched from off to on in real time. On the other hand, the first image processing unit 116 determines not to start screen sharing if screen sharing is set to off. In the determination of step S4, if the first image processing unit 116 of the first display device A1 determines that screen sharing should be started, the result of step S4 is YES, and the process proceeds to step S5. On the other hand, in the determination of step S4, if the first image processing unit 116 of the first display device A1 determines that screen sharing should not be started, the result is NO in step S4, and the process of this flow ends.

[0088] In step S5, the first image processing unit 116 of the first display device A1 cuts out an appropriate portion from the second master layer 312 and performs processing to display the image of that portion on the second display screen B2 of the second display device A2, which is the sharing destination device. Then, the processing of this flow ends. In this example, this appropriate portion is the portion of the second region H2. Furthermore, this appropriate portion is cut out by trimming.

[0089] As a specific example, while a first user E1 is viewing a first image C1 displayed on a first display screen B1 of a first display device A1, a second user E2 can view a second image C2 displayed on a second display screen B2 of a second display device A2. For example, the size of the second display screen B2 of the second display device A2 is larger than the size of the first display screen B1 of the first display device A1, and multiple users can simultaneously view the second image C2. For example, when the first user E1 operates the first display device A1 to give an instruction to shift the reference point of the first region H1, request information related to the updated A-th content with the shifted reference point is transmitted from the first display device A1 to the server device D1. As a result, the first provision range 221 on the server device D1 is updated, and the image portion transmitted from the server device D1 to the first display device A1 is updated. Then, the first master image G1 on the first display device A1 is updated, and the image content of the first image C1 is updated. Furthermore, in conjunction with the update of the image content of the first image C1, request information related to the updated B-th content with the shifted reference point is transmitted from the first display device A1 to the server device D1. As a result, the second provision range 222 on the server device D1 is updated, and the image portion transmitted from the server device D1 to the first display device A1 is updated. Then, the second master image G2 on the first display device A1 is updated, and the image content of the second image C2 is updated. As an example, when the reference point of the map information displayed on the first display screen B1 is shifted, the map information displayed on the first display screen B1 scrolls accordingly, and in synchronization with this, the aerial photograph information displayed on the second display screen B2 scrolls.

[0090] 11A and 11B, other content display examples are shown. FIG. 11A is a diagram showing an example of a 1b image C1b displayed on the first display screen B1 of the first display device A1 according to the embodiment. FIG. 11B is a diagram showing an example of a 2b image C2b displayed on the second display screen B2 of the second display device A2 according to the embodiment.

[0091] In this example, the content A displayed on the first display screen B1 of the sharing source is information content that displays images taken by an omnidirectional camera based on a specified position, allowing the viewer to view the actual scenery that exists around the specified position. An image captured by an omnidirectional camera may be called, for example, a 360-degree panoramic image. In the example of FIG. 11A, no icon is displayed on the first display screen B1 that displays the 1b image C1b based on the A content.

[0092] In this example, the B-th content displayed on the second display screen B2 of the sharing destination is map information content. In the example of FIG. 11B, a 2b icon 412b is displayed on the second display screen B2 that displays a 2b image C2b based on the B content. In this example, the position indicated by the 2b icon 412b in the 2b image C2b, which is map information, coincides with the reference position in the 1b image C1b, which is scenery information, but other configurations may also be used.

[0093] Here, in the examples of Figures 11A and 11B, similarly to the examples of Figures 9A, 9B, 10A and 10B, the first image processing unit 116 of the first display device A1 performs image processing so that the coordinate movement of the 2b image C2b displayed on the second display screen B2 of the sharing destination is synchronized with the coordinate movement of the 1b image C1b displayed on the first display screen B1 of the sharing source. In this example, coordinate movement by a swipe operation is illustrated, but as another example, the screens of the sharing source and sharing destination may be linked to each other when an image is reduced by a pinch-in operation or enlarged by a pinch-out operation. The content displayed on the sharing source device and the content displayed on the sharing destination device may be reversed.

[0094] Here, when the direction of the line of sight for viewing the scenery in the 1b image C1b displayed on the first display screen B1 of the sharing source changes within a 360-degree range, for example, the display orientation of the 2b image C2b displayed on the second display screen B2 of the sharing destination may not be changed, or may be changed. The display orientation is, for example, the north-south, east-west orientation on a map.

[0095] In this embodiment, the first display device A1 changes the request information sent to the server device D1 when a predetermined event occurs on the first display device A1, thereby changing the first master image G1. The event may be, for example, a predetermined operation such as scrolling performed by the first user E1 on the first display device A1, or a predetermined automatic operation such as scrolling performed on the first display device A1.

[0096] As another example, when a predetermined event occurs on the second display device A2, the second display device A2 may notify the first display device A1 of the occurrence, and the first display device A1 may change the request information that it sends to the server device D1 in response to the notification, thereby changing the first master image G1. The event may be, for example, a predetermined operation such as scrolling by the second user E2 on the second display device A2, or the occurrence of a predetermined automatic operation such as scrolling on the second display device A2. In this case, the notification from the second display device A2 to the first display device A1 is performed by the second display device A2 sending predetermined information to the first display device A1.

[0097] In this embodiment, it is assumed that an operation such as scrolling occurs only on one of the sharing source device and the sharing destination device, i.e., the other device cannot perform an operation such as scrolling. However, a configuration may be used in which operations such as scrolling can occur on both the sharing source device and the sharing destination device.

[0098] In addition, in this embodiment, when the first display device A1 shares its screen with the second display device A2, the first display device A1 generates an image suitable for the aspect ratio of the second display screen B2 of the second display device A2 based on the second master image G2, and transmits the generated image to the second display device A2. As another example, when the first display device A1 shares its screen with the second display device A2, the first display device A1 may transmit an image corresponding to the second master image G2 to the second display device A2, and the second display device A2 may generate an image suitable for the aspect ratio of the second display screen B2 based on the image received by the first display device A1 and display the generated image. This generation process may include, for example, setting the second region H2 and trimming. The first display device A1 stores the aspect ratio of the first display screen B1 in the first storage unit 114 or the like, and the second display device A2 stores the aspect ratio of the second display screen B2 in the second storage unit 124 or the like.

[0099] In addition, in this embodiment, the first display device A1 acquires the first master image G1 and the second master image G2 based on information received from the server device D1. As another example, for one or both of the first master image G1 and the second master image G2, the original information used to generate the master image may be stored in a predetermined database, and the first display device A1 may acquire the master image based on that information. As another example, for one or both of the first master image G1 and the second master image G2, the original information for generating the master image may be stored in the first memory unit 114 of the first display device A1, and the first display device A1 may acquire the master image based on that information.

[0100] For example, a configuration may be used in which the first master image G1 and the second master image G2 are provided to the first display device A1 from different server devices. Also, for example, a configuration may be used in which one of the first master image G1 and the second master image G2 is provided from the server device D1 to the first display device A1, and the other is stored in the first display device A1 or a predetermined database other than the server device.

[0101] While the above describes screen sharing between the first display device A1 and the second display device A2, similar screen sharing may also be applied to the combination of the first display device A1 and the third display device A3. In this case, for example, the first display device A1 acts as the master and the third display device A3 acts as the slave. Generally, similar operations are performed by the third display device A3 and the third user E3 instead of the second display device A2 and the second user E2. However, in this embodiment, the second display device A2 is a projector, whereas the third display device A3 is a tablet terminal, and operations may differ due to these differences.

[0102] As described above, in the display method and display system 1 according to this embodiment, a first display device A1, which is an information processing device having a first display area, acquires information on content A, coordinate information corresponding to content A, and information on content B corresponding to the coordinate information. The first display device A1 displays an image of first image data capable of displaying content A in the first display area, in accordance with the aspect ratio of the first display area. Next, a second display device A2, which is connected to the first display device A1 and has a second display area, acquires information on content B, and displays an image of second image data capable of displaying content B in the second display area, in accordance with the aspect ratio of the second display area.

[0103] Therefore, in the display method and display system 1 according to this embodiment, multiple contents associated by coordinate information can be displayed according to the aspect ratio of each display screen, thereby making effective use of the display area. In the display method and display system 1 according to this embodiment, for example, when screen sharing is performed from a mobile terminal, multiple contents can be synchronized based on coordinate information, thereby providing flexibility in the display content or display layout.

[0104] For example, in this embodiment, multiple pieces of content, such as maps or documents, with coordinate information are used, and images of different pieces of content synchronized based on the coordinate information are drawn on the screen sharing terminal and on another video device. The sharing terminal prepares a virtual master layer that draws images of different pieces of content to be supplied to the sharing destination, in addition to a master layer that draws the content displayed on that terminal. Such a virtual master layer is adjusted based on the coordinate information to fit the resolution or aspect ratio of the destination. As a result, in this embodiment, for example, content that is different from the content of the sharing source can be displayed at the sharing destination based on the coordinate information, thereby realizing flexible screen sharing.

[0105] Here, the effect of screen sharing in this embodiment will be explained by comparing it with a conventional example. In conventional screen sharing systems, when using a mobile terminal to share a screen with another video device such as an external display or projector via a network, mirroring was typically performed to copy the contents displayed on the mobile terminal's display screen onto the other video device. With this type of mirroring, when screen sharing is performed between a mobile device with a different aspect ratio and another video device, there are problems such as blank spaces on the screen where the image is not displayed, and the displayed image not fitting properly with the screen. Furthermore, when the screen sharing method is mirroring, there is a restriction that, for example, different contents cannot be shared between the sharing source and the sharing destination.

[0106] For example, when projecting an image from a mobile device onto a projector, it is possible to project the entire document, such as a PDF file, onto the projector. However, in the past, it was difficult to instruct the zooming in or zooming out of content, such as a map or document, being projected by a mobile device, and it was also difficult to display different content information on the sharing source and sharing destination while synchronizing with the operation of the mobile device.

[0107] In contrast to this, in this embodiment, the screen is shared between the source and destination by utilizing coordinate synchronization, which eliminates the problem of white space that occurs when screen mirroring is performed between multiple displays with different aspect ratios, for example, and makes it possible to properly fit each displayed image on each screen. In addition, in this embodiment, for example, even if the same coordinate information is used at the source and destination of sharing, different content information can be displayed at the source and destination of sharing, thereby increasing the flexibility of display and broadening the range of information provided.

[0108] In the display method according to this embodiment, the first display device A1 acquires coordinate information, acquires first content corresponding to the coordinate information, and acquires second content corresponding to the coordinate information. In addition, in the display method of this embodiment, the generated first image C1 is displayed on the first display screen B1 based on the first aspect ratio of the first display screen B1 of the first display device A1 and the first content. In addition, in the display method according to this embodiment, the generated second image C2 is displayed on the second display screen B2 based on the second aspect ratio of the second display screen B2 of the second display device A2 and the second content.

[0109] Therefore, in the display method according to this embodiment, for example, multiple contents associated by coordinate information can be displayed in accordance with the aspect ratio of each display screen, thereby making effective use of the display area of ​​each display screen. In this embodiment, the A-th content is an example of the first content, and the B-th content is an example of the second content.

[0110] Note that, here, the example is explained using a case where the sharing source device is the first display device A1 and the sharing destination device is the second display device A2, but the same effect can be obtained, for example, when the sharing destination device is the third display device A3, except for the difference that the second display device A2 is a projector and the third display device A3 is a tablet terminal.

[0111] In the display method according to the present embodiment, the first display device A1 receives a first operation for updating the first image C1. Furthermore, in the display method according to the present embodiment, the second image C2 is updated based on the first operation and the coordinate information. Therefore, in the display method according to this embodiment, when the first user E1 operates the first display device A1, for example, it is possible to achieve screen linkage with the second display device A2. However, such a configuration does not necessarily have to be used.

[0112] In the display method according to the present embodiment, the first operation includes at least one of a swipe operation, a pinch-in operation, a pinch-out operation, and a rotation operation. Therefore, in the display method according to the present embodiment, when a map or the like is displayed on the first display screen B1, the first user E1 can perform an intuitive operation. Here, these operations may be performed, for example, when the first display screen B1 is configured as a touch panel. However, such a configuration does not necessarily have to be used.

[0113] In the display method according to this embodiment, information representing at least a part of the coordinate information is displayed on the first display screen B1 or the second display screen B2. Therefore, in the display method of this embodiment, information indicating the positional relationship between the first image C1 and the second image C2 is displayed, making it easier for the viewer to understand the correspondence between the first image C1 and the second image C2, for example, when comparing them. In this embodiment, an icon indicating a predetermined position is used as an example of information representing at least a portion of the coordinate information, but other information may be used. Furthermore, information representing at least a portion of the coordinate information may be displayed, for example, on both the first display screen B1 and the second display screen B2, or may be displayed on any one of the first display screen B1 and the second display screen B2. However, such a configuration does not necessarily have to be used.

[0114] The display system 1 according to this embodiment can realize processing corresponding to various configurations of the display method according to this embodiment. As an example configuration, a display system 1 according to this embodiment includes a first display device A1 and a second display device A2. The first display device A1 acquires coordinate information, acquires first content corresponding to the coordinate information, acquires second content corresponding to the coordinate information, and displays a generated first image C1 on the first display screen B1 based on the first aspect ratio of the first display screen B1 of the first display device A1 and the first content. The first display device A1 or the second display device A2 displays the generated second image C2 on the second display screen B2 based on the second aspect ratio of the second display screen B2 of the second display device A2 and the second content.

[0115] Therefore, in the display system 1 according to this embodiment, for example, multiple contents associated by coordinate information can be displayed according to the aspect ratio of each display screen, thereby making effective use of the display area of ​​each display screen. Here, the process of displaying the second image C2 on the second display screen B2 based on the second aspect ratio of the second display screen B2 and the second content may be performed, for example, by the first display device A1 or by the second display device A2.

[0116] A program for realizing the functions of any of the components in any of the above-described devices may be recorded on a computer-readable recording medium, and the program may be read and executed by a computer system. The term "computer system" here includes an operating system and hardware such as peripheral devices. "Computer-readable recording media" refers to portable media such as flexible disks, optical magnetic disks, ROMs (Read Only Memory), and CDs (Compact Discs)-ROMs, as well as storage devices such as hard disks built into computer systems. "Computer-readable recording media" also includes devices that retain a program for a certain period of time, such as volatile memory within a computer system that acts as a server or client when a program is transmitted over a network such as the Internet or a communication line such as a telephone line. Such volatile memory may be RAM. The recording medium may also be a non-transitory recording medium.

[0117] The above program may be transmitted from a computer system that stores the program in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. The "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network such as the Internet or a communication line such as a telephone line. The above program may be for realizing some of the above functions. The above program may be a so-called differential file that can realize the above functions in combination with a program already recorded in a computer system. The differential file may also be called a differential program.

[0118] The functions of any of the components in any of the above-described devices may be implemented by a processor. Each process in the embodiments may be implemented by a processor operating based on information such as a program and a computer-readable recording medium storing information such as the program. The functions of each unit of the processor may be implemented by separate hardware, or may be implemented by integrated hardware. The processor includes hardware, and the hardware may include at least one of a circuit for processing digital signals and a circuit for processing analog signals. The processor may be configured using one or more circuit devices mounted on a circuit board, or one or both of one or more circuit elements. An integrated circuit (IC) or the like may be used as the circuit device, and a resistor or a capacitor may be used as the circuit element.

[0119] The processor may be a CPU. However, the processor is not limited to a CPU, and various types of processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) may be used. The processor may be a hardware circuit using an ASIC (Application Specific Integrated Circuit). The processor may be configured with multiple CPUs, or may be configured with a hardware circuit using multiple ASICs. The processor may be configured with a combination of multiple CPUs and a hardware circuit using multiple ASICs. The processor may include one or more of an amplifier circuit or a filter circuit that processes analog signals.

[0120] Although the embodiments have been described above in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and includes designs within the scope of the gist of this disclosure.

[0121] Summary of this disclosure A summary of this disclosure is provided below. (Appendix 1) The first display device acquires coordinate information; the first display device acquires first content corresponding to the coordinate information; the first display device acquires second content corresponding to the coordinate information; displaying a first image generated based on a first aspect ratio of a first display screen of the first display device and the first content on the first display screen; displaying a second image generated based on a second aspect ratio of a second display screen of a second display device and the second content on the second display screen; Display method. This allows, for example, a plurality of pieces of content associated with each other by coordinate information to be displayed in accordance with the aspect ratio of each display screen, thereby making effective use of the display area of ​​each display screen.

[0122] (Appendix 2) the first display device receiving a first operation to update the first image; updating the second image based on the first operation and the coordinate information; This is how to display (Appendix 1). This allows, for example, when a user operates the first display device, screen linkage with the second display device can be achieved.

[0123] (Appendix 3) the first operation includes at least one of a swipe operation, a pinch-in operation, a pinch-out operation, and a rotation operation; (Appendix 2) Display method. This allows the user to perform intuitive operations when a map or the like is displayed on the first display screen.

[0124] (Appendix 4) displaying information representing at least a part of the coordinate information on the first display screen or the second display screen; The display method is one of (Appendix 1) to (Appendix 3). This allows information indicating the positional relationship between the first image and the second image to be displayed, making it easier for the viewer to understand the corresponding relationship between the first image and the second image when comparing them, for example.

[0125] (Appendix 5) A first display device and a second display device are provided, The first display device is Get the coordinate information, acquiring a first content corresponding to the coordinate information; acquiring second content corresponding to the coordinate information; displaying a first image generated based on a first aspect ratio of a first display screen of the first display device and the first content on the first display screen; The first display device or the second display device is displaying a second image generated based on a second aspect ratio of a second display screen of the second display device and the second content on the second display screen; Display system. This allows, for example, a plurality of pieces of content associated with each other by coordinate information to be displayed in accordance with the aspect ratio of each display screen, thereby making effective use of the display area of ​​each display screen. [Explanation of symbols]

[0126] 1...display system, 111...first input unit, 112...first output unit, 113...first communication unit, 114...first memory unit, 115...first control unit, 116...first image processing unit, 117...first display unit, 121...second input unit, 122...second output unit, 123...second communication unit, 124...second memory unit, 125...second control unit, 126...second image processing unit, 127...second display unit, 131...third input unit, 13 2...Third output unit, 133...Third communication unit, 134...Third storage unit, 135...Third control unit, 136...Third image processing unit, 137...Third display unit, 141...Input unit, 142...Output unit, 143...Communication unit, 144...Storage unit, 145...Control unit, 146...Service provision processing unit, 211A...Ath content, 211B...Bth content, 221...First provision range, 222...Second provision range, 311... First master layer, 312...second master layer, 411...first icon, 411a...first a icon, 412...second icon, 412a...second a icon, 412b...second b icon, 431...finger, A1...first display device, A2...second display device, A3...third display device, B1...first display screen, B2...second display screen, B3...third display screen, C1...first image, C1a... Image 1a, C1b...image 1b, C2...image 2, C2a...image 2a, C2b...image 2b, C3...image 3, D1...server device, Dr1...direction 1, Dr2...direction 2, Dr3...direction 3, E1...user 1, E2...user 2, E3...user 3, F1...master area 1, F2...master area 2, G1...master image 1, G2...master image 2

Claims

1. The first display device acquires coordinate information; the first display device acquires first content corresponding to the coordinate information; the first display device acquires second content corresponding to the coordinate information; displaying a first image generated based on a first aspect ratio of a first display screen of the first display device and the first content on the first display screen; displaying a second image generated based on a second aspect ratio of a second display screen of a second display device and the second content on the second display screen; Display method.

2. the first display device receiving a first operation to update the first image; updating the second image based on the first operation and the coordinate information; The display method according to claim 1 , further comprising:

3. the first operation includes at least one of a swipe operation, a pinch-in operation, a pinch-out operation, or a rotation operation; The display method according to claim 2.

4. displaying information representing at least a part of the coordinate information on the first display screen or the second display screen; The display method according to claim 1 , further comprising:

5. A first display device and a second display device are provided, The first display device is Get the coordinate information, acquiring a first content corresponding to the coordinate information; acquiring second content corresponding to the coordinate information; displaying a first image generated based on a first aspect ratio of a first display screen of the first display device and the first content on the first display screen; The first display device or the second display device is displaying a second image generated based on a second aspect ratio of a second display screen of the second display device and the second content on the second display screen; Display system.

Images