Display method and display system

Abstract

To achieve screen synchronization of display contents.SOLUTION: A display method includes: acquiring a master image; acquiring a first aspect ratio of a first display screen of a first display device; setting a first region in a master region of the master image on the basis of the first aspect ratio; displaying, on the first display screen, the first image obtained by trimming an image portion inside the first region; acquiring a second aspect ratio of a second display screen of a second display device; setting, in the master region, a second region having an overlapping region that overlaps the first region and a non-overlapping region that does not overlap the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region, on the basis of the second aspect ratio; displaying, on the second display screen, the second image obtained by trimming an image portion inside the second region; setting a positional relationship between the first region and the second region; and updating, when one of the first region and the second region is updated, the other region to maintain the positional relationship.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a display method and a display system. [Background technology]

[0002] BACKGROUND ART A system is known in which an image is supplied from a smartphone to a projector, and the projector projects the image (see, for example, Patent Document 1). Patent Document 1 describes that a smartphone and a projector are connected, and that a wireless communication interface is used for connection using, for example, Miracast (registered trademark).

[0003] Patent document 1 also describes that when a smartphone connected to the projector is used in a so-called portrait orientation, and the DMD (Digital Micro-mirror Device) is used in its normal usage state, the projected image is projected onto the screen with black bars on both sides of the screen in the horizontal direction. Patent document 1 also describes that when a projector receives a notification that a smartphone connected to the projector is being used in portrait orientation, it controls the DMD to rotate by 90 degrees, thereby maintaining the aspect ratio of the image displayed on the smartphone. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2017-97107 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with conventional technology, if the projector does not have a mechanism for rotating the DMD by 90 degrees, the projector will project and display an image on the screen with black bars on both sides of the screen, preventing the display area from being used to its full potential. [Means for solving the problem]

[0006] In order to solve the above problem, one aspect is a display method that includes acquiring a master image, acquiring a first aspect ratio of a first display screen of a first display device, setting a first region in a master region of the master image based on the first aspect ratio, displaying a first image in which an image portion inside the first region in the master image has been cropped on the first display screen, acquiring a second aspect ratio of a second display screen of a second display device different from the first display device, setting a second region in the master region based on the second aspect ratio, the second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction or a second direction that are perpendicular to each other in the master region, displaying a second image in which an image portion inside the second region in the master image has been cropped on the second display screen, setting a positional relationship between the first region and the second region, and when one of the first region and the second region is updated, updating the other region so as to maintain the positional relationship.

[0007] In one aspect to solve the above problem, a display device includes a first display device and a second display device, wherein the first display device acquires a master image, acquires a first aspect ratio of a first display screen of the first display device, and sets a first region in a master region of the master image based on the first aspect ratio, and displays a first image in which an image portion inside the first region in the master image is trimmed on the first display screen, and the first display device or the second display device acquires a second aspect ratio of a second display screen of the second display device, and sets a first region in the master region based on the second aspect ratio, overlapping with the first region. a second area is set in the master area, the second area having an overlapping area that overlaps with the first area and a non-overlapping area that does not overlap with the first area in at least one of a first direction or a second direction that are perpendicular to each other; the second display device displays a second image in which the image portion inside the second area in the master image has been cropped on the second display screen; the first display device sets a positional relationship between the first area and the second area; and when there is an update to one of the first area or the second area, the first display device or the second display device updates the other area so as to maintain the positional relationship. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating a schematic configuration example of a display system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating a schematic configuration example of a first display device according to the embodiment. [Figure 3] FIG. 2 is a diagram illustrating a schematic configuration example of a second display device according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating a schematic configuration example of a third display device according to an embodiment. [Figure 5] FIG. 2 is a diagram illustrating a schematic configuration example of a server device according to an embodiment. [Figure 6] FIG. 4 is a diagram illustrating an example of map information stored in the server device according to the embodiment. [Figure 7] FIG. 2 is a diagram showing an example of the configuration of a master layer in the first display device according to the embodiment. [Figure 8A] FIG. 3 is a diagram showing an example of a first image displayed on a first display screen of a first display device according to the embodiment. [Figure 8B] FIG. 10 is a diagram showing an example of a second image displayed on a second display screen of a second display device according to the embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a procedure of a process performed when an image is displayed on the first display device according to the embodiment. [Figure 10] 1 is a diagram for schematically explaining the relationship between a first area on the screen of a sharing source device and a second area on the screen of a sharing destination device according to an embodiment. FIG. [Figure 11A] FIG. 10 is a diagram illustrating an example of a center of a region according to the embodiment. [Figure 11B] FIG. 10 is a diagram illustrating an example of a center of a region according to the embodiment. [Figure 11C] FIG. 10 is a diagram illustrating an example of a center of a region according to the embodiment. [Figure 12] 10 is a diagram showing an example of an icon indicating the positional relationship between a first area and a second area in an image of a share destination according to the embodiment. FIG. [Figure 13] 10 is a diagram showing an example of an icon indicating the positional relationship between a first area and a second area in a sharing source image according to the embodiment. FIG. [Figure 14] FIG. 1 is a diagram illustrating an example of screen sharing according to the background art. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments will be described with reference to the drawings. In the following description, the dimensions of areas and the like shown in the drawings are merely examples for the purpose of explanation, and are not necessarily exact dimensions, nor are they necessarily limited to the dimensions shown in the drawings. Furthermore, when two or more overlapping line segments are shown in the drawings, these line segments may be slightly shifted from one another to make them easier to see. In addition, in the following description, the names of components may be given numbers or letters, such as 1st, 2nd, or a combination thereof, but this is for the convenience of explanation and is not intended to unnecessarily limit the contents of the disclosure.

[0010] FIG. 1 is a diagram showing a schematic configuration example of a display system 1 according to an embodiment. The display system 1 includes a first display device A1, a second display device A2, a third display device A3, and a server device D1. FIG. 1 shows a first user E1 who operates a first display device A1, a second user E2 who operates a second display device A2, and a third user E3 who operates a third display device A3.

[0011] In this embodiment, the server device D1 is described as being included in the display system 1, but as another example, the server device D1 may be considered as an external device to the display system 1. Furthermore, in this embodiment, the display system 1 includes three display devices, but as another example, a display system having two display devices may be realized, or a display system having four or more display devices may be realized.

[0012] In this embodiment, the first display device A1 and the server device D1 communicate with each other via wired or wireless communication, or both. In this embodiment, the first display device A1 and the second display device A2 communicate with each other via wired or wireless communication, or both. In this embodiment, the first display device A1 and the third display device A3 communicate with each other via wired or wireless communication, or both.

[0013] In this embodiment, as specific examples, the first display device A1 is a smartphone, the second display device A2 is a projector, and the third display device A3 is a tablet terminal. In this embodiment, a display system 1 including a first display device A1 to a third display device A3 is shown to explain a combination of a first display device A1 which is a smartphone, an example of a mobile terminal, and a second display device A2 which is a projector, and a combination of a first display device A1 which is a smartphone and a third display device A3 which is a tablet terminal.

[0014] As another example, a display system may be implemented that has a first display device A1 that is a smartphone and a second display device A2 that is a projector, with each combination separated, or a display system may be implemented that has a first display device A1 that is a smartphone and a third display device A3 that is a tablet terminal.

[0015] In this embodiment, the case where each display device is operated by a different user is shown, but as another example, two of the first user E1 to the third user E3 may be the same user, or all three may be the same user. Also, for example, one or more display devices may automatically execute processing according to a predetermined processing procedure without being operated by a user.

[0016] The first display device A1 includes a first display screen B1. In the example of Fig. 1, a first image C1 is displayed on the first display screen B1. The second display device A2 includes a second display screen B2. In the example of Fig. 1, a second image C2 is displayed on the second display screen B2. In this embodiment, the second display device A2 is a projector, the second display screen B2 is a screen, and the second image C2 is an image projected onto the screen. For example, the present invention may be applied to a case where an image projected on the screen is viewed by multiple people in a predetermined room. The third display device A3 includes a third display screen B3. In the example of Fig. 1, a third image C3 is displayed on the third display screen B3.

[0017] In this embodiment, the image displayed on the display screen may be an image of any display content, such as an image representing a map, text, a figure, a still image, a video, or a combination of two or more of these. Instead of an image, it may be called a video or the like.

[0018] Here, the specific examples of the respective display devices are merely examples, and various devices may be used as the respective display devices. For example, a display device of a car navigation system or a display device of an electronic whiteboard system may be used as the second display device A2 or the third display device A3. Furthermore, for example, a display device having a screen and a function of displaying an image input from the outside on the screen may be used as the second display device A2 or the third display device A3. In contrast to the first display screen B1 of the first display device A1, the second display screen B2 of the second display device A2 and the third display screen B3 of the third display device A3 may be considered to be external monitors whose screens can be shared. Note that screen sharing may also be called, for example, image sharing. The display device may also be called, for example, an information processing device.

[0019] The server device D1 may be, for example, a cloud device. In this embodiment, the first display device A1 communicates with the server device D1, but as another example, the second display device A2 or the third display device A3, or two or more display devices may communicate with the server device D1.

[0020] In this embodiment, a case is shown in which, in screen sharing, the first display device A1 is used as a sharing source device, and the second display device A2 or the third display device A3 is used as a sharing destination device. In general, the first display device A1, which is the sharing source device, acquires image information from the server device D1 and displays an image based on the image information on its own screen. The first display device A1 also transmits an image based on the image information to a sharing destination device as needed. The sharing destination device, the second display device A2 or the third display device A3, displays the image on its own screen.

[0021] FIG. 2 is a diagram showing a schematic configuration example of the first display device A1 according to the embodiment. The first display device A1 includes a first input unit 111, a first output unit 112, a first communication unit 113, a first storage unit 114, a first control unit 115, and a first image processing unit . The first output unit 112 includes a first display unit 117 .

[0022] First input unit 111 inputs information according to an operation performed by first user E1. Furthermore, first input unit 111 may input information output from an external device connected via a connection terminal, for example. The first output unit 112 displays and outputs information on the first display screen B1 using the first display unit 117. The first output unit 112 may also output sound along with the image display. Furthermore, the first output unit 112 may output information to an external device connected using a connection terminal, for example. Here, the first input unit 111 and the first display unit 117 may be configured using, for example, a touch panel.

[0023] The first communication unit 113 communicates with an external device. In this embodiment, the external device is the second display device A2, the third display device A3, or the server device D1. The first storage unit 114 stores various types of information.

[0024] The first control unit 115 performs various processes and controls in the first display device A1. In this embodiment, the first display device A1 is configured using a computer. The first control unit 115 includes a processor such as a CPU (Central Processing Unit), and executes predetermined programs using the processor to perform various processes and controls. The first image processing unit 116 performs various types of image processing. In this embodiment, the first image processing unit 116 is controlled by the first control unit 115, for example, to perform various types of image processing. Here, first display unit 117 displays and outputs, for example, an image processed by first image processing unit .

[0025] FIG. 3 is a diagram showing a schematic configuration example of the second display device A2 according to the embodiment. The second display device A2 includes a second input unit 121, a second output unit 122, a second communication unit 123, a second storage unit 124, a second control unit 125, and a second image processing unit 126. The second output unit 122 includes a second display unit 127 .

[0026] Second input unit 121 inputs information according to an operation performed by second user E2. Here, second input unit 121 may be configured using, for example, keys or a touch panel. The second output unit 122 displays and outputs information on the second display screen B2 using the second display unit 127. The second output unit 122 may output sound along with the image display.

[0027] The second communication unit 123 communicates with an external device, which in this embodiment is the first display device A1. The second storage unit 124 stores various types of information.

[0028] The second control unit 125 performs various processes and controls in the second display device A2. In this embodiment, the second display device A2 is configured to include a control computer. The second control unit 125 includes a processor such as a CPU, and performs various processes and controls by executing predetermined programs using the processor. The second image processing unit 126 performs various types of image processing.

[0029] In this embodiment, the second display device A2 is a projector. The second image processing unit 126 includes, for example, a predetermined optical system, and processes the image to be projected onto the screen. For example, the second display unit 127 outputs the image processed by the second image processing unit 126 so as to be displayed on a screen. In this embodiment, for convenience of explanation, the second image processing unit 126 and the second display unit 127 are described separately, but they may be integrated, for example.

[0030] FIG. 4 is a diagram showing a schematic configuration example of the third display device A3 according to the embodiment. The third display device A3 includes a third input unit 131, a third output unit 132, a third communication unit 133, a third storage unit 134, a third control unit 135, and a third image processing unit 136. The third output unit 132 includes a third display unit 137 .

[0031] The third input unit 131 inputs information according to an operation performed by the third user E3. Furthermore, the third input unit 131 may receive, for example, information output from an external device connected via a connection terminal. The third output unit 132 displays and outputs information on the third display screen B3 using the third display unit 137. The third output unit 132 may output sound along with the image display. Furthermore, the third output unit 132 may output information to an external device connected using a connection terminal, for example. Here, the third input unit 131 and the third display unit 137 may be configured using, for example, a touch panel.

[0032] The third communication unit 133 communicates with an external device, which in this embodiment is the first display device A1. The third storage unit 134 stores various types of information.

[0033] The third control unit 135 performs various processes and controls in the third display device A3. In this embodiment, the third display device A3 is configured using a computer. The third control unit 135 includes a processor such as a CPU, and performs various processes and controls by executing predetermined programs using the processor. The third image processing unit 136 performs various types of image processing. In this embodiment, the third image processing unit 136 is controlled by the third control unit 135, for example, to perform various types of image processing. Here, the third display unit 137 displays and outputs, for example, an image processed by the third image processing unit 136.

[0034] FIG. 5 is a diagram showing an example of a schematic configuration of the server device D1 according to the embodiment. The server device D1 includes an input unit 141, an output unit 142, a communication unit 143, a storage unit 144, a control unit 145, and a service providing processing unit 146.

[0035] The input unit 141 inputs information according to an operation performed by an operator (not shown). The output unit 142 outputs information by display output, audio output, or the like. The communication unit 143 communicates with an external device, which in this embodiment is the first display device A1. The storage unit 144 stores various types of information.

[0036] The control unit 145 performs various processes and controls in the server device D1. In this embodiment, the server device D1 is configured using a computer. The control unit 145 includes a processor such as a CPU, and performs various processes and controls by executing predetermined programs using the processor. The service providing processing unit 146 performs processing for providing a predetermined service. In this embodiment, the service providing processing unit 146 is controlled by the control unit 145, for example, to perform various types of processing.

[0037] In this embodiment, the service providing processing unit 146 of the server device D1 provides a service of providing predetermined map information. The map information is stored, for example, in the storage unit 144. As another example, the map information may be stored in a database or the like (not shown) that is provided externally to the server device D1, and in this case, the server device D1 acquires the map information from the database or the like. The information provided by the server device D1 is not particularly limited, and any other information may be used.

[0038] In this embodiment, the server device D1 is operated by an operator, but the server device D1 may be remotely operated by an operator, for example. As another example, the server device D1 may automatically perform a predetermined process without being operated by an operator.

[0039] FIG. 6 is a diagram showing an example of map information 211 stored in the server device D1 according to the embodiment. The map information 211 is, for example, information about a world map. For ease of explanation, Fig. 6 shows an αβ Cartesian coordinate system, which is a two-dimensional Cartesian coordinate system. In the αβ Cartesian coordinate system, an origin γ, an α axis, and a β axis are shown. In this embodiment, the α direction parallel to the α axis corresponds to the so-called horizontal direction, and the β direction parallel to the β axis corresponds to the so-called vertical direction.

[0040] FIG. 6 shows an example of the coverage area 221 set in the map information 211. The provision range 221 indicates the range of the information portion of the entire map information 211 that is provided to the destination by the service provision processing unit 146 . In this embodiment, the destination is the first display device A1.

[0041] In this embodiment, the first display device A1 transmits request information to the server device D1 on a website provided by the server device D1. The service providing processing unit 146 of the server device D1 determines the providing range 221 based on the request information received from the first display device A1. Then, the service provision processing unit 146 of the server device D1 transmits the information portion of the map information 211 that is included in the determined provision range 221 to the first display device A1. Here, the first display device A1 changes the request information as necessary and transmits it to the server device D1. The change in the request information from the first display device A1 changes the provision range 221 in the server device D1, and changes the information transmitted from the server device D1 to the first display device A1.

[0042] 7, 8A, 8B, and 9, a description will be given of screen sharing in a combination of a first display device A1 and a second display device A2. In this embodiment, the first display device A1 is the main display device, and the second display device A2 is the sub display device.

[0043] FIG. 7 is a diagram showing an example of the configuration of the master layer 311 in the first display device A1 according to the embodiment. For convenience of explanation, an XY Cartesian coordinate system, which is a two-dimensional Cartesian coordinate system, is shown in Fig. 7. In the XY Cartesian coordinate system, an origin O, an X axis, and a Y axis are shown. In this embodiment, the X direction parallel to the X axis corresponds to the so-called horizontal direction, with the positive side corresponding to the right side and the negative side corresponding to the left side. In this embodiment, the Y direction parallel to the Y axis corresponds to the so-called vertical direction, with the positive side corresponding to the top side and the negative side corresponding to the bottom side. The horizontal and vertical directions may be interpreted in reverse.

[0044] In this embodiment, the X and Y directions in the XY Cartesian coordinate system are parallel to the α and β directions in the αβ Cartesian coordinate system shown in FIG. 6, respectively. However, as another example, the X and Y directions in the XY Cartesian coordinate system may correspond to the α and β directions in the αβ Cartesian coordinate system shown in FIG. 6 in another manner.

[0045] In the first display device A1, the first image processing unit 116 draws a master image on the master layer 311. In this embodiment, the area of ​​the master image is called a master area.

[0046] In the example of FIG. 7, a first master image G1 is shown as the master image drawn on the master layer 311. In the example of FIG. 7, a first master region F1 is shown as the master region of the first master image G1.

[0047] Here, the master layer 311 may be, for example, a predetermined area provided in the recording area of ​​the first storage unit 114. In this case, the process of drawing the master image on the master layer 311 may be a process of storing data of the master image in the master layer 311 and memorizing the master image. In this case, for example, the master layer 311 and the first master area F1 may be considered to be substantially the same. 7, the first master area F1 is a rectangular area surrounded by two line segments in the X direction parallel to the X axis and two line segments in the Y direction parallel to the Y axis. Note that a square may also be included as a type of rectangle.

[0048] In this example, the first image processing unit 116 of the first display device A1 transmits request information to the server device D1, and thereby acquires from the server device D1 an information portion of the provision range 221 based on the request information. The information portion corresponds to map information of the provision range 221. Then, the first image processing unit 116 of the first display device A1 draws the acquired map information on the master layer 311 as a first master image G1.

[0049] In this embodiment, the request information includes information indicating the reference point and information indicating the aspect ratio. The reference point is a point that serves as a reference for setting the coverage area 221 in the map information 211 in the server device D1, and may be a point that is set as the center position of the coverage area 221 in the map information 211, for example. The aspect ratio is used as a value for setting the frame of the provided range 221 with the reference point as the reference. Such information indicating the reference point may be considered to be coordinate information indicating the coordinates of the content. Furthermore, the combination of such a reference point and aspect ratio may also be considered to be coordinate information indicating the coordinates and range of the content. In other words, the request information may be considered to be information including the coordinate information of the content.

[0050] The service providing processing unit 146 of the server device D1 determines and sets the providing range 221 suited to the reference point and aspect ratio specified by the request information from the first display device A1. In this example, the provided range 221 may change if one or both of the reference point and the aspect ratio specified by the request information changes.

[0051] In this embodiment, the first image processing unit 116 of the first display device A1 determines the aspect ratio to be included in the request information based on the aspect ratio of the first display screen B1 of the first display device A1 and the aspect ratio of the second display screen B2 of the second display device A2. In the example of FIG. 7, the first image processing unit 116 of the first display device A1 uses the aspect ratio of the second display screen B2 of the second display device A2 as the aspect ratio to be included in the request information.

[0052] In this embodiment, the aspect ratio (Y direction:X direction) of the first display screen B1 of the first display device A1 is (16:9), and the resolution is (1920:1080). In this embodiment, the aspect ratio of the second display screen B2 of the second display device A2 is (9:16) in the Y direction:X direction, and the resolution is (1080:1920). In this way, the aspect ratio of the first display screen B1 and the aspect ratio of the second display screen B2 are different.

[0053] In the first display device A1, for example, the aspect ratio of the first display screen B1 is stored in the first storage unit 114 in advance. Furthermore, in the first display device A1, for example, the aspect ratio of the second display screen B2 of the second display device A2 may be stored in advance in the first storage unit 114, or information specifying the aspect ratio of the second display screen B2 of the second display device A2 may be acquired from the second display device A2 or another device, which may be the server device D1. For example, the first display device A1 may obtain the aspect ratio of the second display screen B2 of the second display device A2 from the second display device A2 or another device in real time during screen sharing.

[0054] 7, the first image processing unit 116 of the first display device A1 sets a first region H1 in the first master region F1 that matches the aspect ratio of the first display screen B1 of the first display device A1. Then, the first image processing unit 116 of the first display device A1 trims the image portion included in the first region H1 and displays it on the first display screen B1. 7, the first image processing unit 116 of the first display device A1 sets a second region H2 in the first master region F1 that matches the aspect ratio of the second display screen B2 of the second display device A2. The first image processing unit 116 of the first display device A1 then crops the image portion included in the second region H2 and transmits it to the second display device A2. As a result, the second image processing unit 126 of the second display device A2 displays and outputs the image portion on the second display screen B2. Note that trimming may also be called, for example, cutting out.

[0055] Here, the first area H1 may be associated with the master layer 311 or the first master area F1, for example, using coordinates in an XY Cartesian coordinate system. The second area H2 may also be associated with the master layer 311 or the first master area F1, for example, using coordinates in an XY Cartesian coordinate system. The first region H1 and the second region H2 may be associated with each other using coordinates in an XY Cartesian coordinate system, or may be associated with each other using a relative positional relationship. In the example of FIG. 7, the second area H2 overlaps with the first master area F1, but for the sake of convenience in explanation, they are shown slightly offset from each other to make them easier to see. In the example of FIG. 7, the upper and lower sides, which are part of the first region H1, overlap with the first master region F1.

[0056] In this embodiment, the second region H2 has an overlapping region that overlaps with the first region H1. In this embodiment, the second region H2 has a non-overlapping region that does not overlap with the first region H1 in the X direction, the Y direction, or both the X and Y directions. That is, the second region H2 protrudes from the first region H1 in the X direction, the Y direction, or both the X and Y directions. In this embodiment, the first master area F1 and the second area H2 are identical to each other, but a mode in which they do not match may also be used.

[0057] FIG. 8A is a diagram showing an example of a first image C1 displayed on a first display screen B1 of a first display device A1 according to the embodiment. FIG. 8B is a diagram showing an example of a second image C2 displayed on the second display screen B2 of the second display device A2 according to the embodiment.

[0058] FIG. 9 is a diagram showing an example of a procedure of processing performed when an image is displayed on the first display device A1 according to the embodiment. In this example, the sharing source device is the first display device A1, and the sharing destination device is the second display device A2. In this example, the first display device A1 switches screen sharing on and off. This switching may be performed, for example, by the first user E1 operating the first display device A1, or may be performed automatically according to a predetermined switching condition.

[0059] In step S1, the first image processing unit 116 prepares the master layer 311 in the first display device A1, which is the sharing source device. Next, in step S2, in the first display device A1, the first image processing unit 116 draws the display content on the master layer 311. In this example, the display content is the first master image G1.

[0060] Next, in step S3, in the first display device A1, the first image processing unit 116 cuts out an appropriate portion from the master layer 311, and displays the image of that portion on the first display screen B1. In this example, this appropriate portion is the first region H1. Furthermore, this appropriate portion is cut out by trimming.

[0061] Next, in step S4, the first image processing unit 116 of the first display device A1 determines whether or not to start screen sharing. In this example, the first image processing unit 116 determines to start screen sharing if screen sharing is already set to on or if screen sharing is switched from off to on in real time. On the other hand, the first image processing unit 116 determines not to start screen sharing if screen sharing is set to off. In the determination of step S4, if the first image processing unit 116 of the first display device A1 determines that screen sharing should be started, the result of step S4 is YES, and the process proceeds to step S5. On the other hand, in the determination of step S4, if the first image processing unit 116 of the first display device A1 determines that screen sharing should not be started, the result is NO in step S4, and the process of this flow ends.

[0062] In step S5, the first image processing unit 116 of the first display device A1 cuts out an appropriate portion from the master layer 311 and performs processing to display the image of that portion on the second display screen B2 of the second display device A2, which is the sharing destination device. Then, the processing of this flow ends. In this example, this appropriate portion is the portion of the second region H2. Furthermore, this appropriate portion is cut out by trimming.

[0063] As a specific example, while a first user E1 is viewing a first image C1 displayed on a first display screen B1 of a first display device A1, a second user E2 can view a second image C2 displayed on a second display screen B2 of a second display device A2. For example, the size of the second display screen B2 of the second display device A2 is larger than the size of the first display screen B1 of the first display device A1, and multiple users can simultaneously view the second image C2. For example, when the first user E1 operates the first display device A1 to give an instruction to shift the reference point of the first region H1, the updated request information with the shifted reference point is transmitted from the first display device A1 to the server device D1. As a result, the provision range 221 on the server device D1 is updated, and the image portion transmitted from the server device D1 to the first display device A1 is updated. Then, the first master image G1 on the first display device A1 is updated, the image content of the first image C1 is updated, and the image content of the second image C2 is updated. As an example, when the reference point of the map information displayed on the first display screen B1 is shifted, the map information displayed on the first display screen B1 scrolls accordingly, and in synchronization with this, the map information displayed on the second display screen B2 scrolls.

[0064] As described above, in the display method and display system 1 of this embodiment, the first master image G1 of the first master area F1 is set based on the aspect ratio of the first display screen B1 of the first display device A1 and the aspect ratio of the second display screen B2 of the second display device A2. Then, a first image C1 of the first region H1 according to the aspect ratio of the first display screen B1 is generated and displayed on the first display device A1. Also, a second image C2 of the second region H2 is generated according to the aspect ratio of the second display screen B2 and is displayed on the second display device A2. Therefore, in the display method and display system 1 according to this embodiment, it is possible to optimally display the display content on the display screen of each display device.

[0065] In the example of FIG. 7, the first area H1 in the first master area F1 is the area that can be displayed to the maximum extent when the aspect ratio of the first display screen B1 is used. In the example of FIG. 7, the second area H2 in the first master area F1 is the area that can be displayed to the maximum extent when the aspect ratio of the second display screen B2 is used. In this way, the display method and display system 1 according to this embodiment can eliminate wasted space when an image is displayed on each display screen, even if the display screens have different aspect ratios. This wasted space is, for example, the black bars in the conventional example.

[0066] Here, the effect of screen sharing in this embodiment will be explained by comparing it with a conventional example. In conventional screen sharing systems, the display content of the screen of the sharing source device is generally copied as is onto the screen of another sharing destination device. In this case, if the aspect ratio of the sharing source device and the aspect ratio of the sharing destination device are different, blank spaces will appear on the displayed image at the sharing destination device, and these blank spaces will appear as black bars, for example (see, for example, Patent Document 1). In the past, software-controlled automatic scaling or trimming was commonly used to prevent blank spaces from appearing when sharing a screen. However, automatic scaling can cause screen distortion or inappropriate scaling. Furthermore, when cropping, the cropping is performed from the screen of the device from which the image is shared, which causes a problem in that information on the edges of the screen is lost.

[0067] Here, with reference to FIG. 14, a specific example of screen sharing according to the background art will be shown. FIG. 14 is a diagram illustrating an example of screen sharing according to the background art. FIG. 14 shows an example of a second sharer image 1011 displayed on the screen of a sharer device, and an example of a second sharer image 1021 displayed on the screen of a sharer device. In the example of FIG. 14, for the sake of convenience, a cut-out area 1111 in the second sharing source image 1011 is shown, but the cut-out area 1111 is used in internal processing of the sharing source device but is not displayed on the screen. 14, a cutout area 1111 is set in the center excluding the upper and lower areas of the second shared original image 1011. The image of the portion of the second shared original image 1011 included in the cutout area 1111 is set as the second shared image 1021, but information about the upper and lower areas is lost. In the example of FIG. 14, the left and right sides of the cutout area 1111 overlap with the area of ​​the second shared original image 1011.

[0068] Therefore, in this embodiment, the master area of ​​the master image drawn on the master layer is optimized for screen sharing between two devices with screens of different aspect ratios. In this embodiment, the master area is designed to cover the widest image range when screen sharing is performed between these two devices. When screen sharing is performed, the device that is the source of the screen sharing (the sending device) cuts out an appropriate portion from the master layer based on its own aspect ratio and displays the cut-out portion on the screen. Also, when screen sharing is performed, the device that is the source of the screen sharing (the sending device) cuts out an appropriate portion from the master layer based on the aspect ratio of the device that is the recipient of the screen sharing and sends the cut-out portion to the device that is the recipient of the screen sharing. This allows the device that is the recipient of the screen sharing to receive display content optimized for its own aspect ratio. Therefore, in this embodiment, when screen sharing is performed between two devices having screens with different aspect ratios, information loss can be reduced and white space can be eliminated compared to conventional methods. It should be noted that this embodiment is particularly effective for display content that does not have a fixed aspect ratio, for example.

[0069] In this embodiment, the first display device A1 changes the request information sent to the server device D1 when a predetermined event occurs on the first display device A1, thereby changing the first master image G1. The event may be, for example, a predetermined operation such as scrolling performed by the first user E1 on the first display device A1, or a predetermined automatic operation such as scrolling performed on the first display device A1. As another example, when a predetermined event occurs on the second display device A2, the second display device A2 may notify the first display device A1 of the occurrence, and the first display device A1 may change the request information that it sends to the server device D1 in response to the notification, thereby changing the first master image G1. The event may be, for example, a predetermined operation such as scrolling by the second user E2 on the second display device A2, or the occurrence of a predetermined automatic operation such as scrolling on the second display device A2. In this case, the notification from the second display device A2 to the first display device A1 is performed by the second display device A2 sending predetermined information to the first display device A1.

[0070] In addition, in this embodiment, when the first display device A1 shares its screen with the second display device A2, the first display device A1 generates an image suitable for the aspect ratio of the second display screen B2 of the second display device A2 based on the first master image G1, and transmits the generated image to the second display device A2. As another example, when the first display device A1 shares its screen with the second display device A2, the first display device A1 may transmit an image corresponding to the first master image G1 to the second display device A2, and the second display device A2 may generate an image suitable for the aspect ratio of the second display screen B2 based on the image received by the first display device A1 and display the generated image. This generation process may include, for example, setting the second region H2 and trimming. The first display device A1 stores the aspect ratio of the first display screen B1 in the first storage unit 114 or the like, and the second display device A2 stores the aspect ratio of the second display screen B2 in the second storage unit 124 or the like.

[0071] In addition, in this embodiment, the first display device A1 acquires the first master image G1 based on information received from the server device D1. As another example, the original information for generating the first master image G1 may be stored in a predetermined database, and the first display device A1 may acquire the first master image G1 based on that information. As another example, the original information for generating the first master image G1 may be stored in the first memory unit 114 of the first display device A1, and the first display device A1 may acquire the first master image G1 based on that information.

[0072] While the above describes screen sharing between the first display device A1 and the second display device A2, similar screen sharing may also be applied to the combination of the first display device A1 and the third display device A3. In this case, for example, the first display device A1 acts as the master and the third display device A3 acts as the slave. Generally, similar operations are performed by the third display device A3 and the third user E3 instead of the second display device A2 and the second user E2. However, in this embodiment, the second display device A2 is a projector, whereas the third display device A3 is a tablet terminal, and operations may differ due to these differences.

[0073] The positional relationship between the first area on the screen of the sharing source device and the second area on the screen of the sharing destination device will be described with reference to FIG. FIG. 10 is a diagram for schematically explaining the relationship between the first area on the screen of the sharing source device and the second area on the screen of the sharing destination device according to the embodiment.

[0074] FIG. 10 shows a map area 211R, which is the area of ​​the map information 211 shown in FIG. For convenience of explanation, FIG. 10 shows an αβ orthogonal coordinate system, as in FIG.

[0075] FIG. 10 also shows area 1a H1a of the screen of the device from which the sharing originates and area 2a H2a of the screen of the device to which the sharing is to be performed in the first state, and area 1b H1b of the screen of the device from which the sharing originates and area 2b H2b of the screen of the device to which the sharing is to be performed in the second state. In the example of FIG. 10, for convenience of explanation, the 1a region H1a and the 2a region H2a, and the 1b region H1b and the 2b region H2b are shown overlapping the map region 211R. In the example of FIG. 10, arrows indicating the transition from the 1a region H1a and the 2a region H2a to the 1b region H1b and the 2b region H2b are schematically shown superimposed on the map region 211R. In the example of FIG. 10, the upper and lower sides of the 1a region H1a overlap with the 2a region H2a, and the upper and lower sides of the 1b region H1b overlap with the 2b region H2b.

[0076] Here, the first state is a state in which the 1a region H1a is located at a first position in the map region 211R. The second state is a state in which the 1a region H1a is moved from the first state and is present at a second position, which is the position of the 1b region H1b in the map area 211R. In this embodiment, the movement of the 1a region H1a from the first position to the second position, i.e., the transition from the first state to the second state, occurs when, for example, a predetermined operation is performed on the sharing source device. As another example, the movement of the 1a region H1a from the first position to the second position, i.e., the transition from the first state to the second state, may occur in response to a predetermined operation being performed on the sharing destination device and the sharing destination device notifying the sharing source device of that fact.

[0077] As a specific example, a case will be described in which the sharing source device is a first display device A1, which is a smartphone, and the sharing destination device is a second display device A2, which is a projector. In this embodiment, the first image processing unit 116 of the first display device A1 sets the positional relationship between the 1a region H1a and the 2a region H2a. This setting may be performed in advance, or at any timing. The content of this setting may be stored in the first storage unit 114, for example. When an update is made to the 1a region H1a, the first image processing unit 116 updates the other 2a region H2a so as to maintain the set positional relationship.

[0078] 10, the 1a region H1a is moved to the 1b region H1b, and accordingly the 2a region H2a is moved to the 2b region H2b, whereby the positional relationship between the 1a region H1a and the 2a region H2a is maintained, and the 1b region H1b and the 2b region H2b are transferred. That is, the combination of the 1a region H1a and the 2a region H2a is moved together while maintaining their relative positions. Here, when the combination of 1a area H1a and 2a area H2a is moved and goes beyond the master area of ​​the original master layer 311, the master image is updated on the sharing source device according to the position of the combination of 1a area H1a and 2a area H2a.

[0079] As another example, if there is an update regarding the 2a region H2a, the second image processing unit 126 of the second display device A2 may notify the first image processing unit 116 of the first display device A1 of this, and the first image processing unit 116 may then perform an update regarding the other 1a region H1a so as to maintain the set positional relationship. In addition, in this example, the sharing destination device is the second display device A2, which is a projector, but as another example, the present invention may be applied to a case where the sharing destination device is the third display device A3, which is a tablet terminal.

[0080] In this manner, in the display method and display system 1 according to the present embodiment, when the 1a region H1a is moved on the sharing source device, the 2a region H2a on the sharing destination device is also moved accordingly, thereby updating the images in the 1a region H1a and the 2a region H2a. At this time, the master image is updated on the sharing source device as necessary. Similarly, in the display method and display system 1 according to this embodiment, when the 2a region H2a is moved on the sharing destination device, the 1a region H1a on the sharing source device is also moved accordingly, thereby updating the images in the 1a region H1a and the 2a region H2a. At this time, the master image is updated on the sharing source device as necessary. Therefore, in the display method and display system 1 of this embodiment, when an image of the 1a region H1a and an image of the 2a region H2a are displayed via the master layer 311, the movement of one region is accompanied by the movement of the other region, and the positional relationship between these regions is maintained. Note that maintaining the positional relationship between these areas corresponds to, for example, the positional relationship between these areas remaining unchanged.

[0081] As a specific example, if a master image is cropped and displayed on a smartphone and a projector, even if the image displayed on the smartphone screen is updated, the image displayed by the projector will not be updated as long as the update is within the range of the master image. Therefore, in this embodiment, the relative positions of the smartphone's display area and the projector's display area are fixed, and when the image in one display area is updated, the image in the other display area is also updated in conjunction with it. Here, such a configuration is particularly effective when, for example, one of the sharing source device and the sharing destination device allows screen operations, while the other does not. The sharing device may be a tablet terminal instead of a projector.

[0082] Here, the sharing source device or the sharing destination device may be equipped with a touch panel, and may receive input operations from the user via the touch panel. The input operation is not particularly limited, and for example, a swipe operation, a pinch out operation, a pinch in operation, or a rotation operation may be used. As a specific example, a user may be able to double-tap and then swipe up or down to indicate zoom in or out with one hand. The user may also be able to instruct zooming in or zooming out with both hands by pinching out or in. The user may also be able to indicate a rotation of the image by using two fingers to form a rotation. The input operation is not limited to this example, and various operations may be used.

[0083] In the example of FIG. 10, the positional relationship between the 1a area H1a corresponding to the screen of the sharing source device and the 2a area H2a corresponding to the screen of the sharing destination device is maintained.

[0084] Now, with reference to Figures 11A, 11B and 11C, examples of region centers are shown. FIG. 11A is a diagram illustrating an example of the center of a region according to the embodiment. In the example of FIG. 11A, the intersection of two diagonals of an eleventh rectangular area H11 is defined as a first center point 411. For convenience of explanation, these two diagonal lines are also shown in FIG. 11A.

[0085] FIG. 11B is a diagram illustrating an example of the center of the region according to the embodiment. In the example of FIG. 11B, for the rectangular twelfth region H12, a line parallel to the vertical direction that is drawn so as to divide the horizontal width into two equal parts is defined as a first center line 421.

[0086] FIG. 11C is a diagram illustrating an example of the center of the region according to the embodiment. In the example of FIG. 11C, for the rectangular thirteenth region H13, a line parallel to the horizontal direction that is drawn so as to divide the vertical height into two equal parts is defined as the second center line 431.

[0087] In the example of Figure 10, if the center point shown in Figure 11A or the center line shown in Figure 11B or Figure 11C is used as the center reference, the centers of the 1a region H1a and the 2a region H2a will coincide with each other. The centers of the 1b region H1b and the 2b region H2b, which are the regions to which the 1a region H1a and the 2a region H2a are moved, also coincide with each other.

[0088] FIG. 12 is a diagram showing an example of an icon indicating the positional relationship between the first area and the second area in the image of the share destination according to the embodiment. FIG. 12 shows a first sharer image 511, which is an image displayed on the screen of the sharer device. First sharer image 511 has a first icon 521 displayed in an overlapping manner, which indicates the positional relationship between a first area, which is the area of ​​the sharing source image that is the image displayed on the screen of the sharing source device, and a second area, which is the area of ​​first sharer image 511. This display is performed, for example, on the sharing destination device based on information from the sharing source device. In the example of FIG. 12, the first icon 521 is information representing the boundary line in the second area of ​​the first sharer image 511 that corresponds to the first area.

[0089] In this example, the top and bottom edges of the first icon 521 overlap with the top and bottom edges of the second area of ​​the first sharer image 511, but in the example of Figure 12, for ease of explanation, they are shown slightly shifted to make them easier to see. As another example, when the first area of ​​the source image and the second area of ​​the first sharer image 511 overlap in part or in whole, a mode may be used in which the area of ​​the first icon 521 is slightly shifted and displayed on the screen so that the first icon 521 does not overlap the second area of ​​the first sharer image 511, as shown in Figure 12.

[0090] FIG. 13 is a diagram showing an example of an icon indicating the positional relationship between the first area and the second area in the sharing source image according to the embodiment. FIG. 13 shows a first sharing source image 531, which is an image displayed on the screen of the sharing source device. A second icon 541 indicating the positional relationship between a first area, which is the area of ​​the first sharing source image 531, and a second area, which is the area of ​​the sharing destination image, which is an image displayed on the screen of the sharing destination device, is displayed in an overlapping manner on the first sharing source image 531. This display is performed, for example, on the sharing source device based on information about the sharing destination device. 13, the second icon 541 is information representing a boundary line corresponding to the second area in the first area of ​​the first shared original image 531. Specifically, the second icon 541 is composed of two linear marks representing the bottom and top edges of the first area.

[0091] In this example, the top and bottom edges of the second icon 541 overlap with the top and bottom edges of the first area of ​​the first shared original image 531, but in the example of Figure 13, for ease of explanation, they are shown slightly shifted to make them easier to see. As another example, when the first area of ​​the first shared source image 531 and the second area of ​​the shared image overlap in part or in whole, a mode may be used in which the area of ​​the second icon 541 is slightly shifted and displayed on the screen so that the second icon 541 does not overlap the first area of ​​the first shared source image 531, as shown in FIG. 13.

[0092] As an example, a mode may be used in which the first icon 521 is displayed on the first sharer image 511, while no icon is displayed on the sharer image, as in the example of FIG. As another example, a mode may be used in which a first icon 521 is displayed on a first sharer image 511 as in the example of FIG. 12, and a second icon 541 is displayed on a first sharer image 531 as in the example of FIG. 13. As a specific example, the sharing source device may be a smartphone, and the sharing destination device may be a tablet terminal.

[0093] Here, in the examples of Figures 12 and 13, information representing the boundary of the other party's area is used as an icon representing the positional relationship between the first area of ​​the image from which the sharing originates and the second area of ​​the image to which the sharing destination resides, but other information may also be used, for example, information representing the center point of the other party's area may also be used.

[0094] As an example, the display of the first icon on the sharing destination device may be achieved by the sharing source device generating an image including the first icon, providing the image to the sharing destination device, and the sharing destination device displaying the image. As another example, the display of the first icon on the sharing destination device may be achieved by the sharing source device providing information identifying the first area to the sharing destination device, and the sharing destination device generating an image based on the information identifying its own second area and information from the sharing source device, and displaying the image.

[0095] The display method of this embodiment involves acquiring a first master image G1, acquiring a first aspect ratio of a first display screen B1 of a first display device A1, setting a first region H1 in a first master region F1 of the first master image G1 based on the first aspect ratio, and displaying a first image C1 on the first display screen B1 in which the image portion inside the first region H1 in the first master image G1 has been cropped. In addition, the display method of this embodiment includes obtaining a second aspect ratio of a second display screen B2 of a second display device A2 different from the first display device A1, setting a second region H2 in the first master region F1 based on the second aspect ratio, the second region H2 having an overlapping region that overlaps with the first region H1 and a non-overlapping region that does not overlap with the first region H1 in at least one of a first direction or a second direction that are perpendicular to each other in the first master region F1, and displaying a second image C2 on the second display screen B2, in which the image portion inside the second region H2 in the first master image G1 has been cropped. In addition, the display method according to this embodiment sets the positional relationship between the first area H1 and the second area H2, and when an update is made to one of the first area H1 and the second area H2, an update is made to the other area so as to maintain the positional relationship.

[0096] Therefore, in the display method of this embodiment, for example, instead of generating a second image from a first image, by generating a first image C1 and a second image C2 from a first master image G1, it is possible to display images that match the aspect ratios of the first display screen B1 and the second display screen B2, and it is possible to prevent, for example, both sides of the second image from becoming black images. Furthermore, in the display method according to this embodiment, for example, by setting the relative positions of the first area H1 and the second area H2, when generating the first image C1 and the second image C2 from the first master image G1, it is possible to achieve screen linkage between the display content of the first display screen B1 and the display content of the second display screen B2. Here, in the example of FIG. 7, the first direction is a direction parallel to the Y axis, and the second direction is a direction parallel to the X axis.

[0097] The positional relationship between the first region H1 and the second region H2 may be set using, for example, the coordinates of the first master image G1. For example, the coordinates of a first point in the first master image G1 may correspond to the coordinates of a point in the first region H1, and the coordinates of a second point in the first master image G1 may correspond to the coordinates of a point in the second region H2. Here, the first point and the second point may be the same point or different points. As another example, the positional relationship between the first region H1 and the second region H2 may be set using the relative positional relationship between the first region H1 and the second region H2, without using the coordinates of the master image.

[0098] Note that, here, the example is explained using a case where the sharing source device is the first display device A1 and the sharing destination device is the second display device A2, but the same effect can be obtained, for example, when the sharing destination device is the third display device A3, except for the difference that the second display device A2 is a projector and the third display device A3 is a tablet terminal.

[0099] In one configuration example, the display method according to this embodiment receives an operation to update the first image C1, and updates the second image C2 based on the operation and the above-described positional relationship. Therefore, in the display method according to this embodiment, by operating the first display device A1, it is possible to realize screen linkage. However, such a configuration does not necessarily have to be used.

[0100] In one configuration example, the display method according to this embodiment receives an operation to update the second image C2, and updates the first image C1 based on the operation and the above-described positional relationship. Therefore, in the display method according to this embodiment, by operating the second display device A2, it is possible to realize screen linkage. In this case, for example, the second display device A2 notifies the first display device A1 of the content of the operation, and the first display device A1 updates the first master image G1 as necessary. However, such a configuration does not necessarily have to be used.

[0101] In the display method according to this embodiment, as one configuration example, the operation of updating the first image C1 or the operation of updating the second image C2 includes at least one of a swipe operation, a pinch-in operation, a pinch-out operation, or a rotation operation. Therefore, the display method according to this embodiment allows the user to perform intuitive operations when displaying information such as a map. However, such a configuration does not necessarily have to be used.

[0102] In the display method according to the present embodiment, as one configuration example, the above-described positional relationship is a relationship in which the position of the first center point of the first region H1 coincides with the position of the second center point of the second region H2. Therefore, in the display method according to this embodiment, the centers of the image displayed on the first display screen B1 and the image displayed on the second display screen B2 are aligned, making it easy for the user to understand the positional relationship between the first area H1 and the second area H2. However, such a configuration does not necessarily have to be used.

[0103] In the display method according to the present embodiment, as one configuration example, first positional relationship information representing the above-described positional relationship is displayed on the second image C2. Therefore, in the display method according to the present embodiment, first positional relationship information indicating the positional relationship between the first region H1 and the second region H2 is displayed on the second image C2, making it easier for the user to understand the correspondence when comparing the first display screen B1 and the second display screen B2. Here, the first positional relationship information may be, for example, a predetermined icon. However, such a configuration does not necessarily have to be used.

[0104] In the display method according to the present embodiment, as one configuration example, second positional relationship information representing the above-described positional relationship is displayed on the first image C1. Therefore, in the display method according to the present embodiment, by displaying second positional relationship information indicating the positional relationship between the first region H1 and the second region H2 on the first image C1, it is possible for the user to easily grasp the correspondence when comparing the first display screen B1 and the second display screen B2. Here, the second positional relationship information may be, for example, a predetermined icon. However, such a configuration does not necessarily have to be used.

[0105] In the display method according to the present embodiment, as one configuration example, the above-described positional relationship is expressed by relative position coordinates between the first region H1 and the second region H2. Therefore, in the display method according to this embodiment, the positional relationship between the first region H1 and the second region H2 can be set using the coordinates of their direct relative positions. However, such a configuration does not necessarily have to be used.

[0106] The display system 1 according to this embodiment can realize processing corresponding to various configurations of the display method according to this embodiment. As an example configuration, a display system 1 according to this embodiment includes a first display device A1 and a second display device A2. The first display device A1 acquires a first master image G1, acquires a first aspect ratio of the first display screen B1 of the first display device A1, sets a first area H1 in the first master area F1 of the first master image G1 based on the first aspect ratio, and displays a first image C1 on the first display screen B1 in which the image portion inside the first area H1 in the first master image G1 has been cropped. The first display device A1 or the second display device A2 acquires a second aspect ratio of the second display screen B2 of the second display device A2, and based on the second aspect ratio, sets a second region H2 in the first master region F1, which has an overlapping region that overlaps with the first region H1 and a non-overlapping region that does not overlap with the first region H1 in at least one of a first direction or a second direction that are perpendicular to each other in the first master region F1. The second display device A2 displays a second image C2 on the second display screen B2, which is obtained by trimming the image portion inside the second region H2 of the first master image G1. The first display device A1 sets the positional relationship between the first area H1 and the second area H2. When an update is made to one of the first region H1 and the second region H2, the first display device A1 or the second display device A2 updates the other so as to maintain the positional relationship.

[0107] Therefore, in the display system 1 of this embodiment, for example, instead of generating a second image from a first image, by generating a first image C1 and a second image C2 from a first master image G1, it is possible to display images that match the aspect ratios of the first display screen B1 and the second display screen B2, and it is possible to prevent, for example, both sides of the second image from becoming black images. Furthermore, in the display system 1 of this embodiment, for example, by setting the relative positions of the first area H1 and the second area H2, when generating the first image C1 and the second image C2 from the first master image G1, it is possible to achieve screen linkage between the display content of the first display screen B1 and the display content of the second display screen B2.

[0108] Here, the acquisition of the second aspect ratio and the setting of the second region H2 based on the second aspect ratio may be performed by, for example, the first display device A1, or may be performed by the second display device A2. Furthermore, the process of updating the first area H1 and the second area H2 so as to maintain the above-described positional relationship may be performed by, for example, the first display device A1. Furthermore, the process of updating the first area H1 and the second area H2 so as to maintain the above-mentioned positional relationship may be, for example, a process of updating the first area H1 performed by the first display device A1, and a process of updating the second area H2 performed by the second display device A2.

[0109] A program for implementing the functions of any of the components of any of the above-described devices may be recorded on a computer-readable recording medium and loaded into a computer system for execution. Here, "computer system" includes hardware such as an operating system or peripheral devices. "Computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs (Read Only Memory), and CDs (Compact Discs)-ROMs, as well as storage devices such as hard disks built into computer systems. "Computer-readable recording medium" also includes devices that retain a program for a certain period of time, such as volatile memory within a computer system that acts as a server or client when a program is transmitted over a network such as the Internet or a communication line such as a telephone line. Such volatile memory may be RAM. The recording medium may also be non-transitory.

[0110] The above program may be transmitted from a computer system that stores the program in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. The "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network such as the Internet or a communication line such as a telephone line. The above program may be for realizing some of the above functions. The above program may be a so-called differential file that can realize the above functions in combination with a program already recorded in a computer system. The differential file may also be called a differential program.

[0111] The functions of any of the components in any of the above-described devices may be implemented by a processor. Each process in the embodiments may be implemented by a processor operating based on information such as a program and a computer-readable recording medium storing information such as the program. The functions of each unit of the processor may be implemented by separate hardware, or may be implemented by integrated hardware. The processor includes hardware, and the hardware may include at least one of a circuit for processing digital signals and a circuit for processing analog signals. The processor may be configured using one or more circuit devices mounted on a circuit board, or one or both of one or more circuit elements. An integrated circuit (IC) or the like may be used as the circuit device, and a resistor or a capacitor may be used as the circuit element.

[0112] The processor may be a CPU. However, the processor is not limited to a CPU, and various types of processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) may be used. The processor may be a hardware circuit using an ASIC (Application Specific Integrated Circuit). The processor may be configured with multiple CPUs, or may be configured with a hardware circuit using multiple ASICs. The processor may be configured with a combination of multiple CPUs and a hardware circuit using multiple ASICs. The processor may include one or more of an amplifier circuit or a filter circuit that processes analog signals.

[0113] Although the embodiments have been described above in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and includes designs within the scope of the gist of this disclosure.

[0114] Summary of this disclosure A summary of this disclosure is provided below. (Appendix 1) acquiring a master image; obtaining a first aspect ratio of a first display screen of a first display device; setting a first area in a master area of ​​the master image based on the first aspect ratio; displaying a first image on the first display screen, the first image being obtained by trimming an image portion inside the first region in the master image; acquiring a second aspect ratio of a second display screen of a second display device different from the first display device; setting, in the master region based on the second aspect ratio, a second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region; displaying a second image on the second display screen, the second image being obtained by trimming the image portion inside the second region of the master image; setting a positional relationship between the first area and the second area; When one of the first area and the second area is updated, the other is updated so as to maintain the positional relationship; Display method. This makes it possible to display images that match the aspect ratios of the first and second display screens, for example, by generating the first and second images from a master image rather than generating the second image from the first image, thereby preventing both sides of the second image from becoming black. Furthermore, by setting the relative positions of the first area and the second area, when generating the first image and the second image from the master image, screen linkage can be achieved between the display content of the first display screen and the display content of the second display screen.

[0115] (Appendix 2) accepting an operation to update the first image; updating the second image based on the operation and the positional relationship; (Appendix 1) Display method. This makes it possible to realize screen linkage by operating the first display device.

[0116] (Appendix 3) accepting an operation to update the second image; updating the first image based on the operation and the positional relationship; How to display (Appendix 1) or (Appendix 2). This makes it possible to realize screen linkage by operating the second display device.

[0117] (Appendix 4) the operation of updating the first image or the operation of updating the second image includes at least one of a swipe operation, a pinch-in operation, a pinch-out operation, or a rotation operation; How to display (Appendix 2) or (Appendix 3). This allows users to intuitively operate the device when displaying information such as maps.

[0118] (Appendix 5) the positional relationship is a relationship in which the position of a first center point of the first region coincides with the position of a second center point of the second region; Display method: either (Appendix 1) to (Appendix 4). As a result, the centers of the image displayed on the first display screen and the image displayed on the second display screen coincide with each other, making it easy for the user to grasp the positional relationship between the first area and the second area.

[0119] (Appendix 6) displaying first positional relationship information representing the positional relationship on the second image; Display method: any one of (Appendix 1) to (Appendix 5). By displaying the first positional relationship information, which indicates the positional relationship between the first region and the second region, on the second image, the user can easily understand the correspondence when comparing the first display screen and the second display screen. Here, the first positional relationship information may be, for example, a predetermined icon.

[0120] (Appendix 7) second positional relationship information representing the positional relationship is displayed on the first image; Display method: either (Appendix 1) to (Appendix 6). By displaying the second positional relationship information, which indicates the positional relationship between the first area and the second area, on the first image, the user can easily understand the correspondence when comparing the first display screen and the second display screen. Here, the second positional relationship information may be, for example, a predetermined icon.

[0121] (Appendix 8) The positional relationship is expressed by relative position coordinates between the first area and the second area. Display method: either (Appendix 1) to (Appendix 7). This makes it possible to set the positional relationship between the first area and the second area using the coordinates of their direct relative positions.

[0122] (Appendix 9) A first display device and a second display device are provided, The first display device is Acquire a master image, obtaining a first aspect ratio of a first display screen of the first display device; setting a first area in a master area of ​​the master image based on the first aspect ratio; displaying a first image on the first display screen, the first image being obtained by trimming an image portion inside the first region of the master image; The first display device or the second display device is obtaining a second aspect ratio of a second display screen of the second display device; based on the second aspect ratio, a second region is set in the master region, the second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region; The second display device is displaying a second image on the second display screen, the second image being obtained by trimming the image portion inside the second region of the master image; The first display device is setting a positional relationship between the first area and the second area; The first display device or the second display device is When an update is made to one of the first area and the second area, an update is made to the other area so as to maintain the positional relationship. Display system. This allows the first and second images to be generated from a master image rather than from a first image, thereby displaying images that match the aspect ratios of the first and second display screens, thereby preventing, for example, both sides of the second image from becoming black. Furthermore, for example, by setting the relative positions of the first area and the second area, when generating the first image and the second image from the master image, it is possible to achieve screen linkage between the display content of the first display screen and the display content of the second display screen. [Explanation of symbols]

[0123] 1...display system, 111...first input unit, 112...first output unit, 113...first communication unit, 114...first memory unit, 115...first control unit, 116...first image processing unit, 117...first display unit, 121...second input unit, 122...second output unit, 123...second communication unit, 124...second memory unit, 125...second control unit, 126...second image processing unit, 127...second display unit, 131...third input unit, 132 ...third output unit, 133...third communication unit, 134...third storage unit, 135...third control unit, 136...third image processing unit, 137...third display unit, 141...input unit, 142...output unit, 143...communication unit, 144...storage unit, 145...control unit, 146...service provision processing unit, 211...map information, 211R...map area, 221...provision range, 311...master layer, 411...first center point, 421 ...First center line, 431...Second center line, 511...First sharing destination image, 521...First icon, 531...First sharing source image, 541...Second icon, 1011...Second sharing source image, 1021...Second Sharing destination image, 1111...Cutout area, A1...First display device, A2...Second display device, A3...Third display device, B1...First display screen, B2...Second display screen, B3...Third display screen, C1...First screen image, C2...second image, C3...third image, D1...server device, E1...first user, E2...second user, E3...third user, F1...first master area, G1...first master image, H1...first area, H1a...area 1a, H1b...area 1b, H2...second area, H2a...area 2a, H2b...area 2b, H11...area 11, H12...area 12, H13...area 13

Claims

1. acquiring a master image; obtaining a first aspect ratio of a first display screen of a first display device; setting a first area in a master area of ​​the master image based on the first aspect ratio; displaying a first image on the first display screen, the first image being obtained by trimming an image portion inside the first region of the master image; acquiring a second aspect ratio of a second display screen of a second display device different from the first display device; setting, in the master region, a second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region, based on the second aspect ratio; displaying a second image on the second display screen, the second image being obtained by trimming an image portion inside the second region of the master image; setting a positional relationship between the first area and the second area; When one of the first area and the second area is updated, the other area is updated so as to maintain the positional relationship; Display method.

2. accepting an operation to update the first image; updating the second image based on the operation and the positional relationship; The display method according to claim 1, further comprising:

3. accepting an operation to update the second image; updating the first image based on the operation and the positional relationship; The display method according to claim 1, further comprising:

4. the operation of updating the first image or the operation of updating the second image includes at least one of a swipe operation, a pinch-in operation, a pinch-out operation, or a rotation operation; The display method according to claim 2 or 3.

5. the positional relationship is a relationship in which a position of a first center point of the first region coincides with a position of a second center point of the second region; The display method according to claim 1 .

6. displaying first positional relationship information representing the positional relationship on the second image; The display method according to claim 1 .

7. second positional relationship information representing the positional relationship is displayed on the first image; The display method according to claim 6.

8. the positional relationship is expressed by relative position coordinates between the first region and the second region; The display method according to claim 1 .

9. A first display device and a second display device are provided, The first display device is Acquire a master image, obtaining a first aspect ratio of a first display screen of the first display device; setting a first area in a master area of ​​the master image based on the first aspect ratio; displaying a first image on the first display screen, the first image being obtained by trimming an image portion inside the first region of the master image; The first display device or the second display device is obtaining a second aspect ratio of a second display screen of the second display device; based on the second aspect ratio, a second region is set in the master region, the second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region; The second display device is displaying a second image on the second display screen, the second image being obtained by trimming the image portion inside the second region of the master image; The first display device is setting a positional relationship between the first area and the second area; The first display device or the second display device is When an update is made to one of the first area and the second area, an update is made to the other area so as to maintain the positional relationship. Display system.

Images