Display method and display system

Abstract

To display an image matching the aspect ratio of each display screen.SOLUTION: A display method includes: acquiring a master image; acquiring a first aspect ratio of a first display screen of a first display device; setting a first region in a master region of the master image on the basis of the first aspect ratio; displaying, on the first display screen, a first image obtained by trimming an image portion inside the first region in the master image; acquiring a second aspect ratio of a second display screen of a second display device different the fist display device; setting, in the master region, a second region having an overlapping region that overlaps the first region and a non-overlapping region that does not overlap the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region, on the basis of a second aspect ratio; and displaying, on the second display screen, a second image obtained by trimming an image portion inside the second region in the master image.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a display method and a display system. [Background technology]

[0002] BACKGROUND ART A system is known in which an image is supplied from a smartphone to a projector, and the projector projects the image (see, for example, Patent Document 1). Patent Document 1 describes that a smartphone and a projector are connected, and that a wireless communication interface is used for connection using, for example, Miracast (registered trademark).

[0003] Patent document 1 also describes that when a smartphone connected to the projector is used in a so-called portrait orientation, and the DMD (Digital Micro-mirror Device) is used in its normal usage state, the projected image is projected onto the screen with black bars on both sides of the screen in the horizontal direction. Patent document 1 also describes that when a projector receives a notification that a smartphone connected to the projector is being used in portrait orientation, it controls the DMD to rotate by 90 degrees, thereby maintaining the aspect ratio of the image displayed on the smartphone. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2017-97107 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with conventional technology, if the projector does not have a mechanism for rotating the DMD by 90 degrees, the projector will project and display an image on the screen with black bars on both sides of the screen, preventing the display area from being used to its full potential. [Means for solving the problem]

[0006] In order to solve the above problem, one aspect is a display method that includes acquiring a master image, acquiring a first aspect ratio of a first display screen of a first display device, setting a first region in a master region of the master image based on the first aspect ratio, displaying a first image in which an image portion inside the first region in the master image has been cropped on the first display screen, acquiring a second aspect ratio of a second display screen of a second display device different from the first display device, setting a second region in the master region based on the second aspect ratio, the second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction or a second direction that are perpendicular to each other in the master region, and displaying a second image in which an image portion inside the second region in the master image has been cropped on the second display screen.

[0007] In order to solve the above problem, one embodiment is a display system comprising a first display device and a second display device, wherein the first display device acquires a master image, acquires a first aspect ratio of a first display screen of the first display device, and sets a first region in a master region of the master image based on the first aspect ratio, and displays a first image on the first display screen, in which an image portion inside the first region in the master image has been cropped; the first display device or the second display device acquires a second aspect ratio of a second display screen of the second display device, and sets a second region in the master region based on the second aspect ratio, the second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction or a second direction that are perpendicular to each other in the master region; and the second display device displays a second image on the second display screen, in which an image portion inside the second region in the master image has been cropped. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating a schematic configuration example of a display system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating a schematic configuration example of a first display device according to the embodiment. [Figure 3] FIG. 2 is a diagram illustrating a schematic configuration example of a second display device according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating a schematic configuration example of a third display device according to an embodiment. [Figure 5] FIG. 2 is a diagram illustrating a schematic configuration example of a server device according to an embodiment. [Figure 6] FIG. 4 is a diagram illustrating an example of map information stored in the server device according to the embodiment. [Figure 7] FIG. 2 is a diagram showing an example of the configuration of a master layer in the first display device according to the embodiment. [Figure 8A] FIG. 3 is a diagram showing an example of a first image displayed on a first display screen of a first display device according to the embodiment. [Figure 8B]FIG. 10 is a diagram showing an example of a second image displayed on a second display screen of a second display device according to the embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a procedure of a process performed when an image is displayed on the first display device according to the embodiment. [Figure 10A] FIG. 10 is a diagram illustrating an example of the configuration of a master area before change according to the embodiment. [Figure 10B] FIG. 10 is a diagram showing an example of the configuration of a master area after a change according to the embodiment. [Figure 11A] FIG. 10 is a diagram illustrating an example of the configuration of a master area before change according to the embodiment. [Figure 11B] FIG. 10 is a diagram showing an example of the configuration of a master area after a change according to the embodiment. [Figure 12] FIG. 2 is a diagram illustrating an example of a configuration of a master area according to the embodiment. [Figure 13] FIG. 2 is a diagram illustrating an example of a configuration of a master area according to the embodiment. [Figure 14A] FIG. 2 is a diagram illustrating an example of a configuration of a master area according to the embodiment. [Figure 14B] FIG. 2 is a diagram illustrating an example of a configuration of a master area according to the embodiment. [Figure 15A] FIG. 10 is a diagram illustrating an example of a center of a region according to the embodiment. [Figure 15B] FIG. 10 is a diagram illustrating an example of a center of a region according to the embodiment. [Figure 15C] FIG. 10 is a diagram illustrating an example of a center of a region according to the embodiment. [Figure 16] FIG. 1 is a diagram illustrating an example of screen sharing according to the background art. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments will be described with reference to the drawings. In the following description, the dimensions of areas and the like shown in the drawings are merely examples for the purpose of explanation, and are not necessarily exact dimensions, nor are they necessarily limited to the dimensions shown in the drawings. Furthermore, when two or more overlapping line segments are shown in the drawings, these line segments may be slightly shifted from one another to make them easier to see. In addition, in the following description, the names of components may be given numbers or letters, such as 1st, 2nd, or a combination thereof, but this is for the convenience of explanation and is not intended to unnecessarily limit the contents of the disclosure.

[0010] FIG. 1 is a diagram showing a schematic configuration example of a display system 1 according to an embodiment. The display system 1 includes a first display device A1, a second display device A2, a third display device A3, and a server device D1. FIG. 1 shows a first user E1 who operates a first display device A1, a second user E2 who operates a second display device A2, and a third user E3 who operates a third display device A3.

[0011] In this embodiment, the server device D1 is described as being included in the display system 1, but as another example, the server device D1 may be considered as an external device to the display system 1. Furthermore, in this embodiment, the display system 1 includes three display devices, but as another example, a display system having two display devices may be realized, or a display system having four or more display devices may be realized.

[0012] In this embodiment, the first display device A1 and the server device D1 communicate with each other via wired or wireless communication, or both. In this embodiment, the first display device A1 and the second display device A2 communicate with each other via wired or wireless communication, or both. In this embodiment, the first display device A1 and the third display device A3 communicate with each other via wired or wireless communication, or both.

[0013] In this embodiment, as specific examples, the first display device A1 is a smartphone, the second display device A2 is a projector, and the third display device A3 is a tablet terminal. In this embodiment, a display system 1 including a first display device A1 to a third display device A3 is shown to explain a combination of a first display device A1 which is a smartphone, an example of a mobile terminal, and a second display device A2 which is a projector, and a combination of a first display device A1 which is a smartphone and a third display device A3 which is a tablet terminal.

[0014] As another example, a display system may be implemented that has a first display device A1 that is a smartphone and a second display device A2 that is a projector, with each combination separated, or a display system may be implemented that has a first display device A1 that is a smartphone and a third display device A3 that is a tablet terminal.

[0015] In this embodiment, the case where each display device is operated by a different user is shown, but as another example, two of the first user E1 to the third user E3 may be the same user, or all three may be the same user. Also, for example, one or more display devices may automatically execute processing according to a predetermined processing procedure without being operated by a user.

[0016] The first display device A1 includes a first display screen B1. In the example of Fig. 1, a first image C1 is displayed on the first display screen B1. The second display device A2 includes a second display screen B2. In the example of Fig. 1, a second image C2 is displayed on the second display screen B2. In this embodiment, the second display device A2 is a projector, the second display screen B2 is a screen, and the second image C2 is an image projected onto the screen. For example, the present invention may be applied to a case where an image projected on the screen is viewed by multiple people in a predetermined room. The third display device A3 includes a third display screen B3. In the example of Fig. 1, a third image C3 is displayed on the third display screen B3.

[0017] In this embodiment, the image displayed on the display screen may be an image of any display content, such as an image representing a map, text, a figure, a still image, a video, or a combination of two or more of these. Instead of an image, it may be called a video or the like.

[0018] Here, the specific examples of the respective display devices are merely examples, and various devices may be used as the respective display devices. For example, a display device of a car navigation system or a display device of an electronic whiteboard system may be used as the second display device A2 or the third display device A3. Furthermore, for example, a display device having a screen and a function of displaying an image input from the outside on the screen may be used as the second display device A2 or the third display device A3. In contrast to the first display screen B1 of the first display device A1, the second display screen B2 of the second display device A2 and the third display screen B3 of the third display device A3 may be considered to be external monitors whose screens can be shared. Note that screen sharing may also be called, for example, image sharing. The display device may also be called, for example, an information processing device.

[0019] The server device D1 may be, for example, a cloud device. In this embodiment, the first display device A1 communicates with the server device D1, but as another example, the second display device A2 or the third display device A3, or two or more display devices may communicate with the server device D1.

[0020] In this embodiment, a case is shown in which, in screen sharing, the first display device A1 is used as a sharing source device, and the second display device A2 or the third display device A3 is used as a sharing destination device. In general, the first display device A1, which is the sharing source device, acquires image information from the server device D1 and displays an image based on the image information on its own screen. The first display device A1 also transmits an image based on the image information to a sharing destination device, as necessary. The sharing destination device, the second display device A2 or the third display device A3, displays the image on its own screen.

[0021] FIG. 2 is a diagram showing a schematic configuration example of the first display device A1 according to the embodiment. The first display device A1 includes a first input unit 111, a first output unit 112, a first communication unit 113, a first storage unit 114, a first control unit 115, and a first image processing unit . The first output unit 112 includes a first display unit 117 .

[0022] First input unit 111 inputs information according to an operation performed by first user E1. Furthermore, first input unit 111 may input information output from an external device connected via a connection terminal, for example. The first output unit 112 displays and outputs information on the first display screen B1 using the first display unit 117. The first output unit 112 may also output sound along with the image display. Furthermore, the first output unit 112 may output information to an external device connected using a connection terminal, for example. Here, the first input unit 111 and the first display unit 117 may be configured using, for example, a touch panel.

[0023] The first communication unit 113 communicates with an external device. In this embodiment, the external device is the second display device A2, the third display device A3, or the server device D1. The first storage unit 114 stores various types of information.

[0024] The first control unit 115 performs various processes and controls in the first display device A1. In this embodiment, the first display device A1 is configured using a computer. The first control unit 115 includes a processor such as a CPU (Central Processing Unit), and executes predetermined programs using the processor to perform various processes and controls. The first image processing unit 116 performs various types of image processing. In this embodiment, the first image processing unit 116 is controlled by the first control unit 115, for example, to perform various types of image processing. Here, first display unit 117 displays and outputs, for example, an image processed by first image processing unit .

[0025] FIG. 3 is a diagram showing a schematic configuration example of the second display device A2 according to the embodiment. The second display device A2 includes a second input unit 121, a second output unit 122, a second communication unit 123, a second storage unit 124, a second control unit 125, and a second image processing unit 126. The second output unit 122 includes a second display unit 127 .

[0026] Second input unit 121 inputs information according to an operation performed by second user E2. Here, second input unit 121 may be configured using, for example, keys or a touch panel. The second output unit 122 displays and outputs information on the second display screen B2 using the second display unit 127. The second output unit 122 may output sound along with the image display.

[0027] The second communication unit 123 communicates with an external device, which in this embodiment is the first display device A1. The second storage unit 124 stores various types of information.

[0028] The second control unit 125 performs various processes and controls in the second display device A2. In this embodiment, the second display device A2 is configured to include a control computer. The second control unit 125 includes a processor such as a CPU, and performs various processes and controls by executing predetermined programs using the processor. The second image processing unit 126 performs various types of image processing.

[0029] In this embodiment, the second display device A2 is a projector. The second image processing unit 126 includes, for example, a predetermined optical system, and processes the image to be projected onto the screen. For example, the second display unit 127 outputs the image processed by the second image processing unit 126 so as to be displayed on a screen. In this embodiment, for convenience of explanation, the second image processing unit 126 and the second display unit 127 are described separately, but they may be integrated, for example.

[0030] FIG. 4 is a diagram showing a schematic configuration example of the third display device A3 according to the embodiment. The third display device A3 includes a third input unit 131, a third output unit 132, a third communication unit 133, a third storage unit 134, a third control unit 135, and a third image processing unit 136. The third output unit 132 includes a third display unit 137 .

[0031] The third input unit 131 inputs information according to an operation performed by the third user E3. Furthermore, the third input unit 131 may receive, for example, information output from an external device connected via a connection terminal. The third output unit 132 displays and outputs information on the third display screen B3 using the third display unit 137. The third output unit 132 may output sound along with the image display. Furthermore, the third output unit 132 may output information to an external device connected using a connection terminal, for example. Here, the third input unit 131 and the third display unit 137 may be configured using, for example, a touch panel.

[0032] The third communication unit 133 communicates with an external device, which in this embodiment is the first display device A1. The third storage unit 134 stores various types of information.

[0033] The third control unit 135 performs various processes and controls in the third display device A3. In this embodiment, the third display device A3 is configured using a computer. The third control unit 135 includes a processor such as a CPU, and performs various processes and controls by executing predetermined programs using the processor. The third image processing unit 136 performs various types of image processing. In this embodiment, the third image processing unit 136 is controlled by the third control unit 135, for example, to perform various types of image processing. Here, the third display unit 137 displays and outputs, for example, an image processed by the third image processing unit 136.

[0034] FIG. 5 is a diagram showing an example of a schematic configuration of the server device D1 according to the embodiment. The server device D1 includes an input unit 141, an output unit 142, a communication unit 143, a storage unit 144, a control unit 145, and a service providing processing unit 146.

[0035] The input unit 141 inputs information according to an operation performed by an operator (not shown). The output unit 142 outputs information by display output, audio output, or the like. The communication unit 143 communicates with an external device, which in this embodiment is the first display device A1. The storage unit 144 stores various types of information.

[0036] The control unit 145 performs various processes and controls in the server device D1. In this embodiment, the server device D1 is configured using a computer. The control unit 145 includes a processor such as a CPU, and performs various processes and controls by executing predetermined programs using the processor. The service providing processing unit 146 performs processing for providing a predetermined service. In this embodiment, the service providing processing unit 146 is controlled by the control unit 145, for example, to perform various types of processing.

[0037] In this embodiment, the service providing processing unit 146 of the server device D1 provides a service of providing predetermined map information. The map information is stored, for example, in the storage unit 144. As another example, the map information may be stored in a database or the like (not shown) that is provided externally to the server device D1, and in this case, the server device D1 acquires the map information from the database or the like. The information provided by the server device D1 is not particularly limited, and any other information may be used.

[0038] In this embodiment, the server device D1 is operated by an operator, but the server device D1 may be remotely operated by an operator, for example. As another example, the server device D1 may automatically perform a predetermined process without being operated by an operator.

[0039] FIG. 6 is a diagram showing an example of map information 211 stored in the server device D1 according to the embodiment. The map information 211 is, for example, information about a world map. For ease of explanation, Fig. 6 shows an αβ Cartesian coordinate system, which is a two-dimensional Cartesian coordinate system. In the αβ Cartesian coordinate system, an origin γ, an α axis, and a β axis are shown. In this embodiment, the α direction parallel to the α axis corresponds to the so-called horizontal direction, and the β direction parallel to the β axis corresponds to the so-called vertical direction.

[0040] FIG. 6 shows an example of the coverage area 221 set in the map information 211. The provision range 221 indicates the range of the information portion of the entire map information 211 that is provided to the destination by the service provision processing unit 146 . In this embodiment, the destination is the first display device A1.

[0041] In this embodiment, the first display device A1 transmits request information to the server device D1 on a website provided by the server device D1. The service providing processing unit 146 of the server device D1 determines the providing range 221 based on the request information received from the first display device A1. Then, the service provision processing unit 146 of the server device D1 transmits the information portion of the map information 211 that is included in the determined provision range 221 to the first display device A1. Here, the first display device A1 changes the request information as necessary and transmits it to the server device D1. The change in the request information from the first display device A1 changes the provision range 221 in the server device D1, and changes the information transmitted from the server device D1 to the first display device A1.

[0042] 7, 8A, 8B, and 9, a description will be given of screen sharing in a combination of a first display device A1 and a second display device A2. In this embodiment, the first display device A1 is the main display device, and the second display device A2 is the sub display device.

[0043] FIG. 7 is a diagram showing an example of the configuration of the master layer 311 in the first display device A1 according to the embodiment. For convenience of explanation, an XY Cartesian coordinate system, which is a two-dimensional Cartesian coordinate system, is shown in Fig. 7. In the XY Cartesian coordinate system, an origin O, an X axis, and a Y axis are shown. In this embodiment, the X direction parallel to the X axis corresponds to the so-called horizontal direction, with the positive side corresponding to the right side and the negative side corresponding to the left side. In this embodiment, the Y direction parallel to the Y axis corresponds to the so-called vertical direction, with the positive side corresponding to the top side and the negative side corresponding to the bottom side. The horizontal and vertical directions may be interpreted in reverse.

[0044] In this embodiment, the X and Y directions in the XY Cartesian coordinate system are parallel to the α and β directions in the αβ Cartesian coordinate system shown in FIG. 6, respectively. However, as another example, the X and Y directions in the XY Cartesian coordinate system may correspond to the α and β directions in the αβ Cartesian coordinate system shown in FIG. 6 in another manner.

[0045] In the first display device A1, the first image processing unit 116 draws a master image on the master layer 311. In this embodiment, the area of ​​the master image is called a master area.

[0046] In the example of FIG. 7, a first master image G1 is shown as the master image drawn on the master layer 311. In the example of FIG. 7, a first master region F1 is shown as the master region of the first master image G1.

[0047] Here, the master layer 311 may be, for example, a predetermined area provided in the recording area of ​​the first storage unit 114. In this case, the process of drawing the master image on the master layer 311 may be a process of storing data of the master image in the master layer 311 and memorizing the master image. In this case, for example, the master layer 311 and the first master area F1 may be considered to be substantially the same. 7, the first master area F1 is a rectangular area surrounded by two line segments in the X direction parallel to the X axis and two line segments in the Y direction parallel to the Y axis. Note that a square may also be included as a type of rectangle.

[0048] In this example, the first image processing unit 116 of the first display device A1 transmits request information to the server device D1, and thereby acquires from the server device D1 an information portion of the provision range 221 based on the request information. The information portion corresponds to map information of the provision range 221. Then, the first image processing unit 116 of the first display device A1 draws the acquired map information on the master layer 311 as a first master image G1.

[0049] In this embodiment, the request information includes information indicating the reference point and information indicating the aspect ratio. The reference point is a point that serves as a reference for setting the coverage area 221 in the map information 211 in the server device D1, and may be a point that is set as the center position of the coverage area 221 in the map information 211, for example. The aspect ratio is used as a value for setting the frame of the provided range 221 with the reference point as the reference. Such information indicating the reference point may be considered to be coordinate information indicating the coordinates of the content. Furthermore, the combination of such a reference point and aspect ratio may also be considered to be coordinate information indicating the coordinates and range of the content. In other words, the request information may be considered to be information including the coordinate information of the content.

[0050] The service providing processing unit 146 of the server device D1 determines and sets the providing range 221 suited to the reference point and aspect ratio specified by the request information from the first display device A1. In this example, the provided range 221 may change if one or both of the reference point and the aspect ratio specified by the request information changes.

[0051] In this embodiment, the first image processing unit 116 of the first display device A1 determines the aspect ratio to be included in the request information based on the aspect ratio of the first display screen B1 of the first display device A1 and the aspect ratio of the second display screen B2 of the second display device A2. In the example of FIG. 7, the first image processing unit 116 of the first display device A1 uses the aspect ratio of the second display screen B2 of the second display device A2 as the aspect ratio to be included in the request information.

[0052] In this embodiment, the aspect ratio (Y direction:X direction) of the first display screen B1 of the first display device A1 is (16:9), and the resolution is (1920:1080). In this embodiment, the aspect ratio of the second display screen B2 of the second display device A2 is (9:16) in the Y direction:X direction, and the resolution is (1080:1920). In this way, the aspect ratio of the first display screen B1 and the aspect ratio of the second display screen B2 are different.

[0053] In the first display device A1, for example, the aspect ratio of the first display screen B1 is stored in the first storage unit 114 in advance. Furthermore, in the first display device A1, for example, the aspect ratio of the second display screen B2 of the second display device A2 may be stored in advance in the first storage unit 114, or information specifying the aspect ratio of the second display screen B2 of the second display device A2 may be acquired from the second display device A2 or another device, which may be the server device D1. For example, the first display device A1 may obtain the aspect ratio of the second display screen B2 of the second display device A2 from the second display device A2 or another device in real time during screen sharing.

[0054] 7, the first image processing unit 116 of the first display device A1 sets a first region H1 in the first master region F1 that matches the aspect ratio of the first display screen B1 of the first display device A1. Then, the first image processing unit 116 of the first display device A1 trims the image portion included in the first region H1 and displays it on the first display screen B1. 7, the first image processing unit 116 of the first display device A1 sets a second region H2 in the first master region F1 that matches the aspect ratio of the second display screen B2 of the second display device A2. The first image processing unit 116 of the first display device A1 then crops the image portion included in the second region H2 and transmits it to the second display device A2. As a result, the second image processing unit 126 of the second display device A2 displays and outputs the image portion on the second display screen B2. Note that trimming may also be called, for example, cutting out.

[0055] Here, the first area H1 may be associated with the master layer 311 or the first master area F1, for example, using coordinates in an XY Cartesian coordinate system. The second area H2 may also be associated with the master layer 311 or the first master area F1, for example, using coordinates in an XY Cartesian coordinate system. The first region H1 and the second region H2 may be associated with each other using coordinates in an XY Cartesian coordinate system, or may be associated with each other using a relative positional relationship. In the example of FIG. 7, the second area H2 overlaps with the first master area F1, but for the sake of convenience, they are shown slightly offset from each other to make them easier to see. In the example of FIG. 7, the upper and lower sides, which are part of the first region H1, overlap with the first master region F1.

[0056] In this embodiment, the second region H2 has an overlapping region that overlaps with the first region H1. In this embodiment, the second region H2 has a non-overlapping region that does not overlap with the first region H1 in the X direction, the Y direction, or both the X and Y directions. That is, the second region H2 protrudes from the first region H1 in the X direction, the Y direction, or both the X and Y directions. In this embodiment, the first master area F1 and the second area H2 are identical to each other, but a mode in which they do not match may also be used.

[0057] FIG. 8A is a diagram showing an example of a first image C1 displayed on a first display screen B1 of a first display device A1 according to the embodiment. FIG. 8B is a diagram showing an example of a second image C2 displayed on the second display screen B2 of the second display device A2 according to the embodiment.

[0058] FIG. 9 is a diagram showing an example of a procedure of processing performed when an image is displayed on the first display device A1 according to the embodiment. In this example, the sharing source device is the first display device A1, and the sharing destination device is the second display device A2. In this example, the first display device A1 switches screen sharing on and off. This switching may be performed, for example, by the first user E1 operating the first display device A1, or may be performed automatically according to a predetermined switching condition.

[0059] In step S1, the first image processing unit 116 prepares the master layer 311 in the first display device A1, which is the sharing source device. Next, in step S2, in the first display device A1, the first image processing unit 116 draws the display content on the master layer 311. In this example, the display content is the first master image G1.

[0060] Next, in step S3, in the first display device A1, the first image processing unit 116 cuts out an appropriate portion from the master layer 311, and displays the image of that portion on the first display screen B1. In this example, this appropriate portion is the first region H1. Furthermore, this appropriate portion is cut out by trimming.

[0061] Next, in step S4, the first image processing unit 116 of the first display device A1 determines whether or not to start screen sharing. In this example, the first image processing unit 116 determines to start screen sharing if screen sharing is already set to on or if screen sharing is switched from off to on in real time. On the other hand, the first image processing unit 116 determines not to start screen sharing if screen sharing is set to off. In the determination of step S4, if the first image processing unit 116 of the first display device A1 determines that screen sharing should be started, the result of step S4 is YES, and the process proceeds to step S5. On the other hand, in the determination of step S4, if the first image processing unit 116 of the first display device A1 determines that screen sharing should not be started, the result is NO in step S4, and the process of this flow ends.

[0062] In step S5, the first image processing unit 116 of the first display device A1 cuts out an appropriate portion from the master layer 311 and performs processing to display the image of that portion on the second display screen B2 of the second display device A2, which is the sharing destination device. Then, the processing of this flow ends. In this example, this appropriate portion is the portion of the second region H2. Furthermore, this appropriate portion is cut out by trimming.

[0063] As a specific example, while a first user E1 is viewing a first image C1 displayed on a first display screen B1 of a first display device A1, a second user E2 can view a second image C2 displayed on a second display screen B2 of a second display device A2. For example, the size of the second display screen B2 of the second display device A2 is larger than the size of the first display screen B1 of the first display device A1, and multiple users can simultaneously view the second image C2. For example, when the first user E1 operates the first display device A1 to give an instruction to shift the reference point of the first region H1, the updated request information with the shifted reference point is transmitted from the first display device A1 to the server device D1. As a result, the provision range 221 on the server device D1 is updated, and the image portion transmitted from the server device D1 to the first display device A1 is updated. Then, the first master image G1 on the first display device A1 is updated, the image content of the first image C1 is updated, and the image content of the second image C2 is updated. As an example, when the reference point of the map information displayed on the first display screen B1 is shifted, the map information displayed on the first display screen B1 scrolls accordingly, and in synchronization with this, the map information displayed on the second display screen B2 scrolls.

[0064] As described above, in the display method and display system 1 of this embodiment, the first master image G1 of the first master area F1 is set based on the aspect ratio of the first display screen B1 of the first display device A1 and the aspect ratio of the second display screen B2 of the second display device A2. Then, a first image C1 of the first region H1 according to the aspect ratio of the first display screen B1 is generated and displayed on the first display device A1. Also, a second image C2 of the second region H2 is generated according to the aspect ratio of the second display screen B2 and is displayed on the second display device A2. Therefore, in the display method and display system 1 according to this embodiment, it is possible to optimally display the display content on the display screen of each display device.

[0065] In the example of FIG. 7, the first area H1 in the first master area F1 is the area that can be displayed to the maximum extent when the aspect ratio of the first display screen B1 is used. In the example of FIG. 7, the second area H2 in the first master area F1 is the area that can be displayed to the maximum extent when the aspect ratio of the second display screen B2 is used. In this way, the display method and display system 1 according to this embodiment can eliminate wasted space when an image is displayed on each display screen, even if the display screens have different aspect ratios. This wasted space is, for example, the black bars in the conventional example.

[0066] Here, the effect of screen sharing in this embodiment will be explained by comparing it with a conventional example. In conventional screen sharing systems, the display content of the screen of the sharing source device is generally copied as is onto the screen of another sharing destination device. In this case, if the aspect ratio of the sharing source device and the aspect ratio of the sharing destination device are different, blank spaces will appear on the displayed image at the sharing destination device, and these blank spaces will appear as black bars, for example (see, for example, Patent Document 1). In the past, software-controlled automatic scaling or trimming was commonly used to prevent blank spaces from appearing when sharing a screen. However, automatic scaling can cause screen distortion or inappropriate scaling. Furthermore, when cropping, the cropping is performed from the screen of the device from which the image is shared, which causes a problem in that information on the edges of the screen is lost.

[0067] Here, with reference to FIG. 16, a specific example of screen sharing according to the background art will be shown. FIG. 16 is a diagram illustrating an example of screen sharing according to the background art. FIG. 16 shows an example of a sharing source image 1011 displayed on the screen of a sharing source device, and an example of a sharing destination image 1021 displayed on the screen of a sharing destination device. In the example of FIG. 16, for convenience of explanation, a cutout area 1111 in the sharing source image 1011 is shown, but the cutout area 1111 is used in the internal processing of the sharing source device but is not displayed on the screen. 16, a cutout area 1111 is set in the central portion excluding the upper and lower areas of the source sharing image 1011. The image of the portion of the source sharing image 1011 included in the cutout area 1111 is set as the destination sharing image 1021, but information about the upper and lower areas is lost. In the example of FIG. 16, the left and right sides of the cutout area 1111 overlap with the area of ​​the original sharing image 1011.

[0068] Therefore, in this embodiment, the master area of ​​the master image drawn on the master layer is optimized for screen sharing between two devices with screens of different aspect ratios. In this embodiment, the master area is designed to cover the widest image range when screen sharing is performed between these two devices. When screen sharing is performed, the device that is the source of the screen sharing (the sending device) cuts out an appropriate portion from the master layer based on its own aspect ratio and displays the cut-out portion on the screen. Also, when screen sharing is performed, the device that is the source of the screen sharing (the sending device) cuts out an appropriate portion from the master layer based on the aspect ratio of the device that is the recipient of the screen sharing and sends the cut-out portion to the device that is the recipient of the screen sharing. This allows the device that is the recipient of the screen sharing to receive display content optimized for its own aspect ratio. Therefore, in this embodiment, when screen sharing is performed between two devices having screens with different aspect ratios, information loss can be reduced and white space can be eliminated compared to conventional methods. It should be noted that this embodiment is particularly effective for display content that does not have a fixed aspect ratio, for example.

[0069] In this embodiment, the first display device A1 changes the request information sent to the server device D1 when a predetermined event occurs on the first display device A1, thereby changing the first master image G1. The event may be, for example, a predetermined operation such as scrolling performed by the first user E1 on the first display device A1, or a predetermined automatic operation such as scrolling performed on the first display device A1. As another example, when a predetermined event occurs on the second display device A2, the second display device A2 may notify the first display device A1 of the occurrence, and the first display device A1 may change the request information that it sends to the server device D1 in response to the notification, thereby changing the first master image G1. The event may be, for example, a predetermined operation such as scrolling by the second user E2 on the second display device A2, or the occurrence of a predetermined automatic operation such as scrolling on the second display device A2. In this case, the notification from the second display device A2 to the first display device A1 is performed by the second display device A2 sending predetermined information to the first display device A1.

[0070] In addition, in this embodiment, when the first display device A1 shares its screen with the second display device A2, the first display device A1 generates an image suitable for the aspect ratio of the second display screen B2 of the second display device A2 based on the first master image G1, and transmits the generated image to the second display device A2. As another example, when the first display device A1 shares its screen with the second display device A2, the first display device A1 may transmit an image corresponding to the first master image G1 to the second display device A2, and the second display device A2 may generate an image suitable for the aspect ratio of the second display screen B2 based on the image received by the first display device A1 and display the generated image. This generation process may include, for example, setting the second region H2 and trimming. The first display device A1 stores the aspect ratio of the first display screen B1 in the first storage unit 114 or the like, and the second display device A2 stores the aspect ratio of the second display screen B2 in the second storage unit 124 or the like.

[0071] In addition, in this embodiment, the first display device A1 acquires the first master image G1 based on information received from the server device D1. As another example, the original information for generating the first master image G1 may be stored in a predetermined database, and the first display device A1 may acquire the first master image G1 based on that information. As another example, the original information for generating the first master image G1 may be stored in the first memory unit 114 of the first display device A1, and the first display device A1 may acquire the first master image G1 based on that information.

[0072] While the above describes screen sharing between the first display device A1 and the second display device A2, similar screen sharing may also be applied to the combination of the first display device A1 and the third display device A3. In this case, for example, the first display device A1 acts as the master and the third display device A3 acts as the slave. Generally, similar operations are performed by the third display device A3 and the third user E3 instead of the second display device A2 and the second user E2. However, in this embodiment, the second display device A2 is a projector, whereas the third display device A3 is a tablet terminal, and operations may differ due to these differences.

[0073] Furthermore, a configuration example of the display method and display system 1 according to this embodiment will be described. Changing of the master area in response to rotation of the screen of the sharing source device will be described with reference to FIGS. 10A and 10B. FIG. 10A is a diagram showing an example of the configuration of the master area before change according to the embodiment. FIG. 10B is a diagram showing an example of the configuration of the master area after the change according to the embodiment. For convenience of explanation, FIGS. 10A and 10B show an XY Cartesian coordinate system, similar to the case of FIG.

[0074] 10A shows a 1a master area F1a in a sharing source device, a 1a area H1a corresponding to the screen of the sharing source device, and a 2a area H2a corresponding to the screen of the sharing destination device. Note that the 1a master area F1a, 1a area H1a, and 2a area H2a in the example of Fig. 10A are similar to, for example, the first master area F1, first area H1, and second area H2 shown in Fig. 7. In the example of Figure 10A, as in the example of Figure 7, the 2a region H2a overlaps with the 1a master region F1a, but for ease of explanation, they are shown slightly offset to make them easier to see. In the example of FIG. 10A, the upper and lower sides of the 1a region H1a overlap with the 1a master region F1a.

[0075] FIG. 10B shows a 1b master area F1b on the sharing source device, a 1b area H1b corresponding to the screen of the sharing source device, and a 2b area H2b corresponding to the screen of the sharing destination device. In the example of FIG. 10B, the 1b region H1b and the 2b region H2b overlap with the 1b master region F1b, but for ease of explanation, they are shown slightly shifted from each other to make them easier to see.

[0076] For example, it is assumed that the sharing source device is a first display device A1, which is a smartphone, and has a screen rotation function. The first image processor 116 of the first display device A1 has a screen rotation function that rotates the first image C1 displayed on the first display screen B1 in response to an operation by the first user E1. The operation may be, for example, an operation of inputting a predetermined instruction via a touch panel, or an operation of changing the orientation of the housing of the first display device A1 so as to rotate the first image C1 in a predetermined direction. The screen rotation function has the ability to switch between displaying four types of images rotated in 90-degree increments, such as 0 degrees, 90 degrees, 180 degrees, and 270 degrees, with the center point of the first image C1 as the reference point.

[0077] As a specific example, it is assumed that a so-called vertically long image is displayed on the first display device A1, which is the sharing source device, and that the configuration of the 1a master area F1a shown in FIG. 10A is used. At this time, when the screen of the first display device A1 is rotated by 90 degrees to display a so-called landscape image, the configuration of the 1b master area F1b shown in FIG. 10B is switched to be used. This switching is performed, for example, by the first image processing unit 116. When switching from the configuration of the 1a master area F1a to the configuration of the 1b master area F1b, the first image processing unit 116 accesses the server device D1 as necessary to update the master image. Here, if the portrait image and landscape image are rectangular rather than square, the aspect ratio of the portrait image and the aspect ratio of the landscape image differ, and the master image is updated.

[0078] Similarly, when the first display device A1 switches from displaying a landscape image to displaying a portrait image, the first image processing unit 116 accesses the server device D1 as necessary to update the master image when switching from the configuration of the 1b master area F1b to the configuration of the 1a master area F1a.

[0079] Changing of the master area in response to rotation of the screen of the sharing destination device will be described with reference to FIGS. 11A and 11B. FIG. 11A is a diagram showing an example of the configuration of the master area before change according to the embodiment. FIG. 11B is a diagram showing an example of the configuration of the master area after the change according to the embodiment. For convenience of explanation, FIGS. 11A and 11B show an XY Cartesian coordinate system, similar to the case of FIG.

[0080] FIG. 11A shows a 1c master area F1c in the sharing source device, a 1c area H1c corresponding to the screen of the sharing source device, and a 2c area H2c corresponding to the screen of the sharing destination device. In the example of FIG. 11A, the 2c region H2c overlaps with the 1c master region F1c, but for ease of explanation, they are shown slightly offset from each other to make them easier to see. In the example of FIG. 11A, the upper and lower sides that are part of the 1c region H1c overlap with the 1c master region F1c.

[0081] FIG. 11B shows a 1d master area F1d in the sharing source device, a 1d area H1d corresponding to the screen of the sharing source device, and a 2d area H2d corresponding to the screen of the sharing destination device. In the example of FIG. 11B, the 2d region H2d overlaps with the 1d master region F1d, but for ease of explanation, they are shown slightly offset from each other to make them easier to see. In the example of FIG. 11B, the upper and lower sides, which are part of the 1d region H1d, overlap with the 1d master region F1d.

[0082] Here, the examples of Figures 11A and 11B show a case where the aspect ratio of at least one of the screen of the sharing device and the screen of the sharing device is different from the corresponding aspect ratio in the examples of Figures 10A and 10B. The aspect ratio in this example is an example to show a case different from the examples in FIGS. 10A and 10B.

[0083] For example, it is assumed that the sharing destination device is a third display device A3, which is a tablet terminal, and has a screen rotation function. The third image processor 136 of the third display device A3 has a screen rotation function that rotates the third image C3 displayed on the third display screen B3 in response to an operation by the third user E3. The operation may be, for example, an operation of inputting a predetermined instruction via a touch panel, or an operation of changing the orientation of the housing of the third display device A3 so as to rotate the third image C3 in a predetermined direction. The screen rotation function has the ability to switch between displaying four types of images rotated in 90-degree increments, such as 0 degrees, 90 degrees, 180 degrees, and 270 degrees, with the center point of the third image C3 as the reference point.

[0084] As a specific example, it is assumed that a so-called landscape image is displayed on the third display device A3, which is a sharing device, and that the configuration of the 1c master area F1c shown in FIG. 11A is used. At this time, when the screen is rotated by 90 degrees on the third display device A3 to display a so-called vertically long image, the configuration of the 1d master region F1d shown in FIG. 11B is switched to be used. This switching is performed, for example, by the first image processing unit 116 of the first display device A1, after the third image processing unit 136 of the third display device A3 notifies the first image processing unit 116. When switching from the configuration of the 1c master region F1c to the configuration of the 1d master region F1d, the first image processing unit 116 accesses the server device D1 as necessary to update the master image. Here, if the portrait image and landscape image are rectangular and not square, the aspect ratio of the portrait image and the aspect ratio of the landscape image differ, and the master image is updated accordingly.

[0085] Similarly, when the third display device A3 switches from displaying a portrait image to displaying a landscape image, the first image processing unit 116 accesses the server device D1 as necessary to update the master image when switching from the configuration of the 1d master area F1d to the configuration of the 1c master area F1c.

[0086] 10A and 12, an example is shown in which the aspect ratio of the master region matches the aspect ratio of the screen of the sharing destination device. In the example of FIG. 10A, the aspect ratio of the 1a master region F1a matches the aspect ratio of the 2a region H2a.

[0087] FIG. 12 is a diagram illustrating an example of the configuration of the master area according to the embodiment. For convenience of explanation, FIG. 12 shows an XY Cartesian coordinate system, similar to FIG.

[0088] FIG. 12 shows a 1e master area F1e in the sharing source device, a 1e area H1e corresponding to the screen of the sharing source device, and a 2e area H2e corresponding to the screen of the sharing destination device. In the example of FIG. 12, the 2e region H2e overlaps with the 1e master region F1e, but for the sake of convenience in explanation, they are shown slightly offset from each other to make them easier to see. In the example of FIG. 12, the lower side, which is part of the 1e region H1e, overlaps with the 1e master region F1e.

[0089] In the example of FIG. 12, the aspect ratio of the 1e master region F1e matches the aspect ratio of the 2e region H2e. In the example of FIG. 12, the aspect ratio of the 1e region H1e is different from that in the example of FIG. 10A.

[0090] Referring to FIG. 10A, an example is shown in which the vertical length of the first region is longer than the horizontal length of the first region and the vertical length of the first region matches the vertical length of the second region. In the example of FIG. 10A, the length of the 1a region H1a in the vertical direction is longer than the length of the 1a region H1a in the horizontal direction. In the example of FIG. 10A, the length in the vertical direction of the 1a region H1a coincides with the length in the vertical direction of the 2a region H2a.

[0091] Referring to FIG. 13, an example is shown in which the horizontal length of the second region is the same as the horizontal length of the master region, and the vertical length of the second region is shorter than the vertical length of the master region. FIG. 13 is a diagram illustrating an example of the configuration of the master area according to the embodiment. For convenience of explanation, FIG. 13 shows an XY Cartesian coordinate system, similar to FIG.

[0092] FIG. 13 shows a 1f master area F1f in the sharing source device, a 1f area H1f corresponding to the screen of the sharing source device, and a 2f area H2f corresponding to the screen of the sharing destination device. In the example of FIG. 13, the horizontal length of the 2f region H2f coincides with the horizontal length of the 1f master region F1f. In the example of FIG. 13, the vertical length of the 2f region H2f is shorter than the vertical length of the 1f master region F1f. In the example of FIG. 13, the upper and lower sides, which are part of the 1f region H1f, overlap with the 1f master region F1f. In the example of FIG. 13, the left and right sides of the 2f region H2f overlap with the 1f master region F1f.

[0093] A case where the center of the first area on the screen of the sharing device does not match the center of the second area on the screen of the sharing device will be described with reference to FIGS. 14A and 14B. 14A and 14B are diagrams each showing an example of the configuration of a master area according to an embodiment. For convenience of explanation, FIGS. 14A and 14B show an XY Cartesian coordinate system, similar to the case of FIG.

[0094] FIG. 14A shows a 1g master area F1g in the sharing source device, a 1g area H1g corresponding to the screen of the sharing source device, and a 2g area H2g corresponding to the screen of the sharing destination device. Moreover, Fig. 14B shows a state in which the 1g region H1g has been moved from the state shown in Fig. 14A. In the example of Fig. 14B, the 1h region H1h represents the region after the 1g region H1g shown in Fig. 14A has been moved. In the examples of FIGS. 14A and 14B, the 2g region H2g overlaps with the 1g master region F1g, ​​but for ease of explanation, they are shown slightly offset from each other to make them easier to see. In the example of FIGS. 14A and 14B, the upper and lower sides that are part of the 1g region H1g and the upper and lower sides that are part of the 1h region H1h overlap with the 1g master region F1g.

[0095] Now, with reference to Figures 15A, 15B and 15C, examples of region centers are shown. FIG. 15A is a diagram illustrating an example of the center of a region according to the embodiment. In the example of FIG. 15A, the intersection of two diagonals of the rectangular eleventh region H11 is defined as the first center point 411. For convenience of explanation, these two diagonal lines are also shown in FIG. 15A.

[0096] FIG. 15B is a diagram illustrating an example of the center of the region according to the embodiment. In the example of FIG. 15B, for the rectangular twelfth region H12, a line parallel to the vertical direction that is drawn so as to divide the horizontal width into two equal parts is defined as the first center line 421.

[0097] FIG. 15C is a diagram illustrating an example of the center of the region according to the embodiment. In the example of FIG. 15C, for a rectangular thirteenth region H13, a line parallel to the horizontal direction that is drawn so as to divide the vertical height into two equal parts is defined as a second center line 431.

[0098] In the example of Figure 14A, if the center point as shown in Figure 15A or the center line as shown in Figure 15B or Figure 15C is used as the center reference, the centers of the first g region H1g and the second g region H2g do not coincide with each other. Similarly, in the example of Figure 14B, if the center point as shown in Figure 15A or the center line as shown in Figure 15B or Figure 15C is used as the center reference, the centers of the 1h region H1h and the 2g region H2g do not coincide with each other.

[0099] Furthermore, if we consider the case where the 1g region H1g moves in the positive direction of the X-axis from the state shown in Figure 14A to become the 1h region H1h shown in Figure 14B, it is possible that at some stage during the movement, the center of the moving 1g region H1g will overlap and coincide with the center of the 2g region H2g.

[0100] The display method of this embodiment involves acquiring a first master image G1, acquiring a first aspect ratio of a first display screen B1 of a first display device A1, setting a first region H1 in a first master region F1 of the first master image G1 based on the first aspect ratio, and displaying a first image C1 on the first display screen B1 in which the image portion inside the first region H1 in the first master image G1 has been cropped. In addition, the display method of this embodiment includes obtaining a second aspect ratio of a second display screen B2 of a second display device A2 different from the first display device A1, setting a second region H2 in the first master region F1 based on the second aspect ratio, the second region H2 having an overlapping region that overlaps with the first region H1 and a non-overlapping region that does not overlap with the first region H1 in at least one of a first direction or a second direction that are perpendicular to each other in the first master region F1, and displaying a second image C2 on the second display screen B2, in which the image portion inside the second region H2 in the first master image G1 has been cropped.

[0101] Therefore, in the display method of this embodiment, for example, instead of generating a second image from a first image, by generating a first image C1 and a second image C2 from a first master image G1, it is possible to display images that match the aspect ratios of the first display screen B1 and the second display screen B2, and it is possible to prevent, for example, both sides of the second image from becoming black images. Here, in the example of FIG. 7, the first direction is a direction parallel to the Y axis, and the second direction is a direction parallel to the X axis.

[0102] Note that, here, the example is explained using a case where the sharing source device is the first display device A1 and the sharing destination device is the second display device A2, but the same effect can be obtained, for example, when the sharing destination device is the third display device A3, except for the difference that the second display device A2 is a projector and the third display device A3 is a tablet terminal.

[0103] In one example configuration of the display method according to this embodiment, first rotation information of the first display screen B1 of the first display device A1 is acquired, and a first aspect ratio is acquired based on the first rotation information. Therefore, in the display method according to this embodiment, it is possible to display images that match the aspect ratios of the first display screen B1 and the second display screen B2 based on the screen rotation function of the first display device A1. Here, the first rotation information is information about the screen being rotated by the screen rotation function of the first display device A1, and includes, for example, the amount of rotation, such as the rotation angle. When the first display screen B1 of the first display device A1 is rotated, the first aspect ratio is changed, and therefore the master image, the first region, and the second region may change. However, such a configuration does not necessarily have to be used.

[0104] In one example configuration of the display method according to this embodiment, second rotation information for the second display screen B2 of the second display device A2 is acquired, and a second aspect ratio is acquired based on the second rotation information. Therefore, in the display method according to this embodiment, it is possible to display images that match the aspect ratios of the first display screen B1 and the second display screen B2 based on the screen rotation function of the second display device A2. Here, the second rotation information is information about the screen being rotated by the screen rotation function of the second display device A2, and includes, for example, the amount of rotation, such as the rotation angle. When the second display screen B2 of the second display device A2 is rotated, the second aspect ratio is changed, and therefore the master image, the first region, and the second region may change. However, such a configuration does not necessarily have to be used.

[0105] In the display method according to the present embodiment, as one configuration example, the aspect ratio of the first master image G1 is the same as the second aspect ratio. Therefore, in the display method according to this embodiment, when acquiring the first master image G1, the amount of data to be acquired is kept to a minimum. However, such a configuration does not necessarily have to be used.

[0106] In the display method according to this embodiment, as one configuration example, the length in the first direction of the first region H1 is greater than the length in the second direction of the first region H1, and the length in the first direction of the first region H1 is the same as the length in the first direction of the second region. Therefore, in the display method according to this embodiment, the image displayed on the first display screen B1 can be displayed to the maximum extent on the second display screen B2, and the display area of ​​the second display screen B2 can be utilized to the maximum extent. However, such a configuration does not necessarily have to be used.

[0107] In the display method according to this embodiment, as one configuration example, the length in the second direction of the second region H2 is the same as the length in the second direction of the first master region F1, and the length in the first direction of the second region H2 is smaller than the length in the first direction of the first master region F1. Therefore, with the display method according to this embodiment, it is possible to optimally display an image that is desired to be displayed in accordance with each aspect ratio. However, such a configuration does not necessarily have to be used.

[0108] In the display method according to the present embodiment, as one configuration example, the center of the first region H1 does not coincide with the center of the second region H2. Therefore, in the display method according to this embodiment, any range within the first master image G1 can be displayed on a predetermined screen, which may be, for example, the screen of a smartphone. However, such a configuration does not necessarily have to be used.

[0109] The display system 1 according to this embodiment can realize processing corresponding to various configurations of the display method according to this embodiment. As an example configuration, a display system 1 according to this embodiment includes a first display device A1 and a second display device A2. The first display device A1 acquires a first master image G1, acquires a first aspect ratio of the first display screen B1 of the first display device A1, sets a first area H1 in the first master area F1 of the first master image G1 based on the first aspect ratio, and displays a first image C1 on the first display screen B1 in which the image portion inside the first area H1 in the first master image G1 has been trimmed. The first display device A1 or the second display device A2 acquires a second aspect ratio of the second display screen B2 of the second display device A2, and based on the second aspect ratio, sets a second region H2 in the first master region F1, which has an overlapping region that overlaps with the first region H1 and a non-overlapping region that does not overlap with the first region H1 in at least one of a first direction or a second direction that are perpendicular to each other in the first master region F1. The second display device A2 displays a second image C2 on the second display screen B2, which is obtained by trimming the image portion inside the second region H2 of the first master image G1.

[0110] Therefore, in the display system 1 of this embodiment, for example, instead of generating a second image from a first image, by generating a first image C1 and a second image C2 from a first master image G1, it is possible to display images that match the aspect ratios of the first display screen B1 and the second display screen B2, and it is possible to prevent, for example, both sides of the second image from becoming black images. Here, the acquisition of the second aspect ratio and the setting of the second region H2 based on the second aspect ratio may be performed by, for example, the first display device A1, or may be performed by the second display device A2.

[0111] A program for implementing the functions of any of the components of any of the above-described devices may be recorded on a computer-readable recording medium and loaded into a computer system for execution. Here, "computer system" includes hardware such as an operating system or peripheral devices. "Computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs (Read Only Memory), and CDs (Compact Discs)-ROMs, as well as storage devices such as hard disks built into computer systems. "Computer-readable recording medium" also includes devices that retain a program for a certain period of time, such as volatile memory within a computer system that acts as a server or client when a program is transmitted over a network such as the Internet or a communication line such as a telephone line. Such volatile memory may be RAM. The recording medium may also be non-transitory.

[0112] The above program may be transmitted from a computer system that stores the program in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. The "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network such as the Internet or a communication line such as a telephone line. The above program may be for realizing some of the above functions. The above program may be a so-called differential file that can realize the above functions in combination with a program already recorded in a computer system. The differential file may also be called a differential program.

[0113] The functions of any of the components in any of the above-described devices may be implemented by a processor. Each process in the embodiments may be implemented by a processor operating based on information such as a program and a computer-readable recording medium storing information such as the program. The functions of each unit of the processor may be implemented by separate hardware, or may be implemented by integrated hardware. The processor includes hardware, and the hardware may include at least one of a circuit for processing digital signals and a circuit for processing analog signals. The processor may be configured using one or more circuit devices mounted on a circuit board, or one or both of one or more circuit elements. An integrated circuit (IC) or the like may be used as the circuit device, and a resistor or a capacitor may be used as the circuit element.

[0114] The processor may be a CPU. However, the processor is not limited to a CPU, and various types of processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) may be used. The processor may be a hardware circuit using an ASIC (Application Specific Integrated Circuit). The processor may be configured with multiple CPUs, or may be configured with a hardware circuit using multiple ASICs. The processor may be configured with a combination of multiple CPUs and a hardware circuit using multiple ASICs. The processor may include one or more of an amplifier circuit or a filter circuit that processes analog signals.

[0115] Although the embodiments have been described above in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and includes designs within the scope of the gist of this disclosure.

[0116] Summary of this disclosure A summary of this disclosure is provided below. (Appendix 1) acquiring a master image; obtaining a first aspect ratio of a first display screen of a first display device; setting a first area in a master area of ​​the master image based on the first aspect ratio; displaying a first image on the first display screen, the first image being obtained by trimming an image portion inside the first region in the master image; acquiring a second aspect ratio of a second display screen of a second display device different from the first display device; setting, in the master region, a second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region, based on the second aspect ratio; displaying a second image on the second display screen, the second image being obtained by trimming the image portion inside the second region of the master image; Display method. This makes it possible to display images that match the aspect ratios of the first and second display screens, for example, by generating the first and second images from a master image rather than generating the second image from the first image, thereby preventing both sides of the second image from becoming black.

[0117] (Appendix 2) obtaining first rotation information of the first display screen of the first display device; obtaining the first aspect ratio based on the first rotation information; (Appendix 1) Display method. This makes it possible to display images that match the aspect ratios of the first and second display screens based on the screen rotation function of the first display device.

[0118] (Appendix 3) obtaining second rotation information of the second display screen of the second display device; obtaining the second aspect ratio based on the second rotation information; How to display (Appendix 1) or (Appendix 2). This makes it possible to display images that match the aspect ratios of the first and second display screens based on the screen rotation function of the second display device.

[0119] (Appendix 4) The aspect ratio of the master image is the same as the second aspect ratio. Display method: either (Appendix 1) or (Appendix 3). This minimizes the amount of data that needs to be acquired when acquiring a master image.

[0120] (Appendix 5) The length of the first region in the first direction is greater than the length of the first region in the second direction, The length of the first region in the first direction is the same as the length of the second region in the first direction. (Appendix 4) Display method. This allows the image displayed on the first display screen to be displayed to the maximum extent on the second display screen, while making the most of the display area of ​​the second display screen.

[0121] (Appendix 6) the length of the second region in the second direction is the same as the length of the master region in the second direction; The length of the second region in the first direction is smaller than the length of the master region in the first direction. Display method: either (Appendix 1) or (Appendix 3). This allows you to optimally display the image you want to display according to each aspect ratio.

[0122] (Appendix 7) The center of the first region does not coincide with the center of the second region. Display method: either (Appendix 1) to (Appendix 6). This allows any desired range within the master image to be displayed on a predetermined screen of a smartphone or the like.

[0123] (Appendix 8) A first display device and a second display device are provided, The first display device is Acquire a master image, obtaining a first aspect ratio of a first display screen of the first display device; setting a first area in a master area of ​​the master image based on the first aspect ratio; displaying a first image on the first display screen, the first image being obtained by trimming an image portion inside the first region of the master image; The first display device or the second display device is obtaining a second aspect ratio of a second display screen of the second display device; based on the second aspect ratio, a second region is set in the master region, the second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region; The second display device is a second image obtained by trimming the image portion inside the second region of the master image is displayed on the second display screen; Display system. This makes it possible to display images that match the aspect ratios of the first and second display screens, for example, by generating the first and second images from a master image rather than generating the second image from the first image, thereby preventing both sides of the second image from becoming black. [Explanation of symbols]

[0124] 1...display system, 111...first input unit, 112...first output unit, 113...first communication unit, 114...first memory unit, 115...first control unit, 116...first image processing unit, 117...first display unit, 121...second input unit, 122...second output unit, 123...second communication unit, 124...second memory unit, 125...second control unit, 126...second image processing unit, 127...second display unit, 131...third input unit, 132...third output unit, 133...third communication unit, 134...third memory unit, 135...third control unit, 136...third Image processing unit, 137...third display unit, 141...input unit, 142...output unit, 143...communication unit, 144...storage unit, 145...control unit, 146...service provision processing unit, 211...map information, 221...provision range, 311...master layer, 411...first center point, 421...first center line, 431...second center line, 1011...source image to be shared, 1021...destination image to be shared, 1111...clip-out area, A1...first display device, A2...second display device, A3...third display device, B1...first display screen, B2...second Display screen, B3...third display screen, C1...first image, C2...second image, C3...third image, D1...server device, E1...first user, E2...second user, E3...third user, F1...first master area, F1a...first a master area, F1b...first b master area, F1c...first c master area, F1d...first d master area, F1e...first e master area, F1f...first f master area, F1g...first g master area, F1h...first h master area, G1...first square ter image, H1...1st area, H1a...1a area, H1b...1b area, H1c...1c area, H1d...1d area, H1e...1e area, H1f...1f area, H1g...1g area, H1h...1h area, H2...2nd area, H2a... 2nd a area, H2b...2nd b area, H2c...2c area, H2d...2d area, H2e...2nd e area, H2f...2f area, H2g...2g area, H2h...2h area, H11...11th area, H12...12th area, H13...13th area

Claims

1. acquiring a master image; obtaining a first aspect ratio of a first display screen of a first display device; setting a first area in a master area of ​​the master image based on the first aspect ratio; displaying a first image on the first display screen, the first image being obtained by trimming an image portion inside the first region of the master image; acquiring a second aspect ratio of a second display screen of a second display device different from the first display device; setting, in the master region, a second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region, based on the second aspect ratio; displaying a second image on the second display screen, the second image being obtained by trimming an image portion inside the second region of the master image; Display method.

2. acquiring first rotation information of the first display screen of the first display device; obtaining the first aspect ratio based on the first rotation information; The display method according to claim 1, further comprising:

3. acquiring second rotation information of the second display screen of the second display device; obtaining the second aspect ratio based on the second rotation information; The display method according to claim 1, further comprising:

4. the aspect ratio of the master image is the same as the second aspect ratio; The display method according to claim 1 .

5. a length of the first region in the first direction is greater than a length of the first region in the second direction; The length of the first region in the first direction is the same as the length of the second region in the first direction. The display method according to claim 4.

6. a length of the second region in the second direction is the same as a length of the master region in the second direction; a length of the second region in the first direction being smaller than a length of the master region in the first direction; The display method according to claim 1 .

7. The center of the first region does not coincide with the center of the second region. The display method according to claim 1 .

8. A first display device and a second display device are provided, The first display device is Acquire a master image, obtaining a first aspect ratio of a first display screen of the first display device; setting a first area in a master area of ​​the master image based on the first aspect ratio; displaying a first image on the first display screen, the first image being obtained by trimming an image portion inside the first region of the master image; The first display device or the second display device is obtaining a second aspect ratio of a second display screen of the second display device; based on the second aspect ratio, a second region is set in the master region, the second region having an overlapping region that overlaps with the first region and a non-overlapping region that does not overlap with the first region in at least one of a first direction and a second direction that are orthogonal to each other in the master region; The second display device is a second image obtained by trimming the image portion inside the second region of the master image is displayed on the second display screen; Display system.

Images