Wearable terminal, linkage display system and linkage display method

Abstract

When a control signal is transmitted from the wearable terminal to the non-wearable terminal on the basis of the location-related information and the information-leakage-medium-related information, the control signal causes the display data displayed on the display of the non-wearable terminal to be non-displayed. Display data is set to be non-display in a display of a non-wearable terminal, and the display data is transmitted to a wearable terminal. Upon receiving the display data from the non-wearable terminal, the wearable terminal displays the display data on a display provided in the wearable terminal.

Description

Technical Field

[0001] The present invention relates to a wearable terminal, a linkage display system and a linkage display method, and in particular to a display technology for linking a wearable display terminal and a non-wearable display terminal. Background Art

[0002] As a linked display system using multiple displays, Patent Document 1 states that "a first device combined with a first display and an image sensor receives output data from a second device having a second display different from the first display. The output data represents content that can be displayed by the second device on the second display. The first device uses the image sensor to determine the position of the second display relative to the first device, and causes the first display to display content based on the output data received from the second device and the determined position of the second display relative to the first device. (Abstract excerpt)".

[0003] Prior art literature

[0004] Patent Document 1: Japanese Patent Application No. 2020-536311 Summary of the invention

[0005] Regarding the screen of a display provided on a non-wearable terminal such as a desktop personal computer, a notebook personal computer, or a tablet, a person other than the user of the non-wearable terminal can peek at the screen. Although there is an anti-peeping filter for preventing peeping, the information on the screen can be read through the filter depending on the angle of the peeping screen, so there is a need to effectively prevent information leakage.

[0006] Therefore, although the display technology of Patent Document 1 is also considered, in Patent Document 1, when the user arbitrarily selects or determines that the HMD is used to view the PC or portable terminal, the image of the screen of the PC or portable terminal is simply replaced by the screen of the HMD in a manner that matches the screen position of the PC or portable terminal, and the view of preventing information leakage according to the location where the user uses a non-wearable terminal such as a PC or the surrounding conditions is not considered. Therefore, security cannot be maintained by simply displaying the output data of the first device on the second device.

[0007] The present invention is completed in view of the above-mentioned points, and its purpose is to inhibit others from peeping at the screen and improve the security of information.

[0008] In order to solve the above-mentioned problems, the present invention has the structures described in the claims.

[0009] According to the present invention, it is possible to prevent others from peeping at the screen and improve the security of information. Other objects, structures, and effects than those described above will become clear from the following embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1A It is a schematic structural diagram of an alternative display system involved in this embodiment.

[0011] Figure 1B This is a schematic diagram of the structure of a non-wearable terminal.

[0012] Figure 2 The following are appearance diagrams of wearable terminals, where (a) shows the HMD and (b) shows the AR glasses.

[0013] Figure 3 It is a functional block diagram of a replacement display system.

[0014] Figure 4 The diagram shows the field of view of others and the user in an alternative display when a notebook personal computer is used as a non-wearable terminal.

[0015] Figure 5 The diagram shows the field of view of others and the user in an alternative display when a desktop personal computer is used as a non-wearable terminal.

[0016] Figure 6 This is a diagram showing the field of view of others and the user in an alternative display when the portable terminal is used as a non-wearable terminal.

[0017] Figure 7 The figures are figures showing examples of alternative display control using location information of the place and information related to the surrounding environment as a basis for information related to the place, wherein (a) shows an example of use in a non-private office space, (b) shows an example of use in one's own room, and (c) shows an example of use in an office.

[0018] Figure 8 This is a modification example of alternative display control that uses location information of a place and information about a surrounding environment as information about a place, and is a diagram showing an alternative display control example corresponding to the presence or absence of an obstruction.

[0019] Fig. 9 1 and 10 are diagrams showing an example of alternative display control corresponding to the height of an obstruction. (a) shows a case where the obstruction is not high enough, and (b) shows the field of view of the user.

[0020] Fig.10 The figures show an example of alternative display control according to the depth of an obstruction, wherein (a) shows a case where the obstruction does not extend to the front, and (b) shows the field of view of the user.

[0021] Fig.11The figures show examples of alternative display control in a space where a surveillance camera is installed as an information leakage medium. (a) is an example in which alternative display is performed, and (b) is an example in which alternative display is not performed.

[0022] Fig.12 is shown in Fig.11 This diagram shows a situation where no surveillance camera is installed in the same space.

[0023] Fig.13 This is a diagram showing an alternative display control example in which a person other than the user is used as a reference as an information leakage medium.

[0024] Fig.14 1 and 2 are diagrams showing examples of alternative display control when another person is present at a location farther than a first distance. (a) is an example in which alternative display is performed, and (b) is an example in which alternative display is not performed.

[0025] Fig.15 This is a diagram showing an example in which another person exists at a location farther than the first distance and no alternative display is performed.

[0026] Fig.16 An example of a user setting screen for an alternative display function is shown.

[0027] Fig.17 This is the user setting screen for the detailed alternative display function.

[0028] Fig.18 This is the affiliation information registration setting screen.

[0029] Fig.19 It is a diagram showing an example of alternative display control rule information.

[0030] Fig. 20 This is a flowchart (first half) showing the flow of processing of the alternative display system according to the present embodiment.

[0031] Fig.21 This is a flowchart (second half) showing the flow of processing of the alternative display system according to the present embodiment.

[0032] Fig. 22 The flowchart shows the flow of processing of alternative display control based on location information of the place and information about the surrounding environment as information about the place.

[0033] Fig.23 This is a flowchart showing the flow of processing of alternative display control using a surveillance camera as a medium for information leakage.

[0034] Fig.24This is a flowchart showing the flow of processing of alternative display control using a person other than the user as a medium of information leakage as a reference.

[0035] Fig.25 This is a flowchart showing the flow of processing for alternative display control based on the affiliation of a character.

[0036] Fig.26 This is a flowchart showing the flow of processing for alternative display control based on the affiliation of a character. DETAILED DESCRIPTION

[0037] The present invention helps prevent the leakage of information displayed on a non-wearable terminal, so the commodity value of the non-wearable terminal to which the present invention is applied can be increased. Therefore, it can be expected to contribute to 8.2 of the Sustainable Development Goals (SDGs) advocated by the United Nations (focusing on industries that further increase the value of goods and services and labor-intensive industries, and improving economic productivity through diversification, technological improvement, and innovation).

[0038] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In all the drawings, the same components are denoted by the same reference numerals, and repeated descriptions are omitted.

[0039] (Schematic structure of the alternative display system)

[0040] Figure 1A It is a schematic structural diagram of an alternative display system involved in this embodiment. Figure 1B This is a schematic diagram of the structure of a non-wearable terminal. Figure 2 The following are appearance diagrams of wearable terminals, where (a) shows the HMD and (b) shows the AR glasses.

[0041] Figure 1A The alternative display system 10 shown is constituted by wirelessly connecting a wearable terminal 1 and a non-wearable terminal 2. In the wireless communication connection, for example, the wearable terminal 1 and the non-wearable terminal 2 may be directly connected using short-range wireless communication such as Bluetooth (registered trademark in Japan), or may be indirectly connected via a LAN.

[0042] The wearable terminal 1 used in the alternative display system 10 may be a terminal that allows only a user wearing the wearable terminal 1 to visually recognize the screen of the wearable terminal. Figure 2 HMD 100 shown in (a), Figure 2 AR glasses 100s shown in (b).

[0043] Returning to Figure 1, the wearable terminal 1 has a processor 101 (equivalent to the first processor), a memory 102, a storage device 103, an operation input interface 104, a camera 106, a positioning sensor 107, a distance measuring sensor 108, an acceleration sensor 109, a gyroscope sensor 110, a geomagnetic sensor 111, a display 112 (equivalent to the first display), a microphone 113, a speaker 114, a timer 115, a network communicator 116, and a BT communicator 117 (BT: Bluetooth (registered trademark in Japan)), which are interconnected via a bus 118.

[0044] The storage device 103 stores the alternative display program 120 , and the processor 101 expands and stores the alternative display program 120 in the memory 102 , and executes the alternative display program 120 .

[0045] The storage device 103 stores data 130 generated by the process of executing the alternative display program 120 and the result thereof. The data 130 includes location information 131, information leakage medium information 132, and alternative display control information 133. Fig.16 )、User setting screen 410( Fig.17 (a)) and the belonging information registration setting screen 420 ( Fig.17 (b)) and the belonging information details screen 430 ( Fig.18 ), input location information 131, information leakage medium information 132 and alternative display control information 133 respectively.

[0046] The distance measuring sensor 108 is a sensor that outputs distance information to a real object that is a measurement target. For example, it may be a sensor that calculates the distance using an image with parallax such as a stereo camera for feature points such as the contour of a real object and outputs the distance information. In addition, it may be a sensor that measures the distance by irradiating light two-dimensionally to a measurement target such as a TOF (Time of Flight) method.

[0047] The network communicator 116 is a communicator that realizes a communication function using wireless communication using the Wi-Fi (Japanese registered trademark) standard, etc. The network communicator 116 may be communicatively connected to the server 4 via a LAN or the external network 5. The update program may be downloaded from the server 4.

[0048] The BT communicator 117 is a communicator using Bluetooth (a registered trademark in Japan) and performs short-range wireless communication with a non-wearable terminal 2 that performs alternative display processing, such as a personal computer (including a notebook personal computer and a desktop personal computer) or a portable terminal (including a smartphone and a tablet).

[0049] The display 112 is a transmissive display, and the user visually recognizes the virtual reality object displayed on the display 112 by superimposing it on the real world that the user visually recognizes through the display 112.

[0050] The non-wearable terminal 2 is a terminal whose screen can be visually recognized by a person other than the user of the wearable terminal 1 , and is, for example, a desktop personal computer connected to a monitor, a notebook personal computer, a smartphone, or a tablet.

[0051] like Figure 1B As shown, the non-wearable terminal 2 has a processor 201 (equivalent to the second processor), a memory 202, a storage device 203, an operation input interface 204, a camera 206, a display 212 (equivalent to the second display), a network communicator 216, and a BT communicator 217, which are interconnected via a bus 218.

[0052] When a smartphone or tablet is used as the non-wearable terminal 2, it has a distance sensor, a positioning sensor, etc. in addition to the above structure. However, the non-wearable terminal 2 used in the replacement display system 10 does not necessarily need to have a distance sensor or a positioning sensor. Figure 1B Omitted in .

[0053] When a control signal is received from the wearable terminal 1 to make the display data currently displayed or displayed from now on in the display 212 non-displayed, the non-display switching program 140 stored in the storage device 203 makes the display data currently displayed or displayed from now on in the display 212 non-displayed and sends the display data to the wearable terminal 1.

[0054] In this embodiment, the alternative display program 120 is installed in the wearable terminal 1, and the wearable terminal 1 determines whether the alternative display control is executed. The non-display switching program 140 installed in the non-wearable terminal 2 mainly executes the display control of making the display 212 of the non-wearable terminal 2 non-display according to the control signal from the wearable terminal 1.

[0055] Figure 3 It is a functional block diagram of a replacement display system.

[0056] The alternative display program 120 includes an image recognition unit 121 , an obstruction determination unit 122 , a non-display area determination unit 123 , an information leakage medium determination unit 124 , an alternative display control unit 125 , a display data receiving unit 126 , and a virtual reality object display unit 127 .

[0057] The image recognition unit 121 analyzes an image captured by the camera 106 or 206 mounted on the wearable terminal 1 or the non-wearable terminal 2 and performs subject recognition processing.

[0058] When an obstruction is captured as a subject, the obstruction determination unit 122 determines the height, arrangement position, opacity, etc. of the obstruction.

[0059] The non-display region determining unit 123 determines a non-display region corresponding to the obstruction based on the determination result of the obstruction determining unit 122 .

[0060] The information leakage medium determination unit 124 determines whether the subject corresponds to the information leakage medium.

[0061] The alternative display control unit 125 determines the start and end of the alternative display and whether or not alternative display control based on position information and image information is necessary.

[0062] The display data receiving unit 126 receives display data for alternative display from the non-wearable terminal 2 .

[0063] The virtual reality object display unit 127 detects the position of the display 212 of the non-wearable terminal 2 based on the image captured by the camera 106 of the wearable terminal 1, and displays the display data on the display 112 of the wearable terminal 1 in a manner overlapping the display 212 of the non-wearable terminal 2. Thus, the display data is displayed on the display 112 as a virtual reality object.

[0064] The non-display switching program 140 includes a display switching unit 141 and a display data transmitting unit 142 .

[0065] The display switching unit 141 switches non-display and display of the display 212 in accordance with a control signal instructing the start and end of the alternative display from the wearable terminal 1 .

[0066] The display data transmission unit 142 transmits display data for alternative display to the wearable terminal 1 .

[0067] (Comparison between other people's perspective and user's perspective)

[0068] Reference Figure 4 , Figure 5 , Figure 6 , illustrating the user's field of view in the replacement display. Figure 4 The diagram shows the field of view of others and the user in alternative display using a notebook personal computer.

[0069] Figure 5 The diagram shows the field of view of others and the user in an alternative display using a desktop personal computer. Figure 6This is a diagram showing the field of view of others and the user in alternative display using a portable terminal.

[0070] like Figure 4 As shown, in the alternative display, the display 212A of the notebook personal computer 2A becomes non-display, and the information that the user originally wants to visually recognize is not displayed. Therefore, in the field of vision seen by others, the display 212 of the notebook personal computer 2A is a non-display screen. The notebook personal computer 2A sends the display data 300 to be displayed on the display 212A to the wearable terminal 1.

[0071] The position of the display 212A is detected in the wearable terminal 1, and the display data 300 is displayed in the display 112 of the wearable terminal 1 in a manner superimposed on the position seen through the display 112 on the display 212A. Therefore, in the field of vision seen by the user wearing the wearable terminal 1, it looks like the display data 300 is displayed on the display 212A of the notebook personal computer 2A.

[0072] Figure 5 The figure shows a state where a desktop personal computer (not shown) and the wearable terminal 1 are communicatively connected, and the display 212B connected to the desktop personal computer is displayed instead of the wearable terminal 1 .

[0073] Figure 6 The state in which the portable terminal 2C and the wearable terminal 1 are communicatively connected and the display 212C of the portable terminal 2C is replaced by the display of the wearable terminal 1 is shown.

[0074] exist Figure 4 , Figure 5 , Figure 6 In any case, the display data 300 displayed on the display 112 of the wearable terminal 1 is overlapped on the display 212 of the non-wearable terminal 2 in the real world that is visually recognized through the display 112 of the wearable terminal 1, and is visually recognized by the user. On the other hand, the display 212 of the non-wearable terminal 2 becomes non-displayed, so that the display data 300 appears to be displayed on the display 212 of the non-wearable terminal 2 from the user's perspective, but the display data 300 cannot be seen from others.

[0075] (Alternative display control based on location information of a place and information related to the surrounding environment as information related to the place)

[0076] Figure 7 The figures are figures showing examples of alternative display control using location information of the place and information related to the surrounding environment as a basis for information related to the place, wherein (a) shows an example of use in a non-private office space, (b) shows an example of use in one's own room, and (c) shows an example of use in an office.

[0077] Figure 7 (a) is a usage example of a case where no prior registration is made, such as a non-private office space. In this case, an alternative display is performed.

[0078] Figure 7 (b) is an example of using it in your own room (which has been registered in advance). Figure 7 (c) is a usage example in an office (pre-registered). In a place where others do not enter or leave, such as one's own room, or in an office, the user has the same confidentiality obligation as the user, so it is considered that information security is high. Therefore, the location information of a place with high information security and an image representing the surrounding environment are obtained by using the positioning sensor 107 and the camera 106 and registered in advance, and the alternative display function is controlled not to work in the pre-registered place, and the alternative display function is controlled to work in the place that has not been registered in advance. As a result, as information related to the place, the alternative display function can be controlled based on the location information and image of the pre-registered place and the place where the user is currently located.

[0079] (Variation of alternative display control using location information of a place and information about surrounding environment as reference as information about a place: obstruction)

[0080] Figure 8 This is a variation of alternative display control that uses location information of a place and information about the surrounding environment as information about the place, and is a diagram showing an alternative display control example corresponding to the presence or absence of an obstruction to the non-wearable terminal 2 as information about the surrounding environment.

[0081] When there are non-transparent shielding objects 320, such as partitions or walls, on the left and right sides of the display 212 of the non-wearable terminal 2 used by the user, the display 212 of the non-wearable terminal 2 cannot be seen from adjacent seats (in Figure 8 In the figure, the display 212 of the non-wearable terminal 2 is shown in a manner that allows the user to know the state of the display 212, so the information security of the user's location is higher than when there is no partition or wall. Therefore, the image captured by the camera 106 of the wearable terminal 1 or the camera 206 of the non-wearable terminal 2 can also be analyzed to determine whether there is a partition. When it is determined that there is an obstruction 320 that prevents the display 212 from being viewed, control is performed so as not to perform alternative display.

[0082] Fig. 9 1 and 2 are diagrams showing an alternative display control example corresponding to the height of an obstruction relative to the non-wearable terminal 2. (a) shows a case where the obstruction is not high enough, and (b) shows the user's field of view. Fig.10The figure shows an alternative display control example corresponding to the depth of the obstruction relative to the non-wearable terminal 2, (a) shows the case where the obstruction does not extend to the front, and (b) shows the user's field of view. The area of ​​the display 212 visible from the outside changes according to the height and depth of the obstruction (in Fig. 9 and Fig.10 In the figure, it is illustrated in a manner that allows the display 212 of the non-wearable terminal 2 to be known in what state it is), so the information security of the location is different.

[0083] When the height of the non-transparent part of the shielding object 320a is low, the information security is higher than when there is no shielding object, but the information security is lower than when the shielding object is sufficiently high. In this case, the application screen related to the area where the display 212 of the non-wearable terminal 2 can be seen from the left and right can also be displayed alternatively. For example, in Fig. 9 In (a), the height of the shield 320a is lower than the upper end of the display 212 of the non-wearable terminal 2. Therefore, the application screen on the upper side of the half of the non-wearable terminal 2 is set to be non-displayed.

[0084] The display data 300 of the application screen set to non-display is sent to the wearable terminal 1 and displayed instead, so the user wearing the wearable terminal 1, such as Fig. 9 As shown in (b), the application screen displayed instead of the wearable terminal 1 is seen in an overlapping manner on the display 212 of the non-wearable terminal 2. On the other hand, the application screen 301 is displayed on the display 212 of the non-wearable terminal 2, so the application screen 301 is not displayed on the wearable terminal 1. The user visually recognizes the application screen 301 actually displayed on the display 212 of the non-wearable terminal 2 through the display 112 of the wearable terminal 1.

[0085] Fig.10 This is a diagram showing an alternative display control example corresponding to the size of the obstruction relative to the depth of the non-wearable terminal 2. Although the height of the partition as the obstruction 320b is equal to or higher than the upper end of the non-wearable terminal 2, the length in the depth direction is short, and the partition is not blocked from the front of the table to the center in the depth direction. Therefore, the lower left of the non-wearable terminal 2 can be blocked by the partition, so the alternative display is not performed and the application screen 301 is displayed, but the application screen above the half of the display 212 and the right side is displayed instead.

[0086] The display data 300 of the application screen set to non-display is sent to the wearable terminal 1 and displayed instead, so the user wearing the wearable terminal 1, such as Fig.10As shown in (b), the application screen displayed instead of the wearable terminal 1 is seen in an overlapping manner on the display 212 of the non-wearable terminal 2. On the other hand, the application screen 301 is displayed on the display 212 of the non-wearable terminal 2, so the application screen 301 is not displayed on the wearable terminal 1. The user visually recognizes the application screen 301 actually displayed on the display 212 of the non-wearable terminal 2 through the display 112 of the wearable terminal 1.

[0087] Thus, as information related to the surrounding environment of the place where the user operates the non-wearable terminal 2, alternative display control can be performed based on information related to the transparency and shape of the obstruction relative to the non-wearable terminal 2, and control can be performed in a manner that only the application screen across the partial area that is difficult to be obstructed in the display 212 of the non-wearable terminal 2 is displayed alternatively according to the transparency and shape of the obstruction. In the case where the image quality and other performance of the screen of the wearable terminal 1 such as HMD and AR glasses are inferior to those of the non-wearable terminal 2 such as PC, it may also become a reason that the user's usability of the non-wearable terminal 2 is hindered due to the alternative display. Therefore, by retaining only the necessary part of the area of ​​the screen for alternative display, it is possible to suppress the reduction of the user's usability of the non-wearable terminal 2 and improve information security.

[0088] (Alternative display control based on surveillance cameras as information leakage medium)

[0089] As information related to the information leakage medium, an alternative display control example corresponding to the presence or absence of a surveillance camera will be described. Fig.11 1 and 2 are diagrams showing examples of alternative display control in a space where a surveillance camera is installed. (a) is an example in which alternative display is performed, and (b) is an example in which alternative display is not performed. Fig.12 is shown in Fig.11 This diagram shows a situation where no surveillance camera is installed in the same space.

[0090] exist Fig.11 In both (a) and (b), a surveillance camera 350 is installed in the room of the user who operates the non-wearable terminal 2. The surveillance camera 350 is an example of an information leakage medium.

[0091] When the screen of the display 212 of the non-wearable terminal 2 enters the field of view of the monitoring camera 350, the display data displayed on the screen of the display 212 of the non-wearable terminal 2 is reflected in the image of the monitoring camera 350, resulting in information leakage.

[0092] Therefore, alternative display control may be performed according to the presence or absence of the surveillance camera 350 as the information related to the information leakage medium.

[0093] exist Fig.11 In (a), the monitoring camera 350 is captured in the camera image of the camera 206 mounted on the non-wearable terminal 2. Therefore, the screen of the display 212 of the non-wearable terminal 2 may be reflected in the image of the monitoring camera 350, so it is displayed instead. In addition, the camera 106 of the wearable terminal 1 can also be used for shooting. In this case, the relationship between the position and direction of the display 212 of the non-wearable terminal 2 and the monitoring camera 350 is analyzed based on the image captured by the camera 106 and the distance measurement result measured by the distance measurement sensor 108.

[0094] exist Fig.11 In (b), although the surveillance camera 350 is captured in the image captured by the camera 106 of the wearable terminal 1, the surveillance camera 350 is not captured in the image captured by the camera 206 mounted on the non-wearable terminal 2. Fig.11 In (b), it can be determined that the direction (camera direction) of the monitoring camera 350 is a direction in which the screen of the display 212 cannot be imaged, so no alternative display is performed.

[0095] Fig.12 is with Fig.11 Therefore, when judging whether there is a surveillance camera 350 based on the image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1, it is judged as "no", and no replacement display is performed.

[0096] According to this example, alternative display control can be performed based on the presence or absence of the surveillance camera 350 around the user or the non-wearable terminal 2 and the orientation (imaging direction) of the lens of the surveillance camera 350 as information related to the information leakage medium.

[0097] (Alternative display control that uses someone other than the user as a reference as a medium for information leakage)

[0098] Fig.13 This is a diagram showing an alternative display control example in which a person other than the user is used as a reference as an information leakage medium.

[0099] When another person 360 other than the user is captured in the image of the camera 206 of the non-wearable terminal 2, the non-wearable terminal 2 measures the distance to the other person. In the measurement of the distance, if the non-wearable terminal 2 is equipped with a distance measuring sensor, the distance measuring information of the distance measuring sensor can be used. In the case where the distance measuring sensor is not equipped, the approximate distance can be estimated based on the image of the camera 206. In this case, for example, if the ratio of the size of the user's face and the size of the face of the other person is a predetermined ratio, the non-wearable terminal 2 can be used as a reference to determine that the distance to the user and the distance to the other person are approximately equal. In addition, the camera 106 and the distance measuring sensor 108 of the wearable terminal 1 can also be used to shoot and measure the distance. In this case, based on the image shot by the camera 106 and the distance measuring result measured by the distance measuring sensor 108, the relationship between the position and orientation of the display 212 of the non-wearable terminal 2 and the other person 360 other than the user is analyzed.

[0100] If the distance from the non-wearable terminal 2 to the other person is within the first distance range for determining whether information on the display 212 can be read, alternative display is performed. For example, the first distance range is set to be substantially equal to the distance between the user and the non-wearable terminal 2.

[0101] Fig.14 1 and 10 are diagrams showing examples of alternative display control when another person 360 is present at a location farther than a first distance. (a) is an example in which alternative display is performed, and (b) is an example in which alternative display is not performed.

[0102] Fig.14 (a) shows a case where another person 360 is present outside the first distance range and the face of the other person 360 is in a position where the display 212 of the non-wearable terminal 2 can be seen. When the image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1 is analyzed and the image is recognized as another person, a replacement display is performed.

[0103] Fig.14 (b) shows a situation where another person 360 exists at a place away from the first distance range, and the face of the other person 360 is not visible from the display 212 of the non-wearable terminal 2. In this case, the display 212 is blocked by the user's figure and cannot be seen by the other person 360, and there is a high possibility that the information cannot be read, so no replacement display is performed.

[0104] Fig.15 This is a diagram showing an example in which another person 360 is present at a location farther than the first distance and no replacement display is performed.

[0105] exist Fig.15In the example, the other person 360 is out of the first distance range. Moreover, the back is facing the non-wearable terminal 2, and the display data of the display 212 cannot be read. Therefore, in this case, the alternative display is not performed.

[0106] Thus, alternative display control can be performed according to the presence, position, and orientation of another person 360 present around the user or the non-wearable terminal 2 as information related to the information leakage medium.

[0107] (Settings screen)

[0108] Although the setting of the substitute display is performed by the wearable terminal 1, it may be performed by the non-wearable terminal 2 and the setting information may be transmitted after pairing with the wearable terminal 1. Fig.16 An example of a user setting screen for an alternative display function is shown.

[0109] exist Fig.16 In the setting screen 400, as major items, there are (1) "Never apply (OFF)", (2) "Always apply (ON)", and (3) "Apply at appropriate times", and the application mode is selected.

[0110] When (3) "Apply at the right time" is selected, you can select (3-1) whether to apply at the right time based on the application location ("Application location (information security: low) automatic identification"), and (3-2) whether to apply at the right time based on the application object ("Application object (information leakage medium) automatic identification"). It is also possible to select both sides, so in this case, the priority of the application location and the application object can also be set from the "Priority Setting" button 401. The priority can be used to set whether to control the alternative display based on whether any condition is met, or to control the alternative display by giving priority to one condition. This prevents conflicts from occurring in the alternative display control. Alternative display control corresponding to the priority of the application condition set by the user can be performed.

[0111] (3-1) Automatic identification of application sites (information security: low)

[0112] In "Automatic recognition of application locations (information security: low)", you can select (3-1-1) "Exclude registered locations (information security: high)" to exclude pre-registered locations from application, (3-1-2) "Automatic selection" of application locations, and (3-1-3) "Automatic recognition of location specification".

[0113] (3-1-1) Remove the registered location (Information security: High)

[0114] When the "do not apply location registration setting" button 402 is pressed, the location information and images of the location where the alternative display control is not performed, such as the user's home or room, are obtained through the positioning sensor 107 and the camera 106, and are pre-registered as a location with high information security. Furthermore, when "remove registered location (information security: high)" is selected, control is performed so that the alternative display control is not performed in the pre-registered location based on the location information and images of the location where the user is currently located.

[0115] (3-1-2) Automatic selection

[0116] Automatically select a place for alternative display (commissioned setting: automatically identify whether the user's current location is similar to all the places registered by default (for example: cafes, trains, etc.) based on the default registered location information and images, and display them instead.) In this way, it is possible to control the automatic selection of places with low information security and display them instead.

[0117] (3-1-3) Automatic recognition of location designation

[0118] The user specifies in advance the place to be automatically recognized and displayed in place of the application. As the spaces recognized as the application place, there are items such as "cafe", "library", "inside the car", and "inside the train", but the "automatic recognition place registration setting" button 403 can be further pressed to set additional automatic recognition places. In this way, it is possible to control whether the place where the user is currently located is automatically recognized based on the registered location information and image, and to display it in place of the user.

[0119] (3-2) Automatic identification of application objects (information leakage media)

[0120] In "Automatic identification of application targets (information leakage media)", it is possible to select (3-2-1) automatic selection and (3-2-2) automatic identification target (information leakage media) designation.

[0121] (3-2-1) Automatic selection

[0122] The image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1 is analyzed, and the information leakage medium is automatically selected for alternative display (commission setting: for all information leakage media registered by default (for example: surveillance cameras, people), the images of the information leakage media registered by default are automatically identified and alternatively displayed.). Thus, it is possible to control the automatic identification of information leakage media and alternative display.

[0123] (3-2-2) Automatic identification target (information leakage medium) designation

[0124] The image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1 is analyzed, and the information leakage medium registered / specified by the user in advance is automatically identified based on the image of the registered information leakage medium, and is displayed instead (for example: surveillance camera, person. Additional objects, such as portable terminals, etc.) can be added. In this way, it is possible to control the automatic identification and replacement display for specific information leakage media registered / specified by the user in advance. The "Automatic Recognition Object Registration Setting" button 404 can also be pressed to add information leakage media.

[0125] Fig.17 This is the user setting screen for the detailed alternative display function.

[0126] exist Fig.17 The detailed application conditions of the alternative display function can be set in the user setting screen 410 of (a). Specifically, it can be selected whether to use the presence or absence of "obstruction" and "person / machine used" as the application condition or both.

[0127] exist Fig.16 "Obstruction" can be applied when "Automatic identification of application location (information security: low)" is checked in the setting screen 400.

[0128] exist Fig.16 When "Automatically identify the target (information leakage medium) designation" and "Person" are checked in the setting screen 400, "Person / machine belonging" can be applied. When "Person" is checked, people other than the surrounding users who do not match the belonging are identified and displayed instead.

[0129] When the "affiliation information registration setting" button 411 is pressed, Fig.17 The belonging information registration setting screen 420 of (b) is opened. In the belonging information registration setting screen 420, the belonging information of each person and the machine used is edited, and the "registration setting" button 421 is pressed to enter the Fig.18 The belonging information details screen 430. Fig.17 (b) and Fig.18 An example of a situation in which information related to "person / machine used" is classified for each same affiliation is shown, but the method of classifying information related to "person / machine used" does not need to be limited to this example. For example, it can also be classified for each person or each machine used.

[0130] Fig.18 This is the affiliation information registration setting screen. Hereinafter, each item of the affiliation information detail screen 430 will be described.

[0131] (1) Ownership name: any ownership name.

[0132] (2) Belonging information: Specific belonging (company (including position information, etc.), family, department / group, etc.). For the subsequent Fig.19 substitute display control, it is preferable to be able to specify the belonging information in several stages.

[0133] (3) Matching person: A person who matches the current belonging (person identification information such as registered images and sounds that can inherently identify a person).

[0134] (4) Used machine: Machines used in the current belonging (PC, portable terminal, etc.).

[0135] (5) Specific hidden characters for non-matching persons: Specific hidden characters (〇〇 section, △△ meeting, …).

[0136] (6) Detailed substitute display function application conditions.

[0137] The belonging information detailed screen 430 has "registration setting buttons" 431, 432, 433, 434, 435 for registration after editing each item of (1) belonging name, (2) belonging information, (3) matching person, (4) used machine, and (5) specific hidden characters for non-matching persons.

[0138] In the above (6) "detailed substitute display function application conditions", (6-1) "non-matching person identification (user standard)" and (6-2) "non-matching person identification (used machine standard)" can be selected.

[0139] (6-1) "Non-matching person identification (user standard)"

[0140] Judge the identity of the belonging of the user using a PC, etc. and the belonging of others existing around the user, and perform substitute display control according to the judgment result.

[0141] (6-2) "Non-matching person identification (used machine standard)"

[0142] Judge the identity of the organization (belonging) that manages the machine such as a PC used by the user and the belonging of others existing around the user, and perform substitute display control according to the judgment result.

[0143] In both the case of the user standard and the used machine standard, by selecting "specific hidden characters for non-matching persons", screens such as the application screen containing specific hidden characters for non-matching persons are substituted and displayed.

[0144] Thus, detailed substitute display control can be performed according to the relevance between the user or the machine used by the user and persons other than the surrounding users.

[0145] Fig.19 It shows that when you select Fig.17 "Person / Ownership of the device used" in the screen (a) of Fig.18 FIG. 2 is a diagram showing an example of alternative display control rule information applied when any of the contents of “Incompatible person recognition (user basis)” and “Incompatible person recognition (machine basis)” are displayed on the screen.

[0146] Fig.19 The replacement display control rule information 440 in "belongs to 1", "belongs to 2" and in Fig.18 The hierarchy defined in Fig.19 In the above example, the hierarchy to which the control belongs is associated with the content of the alternative display control.

[0147] For example, Fig.19 In the first row of , the entire screen is displayed in place of "a person who does not match the affiliation 1", that is, other people who are not employees of the company.

[0148] In the second row, for "people who match affiliation 1 but do not match affiliation 1+2~", that is, other people who are employees of the company but in other positions, the call / conference application screen and the application screen including characters and symbols indicating that it is a confidential document are displayed instead.

[0149] In the third row, for "people other than the user who belong to 1+2 or above", i.e., employees of the company and other people in the same position, the confidentiality obligation of business information is considered to be the same, and the user's private information is displayed instead. As the user's private information, there is an application screen containing characters of the user's name, ID, and password.

[0150] (Instead of display control process)

[0151] Fig. 20 is a flowchart (first half) showing the flow of processing of the alternative display system involved in this embodiment, Fig.21 This is a flowchart (second half) showing the flow of processing of the alternative display system according to the present embodiment.

[0152] When the wearable terminal 1 starts alternative display control, the alternative display control unit 125 confirms setting information ( S101 ).

[0153] When multiple application conditions for the alternative display function are set, Fig.16In order to perform the judgment process of whether to replace the display in step S108 described later, the priority setting information is also obtained in step S101. In the case where multiple application conditions are set even though the priority is not set, it can also be set to perform the judgment of whether the application conditions are used in a predetermined order.

[0154] If the setting is “always not applied”, the process ends. If the setting is “always applied” or “applied as appropriate”, the alternative display control unit 125 transmits alternative display start / continue information to the non-wearable terminal 2 (S102).

[0155] In the alternative display start / continue information, there is also recorded information for determining whether the setting information (refer to Fig.16 ) is a request information for data required in place of the application conditions specified in the display. For example, if "surveillance camera" is included in "automatic identification of application object (information leakage medium)", a camera request based on the non-wearable terminal 2 is included.

[0156] Furthermore, if “person” is included in “automatic identification of application object (information leakage medium)”, in addition to the image capture request by the non-wearable terminal 2, a request to obtain distance information may also be made if the non-wearable terminal 2 has a distance measuring sensor.

[0157] The non-wearable terminal 2 receives the alternative display start / continue information ( S103 ), and based on the information, collects information for determining whether alternative display is necessary ( S104 ).

[0158] In the non-wearable terminal 2, when it is necessary to use the camera 206 mounted on the non-wearable terminal 2 to measure the distance of a person as an information leakage medium, the distance is measured to the person being photographed (S104) and sent to the wearable terminal 1 (S105).

[0159] Furthermore, when "Always apply" is selected, after the transmission and reception of the start / continue information is replaced with the display (S102, S103), the display 212 of the non-wearable terminal 2 is switched to non-display (jump to S112).

[0160] Information (S106) for determining whether to replace display is also collected in the wearable terminal 1. In the wearable terminal 1, in addition to the position information obtained by the camera, ranging, and positioning sensor 107, the microphone 113 is also used to collect the user's voice in the range required for determining whether to replace display.

[0161] The wearable terminal 1 obtains information about the location of the user (location information detected by the positioning sensor 107, images captured by the cameras 106 and 206), information about the surrounding information leakage medium (images captured by the cameras 106 and 206), user information (user belonging information read from the setting information of the wearable terminal 1, sound collected by the microphone 113, etc.), and machine information received from the non-wearable terminal 2 (S107), and uses them for the judgment process of whether the alternative display is required (S108). The details of the judgment process of whether the alternative display is required will be described later (S108).

[0162] In the determination process of whether alternative display is necessary, there is "alternative display control based on the location information of the place and the information related to the surrounding environment as information related to the place" ( Fig. 22 ), "Substitute display control based on surveillance cameras as information leakage medium" ( Fig.23 ), "Substitute display control that uses a person other than the user as a reference as a medium for information leakage" ( Fig.24 ), "Alternative display control based on the character's affiliation" ( Fig.25 ), "Alternative display control based on the ownership of the used machine" ( Fig.26 ). These are processed according to the priority information read in S101.

[0163] If the result of the determination process of whether alternative display is required is to perform alternative display (S109: YES), the wearable terminal 1 specifies a screen area for alternative display and transmits alternative display instruction information indicating the screen area to the non-wearable terminal 2 (S110).

[0164] The non-wearable terminal 2 receives the alternative display instruction information (S111), switches the screen area for alternative display to non-display (S112), and sends the non-display display data 300 to the wearable terminal 1 (S113), which is received by the wearable terminal 1 (S114).

[0165] The wearable terminal 1 displays the received information related to the alternative display on the display 112 of the wearable terminal 1 (S115). In the case of continuing the alternative display (S116: "No"), the process returns to step S102, and the information used in the determination process of whether the alternative display is required is collected in each of the non-wearable terminal 2 and the wearable terminal 1. In addition, if "Always Apply" is selected, the process returns to step S112.

[0166] When the alternative display control is terminated (S116: Yes), alternative display termination information is transmitted from the wearable terminal 1 to the non-wearable terminal 2 (S117), and is received by the non-wearable terminal 2 (S118).

[0167] The non-wearable terminal 2 returns from non-display to normal display (S119), and stops sending display data to the wearable terminal 1. Then, the alternative display control of the wearable terminal 1 and the non-wearable terminal 2 is terminated.

[0168] (Alternative display control based on location information of a place and information related to the surrounding environment as information related to the place)

[0169] Fig. 22 The flowchart shows the flow of processing of alternative display control based on location information of the place and information about the surrounding environment as information about the place.

[0170] The alternative display control unit 125 obtains the user's position information measured by the positioning sensor 107, the image representing the surrounding environment captured by the camera 206 or 106, and the distance information measured by the distance measuring sensor 108, and refers to the setting information to determine whether the current position or the surrounding environment is an application place for alternative display control (S201). If the determination result is negative (S201: "No"), the determination processing result of whether alternative display is required is output in a manner that proceeds to the process of not executing alternative display (S109: "No") (S205).

[0171] When the judgment result is positive (S201: "Yes"), the alternative display control unit 125 refers to the setting information. If there is a conditional setting based on an obstruction (S202: "Yes"), the image recognition unit 121 analyzes the image captured by the camera 106 of the wearable terminal 1 or the camera 206 of the non-wearable terminal 2 to detect the obstruction, and the obstruction judgment unit 122 determines the area of ​​the screen set to be non-displayed corresponding to the obstruction (S203). Then, the judgment processing result of whether the alternative display is required is output in a manner that proceeds to the processing of the case of performing the alternative display (S109: "Yes") (S205). In the analysis of the above-mentioned image, the image recognition unit 121 detects the camera area of ​​the obstruction reflected in the image. In addition, the obstruction judgment unit 122 determines the area of ​​the screen set to be non-displayed based on the height, opacity, and configuration position of the obstruction.

[0172] If there is no condition setting based on the obstruction (S202: "No"), the entire surface of the display 212 of the non-wearable terminal 2 is determined as a non-display area (S204), and the alternative display control unit 125 outputs a judgment processing result (S205) on whether an alternative display is required in a manner that proceeds to the processing of the case where an alternative display is executed (S109: "Yes").

[0173] Thus, whether alternative display control is necessary can be determined based on location information of the place and information related to the surrounding environment, and the non-display area can be determined based on the height of the shielding object as information related to the surrounding environment of the place.

[0174] (Alternative display control based on surveillance cameras as information leakage medium)

[0175] Fig.23 This is a flowchart showing the flow of processing of alternative display control using a surveillance camera as a medium for information leakage.

[0176] The image recognition unit 121 analyzes the image captured by the camera 106 of the wearable terminal 1 or the image captured by the camera 106 of the non-wearable terminal 2 to detect the surveillance camera, and the information leakage medium determination unit 124 determines whether the surveillance camera matches the information leakage medium according to the position and direction of the surveillance camera (S301). If the determination result is negative (S301: "No"), the determination processing result of whether the alternative display is required is output (S303) in a manner that proceeds to the processing of the case where the alternative display is not performed (S109: "No").

[0177] When the judgment result is affirmative (S301: "Yes"), the information leakage medium judgment unit 124 decides to set the entire screen of the display 212 of the non-wearable terminal 2 to non-display (S302), and the alternative display control unit 125 outputs the judgment processing result of whether the alternative display is required (S303) in a manner that proceeds to the processing of the case of executing the alternative display (S109: "Yes").

[0178] Thus, when there is a possibility that information displayed on the display 212 of the non-wearable terminal 2 may be leaked from the surveillance camera depending on the position and orientation of the surveillance camera, alternative display can be performed, thereby improving information security.

[0179] (Alternative display control that uses someone other than the user as a reference as a medium for information leakage)

[0180] Fig.24 This is a flowchart showing the flow of processing of alternative display control using a person other than the user as a medium of information leakage as a reference.

[0181] The image recognition unit 121 analyzes the image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1 to determine whether a person other than the user is captured (S401). If the determination result is negative (S401: "No"), the determination processing result of whether the alternative display is required is output (S405) in a manner that proceeds to the process of not performing the alternative display (S109: "No").

[0182] If the result of the determination is positive (S401: Yes), the information leakage medium determination unit 124 determines whether the distance from the non-wearable terminal 2 to the other person is within the first distance range for determining whether the information of the display 212 can be read (S402). If the result of the determination is positive (S402: Yes), the information leakage medium determination unit 124 determines to set the entire screen of the display 212 to non-display (S403), and the alternative display control unit 125 outputs the determination processing result of whether the alternative display is required (S405) in a manner that advances to the processing of executing the alternative display (S109: Yes).

[0183] When the distance from the non-wearable terminal 2 to another person deviates from the first distance range (S402: "No"), the information leakage medium judgment unit 124 decides to set the entire screen to non-display (S403) when the face of the other person is facing the display 212 (S404: "Yes"), and the alternative display control unit 125 outputs the judgment processing result of whether alternative display is required (S405) in a manner that proceeds to the processing of executing alternative display (S109: "Yes").

[0184] On the other hand, when the distance from the non-wearable terminal 2 to the other person deviates from the first distance range (S402: "No"), the information leakage medium judgment unit 124 outputs a judgment processing result (S405) on whether alternative display is required in a manner that proceeds to the processing of the case where alternative display is not performed (S109: "No") when the face of the other person is not facing the display 212 (S404: "No").

[0185] This makes it possible to perform alternative display when another person is near the user or when the face of another person is facing the display 212 of the non-wearable terminal 2, thereby improving information security.

[0186] (Alternative display control based on the character's affiliation)

[0187] Fig.25 This is a flowchart showing the flow of processing for alternative display control based on the affiliation of a character.

[0188] The image recognition unit 121 analyzes the image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1 to determine whether a person other than the user is captured (S501). If the determination result is negative (S501: "No"), the determination processing result of whether the alternative display is required is output (S503) in a manner that proceeds to the process of not performing the alternative display (S109: "No").

[0189] If the result of the determination is positive (S501: Yes), the alternative display control unit 125 refers to the belonging information detail screen 430 (reference Fig.18 ) and determines whether the user's affiliation is the same as that of others (S502). Then, the alternative display control unit 125 refers to the alternative display control rule information 440 (reference Fig.19 ) to determine the alternative display control content, and output the judgment processing result (S503) of whether the alternative display is required in a manner to proceed to the processing of executing the alternative display (S109: "Yes").

[0190] As a result, when another person is near the user, alternative display can be performed according to the relationship between the other person and the user, thereby improving information security.

[0191] (Alternative display control based on the machine used)

[0192] Fig.26 This is a flowchart showing the flow of processing for alternative display control based on the affiliation of a character.

[0193] The image recognition unit 121 analyzes the image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1 to determine whether a person other than the user is captured (S601). If the determination result is negative (S601: "No"), the determination processing result of whether the alternative display is required is output (S603) in a manner that proceeds to the process of not performing the alternative display (S109: "No").

[0194] If the result of the determination is positive (S601: Yes), the alternative display control unit 125 refers to the belonging information detail screen 430 (reference Fig.18 ) and determines whether the organization (affiliation) that manages the non-wearable terminal 2 is the same as the affiliation of others (S602). Then, the alternative display control unit 125 refers to the alternative display control rule information 440 (reference Fig.19 ) to determine the alternative display control content, and output the judgment processing result (S603) of whether the alternative display is required in a manner to proceed to the processing of executing the alternative display (S109: "Yes").

[0195] This makes it possible to perform alternative display when there are other people who do not belong to (belong to) the organization that manages the non-wearable terminal, thereby improving information security.

[0196] According to this embodiment, the display of the non-wearable terminal is switched to a dark screen or a masked screen according to the location where the user uses the non-wearable terminal and the surrounding conditions (necessity of alternative display), and the information that is desired to be prevented from leakage is displayed on the display of the wearable terminal. This can prevent information leakage caused by others peeking or snooping at the screen of the display of the non-wearable terminal, thereby improving the information security of the non-wearable terminal.

[0197] This embodiment is not intended to limit the present invention, and any combination of the examples shown in the above embodiment is included in the present invention. In addition, modifications that further add functions to the above embodiments are also possible.

[0198] For example, in this embodiment, the alternative display program 120 is installed on the wearable terminal 1, but the alternative display program 120 can also be installed on the non-wearable terminal 2. After the wearable terminal 1 and the non-wearable terminal 2 are connected, the non-wearable terminal 2 determines whether the alternative display control needs to be executed.

[0199] In addition, the non-display processing performed on the display 212 of the non-wearable terminal 2 in this embodiment can be considered to include brightness control, masking processing, mosaic processing, etc. of the display 212 of the non-wearable terminal 2.

[0200] In addition, the numerical values, messages, etc. that appear in the text and drawings are merely examples, and the effects of the present invention will not be impaired even if different examples are used.

[0201] In addition, the programs described in each processing example may be independent programs, or a plurality of programs may constitute one application program. In addition, the order of performing each process may be changed and executed.

[0202] The functions of the present invention described above may be partially or entirely implemented in hardware by designing, for example, an integrated circuit, a general-purpose processor, or a dedicated processor. The processor includes transistors and other circuits and is considered to be a circuit or a processing circuit. In addition, the functions of the present invention may be implemented in software by interpreting and executing an action program for implementing each function by a processor unit or the like. Hardware and software may also be used simultaneously.

[0203] In addition, the control lines and information lines shown in the drawings are those considered necessary for explanation, and not all control lines and information lines on the product are necessarily shown. It can also be considered that almost all the structures are actually connected to each other.

[0204] The above-mentioned embodiment includes the following aspects.

[0205] (The first viewpoint)

[0206] A wearable terminal, comprising:

[0207] monitor;

[0208] a communicator for receiving display data of a non-wearable terminal; and

[0209] processor,

[0210] The processor performs the following alternative display control: sending a control signal to the non-wearable terminal via the communicator to make the received display data non-displayed, receiving the display data of the non-wearable terminal, and displaying the display data on the display.

[0211] (Method from the second point of view)

[0212] A linkage display system includes a wearable terminal and a non-wearable terminal, wherein:

[0213] Wearable terminals have:

[0214] 1st display;

[0215] a first communicator for receiving display data of a non-wearable terminal; and

[0216] The first processor,

[0217] Non-wearable terminals have:

[0218] 2nd display;

[0219] a second communicator, which sends display data to the wearable terminal; and

[0220] The second processor,

[0221] The first processor performs the following alternative display control: sending a control signal to the non-wearable terminal via the first communicator to make the display data non-displayed, receiving the display data of the non-wearable terminal and displaying the display data on the first display,

[0222] The second processor receives the control signal via the second communicator, sets the display data to non-display on the second display, and transmits the display data to the wearable terminal.

[0223] (Third point of view)

[0224] A linkage display method is a linkage display method performed between a wearable terminal and a non-wearable terminal, comprising:

[0225] The step of sending a control signal from the wearable terminal to the non-wearable terminal to make display data displayed on the display of the non-wearable terminal non-display;

[0226] The step of setting the display data to non-display in the display of the non-wearable terminal and sending the display data to the wearable terminal;

[0227] The wearable terminal receives the display data from the non-wearable terminal; and

[0228] The step of displaying the display data on a display included in the wearable terminal.

[0229] Explanation of symbols

[0230] 1: Wearable terminal; 2: Non-wearable terminal; 2A: Notebook personal computer; 2C: Portable terminal; 4: Server; 5: External network; 10: Alternative display system; 100: HMD; 100s: AR glasses; 101: Processor; 102: Memory; 103: Storage device; 104: Operation input interface; 106: Camera; 107: Positioning sensor; 108: Distance sensor; 109: Acceleration sensor; 110: Gyroscope sensor; 111: Geomagnetic sensor; 112: Display; 113: Microphone; 114: Speaker; 115: timer; 116: network communicator; 117: BT communicator; 118: bus; 120: alternative display program; 121: image recognition unit; 122: occlusion judgment unit; 123: non-display area determination unit; 124: information leakage medium judgment unit; 125: alternative display control unit; 126: display data receiving unit; 127: virtual reality target display unit; 130: data; 131: location information; 132: information leakage medium information; 133: alternative display control information; 140: non-display switching program; 141: display Display switching unit; 142: display data sending unit; 201: processor; 202: memory; 203: storage device; 204: operation input interface; 206: camera; 212: display; 212A: display; 212B: display; 212C: display; 216: network communicator; 217: BT communicator; 218: bus; 300: display data; 301: application screen; 320: obstruction; 320a: obstruction; 320b: obstruction; 350: surveillance camera; 360: others; 400: setting screen; 40 1: Priority setting button; 402: Do not apply location registration setting button; 403: Automatic identification location registration setting button; 404: Automatic identification location registration setting button; 410: User setting screen; 411: Belonging information registration setting button; 420: Belonging information registration setting screen; 421: Registration setting button; 430: Belonging information details screen; 431: Registration setting button; 432: Registration setting button; 433: Registration setting button; 434: Registration setting button; 435: Registration setting button; 440: Replace the display control rule information.

Claims

1. A wearable terminal having: monitor; A communicator, receiving display data of a non-wearable terminal; Memory; and processor, The processor performs the following alternative display control based on the information related to the location or the information related to the information leakage medium stored in the memory: sending a control signal to the non-wearable terminal via the communicator to make the received display data non-displayed, receiving the display data of the non-wearable terminal and displaying the display data on the display.

2. The wearable terminal according to claim 1, wherein: The wearable terminal also has: A positioning sensor to detect position information; and Camera, to capture the surrounding environment. In the memory, position information detected by the positioning sensor or an image captured by the camera is stored as information related to the place.

3. The wearable terminal according to claim 2, wherein: The memory stores the position information detected by the positioning sensor or the image captured by the camera as pre-registered information for executing the alternative display control. The processor executes the alternative display control when it is determined that the location where the user is located is not recorded in the pre-registered information.

4. The wearable terminal according to claim 2, wherein: The processor analyzes the image captured by the camera and identifies obstructions existing around the display of the non-wearable terminal. A screen area set as non-display in a display of the non-wearable terminal is determined according to at least one of a height and a transparency of the shielding object or a position of the shielding object relative to the non-wearable terminal.

5. The wearable terminal according to claim 1, wherein: The wearable terminal also has a camera. The processor analyzes at least one of the images captured by the camera and the images captured by the camera mounted on the non-wearable terminal based on the information related to the information leakage medium, and identifies the information leakage medium existing around the display of the non-wearable terminal. The alternative display control is performed according to at least one of a position and a direction of the information leakage medium relative to the non-wearable terminal.

6. The wearable terminal according to claim 5, wherein: The information leakage medium is a surveillance camera or a person different from the user of the wearable terminal.

7. The wearable terminal according to claim 5, wherein: The memory stores user information that associates an organization to which a user of the wearable terminal belongs with identification information of other persons belonging to the organization. The processor analyzes the image captured by the camera, determines the similarity between the person captured by the camera and the other person belonging to the organization to which the user belongs included in the user information, and executes the alternative display control according to the result of the determination.

8. The wearable terminal according to claim 5, wherein: The memory stores user information that associates an organization to which a user of the wearable terminal belongs with identification information of other persons belonging to the organization. The processor analyzes the image captured by the camera to compare the person captured by the camera with the user information, determines the similarity between the organization to which the user belongs and the person captured by the camera, and executes the alternative display control according to the result of the determination.

9. The wearable terminal according to claim 5, wherein: The memory stores the belonging information of the used device by associating the organization that manages the wearable terminal with the identification information of other persons belonging to the organization. The processor analyzes the image captured by the camera to compare the person captured by the camera with the belonging information of the used machine, determines the similarity between the organization managing the wearable terminal and the person captured by the camera, and executes the alternative display control according to the result of the determination.

10. A linkage display system, comprising a wearable terminal and a non-wearable terminal, wherein: Wearable terminals have: 1st display; a first communicator for receiving display data of a non-wearable terminal; and The first processor, Non-wearable terminals have: 2nd display; a second communicator, which sends display data to the wearable terminal; and The second processor, The first processor performs the following alternative display control: sending a control signal to the non-wearable terminal via the first communicator to make the display data non-displayed, receiving the display data of the non-wearable terminal and displaying the display data on the first display, The second processor receives the control signal via the second communicator, sets the display data to non-display on the second display, and transmits the display data to the wearable terminal.

11. The linkage display system according to claim 10, wherein: The wearable terminal also has a memory. The first processor executes the alternative display control based on the information on the location or the information on the information leakage medium stored in the memory.

12. A linkage display method is a linkage display method performed between a wearable terminal and a non-wearable terminal, comprising: The step of sending a control signal for non-displaying display data displayed on a display of the non-wearable terminal from the wearable terminal to the non-wearable terminal based on the information related to the location or the information related to the information leakage medium stored in the memory of the wearable terminal; The step of setting the display data to non-display in the display of the non-wearable terminal and sending the display data to the wearable terminal; The wearable terminal receives the display data from the non-wearable terminal; as well as The step of displaying the display data on a display included in the wearable terminal.

Images