Wearable terminal, associated display system, and associated display method

The wearable and non-wearable terminal system addresses information leakage by using image recognition and sensors to control display overlap, ensuring secure alternative display based on location and surroundings, thus preventing unauthorized viewing and enhancing security.

JP7717279B2Active Publication Date: 2025-08-01MAXELL LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024528143
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-06-21
Publication Date
2025-08-01
Estimated Expiration
2042-06-21

AI Technical Summary

Technical Problem

Existing display technologies fail to effectively prevent information leakage from non-wearable terminals like desktop computers and tablets, as anti-peeping filters are not sufficient to secure the content from being viewed by others, especially considering the user's location and surrounding environment.

Method used

A wearable terminal and non-wearable terminal system that uses image recognition and sensors to determine the position and surroundings, controlling the display on the wearable terminal to overlap and obscure the non-wearable terminal's screen from view, based on location, shielding objects, surveillance cameras, and proximity to others, ensuring secure alternative display.

Benefits of technology

Prevents unauthorized viewing of non-wearable terminal screens by superimposing secure content on the wearable terminal, enhancing information security and maintaining usability by limiting displayed content to necessary parts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007717279000001
    Figure 0007717279000001
  • Figure 0007717279000002
    Figure 0007717279000002
  • Figure 0007717279000003
    Figure 0007717279000003
Patent Text Reader

Abstract

When a control signal is transmitted from this wearable terminal to a non-wearable terminal on the basis of information relating to a location or information relating to an information leakage medium, the control signal causing display data shown on a display of the non-wearable terminal to be hidden, the display data is hidden on the display of the non-wearable terminal and is transmitted to the wearable terminal. When the display data is received from the non-wearable terminal, the wearable terminal shows the display data on a display that is provided to the wearable terminal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a wearable terminal, an associated display system, and an associated display method, and more particularly to a display technology that associates a wearable display terminal and a non-wearable display terminal.

Background Art

[0002] As an associated display system using a plurality of displays, Patent Document 1 describes that "a first device coupled to a first display and an image sensor receives output data from a second device having a second display different from the first display. The output data represents content that can be displayed by the second device on the second display. The first device uses the image sensor to determine the position of the second display relative to the first device, and based on the output data received from the second device and the determined position of the second display relative to the first device, causes the content to be displayed on the first display. (Abstract excerpt)".

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The screen of a display provided in a non-wearable terminal such as a desktop computer, a notebook computer, or a tablet can be viewed by someone other than the user of the non-wearable terminal. Although there is an anti-peeping filter to prevent this, there is a desire to effectively prevent information leakage because the information on the screen can be read through the filter depending on the viewing angle.

[0005] Therefore, it is conceivable to use the display technology of Patent Document 1. However, in Patent Document 1, when the user makes an arbitrary selection or when it is determined that the user is viewing a PC or a mobile terminal using an HMD, the video of the screen of the PC or the mobile terminal is only alternatively displayed on the screen of the HMD so as to match the screen position of the PC or the mobile terminal. The aspect of preventing information leakage according to the place where the user uses a non-wearable terminal such as a PC and the surrounding situation is not considered. Therefore, simply displaying the output data of the first device on the second device cannot maintain security.

[0006] The present invention has been made in view of the above points, and an object thereof is to improve the security of information by suppressing others from peeping at the screen.

Means for Solving the Problems

[0007] In order to solve the above problems, the present invention has the configuration described in the claims.

Effects of the Invention

[0008] According to the present invention, others are prevented from peeping at the screen, and the security of information is improved. Other objects, configurations, and effects than those described above will be clarified in the following embodiments.

Brief Description of the Drawings

[0009]

Figure 1A

Figure 1B

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Embodiments for Carrying Out the Invention

[0010] Since the present invention is useful for preventing the leakage of information displayed on a non-wearable terminal, the commercial value of the non-wearable terminal to which the present invention is applied can be enhanced. Therefore, it can be expected to contribute to Goal 8.2 of the Sustainable Development Goals (SDGs) proposed by the United Nations (raising economic productivity through diversification, technological improvement, and innovation, focusing on industries that enhance the value of goods and services and labor-intensive industries).

[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The same components are denoted by the same reference numerals throughout the drawings, and redundant descriptions are omitted.

[0012] (Schematic configuration of the alternative display system) FIG. 1A is a schematic configuration diagram of the alternative display system according to this embodiment. FIG. 1B is a schematic configuration diagram of the non-wearable terminal. FIG. 2 is an external view of the wearable terminal, where (a) shows the HMD and (b) shows the AR glasses.

[0013] The alternative display system 10 shown in FIG. 1A is configured by wirelessly connecting the wearable terminal 1 and the non-wearable terminal 2. For the wireless communication connection, the wearable terminal 1 and the non-wearable terminal 2 may be directly connected using short-range wireless communication such as Bluetooth (registered trademark), or may be indirectly connected via a LAN.

[0014] The wearable terminal 1 used in the alternative display system 10 may be any terminal that only the user wearing the wearable terminal 1 can view the screen of the wearable terminal. Specific examples include the HMD 100 shown in FIG. 2(a) and the AR glasses 100s shown in FIG. 2(b).

[0015] Returning to FIG. 1, the wearable terminal 1 includes a processor 101 (corresponding to the first processor), a memory 102, a storage 103, an operation input interface 104, a camera 106, a positioning sensor 107, a distance measuring sensor 108, an acceleration sensor 109, a gyro sensor 110, a geomagnetic sensor 111, a display 112 (corresponding to the first display), a microphone 113, a speaker 114, a timer 115, a network communication device 116, and a BT communication device 117 (BT: Bluetooth (registered trademark)), and they are connected to each other via a bus 118.

[0016] The storage 103 stores the alternative display program 120, and the processor 101 expands and saves the alternative display program 120 in the memory 102 and executes it.

[0017] Furthermore, the storage 103 stores data 130 generated during the execution process and results of the alternative display program 120. The data 130 includes location information 131, information leakage medium information 132, and alternative display control information 133. Each of the location information 131, the information leakage medium information 132, and the alternative display control information 133 is input from the setting screen 400 (see FIG. 16), the user setting screen 410 (FIG. 17(a)), the affiliation information registration setting screen 420 (FIG. 17(b)), and the affiliation information detail screen 430 (FIG. 18) described later.

[0018] The distance measurement sensor 108 is a sensor that outputs distance information to a real object to be measured. For example, it may be a sensor that calculates the distance using an image having parallax like a stereo camera for feature points such as the contour of a real object and outputs the distance information. Also, it may be one that measures the distance by irradiating a light beam two-dimensionally to the measurement target like the TOF (Time of Flight) method.

[0019] The network communication device 116 is a communication device that realizes the communication function of wireless communication using the Wi-Fi (registered trademark) standard or the like. The network communication device 116 may be communicatively connected to the server 4 via a LAN or an external network 5. It may download an update program from the server 4.

[0020] The BT communication device 117 is a communication device using Bluetooth (registered trademark), and performs short-range wireless communication with a non-wearable terminal 2 that performs alternative display processing, such as a personal computer (including a notebook personal computer and a desktop personal computer), and a mobile terminal (including a smartphone and a tablet).

[0021] The display 112 is a transmissive display. The user visually overlaps the virtual reality object displayed on the display 112 with the real world visually recognized through the display 112.

[0022] The non-wearable terminal 2 is a terminal whose screen can be visually recognized by someone other than the user of the wearable terminal 1, such as a desktop computer, a notebook computer, a smartphone, or a tablet connected to a monitor.

[0023] As shown in FIG. 1B, the non-wearable terminal 2 includes a processor 201 (corresponding to the second processor), a memory 202, a storage 203, an operation input interface 204, a camera 206, a display 212 (corresponding to the second display), a network communication device 216, and a BT communication device 217, and they are connected to each other via a bus 218.

[0024] When using a smartphone or a tablet as the non-wearable terminal 2, in addition to the above configuration, it has a distance measuring sensor, a positioning sensor, etc. However, since the non-wearable terminal 2 used in the alternative display system 10 does not necessarily have a distance measuring sensor or a positioning sensor, it is omitted in FIG. 1B.

[0025] When the non-display switching program 140 stored in the storage 203 receives a control signal for making the display data being displayed or to be displayed on the display 212 non-display from the wearable terminal 1, it makes the display data being displayed or to be displayed on the display 212 non-display and transmits the display data to the wearable terminal 1.

[0026] In this embodiment, an alternative display program 120 is installed in the wearable terminal 1, and the wearable terminal 1 determines whether to execute alternative display control. The non-display switching program 140 installed in the non-wearable terminal 2 mainly executes display control for making the display 212 of the non-wearable terminal 2 non-display in response to a control signal from the wearable terminal 1.

[0027] FIG. 3 is a functional block diagram of the alternative display system.

[0028] Instead of the display program 120, the alternative display program 120 includes an image recognition unit 121, an occlusion determination unit 122, a non-display area determination unit 123, an information leakage medium determination unit 124, an alternative display control unit 125, a display data reception unit 126, and a virtual reality object display unit 127.

[0029] The image recognition unit 121 analyzes the images captured by the cameras 106 and 206 mounted on the wearable terminal 1 or the non-wearable terminal 2 and performs recognition processing of the subject.

[0030] The occlusion determination unit 122 determines the height, arrangement position, opacity, etc. of the occlusion when the occlusion is imaged as a subject.

[0031] The non-display area determination unit 123 determines a non-display area corresponding to the occlusion based on the determination result by the occlusion determination unit 122.

[0032] The information leakage medium determination unit 124 determines whether the subject corresponds to an information leakage medium.

[0033] The alternative display control unit 125 determines the start, end, and necessity of alternative display control based on position information and image information.

[0034] The display data reception unit 126 receives display data for performing alternative display from the non-wearable terminal 2.

[0035] The virtual reality object display unit 127 detects the position of the display 212 of the non-wearable terminal 2 based on the image captured by the camera 106 of the wearable terminal 1 and displays the display data on the display 112 of the wearable terminal 1 so as to overlap the display 212 of the non-wearable terminal 2. As a result, the display data is displayed on the display 112 as a virtual reality object.

[0036] The non-display switching program 140 includes a display switching unit 141 and a display data transmission unit 142.

[0037] The display switching unit 141 switches between non-display and display of the display 212 based on a control signal that instructs the start and end of the alternative display from the wearable terminal 1.

[0038] The display data transmission unit 142 transmits display data for performing an alternative display to the wearable terminal 1.

[0039] (Comparison between the view of others and the view of the user) With reference to FIGS. 4, 5, and 6, the view of the user during the alternative display will be described. FIG. 4 is a diagram showing the views of others and the user during the alternative display using a notebook personal computer. FIG. 5 is a diagram showing the views of others and the user during the alternative display using a desktop personal computer. FIG. 6 is a diagram showing the views of others and the user during the alternative display using a mobile terminal.

[0040] As shown in FIG. 4, during the alternative display, the display 212A of the notebook personal computer 2A becomes non-display, and the information that the user originally wants to view is not displayed. Therefore, in the view visible to others, the display 212 of the notebook personal computer 2A is a non-display screen. The notebook personal computer 2A transmits the display data 300 that should have been displayed on the display 212A to the wearable terminal 1.

[0041] In the wearable terminal 1, the position of the display 212A is detected, and on the display 112 of the wearable terminal 1, the display data 300 is displayed so as to overlap at a position where the display 212A can be seen through the display 112. Therefore, in the view of the user wearing the wearable terminal 1, it appears that the display data 300 is displayed on the display 212A of the notebook personal computer 2A.

[0042] FIG. 5 shows a state in which a desktop personal computer (not shown) and the wearable terminal 1 are communicatively connected, and the display 212B connected to the desktop personal computer is alternatively displayed on the wearable terminal 1.

[0043] FIG. 6 shows a state in which the mobile terminal 2C and the wearable terminal 1 are communicatively connected, and the display 212C of the mobile terminal 2C is alternatively displayed on the wearable terminal 1.

[0044] In any of FIGS. 4, 5, and 6, the user visually recognizes by superimposing the display data 300 displayed on the display 112 of the wearable terminal 1 on the display 212 of the non-wearable terminal 2 in the real world visually recognized through the display 112 of the wearable terminal 1. On the other hand, since the display 212 of the non-wearable terminal 2 is not displayed, it appears to the user that the display data 300 is displayed on the display 212 of the non-wearable terminal 2, but the display data 300 is not visible to others.

[0045] (Alternative display control based on location information about a location and information about the surrounding environment as location-related information) FIG. 7 is a diagram showing an example of alternative display control based on location information about a location and information about the surrounding environment as location-related information, where (a) shows a non-private office space, (b) shows a self-room, and (c) shows an example of use in an office.

[0046] FIG. 7(a) shows an example of use in the case of no prior registration such as a non-private office space. In this case, alternative display is performed.

[0047] FIG. 7(b) shows an example of use in a self-room (pre-registered), and FIG. 7(c) shows an example of use in an office (pre-registered). Places where others do not enter and exit, such as a self-room, and an office are considered to have high information security because they have the same confidentiality obligation as the user. Therefore, images showing the location information and the surrounding environment of places with high information security are acquired by the positioning sensor 107 and the camera 106 and pre-registered, and the alternative display function is controlled not to operate at the pre-registered places, and the alternative display function is controlled to operate at places where no pre-registration has been made. Thereby, as location-related information, the alternative display function can be controlled based on the location information and images of the pre-registered places and the places where the user is currently located.

[0048] (Modification example of alternative display control based on location information of a location and information on the surrounding environment as location-related information: shielding object) FIG. 8 is a modification example of alternative display control based on location information of a location and information on the surrounding environment as location-related information, and is a diagram showing an example of alternative display control according to the presence or absence of a shielding object with respect to the non-wearable terminal 2 as information on the surrounding environment.

[0049] When there are non-transparent shielding objects 320, such as partitions or walls, on the left and right of the display 212 of the non-wearable terminal 2 used by the user, it is not possible to peek at the display 212 of the non-wearable terminal 2 from the adjacent seat (in FIG. 8, the display 212 of the non-wearable terminal 2 is illustrated so that it can be seen what state it is in). Therefore, compared with the case where there is no partition or wall, the information security of the location where the user is located is higher. Thus, when the camera 106 of the wearable terminal 1 or the camera 206 of the non-wearable terminal 2 analyzes the captured image to determine the presence or absence of a partition, and determines that there is a shielding object 320 that cannot be peeked at the display 212, it may be controlled not to perform alternative display.

[0050] FIG. 9 is a diagram showing an example of alternative display control according to the height of a shielding object with respect to the non-wearable terminal 2, where (a) shows the case where the shielding object is not high enough, and (b) shows the user's field of view. FIG. 10 is a diagram showing an example of alternative display control according to the depth size of a shielding object with respect to the non-wearable terminal 2, where (a) shows the case where the shielding object does not reach the front, and (b) shows the user's field of view. Since the area where the display 212 can be seen from the outside changes according to the height and depth size of the shielding object (in FIGS. 9 and 10, the display 212 of the non-wearable terminal 2 is illustrated so that it can be seen what state it is in), the information security of the location is different.

[0051] When the height of the non-transparent portion of the shield 320a is low, the information security is higher compared to the case where there is no shield, but lower compared to the case where the shield is sufficiently high. In this case, an alternative display of the application screen related to the area where the display 212 of the non-wearable terminal 2 can be seen from the left and right may be performed. For example, in FIG. 9(a), the height of the shield 320a is lower than the upper end of the display 212 of the non-wearable terminal 2. Therefore, the application screen related to the upper side of half of the non-wearable terminal 2 is made non-displayed.

[0052] The display data 300 of the non-displayed application screen is transmitted to and alternatively displayed on the wearable terminal 1. Therefore, as shown in FIG. 9(b), the application screen alternatively displayed on the wearable terminal 1 overlaps and can be seen on the display 212 of the non-wearable terminal 2 from the user wearing the wearable terminal 1. On the other hand, since the application screen 301 is displayed on the display 212 of the non-wearable terminal 2, it is not displayed on the wearable terminal 1. The user visually recognizes the application screen 301 actually displayed on the display 212 of the non-wearable terminal 2 through the display 112 of the wearable terminal 1.

[0053] FIG. 10 is a diagram showing an example of alternative display control according to the depth size of the shield with respect to the non-wearable terminal 2. The partition as the shield 320b has a height equal to or higher than the upper end of the non-wearable terminal 2, but the length in the depth direction is short, and the partition does not shield up to the center in the depth direction from the front of the desk. Therefore, since the lower left of the non-wearable terminal 2 can be shielded by the partition, the application screen 301 is displayed without performing alternative display, but alternative display is performed for the application screen related to the upper and right sides of half of the display 212.

[0054] The display data 300 of the application screen that has been hidden is transmitted to and alternatively displayed on the wearable terminal 1. Therefore, as shown in Fig. 10(b), from the user wearing the wearable terminal 1, the application screen alternatively displayed on the wearable terminal 1 overlaps and can be seen on the display 212 of the non-wearable terminal 2. On the other hand, since the application screen 301 is displayed on the display 212 of the non-wearable terminal 2, it is not displayed on the wearable terminal 1. The user visually recognizes the application screen 301 actually displayed on the display 212 of the non-wearable terminal 2 through the display 112 of the wearable terminal 1.

[0055] Accordingly, as information regarding the surrounding environment of the location where the user operates the non-wearable terminal 2, alternative display control can be performed based on information regarding the transparency and shape of the shielding object with respect to the non-wearable terminal 2, and only the application screen that spans the partial region where shielding is difficult in the display 212 of the non-wearable terminal 2 can be controlled to be alternatively displayed from the transparency and shape of the shielding object. When the performance such as the image quality of the screen of the wearable terminal 1 such as an HMD or AR glasses is poorer than that of the non-wearable terminal 2 such as a PC, alternative display may also contribute to deteriorating the usability of the user with respect to the non-wearable terminal 2. Therefore, by limiting the area of the screen for alternative display to only the necessary part, it is possible to enhance the information security while suppressing the deterioration of the usability of the user with respect to the non-wearable terminal 2.

[0056] (Alternative display control based on a surveillance camera as an information leakage medium) An example of alternative display control according to the presence or absence of a surveillance camera will be described as information regarding the information leakage medium. Fig. 11 is a diagram showing an example of alternative display control in a space where a surveillance camera is installed, (a) is an example of performing alternative display, and (b) is an example of not performing alternative display. Fig. 12 is a diagram showing a situation where no surveillance camera is installed in the same space as Fig. 11.

[0057] In both (a) and (b) of FIG. 11, a monitoring camera 350 is installed in the living room of the user operating the non-wearable terminal 2. The monitoring camera 350 is an example of an information leakage medium.

[0058] When the screen of the display 212 of the non-wearable terminal 2 enters the viewing angle of the monitoring camera 350, the display data displayed on the screen of the display 212 of the non-wearable terminal 2 is reflected in the image of the monitoring camera 350, leading to information leakage.

[0059] Therefore, as information regarding the information leakage medium, alternative display control may be performed based on the presence or absence of the monitoring camera 350.

[0060] In FIG. 11(a), the monitoring camera 350 is captured in the captured image of the camera 206 mounted on the non-wearable terminal 2. Therefore, since the screen of the display 212 of the non-wearable terminal 2 may be reflected in the image of the monitoring camera 350, alternative display is performed. Also, imaging may be performed by the camera 106 of the wearable terminal 1. In that case, based on the image captured by the camera 106 and the distance measurement result measured by the distance measurement sensor 108, the positional and directional relationship between the display 212 of the non-wearable terminal 2 and the monitoring camera 350 is analyzed.

[0061] In FIG. 11(b), the monitoring camera 350 is captured in the image captured by the camera 106 of the wearable terminal 1, but the monitoring camera 350 is not captured in the captured image of the camera 206 mounted on the non-wearable terminal 2. Therefore, in FIG. 11(b), it can be determined that the direction (shooting direction) of the monitoring camera 350 is a direction in which the screen of the display 212 cannot be imaged, so alternative display is not performed.

[0062] FIG. 12 shows the same space as FIG. 11 but without the installation of a monitoring camera. Therefore, when determining the presence or absence of the monitoring camera 350 based on the image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1, it is determined as "none", and alternative display is not performed.

[0063] According to this example, as information regarding the information leakage medium, alternative display control can be performed according to the presence or absence of the surveillance camera 350 existing around the user or the non-wearable terminal 2, and the orientation (shooting direction) of the lens of the surveillance camera 350.

[0064] (Alternative display control based on someone other than the user as the information leakage medium) FIG. 13 is a diagram showing an example of alternative display control based on someone other than the user as the information leakage medium.

[0065] When someone other than the user 360 is imaged in the image of the camera 206 of the non-wearable terminal 2, the non-wearable terminal 2 measures the distance to the person. For this distance measurement, if the non-wearable terminal 2 is equipped with a distance measurement sensor, the distance measurement information of the distance measurement sensor may be used. If the distance measurement sensor is not installed, an approximate distance may be estimated from the image of the camera 206. In this case, for example, if the ratio of the size of the user's face to the size of the face of someone else is a predetermined ratio, it may be determined that the distance to the user and the distance to the person are approximately equal based on the non-wearable terminal 2. Also, imaging and distance measurement may be performed by the camera 106 or the distance measurement sensor 108 of the wearable terminal 1. In that case, based on the image captured by the camera 106 and the distance measurement result measured by the distance measurement sensor 108, the relationship between the position and orientation of the display 212 of the non-wearable terminal 2 and someone other than the user 360 is analyzed.

[0066] If the distance from the non-wearable terminal 2 to the person is within a first distance range for determining whether the information on the display 212 can be read, alternative display is executed. For example, the first distance range is set to be approximately equal to the distance between the user and the non-wearable terminal 2.

[0067] FIG. 14 is a diagram showing an example of alternative display control when someone 360 is at a location farther than the first distance, where (a) is an example of performing alternative display and (b) is an example of not performing alternative display.

[0068] Figure 14(a) shows a case where there is a person 360 away from the first distance range and the face of the person 360 is in a position where it can be seen on the display 212 of the non-wearable terminal 2. When an image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1 is analyzed and a person can be recognized by image recognition, an alternative display is performed.

[0069] Figure 14(b) shows a case where there is a person 360 in a place farther than the first distance range and the face of the person 360 cannot be seen from the display 212 of the non-wearable terminal 2. In this case, since the display 212 cannot be seen as the user's shadow from the person 360 and there is a high possibility that the information cannot be read, an alternative display is not performed.

[0070] Figure 15 is a diagram showing an example where there is a person 360 in a place farther than the first distance and no alternative display is performed.

[0071] In Figure 15, the person 360 is outside the first distance range. Furthermore, the person has their back turned to the non-wearable terminal 2 and the display data of the display 212 cannot be read. Therefore, in this case, no alternative display is performed.

[0072] Thus, as information regarding the information leakage medium, alternative display control can be performed based on the presence, position, and orientation of the user or the person 360 existing around the non-wearable terminal 2.

[0073] (Settings screen) The setting of the alternative display is performed on the wearable terminal 1, but it may also be performed on the non-wearable terminal 2 and the setting information may be transmitted after pairing with the wearable terminal 1. Figure 16 shows an example of the user setting screen for the alternative display function.

[0074] In the setting screen 400 of Figure 16, as major items (1) "Always not applicable (OFF)" (2) "Always applicable (ON)" (3) "Apply as appropriate" exist, and an application pattern is selected.

[0075] (3) If "Apply in a timely manner" is selected, (3-1) Whether to apply in a timely manner based on the application location ("Automatically identify application location (low information security)"), (3-2) Whether to apply in a timely manner based on the application target ("Automatically identify application target (information leakage medium)") can be selected. Since it is also possible to select both, in that case, the priorities of the application location and the application target may be set from the "Priority setting" button 401. Using the priorities, it is possible to set whether to control the alternative display based on whether any of the conditions are met, or to control the alternative display with one condition having priority. This can prevent contradictions in the alternative display control. Alternative display control can be performed according to the priorities of the application conditions set by the user.

[0076] (3-1) Automatically identify application location (low information security) In "Automatically identify application location (low information security)", (3-1-1) Exclude the pre-registered location from application "Excluding registered location (high information security)", (3-1-2) "Automatically select" the application location, (3-1-3) "Specify automatically identified location", can be selected.

[0077] (3-1-1) Excluding registered location (high information security) Press the "Non-application location registration setting" button 402 to pre-register the location information and images of locations where alternative display control is not performed, such as home or one's own room, as locations with high information security, obtained by the positioning sensor 107 and the camera 106. Then, when "Excluding registered location (high information security)" is selected, in the pre-registered locations, control is performed so that alternative display control is not performed based on the pre-registered and the location information and images of the location where the user is currently located.

[0078] (3-1-2) Automatic selection Automatically select the location for performing the alternative display (Optional setting: Automatically identify whether the location where the user is currently located is a location similar to all the locations registered by default (e.g., coffee shop, inside a train, …) based on the location information and images registered by default, and perform the alternative display.). As a result, it is possible to control so as to automatically select and perform alternative display for a location with low information security.

[0079] (3-1-3) Automatic device identification location specification The user specifies in advance the location for automatically performing identification and alternative display. As spaces to be identified as applicable locations, there are items such as "coffee shop", "library", "inside a car", "inside a train", but it is also possible to additionally set the automatic identification location by pressing the "Automatic Identification Location Registration Setting" button 403. As a result, it is possible to control so as to automatically identify and perform alternative display based on the registered location information and images whether the location where the user is currently located is a location similar to a specific location registered and specified by the user.

[0080] (3-2) Automatic identification of applicable target (information leakage medium) In "Automatic identification of applicable target (information leakage medium)", (3-2-1) Automatic selection, (3-2-2) Specification of automatic identification target (information leakage medium), can be selected.

[0081] (3-2-1) Automatic selection Analyze the image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1, and automatically select the information leakage medium for performing the alternative display (Optional setting: For all the information leakage media registered by default (e.g., surveillance camera, person), automatically perform identification and alternative display based on the images of the information leakage media registered by default.). As a result, it is possible to control so as to automatically identify and perform alternative display for the information leakage medium.

[0082] (3-2-2). Specification of automatic identification target (information leakage medium) Analyze the images captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1, automatically identify the information leakage media pre-registered and specified by the user based on the images of the registered information leakage media, and perform alternative display (e.g., surveillance cameras, people. Target addition is possible, e.g., mobile terminals, etc.). Thereby, it is possible to control so as to automatically identify and perform alternative display for specific information leakage media pre-registered and specified by the user. You may press the "Automatic Identification Target Registration Setting" button 404 to add information leakage media.

[0083] FIG. 17 is a user setting screen for a detailed alternative display function.

[0084] In the user setting screen 410 of FIG. 17(a), the application conditions of the detailed alternative display function can be set. Specifically, it is possible to select whether to use the presence or absence of a "shelter", or either or both of "the belonging of a person / used device" as the application conditions.

[0085] The "shelter" can be applied when the "Applicable Location (Low Information Security): Automatic Identification" in the setting screen 400 of FIG. 16 is checked.

[0086] The "belonging of a person / used device" can be applied when the "Automatic Identification Target (Information Leakage Media) Specification" and "Person" in the setting screen 400 of FIG. 16 are checked. When "Person" is checked, identify people other than the surrounding users who do not belong and perform alternative display.

[0087] When the "Belonging Information Registration Setting" button 411 is pressed, the belonging information registration setting screen 420 of FIG. 17(b) is opened. Edit the belonging information of individual people and used devices on the belonging information registration setting screen 420 and press the "Registration Setting" button 421 to proceed to the belonging information detail screen 430 of FIG. 18. Here, FIGS. 17(b) and 18 show examples when the information regarding the "belonging of a person / used device" is classified for each same belonging, but the way of classifying the information regarding the "belonging of a person / used device" does not necessarily have to be limited to this example, and it may be in a form classified for each person or each used device, for example.

[0088] Figure 18 is the affiliated information registration settings screen. Hereinafter, each item of the affiliated information details screen 430 will be described. (1) Affiliated name... Arbitrary affiliated name. (2) Affiliated information... Specific affiliation (including information such as company (department, etc.)), family, club / circle, etc. In order to perform the alternative display control of FIG. 19 described later, it is desirable that the affiliated information can be defined in several levels. (3) Relevant person... A person who belongs to the relevant affiliation (register person identification information that can uniquely identify a person, such as an image or voice). (4) Equipment used... Equipment used in the relevant affiliation (PC, mobile terminal, etc.). (5) Specific confidential characters for non-relevant persons... Specific confidential characters (XX section, XX meeting,...). (6) Detailed alternative display function application conditions

[0089] The affiliated information details screen 430 is provided with "registration setting buttons" 431, 432, 433, 434, 435 for registration after editing each item of (1) affiliated name, (2) affiliated information, (3) relevant person, (4) equipment used, and (5) specific confidential characters for non-relevant persons.

[0090] The above (6) "detailed alternative display function application conditions" are (6-1) "Non-relevant person identification (user standard)" (6-2) "Non-relevant person identification (equipment used standard)" can be selected.

[0091] (6-1) "Non-relevant person identification (user standard)" Judge the identity between the affiliation of the user using a PC, etc. and the affiliation of others around the user, and perform alternative display control based on the judgment result. (6-2) "Non-relevant person identification (equipment used standard)" Judge the identity between the organization (affiliation) that manages the equipment such as the PC used by the user and the affiliation of others around the user, and perform alternative display control based on the judgment result.

[0092] In both the case of user criteria and the case of equipment criteria, by selecting "specific confidential characters for non-applicable persons", a screen such as an application screen containing specific confidential characters is alternatively displayed for non-applicable persons.

[0093] Thereby, detailed alternative display control can be performed according to the relationship between the user or the equipment used by the user and persons other than the surrounding users.

[0094] FIG. 19 is a diagram showing an example of alternative display control rule information applied when any one of "belonging of person / equipment used", "non-applicable person identification (user criteria)", and "non-applicable person identification (equipment criteria)" in the screen of FIG. 17(a) is selected.

[0095] "Belonging 1" and "Belonging 2" in the alternative display control rule information 440 in FIG. 19 correspond to the hierarchy of belonging defined in FIG. 18. FIG. 19 associates the hierarchy of belonging with the content of alternative display control.

[0096] For example, in the first row of FIG. 19, it is associated that the entire screen is alternatively displayed for a person who "does not belong to Belonging 1", that is, a person other than an employee of the company.

[0097] In the second row, for a person who "belongs to Belonging 1 but does not belong to Belonging 1+2~", that is, an employee of the company but a person in another department, an alternative display is made for the call / conference application screen and the application screen containing characters or symbols indicating that it is a confidential document.

[0098] In the third row, for a person who "belongs to Belonging 1+2~ but is not the user", that is, an employee of the company and a person in the same department, it is considered that the obligation to keep business information confidential is the same, and the private information of the user is alternatively displayed. As the private information of the user, there is an application screen containing the user's name, ID, and password characters.

[0099] (Alternative display control procedure) FIG. 20 is a flowchart (first half) showing the processing flow of the alternative display system according to the present embodiment, and FIG. 21 is a flowchart (second half) showing the processing flow of the alternative display system according to the present embodiment.

[0100] When the wearable terminal 1 starts the alternative display control, the alternative display control unit 125 checks the setting information (S101).

[0101] When a plurality of application conditions for the alternative display function are set, the necessity determination process of the alternative display in step S108 described later is performed in the order set in the "priority setting" of FIG. 16, so the priority setting information is also acquired in step S101. When the priority is not set but a plurality of application conditions are set, it may be set to perform the necessity determination using the application conditions in a predetermined order.

[0102] If it is set to "always not applicable", the process ends. If it is "always applicable" or "apply as appropriate", the alternative display control unit 125 transmits alternative display start / continuation information to the non-wearable terminal 2 (S102).

[0103] The alternative display start / continuation information also describes the request information for the data necessary for determining the application conditions of the alternative display defined by the setting information (see FIG. 16). For example, if "surveillance camera" is included in "application target (information leakage medium) automatic identification", it includes an imaging request by the non-wearable terminal 2.

[0104] Also, if "person" is included in "application target (information leakage medium) automatic identification", in addition to the imaging request by the non-wearable terminal 2, if the non-wearable terminal 2 has a ranging sensor, it may also request the acquisition of distance information.

[0105] The non-wearable terminal 2 receives the alternative display start / continuation information (S103) and collects the information used to determine the necessity of the alternative display based on it (S104).

[0106] In the non-wearable terminal 2, when imaging using the camera 206 mounted on the non-wearable terminal 2 and ranging of a person as an information leakage medium are required, ranging to the imaged person is performed (S104) and transmitted to the wearable terminal 1 (S105).

[0107] When "always apply" is selected, after the transmission and reception of the alternative display start / continuation information (S102, S103), the display 212 of the non-wearable terminal 2 is switched to non-display (skip to S112).

[0108] The wearable terminal 1 also collects information used to determine the necessity of alternative display (S106). In the wearable terminal 1, in addition to imaging, ranging, and position information from the positioning sensor 107, the microphone 113 picks up the user's voice within the range necessary for determining the necessity of alternative display.

[0109] The wearable terminal 1 acquires information about the location where the user is located collected by the wearable terminal 1 and the non-wearable terminal 2 (position information detected by the positioning sensor 107, images captured by the cameras 106 and 206), information about surrounding information leakage media (images captured by the cameras 106 and 206), user information (user affiliation information read from the setting information of the wearable terminal 1, voices picked up by the microphone 113, etc.), and device information received from the non-wearable terminal 2 (S107), and uses it for the necessity determination process of alternative display (S108). Details of the necessity determination process of alternative display will be described later (S108).

[0110] The necessity determination process of alternative display includes "alternative display control based on location position information and information about the surrounding environment as information about the location" (Figure 22), "alternative display control based on a surveillance camera as an information leakage medium" (Figure 23), "alternative display control based on others other than the user as an information leakage medium" (Figure 24), "alternative display control based on the user's affiliation" (Figure 25), and "alternative display control based on the affiliation of the device used" (Figure 26). These are processed according to the priority information read in S101.

[0111] As a result of the necessity determination process for alternative display, if alternative display is to be performed (S109: Yes), the wearable terminal 1 designates a screen area for alternative display and transmits alternative display instruction information indicating the screen area to the non-wearable terminal 2 (S110).

[0112] The non-wearable terminal 2 receives the alternative display instruction information (S111) and switches the screen area for alternative display to non-display (S112). Further, the non-displayed display data 300 is transmitted to the wearable terminal 1 (S113), and the wearable terminal 1 receives it (S114).

[0113] The wearable terminal 1 displays the information related to the received alternative display on the display 112 of the wearable terminal 1 (S115). If the alternative display is to be continued (S116: No), it returns to step S102, and the non-wearable terminal 2 and the wearable terminal 1 each collect information used for the necessity determination process of the alternative display. In addition, if "always apply" is selected, it returns to step S112.

[0114] If the alternative display control is to be terminated (S116: Yes), the alternative display termination information is transmitted from the wearable terminal 1 to the non-wearable terminal 2 (S117), and the non-wearable terminal 2 receives it (S118).

[0115] The non-wearable terminal 2 returns from non-display to normal display (S119) and also stops transmitting the display data to the wearable terminal 1. Then, the alternative display control of the wearable terminal 1 and the non-wearable terminal 2 is terminated.

[0116] (Alternative display control based on location information about the location and information about the surrounding environment as information about the location) FIG. 22 is a flowchart showing the flow of the process of alternative display control based on location information about the location and information about the surrounding environment as information about the location.

[0117] Instead, the alternative display control unit 125 acquires the position information of the user measured by the positioning sensor 107, the image showing the surrounding environment captured by the camera 206 or 106, and the distance information measured by the distance sensor 108, and refers to the setting information to determine whether the current position or the surrounding environment is a location where alternative display control is applicable (S201). If the determination result is negative (S201: No), the alternative display necessity determination process result is output so as to continue to the process when the alternative display is not executed (S109: No) (S205).

[0118] If the determination result is positive (S201: Yes), the alternative display control unit 125 refers to the setting information. If there is a condition setting by the shielding object (S202: Yes), the image recognition unit 121 analyzes the image captured by the camera 106 of the wearable terminal 1 or the camera 206 of the non-wearable terminal 2 to detect the shielding object, and the shielding object determination unit 122 determines the area of the screen to be made non-display according to the shielding object (S203). Then, the alternative display necessity determination process result is output so as to proceed to the process when the alternative display is executed (S109: Yes) (S205). In the above analysis of the image, the image recognition unit 121 detects the imaging area of the shielding object reflected in the image. Then, the shielding object determination unit 122 determines the area of the screen to be made non-display according to the height, opacity, and arrangement position of the shielding object.

[0119] If there is no condition setting by the shielding object (S202: No), the entire surface of the display 212 of the non-wearable terminal 2 is determined as the non-display area (S204), and the alternative display control unit 125 outputs the alternative display necessity determination process result so as to proceed to the process when the alternative display is executed (S109: Yes) (S205).

[0120] Thereby, it is possible to determine the necessity of alternative display control based on the position information of the location and the information regarding the surrounding environment, and further determine the non-display area according to the height of the shielding object and the like as the information regarding the surrounding environment of the location.

[0121] (Alternative Display Control Based on a Surveillance Camera as an Information Leakage Medium) FIG. 23 is a flowchart showing the processing flow of alternative display control based on a surveillance camera as an information leakage medium.

[0122] The image recognition unit 121 analyzes an image captured by the camera 106 of the wearable terminal 1 or an image captured by the camera 106 of the non-wearable terminal 2 to detect a surveillance camera, and the information leakage medium determination unit 124 determines whether the surveillance camera corresponds to an information leakage medium according to the position and orientation of the surveillance camera (S301). If the determination result is negative (S301: No), the necessity determination processing result of the alternative display is output so as to continue to the processing when the alternative display is not executed (S109: No) (S303).

[0123] If the determination result is positive (S301: Yes), the information leakage medium determination unit 124 determines to make the entire screen of the display 212 of the non-wearable terminal 2 non-display (S302), and the alternative display control unit 125 outputs the necessity determination processing result of the alternative display so as to proceed to the processing when the alternative display is executed (S109: Yes) (S303).

[0124] Thereby, when there is a risk that information displayed on the display 212 of the non-wearable terminal 2 leaks from the surveillance camera based on the position and orientation of the surveillance camera, an alternative display is performed, and information security can be enhanced.

[0125] (Alternative display control based on someone other than the user as an information leakage medium) FIG. 24 is a flowchart showing the processing flow of alternative display control based on someone other than the user as an information leakage medium.

[0126] The image recognition unit 121 analyzes an image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1 to determine whether someone other than the user is captured (S401). If the determination result is negative (S401: No), the necessity determination processing result of the alternative display is output so as to continue to the processing when the alternative display is not executed (S109: No) (S405).

[0127] If the determination result is affirmative (S401: Yes), the information leakage medium determination unit 124 determines whether the distance from the non-wearable terminal 2 to another person is within a first distance range for determining whether the information on the display 212 can be read (S402). If the determination result is affirmative (S402: Yes), the information leakage medium determination unit 124 determines to make the entire screen of the display 212 non-display (S403), and the alternative display control unit 125 outputs the result of the necessity determination process of the alternative display so as to proceed to the process when executing the alternative display (S109: Yes) (S405).

[0128] If the distance from the non-wearable terminal 2 to another person is farther than the first distance range (S402: No), if the face of another person is facing the display 212 (S404: Yes), the information leakage medium determination unit 124 determines to make the entire screen non-display (S403), and the alternative display control unit 125 outputs the result of the necessity determination process of the alternative display so as to proceed to the process when executing the alternative display (S109: Yes) (S405).

[0129] On the other hand, if the distance from the non-wearable terminal 2 to another person is farther than the first distance range (S402: No), if the face of another person is not facing the display 212 (S404: No), the information leakage medium determination unit 124 outputs the result of the necessity determination process of the alternative display so as to proceed to the process when not executing the alternative display (S109: No) (S405).

[0130] Thereby, when another person is near the user or the face of another person is facing the display 212 of the non-wearable terminal 2, alternative display can be performed, and information security can be enhanced.

[0131] (Alternative display control based on the affiliation of a person) FIG. 25 is a flowchart showing the flow of the process of alternative display control based on the affiliation of a person.

[0132] The image recognition unit 121 analyzes the image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1, and determines whether a person other than the user is being imaged (S501). If the determination result is negative (S501: No), the necessity determination processing result of the alternative display is output so as to continue to the processing when the alternative display is not executed (S109: No) (S503).

[0133] If the determination result is positive (S501: Yes), the alternative display control unit 125 refers to the affiliation information set on the affiliation information details screen 430 (see FIG. 18), and determines the identity between the user's affiliation and the affiliation of the other person (S502). Then, the alternative display control unit 125 refers to the alternative display control rule information 440 (see FIG. 19), determines the alternative display control content, and outputs the necessity determination processing result of the alternative display so as to proceed to the processing when the alternative display is executed (S109: Yes) (S503).

[0134] Thereby, when another person is near the user, an alternative display can be performed according to the affiliations of the other person and the user, and the information security can be enhanced.

[0135] (Alternative display control based on the affiliation of the device in use) FIG. 26 is a flowchart showing the flow of the alternative display control process based on the affiliation of a person.

[0136] The image recognition unit 121 analyzes the image captured by the camera 206 of the non-wearable terminal 2 or the camera 106 of the wearable terminal 1, and determines whether a person other than the user is being imaged (S601). If the determination result is negative (S601: No), the necessity determination processing result of the alternative display is output so as to continue to the processing when the alternative display is not executed (S109: No) (S603).

[0137] When the determination result is affirmative (S601: Yes), the alternative display control unit 125 refers to the affiliation information set on the affiliation information details screen 430 (see FIG. 18), and determines the identity between the organization (affiliation) that manages the non-wearable terminal 2 and the affiliations of others (S602). Then, the alternative display control unit 125 refers to the alternative display control rule information 440 (see FIG. 19), determines the alternative display control content, and outputs the result of the necessity determination process for alternative display so as to proceed to the process (S109: Yes) when executing the alternative display.

[0138] As a result, when there are others who do not belong to the organization (affiliation) that manages the non-wearable terminal, alternative display can be performed to enhance information security.

[0139] According to the present embodiment, according to the location where the user uses the non-wearable terminal and the surrounding situation (the necessity of alternative display), the display of the non-wearable terminal is switched to a dark screen or a mask screen, and the information to be protected from leakage is displayed on the display of the wearable terminal, so that others cannot Leakage peek at or snoop on the screen of the display of the non-wearable terminal, thereby preventing information leakage and enhancing the information security of the non-wearable terminal.

[0140] This embodiment is not intended to limit the present invention, and any combination of the examples shown in the above embodiments is included in the present invention. Further, it is also possible to add functions to the above embodiments for modification.

[0141] For example, in this embodiment, the alternative display program 120 is installed in the wearable terminal 1, but the alternative display program 120 may be installed in the non-wearable terminal 2, and after the wearable terminal 1 and the non-wearable terminal 2 are connected, the non-wearable terminal 2 may determine whether to execute alternative display control.

[0142] Also, the non-display process for the display 212 of the non-wearable terminal 2 in this embodiment may be considered to include brightness control, masking process, mosaic process, etc. of the display 212 of the non-wearable terminal 2.

[0143] In addition, numerical values, messages, etc. that appear in the text or drawings are merely examples, and using different ones will not impair the effects of the present invention.

[0144] In addition, the programs described in each processing example may be independent programs, or a plurality of programs may constitute one application program. Also, the order in which each process is performed may be changed and executed.

[0145] The functions, etc. of the present invention described above may be realized in hardware by designing part or all of them, for example, with an integrated circuit, a general-purpose processor, or an application-specific processor. A processor includes transistors and other circuits and is regarded as circuitry or processing circuitry. Also, it may be realized in software by a processor unit or the like interpreting and executing an operation program that realizes each function, etc. Hardware and software may be used in combination.

[0146] In addition, the control lines and information lines shown in the drawings show those considered necessary for explanation, and do not necessarily show all the control lines and information lines on the product. In fact, it may be considered that almost all components are interconnected.

[0147] The above-described embodiment includes the following forms. (Form of the first aspect) A wearable terminal, A display, A communication device that receives display data of a non-wearable terminal, A processor, and The processor transmits a control signal to make the display data received from the non-wearable terminal non-displayed via the communication device, and executes alternative display control to receive the display data of the non-wearable terminal and display the display data on the display. A wearable terminal.

[0148] (Form of the second aspect) A linked display system including a wearable terminal and a non-wearable terminal, The wearable terminal is, A first display, A first communication device that receives display data of the non-wearable terminal, A first processor, and is provided with, The non-wearable terminal is, A second display, A second communication device that transmits display data to the wearable terminal, A second processor, and is provided with, The first processor transmits a control signal to make the display data non-displayed to the non-wearable terminal via the first communication device, receives the display data of the non-wearable terminal, and executes alternative display control to display the display data on the first display, The second processor receives the control signal via the second communication device, makes the display data non-displayed on the second display, and transmits the display data to the wearable terminal, Linked display system.

[0149] (Form of the third aspect) A linked display method executed between a wearable terminal and a non-wearable terminal, A step of transmitting, from the wearable terminal to the non-wearable terminal, a control signal for making the display data displayed on the display of the non-wearable terminal non-displayed, A step of making the display data non-displayed on the display of the non-wearable terminal and transmitting the display data to the wearable terminal, A step of the wearable terminal receiving the display data from the non-wearable terminal, A step of displaying the display data on a display provided in the wearable terminal, Linked display method including.

Explanation of reference numerals

[0150] 1: Wearable terminal, 2: Non-wearable terminal, 2A: Notebook computer, 2C: Mobile terminal, 4: Server, 5: External network, 10: Alternative display system 100: HMD, 100s: AR glasses, 101: Processor, 102: Memory, 103: Storage, 104: Operation input interface, 106: Camera, 107: Positioning sensor, 108: Distance measuring sensor, 109: Acceleration sensor, 110: Gyro sensor, 111: Geomagnetic sensor, 112: Display, 113: Microphone, 114: Speaker, 115: Timer, 116: Network communication device, 117: BT communication device, 118: Bus, 120: Alternative display program, 121: Image recognition unit, 122: Occluder determination unit, 123: Non-display area determination unit, 124: Information leakage medium determination unit, 125: Alternative display control unit, 126: Display data reception unit, 127: Virtual reality object display unit, 130: Data, 131: Location information, 132: Information leakage medium information, 133: Alternative display control information, 140: Non-display switching program, 141: Display switching unit, 142: Display data transmission unit 201: Processor, 202: Memory, 203: Storage, 204: Operation input interface, 206: Camera, 212: Display, 212A: Display, 212B: Display, 212C: Display, 216: Network communication device, 217: BT communication device, 218: Bus 300: Display data, 301: Application screen, 320: Occluder, 320a: Occluder, 320b: Occluder, 350: Surveillance camera, 360: Others 400: Setting screen, 401: Priority setting button, 402: Non-applicable location registration setting button, 403: Automatically recognized location registration setting button, 404: Automatically identified location registration setting button, 410: User setting screen, 411: Affiliation information registration setting button, 420: Affiliation information registration setting screen, 421: Registration setting button, 430: Affiliation information details screen, 431: Registration setting button, 432: Registration setting button, 433: Registration setting button, 434: Registration setting button, 435: Registration setting button, 440: Alternative display control rule information

Claims

1. A wearable terminal, comprising: a display; a communication device that receives display data of a non-wearable terminal; a memory; a processor, wherein the processor transmits a control signal to make the display data received from the non-wearable terminal non-displayed via the communication device based on information regarding a location or information regarding an information leakage medium stored in the memory, and executes alternative display control to receive the display data of the non-wearable terminal and display the display data on the display; a wearable terminal.

2. The wearable terminal according to claim 1, further comprising: a positioning sensor that detects position information; a camera that images a surrounding environment, wherein the memory stores, as the information regarding the location, the position information detected by the positioning sensor or an image captured by the camera; a wearable terminal.

3. The wearable terminal according to claim 2, wherein the memory stores the position information detected by the positioning sensor or the image captured by the camera as pre-registered information for executing the alternative display control, and the processor executes the alternative display control when it determines that the location where the user is located is not recorded in the pre-registered information; a wearable terminal.

4. The wearable terminal according to claim 2, wherein the processor analyzes the image captured by the camera to recognize an object blocking the display of the non-wearable terminal, and determines a screen area to be made non-displayed on the display of the non-wearable terminal according to at least one of the height, transparency of the object blocking the display, or the position of the object blocking the display with respect to the non-wearable terminal; a wearable terminal.

5. The wearable terminal according to claim 1, further comprising: a camera, wherein the processor analyzes at least one of the image captured by the camera and the image captured by a camera mounted on the non-wearable terminal based on the information regarding the information leakage medium to recognize an information leakage medium located around the display of the non-wearable terminal, and executes the alternative display control according to at least one of the position and orientation of the information leakage medium with respect to the non-wearable terminal; a wearable terminal.

6. The wearable terminal according to claim 5, The information leakage medium is a surveillance camera or someone other than the user of the wearable terminal. Wearable terminal.

7. The wearable terminal according to claim 5, wherein the memory stores user information associating the organization to which the user of the wearable terminal belongs with identification information of others belonging to the organization, and the processor analyzes an image captured by the camera to determine the identity of a person captured by the camera and the others belonging to the organization to which the user belongs included in the user information, and executes the alternative display control based on the determination result. Wearable terminal.

8. The wearable terminal according to claim 5, wherein the memory stores user information associating the organization to which the user of the wearable terminal belongs with identification information of others belonging to the organization, and the processor analyzes an image captured by the camera to collate the person captured by the camera with the user information, determines the identity of the organization to which the user belongs and the organization to which the person captured by the camera belongs, and executes the alternative display control based on the determination result. Wearable terminal.

9. The wearable terminal according to claim 5, wherein the memory stores ownership information of a usage device associating the organization that manages the wearable terminal with identification information of others belonging to the organization, and the processor analyzes an image captured by the camera to collate the person captured by the camera with the ownership information of the usage device, determines the identity of the organization that manages the wearable terminal and the organization to which the person captured by the camera belongs, and executes the alternative display control based on the determination result. Wearable terminal.

10. A linked display system including a wearable terminal and a non-wearable terminal, wherein the wearable terminal includes a first display, a first communication unit that receives display data of the non-wearable terminal, and a first processor, and the non-wearable terminal includes a second display, a second communication unit that transmits display data to the wearable terminal, and a second processor, wherein the first processor transmits a control signal for making the display data non-displayable to the non-wearable terminal via the first communication unit, receives the display data of the non-wearable terminal, and executes alternative display control for displaying the display data on the first display. The second processor receives the control signal via the second communicator, makes the display data non-displayed on the second display, and transmits the display data to the wearable terminal. Linked display system. **Claim 11** The linked display system according to claim 10, wherein the wearable terminal further includes a memory, and the first processor executes the alternative display control based on information regarding a location or information regarding an information leakage medium stored in the memory. Linked display system. **Claim 12** A linked display method executed between a wearable terminal and a non-wearable terminal, the method including: transmitting, from the wearable terminal to the non-wearable terminal, a control signal for making non-displayed display data displayed on a display of the non-wearable terminal based on information regarding a location or information regarding an information leakage medium stored in a memory of the wearable terminal; making the display data non-displayed on the display of the non-wearable terminal and transmitting the display data to the wearable terminal; receiving, by the wearable terminal from the non-wearable terminal, the display data; and displaying the display data on a display provided in the wearable terminal. Linked display method including the above steps.

Citation Information

Patent Citations

  • Medical image display device and medical image display method

    JP2008036005A

  • Electronic apparatus, system and method

    JP2015172884A

  • Operation display device, image forming apparatus, program, and operation display system

    JP2016130916A

  • Privacy Screen

    JP2020536311A

  • Controlled display of content on wearable displays

    US20160239091A1