Wearable terminal, linked display system, and linked display method
Patent Information
- Application Number
- JP2024528143
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-06-21
- Filing Date
- 2022-06-21
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2042-06-21
Abstract
Description
Wearable terminal, linked display system, and linked display method
[0001] The present invention relates to a wearable terminal, an linked display system, and an linked display method, and more particularly to a display technology that links a wearable display terminal and a non-wearable display terminal.
[0002] Regarding a coordinated display system using multiple displays, Patent Document 1 states, "A first device coupled to a first display and an image sensor receives output data from a second device having a second display different from the first display. The output data represents content displayable by the second device on the second display. The first device uses the image sensor to determine a position of the second display relative to the first device, and causes the first display to display content based on the output data received from the second device and the determined position of the second display relative to the first device. (Abstract excerpt)."
[0003] Special Publication No. 2020-536311
[0004] The display screens of non-wearable devices such as desktop computers, laptops, and tablets can be viewed by people other than the user of the non-wearable device. Although there are anti-peeping filters to prevent this, depending on the angle at which the screen is viewed, it is possible to read the information on the screen through the filter, so there is a demand for an effective way to prevent information leaks.
[0005] Therefore, it is conceivable to use the display technology of Patent Document 1, but Patent Document 1 simply displays the image of the screen of the PC or mobile device on the HMD screen so as to match the screen position of the PC or mobile device when the user arbitrarily selects it or when it is determined that the user is looking at a PC or mobile device using an HMD, and does not take into consideration the viewpoint of preventing information leakage depending on the location or surrounding conditions where the user uses a non-wearable device such as a PC. Therefore, security cannot be maintained by simply displaying output data of a first device on a second device.
[0006] The present invention has been made in view of the above-mentioned points, and has as its object to improve information security by preventing others from peeking at the screen.
[0007] In order to solve the above problems, the present invention has the configurations described in the claims.
[0008] According to the present invention, it is possible to prevent others from peeking at the screen and improve the security of information. Objects, configurations, and effects other than those described above will become apparent from the following embodiments.
[0009] 1 is a schematic diagram of an alternative display system according to an embodiment of the present invention; FIG. 1 is a schematic diagram of a non-wearable terminal; FIG. 2 is an external view of a wearable terminal, where (a) shows an HMD and (b) shows AR glasses; FIG. 2 is a functional block diagram of an alternative display system; FIG. 3 is a diagram showing the field of view of other people and the user during alternative display when a laptop computer is used as the non-wearable terminal; FIG. 4 is a diagram showing the field of view of other people and the user during alternative display when a desktop PC is used as the non-wearable terminal; FIG. 5 is a diagram showing the field of view of other people and the user during alternative display when a mobile terminal is used as the non-wearable terminal; FIG. 6 is a diagram showing an example of alternative display control based on location information and information about the surrounding environment as information about a location, where (a) shows an example of use in a non-private office space, (b) shows an example of use in one's own room, and (c) shows an example of use in an office; FIG. 7 is a diagram showing an example of alternative display control based on the presence or absence of an obstruction, which is a modified example of alternative display control based on location information and information about the surrounding environment as information about a location. FIG. 8 is a diagram showing an example of alternative display control based on the height of an obstruction, where (a) shows a case where the obstruction is not high enough, and (b) shows the user's field of view. 12A and 12B are diagrams showing an example of alternative display control according to the depth of an obstruction, where (a) shows a case where the obstruction is not close, and (b) shows the user's field of view. 12B are diagrams showing an example of alternative display control in a space where a surveillance camera is installed as an information leak medium, where (a) is an example where alternative display is performed and (b) is an example where alternative display is not performed. 12C are diagrams showing a situation where a surveillance camera is not installed in the same space as FIG. 11. 12C are diagrams showing an example of alternative display control based on other people other than the user as information leak media. 12C are diagrams showing an example of alternative display control when other people are located farther than a first distance, where (a) is an example where alternative display is performed and (b) is an example where alternative display is not performed. 12D are diagrams showing an example where other people are located farther than the first distance and alternative display is not performed. 12E are diagrams showing an example of a user setting screen for the alternative display function. 12F are diagrams showing a user setting screen for the detailed alternative display function. 12G are diagrams showing an affiliation information registration setting screen. 12H are diagrams showing example alternative display control rule information. 12H are diagrams showing the first half of a flowchart showing the processing flow of an alternative display system according to an embodiment. 12H are diagrams showing the second half of a flowchart showing the processing flow of an alternative display system according to an embodiment. 10 is a flowchart showing the flow of processing for alternative display control based on location information of a place and information about the surrounding environment as information about a place.Fig. 1 is a flowchart showing the process flow of alternative display control based on a surveillance camera as an information leak medium. Fig. 2 is a flowchart showing the process flow of alternative display control based on a person's affiliation. Fig. 3 is a flowchart showing the process flow of alternative display control based on a person's affiliation.
[0010] The present invention is useful for preventing the leakage of information displayed on non-wearable devices, thereby increasing the commercial value of non-wearable devices to which the present invention is applied, and is therefore expected to contribute to goal 8.2 of the United Nations' Sustainable Development Goals (SDGs) (increasing economic productivity through diversification, technological improvement, and innovation, particularly in industries that increase the value of goods and services and in labor-intensive industries).
[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The same components are designated by the same reference numerals throughout the drawings, and redundant explanations will be omitted.
[0012] (Schematic Configuration of Alternative Display System) Fig. 1A is a schematic configuration diagram of an alternative display system according to this embodiment. Fig. 1B is a schematic configuration diagram of a non-wearable terminal. Fig. 2 is an external view of a wearable terminal, in which (a) shows an HMD and (b) shows AR glasses.
[0013] 1A is configured by wirelessly connecting a wearable device 1 and a non-wearable device 2. The wireless communication connection may be a direct connection between the wearable device 1 and the non-wearable device 2 using short-range wireless communication such as Bluetooth (registered trademark), or an indirect connection via a LAN.
[0014] The wearable device 1 used in the alternative display system 10 may be a device whose screen can be viewed only by the user wearing the wearable device 1. Specific examples include the HMD 100 shown in FIG. 2(a) and the AR glasses 100s shown in FIG. 2(b).
[0015] Returning to FIG. 1, the wearable terminal 1 includes a processor 101 (corresponding to the first processor), a memory 102, a storage 103, an operation input interface 104, a camera 106, a positioning sensor 107, a distance measurement sensor 108, an acceleration sensor 109, a gyro sensor 110, a geomagnetic sensor 111, a display 112 (corresponding to the first display), a microphone 113, a speaker 114, a timer 115, a network communication device 116, and a BT communication device 117 (BT: Bluetooth (registered trademark)), which are connected to each other via a bus 118.
[0016] The storage 103 stores an alternative display program 120, which the processor 101 loads and saves in the memory 102 and executes.
[0017] Furthermore, the storage 103 stores data 130 that is generated in the process and as a result of executing the alternative display program 120. The data 130 includes location information 131, information leak medium information 132, and alternative display control information 133. The location information 131, information leak medium information 132, and alternative display control information 133 are input from a setting screen 400 (see FIG. 16), a user setting screen 410 (FIG. 17(a)), an affiliation information registration setting screen 420 (FIG. 17(b)), and an affiliation information detail screen 430 (FIG. 18), which will be described later.
[0018] The distance measurement sensor 108 is a sensor that outputs distance information to a physical object to be measured. For example, it may be a sensor that calculates the distance to a feature point such as the contour of the physical object using an image with parallax, such as a stereo camera, and outputs the distance information. Alternatively, it may be a sensor that measures the distance by two-dimensionally irradiating a light beam onto the measurement object, such as a TOF (Time of Flight) method.
[0019] The network communication device 116 is a communication device that realizes a communication function for wireless communication using the Wi-Fi (registered trademark) standard, etc. The network communication device 116 may be communicatively connected to the server 4 via a LAN or an external network 5. Update programs may be downloaded from the server 4.
[0020] The BT communication device 117 is a communication device that uses Bluetooth (registered trademark) and performs short-range wireless communication with a non-wearable device 2 that performs alternative display processing, such as a personal computer (including a laptop or desktop computer) or a mobile device (including a smartphone or tablet).
[0021] The display 112 is a see-through display. The user sees the real world viewed through the display 112 and the virtual reality objects displayed on the display 112 are superimposed on the real world.
[0022] The non-wearable device 2 is a device whose screen can be viewed by someone other than the user of the wearable device 1, and is, for example, a desktop computer connected to a monitor, a laptop computer, a smartphone, or a tablet.
[0023] As shown in FIG. 1B, the non-wearable terminal 2 includes a processor 201 (corresponding to a second processor), a memory 202, a storage 203, an operation input interface 204, a camera 206, a display 212 (corresponding to a second display), a network communication device 216, and a BT communication device 217, which are connected to each other via a bus 218.
[0024] When a smartphone or tablet is used as the non-wearable device 2, in addition to the above configuration, it also has a ranging sensor, a positioning sensor, etc., but the non-wearable device 2 used in the alternative display system 10 does not necessarily need to have a ranging sensor or a positioning sensor, so they are omitted from Figure 1B.
[0025] When a non-display switching program 140 stored in the storage 203 receives a control signal from the wearable terminal 1 to hide display data that is currently being displayed or will be displayed on the display 212, the non-display switching program 140 hides the display data that is currently being displayed or will be displayed on the display 212 and transmits the display data to the wearable terminal 1.
[0026] In this embodiment, an alternative display program 120 is installed in the wearable device 1, and the wearable device 1 determines whether or not to execute alternative display control. A non-display switching program 140 installed in the non-wearable device 2 mainly executes display control to hide the display 212 of the non-wearable device 2 in response to a control signal from the wearable device 1.
[0027] FIG. 3 is a functional block diagram of an alternative display system.
[0028] The alternative display program 120 includes an image recognition unit 121 , an obstruction determination unit 122 , a non-display area determination unit 123 , an information leak medium determination unit 124 , an alternative display control unit 125 , a display data receiving unit 126 , and a virtual reality object display unit 127 .
[0029] The image recognition unit 121 analyzes the image captured by the camera 106, 206 mounted on the wearable device 1 or the non-wearable device 2, and performs subject recognition processing.
[0030] The obstructing object determining unit 122 determines the height, position, opacity, etc. of the obstructing object when the obstructing object is captured as a subject.
[0031] The non-display area determination unit 123 determines a non-display area according to the obstruction based on the determination result by the obstruction determination unit 122 .
[0032] The information leaking medium determining unit 124 determines whether or not the subject corresponds to an information leaking medium.
[0033] The alternative display control unit 125 determines when to start and end the alternative display, and whether or not alternative display control is required based on position information and image information.
[0034] The display data receiving unit 126 receives display data for performing an alternative display from the non-wearable device 2 .
[0035] The virtual reality object display unit 127 detects the position of the display 212 of the non-wearable device 2 based on the image captured by the camera 106 of the wearable device 1, and displays the display data on the display 112 of the wearable device 1 so that it overlaps the display 212 of the non-wearable device 2. As a result, the display data is displayed on the display 112 as a virtual reality object.
[0036] The non-display switching program 140 includes a display switching module 141 and a display data transmission module 142 .
[0037] The display switching unit 141 switches between displaying and hiding the display 212 based on a control signal from the wearable device 1 that instructs the start and end of the alternative display.
[0038] The display data transmission unit 142 transmits display data for performing alternative display to the wearable device 1.
[0039] (Comparison of Other People's Views and User's Views) The user's view during alternative display will be described with reference to Figures 4, 5, and 6. Figure 4 is a diagram showing the view of other people and the user during alternative display using a laptop computer. Figure 5 is a diagram showing the view of other people and the user during alternative display using a desktop computer. Figure 6 is a diagram showing the view of other people and the user during alternative display using a mobile device.
[0040] 4, during the alternative display, the display 212A of the notebook computer 2A is hidden, and the information that the user originally wanted to view is not displayed. Therefore, in the field of view of others, the display 212 of the notebook computer 2A is a hidden screen. The notebook computer 2A transmits the display data 300 that was to be displayed on the display 212A to the wearable device 1.
[0041] The wearable device 1 detects the position of the display 212A, and displays the display data 300 on the display 112 of the wearable device 1 so that the display data 300 overlaps with a position where the display 212A is visible through the display 112. Therefore, from the perspective of the user wearing the wearable device 1, the display data 300 appears to be displayed on the display 212A of the notebook computer 2A.
[0042] FIG. 5 shows a state in which a desktop personal computer (not shown) and the wearable device 1 are communicatively connected, and a display 212B connected to the desktop personal computer is displayed on the wearable device 1 instead.
[0043] FIG. 6 shows a state in which the portable terminal 2C and the wearable terminal 1 are connected for communication and the display 212C of the portable terminal 2C is displayed on the wearable terminal 1 instead.
[0044] 4, 5, and 6, the user sees the display data 300 displayed on the display 112 of the wearable device 1 superimposed on the display 212 of the non-wearable device 2 in the real world as viewed through the display 112 of the wearable device 1. Meanwhile, the display 212 of the non-wearable device 2 is hidden, so that the user sees the display data 300 displayed on the display 212 of the non-wearable device 2, but the display data 300 is invisible to others.
[0045] (Alternative display control based on location information of the location and information on the surrounding environment as information related to the location) Figure 7 shows an example of alternative display control based on location information of the location and information on the surrounding environment as information related to the location, where (a) shows an example of use in a non-private office space, (b) shows an example of use in one's own room, and (c) shows an example of use in an office.
[0046] Figure 7(a) shows an example of use without prior registration, such as in a non-private office space. In this case, an alternative display is provided.
[0047] Figure 7(b) shows an example of use in one's own room (pre-registered), and Figure 7(c) shows an example of use in an office (pre-registered). Places where others do not enter, such as one's own room, and offices are considered to have high information security because they are subject to the same confidentiality obligations as the user. Therefore, location information and images showing the surrounding environment of places with high information security are acquired using the positioning sensor 107 and camera 106 and pre-registered, and the substitute display function is controlled not to operate in pre-registered places, but to operate in places not pre-registered. This makes it possible to control the substitute display function based on location information and images of pre-registered places and the user's current location as location information.
[0048] (Variant example of alternative display control based on location information of the location and information about the surrounding environment as information about the location: Obstructions) Figure 8 is a variant example of alternative display control based on location information of the location and information about the surrounding environment as information about the location, and is a diagram showing an example of alternative display control based on the presence or absence of obstructions to the non-wearable device 2 as information about the surrounding environment.
[0049] If there are opaque obstructions 320, such as partitions or walls, on either side of the display 212 of the non-wearable device 2 used by the user, the display 212 of the non-wearable device 2 cannot be seen from the seat next to the user (FIG. 8 illustrates the state of the display 212 of the non-wearable device 2 so that it is clear), and therefore the information security of the location where the user is located is higher than when there is no partition or wall. Therefore, the image captured by the camera 106 of the wearable device 1 or the camera 206 of the non-wearable device 2 may be analyzed to determine whether or not there is a partition, and if it is determined that there is an obstruction 320 that prevents the display 212 from being seen, control may be exercised to prevent the alternative display from being displayed.
[0050] 9 is a diagram showing an example of alternative display control depending on the height of an obstruction relative to the non-wearable device 2, where (a) shows a case where the obstruction is not high enough, and (b) shows the user's field of view. Fig. 10 is a diagram showing an example of alternative display control depending on the depth of an obstruction relative to the non-wearable device 2, where (a) shows a case where the obstruction is not close, and (b) shows the user's field of view. The area visible from the outside of the display 212 changes depending on the height and depth of the obstruction (Figs. 9 and 10 are illustrated so that the state of the display 212 of the non-wearable device 2 can be seen), and therefore the information security of the location differs.
[0051] When the height of the non-transparent portion of the shield 320a is low, information security is higher compared to when there is no shield, but information security is lower compared to when the shield is sufficiently high. In this case, an application screen relating to the area where the display 212 of the non-wearable device 2 is visible from the left and right may be alternatively displayed. For example, in FIG. 9( a), the height of the shield 320a is lower than the upper end of the display 212 of the non-wearable device 2. Therefore, the application screen relating to the area above half of the non-wearable device 2 is hidden.
[0052] Display data 300 of the hidden application screen is transmitted to and alternatively displayed on the wearable device 1, and therefore, to the user wearing the wearable device 1, the application screen alternatively displayed on the wearable device 1 appears to be superimposed on the display 212 of the non-wearable device 2, as shown in Fig. 9(b) . On the other hand, the application screen 301 is displayed on the display 212 of the non-wearable device 2, and is therefore not displayed on the wearable device 1. The user can see the application screen 301 actually displayed on the display 212 of the non-wearable device 2 through the display 112 of the wearable device 1.
[0053] 10 is a diagram showing an example of alternative display control depending on the depth of an obstruction relative to the non-wearable device 2. The height of the obstruction 320b, a partition, is equal to or higher than the top end of the non-wearable device 2, but is short in the depth direction, and the partition does not obstruct the area from the front of the desk to the center in the depth direction. Therefore, since the lower left of the non-wearable device 2 can be obstructed by the partition, an alternative display is not performed and the application screen 301 is displayed, but an alternative display is performed for the application screen above half of the display 212 and on the right side.
[0054] Display data 300 of the hidden application screen is transmitted to and alternatively displayed on the wearable device 1, and therefore, to the user wearing the wearable device 1, the application screen alternatively displayed on the wearable device 1 appears to be superimposed on the display 212 of the non-wearable device 2, as shown in Fig. 10(b) . On the other hand, the application screen 301 is displayed on the display 212 of the non-wearable device 2, and is therefore not displayed on the wearable device 1. The user can see the application screen 301 actually displayed on the display 212 of the non-wearable device 2 through the display 112 of the wearable device 1.
[0055] This allows alternative display control to be performed based on information about the transparency and shape of an obstruction relative to the non-wearable device 2, as information about the surrounding environment of the location where the user operates the non-wearable device 2, and allows control to be performed so that only an application screen that spans a partial area of the display 212 of the non-wearable device 2 that is difficult to obstruct is alternatively displayed based on the transparency and shape of the obstruction. If the performance, such as image quality, of the screen of a wearable device 1 such as an HMD or AR glasses is poorer than that of a non-wearable device 2 such as a PC, alternative display may be a factor that impairs usability of the non-wearable device 2 for the user. Therefore, by limiting the area of the screen on which alternative display is performed to only the necessary part, it is possible to improve information security while suppressing a decrease in usability of the non-wearable device 2 for the user.
[0056] (Alternative display control based on surveillance cameras as information leaking media) An example of alternative display control depending on the presence or absence of surveillance cameras as information on information leaking media will be described. Figure 11 is a diagram showing an example of alternative display control in a space where surveillance cameras are installed, where (a) is an example where alternative display is performed and (b) is an example where alternative display is not performed. Figure 12 is a diagram showing a situation where no surveillance cameras are installed in the same space as Figure 11.
[0057] 11A and 11B, a surveillance camera 350 is installed in the room of a user who operates a non-wearable device 2. The surveillance camera 350 is an example of an information leak medium.
[0058] If the screen of the display 212 of the non-wearable device 2 is within the field of view of the surveillance camera 350, the display data displayed on the screen of the display 212 of the non-wearable device 2 will be reflected in the image of the surveillance camera 350, leading to information leakage.
[0059] Therefore, alternative display control may be performed based on the presence or absence of the surveillance camera 350 as information regarding the information leak medium.
[0060] 11A, the surveillance camera 350 is captured in an image captured by the camera 206 mounted on the non-wearable device 2. Therefore, since there is a possibility that the screen of the display 212 of the non-wearable device 2 may be reflected in the image of the surveillance camera 350, an alternative display is provided. Alternatively, the image may be captured by the camera 106 of the wearable device 1. In this case, the relationship between the position and orientation of the display 212 of the non-wearable device 2 and the surveillance camera 350 is analyzed based on the image captured by the camera 106 and the distance measurement results measured by the distance sensor 108.
[0061] 11(b), the surveillance camera 350 is captured in the image captured by the camera 106 of the wearable device 1, but the surveillance camera 350 is not captured in the image captured by the camera 206 mounted on the non-wearable device 2. Therefore, in FIG. 11(b), it can be determined that the orientation (shooting direction) of the surveillance camera 350 is such that it cannot capture the screen of the display 212, and therefore no alternative display is performed.
[0062] 12 shows the same space as in FIG. 11, but no surveillance camera is installed. Therefore, when the presence or absence of a surveillance camera 350 is determined based on the image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1, it is determined to be "not present," and no alternative display is performed.
[0063] According to this example, alternative display control can be performed for information regarding information leaking media depending on whether or not there is a surveillance camera 350 around the user or non-wearable device 2 and the lens direction (shooting direction) of the surveillance camera 350.
[0064] (Alternative Display Control Based on Others than the User as Information Leaking Media) FIG. 13 is a diagram showing an example of alternative display control based on other people than the user as information leaking media.
[0065] If a person 360 other than the user is captured in an image captured by the camera 206 of the non-wearable device 2, the non-wearable device 2 measures the distance to that person. This distance measurement can be performed using distance information from a distance sensor if the non-wearable device 2 is equipped with one. If a distance sensor is not equipped, the distance can be estimated from the image captured by the camera 206. In this case, for example, if the ratio between the size of the user's face and the size of the other person's face is a predetermined ratio, the distance to the user and the distance to the other person can be determined to be approximately equal, using the non-wearable device 2 as a reference. Furthermore, image capture and distance measurement can be performed using the camera 106 and distance sensor 108 of the wearable device 1. In this case, the relationship between the position and orientation of the person 360 other than the user and the display 212 of the non-wearable device 2 is analyzed based on the image captured by the camera 106 and the distance measurement results measured by the distance sensor 108.
[0066] If the distance from the non-wearable device 2 to another person is within a first distance range for determining whether it is possible to read information on the display 212, the alternative display is executed. For example, the first distance range is set to a distance approximately equal to the distance between the user and the non-wearable device 2.
[0067] 14A and 14B are diagrams showing examples of alternative display control when another person 360 is present at a location farther than the first distance, where (a) is an example in which an alternative display is performed, and (b) is an example in which an alternative display is not performed.
[0068] 14A shows a case where another person 360 is located further away than the first distance range and the face of the other person 360 is in a position where it can be seen from the display 212 of the non-wearable device 2. If the image of the other person is recognized by analyzing an image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1, an alternative display is performed.
[0069] 14(b) shows a case where another person 360 is located further away than the first distance range, and the face of the other person 360 cannot be seen from the display 212 of the non-wearable device 2. In this case, the display 212 is hidden by the user's shadow from the other person 360, and it is highly likely that the information will be unreadable, so no alternative display is performed.
[0070] FIG. 15 is a diagram showing an example in which another person 360 is present at a location farther than the first distance and no alternative display is performed.
[0071] 15, another person 360 is outside the first distance range. Furthermore, the other person 360 has their back to the non-wearable device 2, so the data displayed on the display 212 cannot be read. Therefore, in this case, no alternative display is performed.
[0072] This allows alternative display control to be performed based on the presence, position, and orientation of other people 360 present around the user or non-wearable device 2 as information about the information leaking medium.
[0073] (Settings Screen) The settings for the alternative display are performed on the wearable device 1, but may also be performed on the non-wearable device 2 and the setting information transmitted after pairing with the wearable device 1. Fig. 16 shows an example of a user settings screen for the alternative display function.
[0074] The setting screen 400 in FIG. 16 has the following main items: (1) "Never applied (OFF)" (2) "Always applied (ON)" (3) "Applied as needed" and allows the user to select an application pattern.
[0075] (3) If "Timely application" is selected, it is possible to select (3-1) whether to apply timely based on the application location ("Application location (information security: low) automatic identification"), or (3-2) whether to apply timely based on the application target ("Application target (information leak medium) automatic identification"). It is also possible to select both, in which case the priority of the application location and the application target may be set using the "Priority setting" button 401. Using the priority, it is possible to set whether to control the alternative display depending on whether one of the conditions is met, or to control the alternative display by giving priority to one of the conditions. This makes it possible to prevent inconsistencies in the alternative display control. It is possible to control the alternative display according to the priority of the application conditions set by the user.
[0076] (3-1) Automatic identification of applicable locations (information security: low) In "Automatic identification of applicable locations (information security: low)," you can select: (3-1-1) "Exclude registered locations (information security: high)" to exclude previously registered locations; (3-1-2) "Automatic selection" of applicable locations; (3-1-3) "Specify automatically identified locations."
[0077] (3-1-1) Excluding registered locations (information security: high) By pressing the "Non-applicable location registration setting" button 402, location information and images of locations where alternative display control is not performed, such as one's home or one's room, are acquired by the positioning sensor 107 or the camera 106 and pre-registered as locations with high information security. Then, by selecting "Exclude registered locations (information security: high)", alternative display control is not performed at the pre-registered locations based on the location information and images of the pre-registered locations and the location where the user is currently located.
[0078] (3-1-2) Automatic Selection: Automatically selects a location for alternative display (automatic setting: automatically identifies whether the user's current location is similar to all locations registered by default (e.g., coffee shop, train, etc.) based on location information and images registered by default, and performs an alternative display). This allows control to automatically select locations with low information security and display them as an alternative.
[0079] (3-1-3) Location specification by automatic machine The user specifies in advance the locations to be automatically identified and displayed as an alternative. Spaces to be identified as applicable locations include "coffee shop," "library," "in a car," and "in a train." Additional locations to be automatically identified may be set by pressing the "Automatic Identification Location Registration Settings" button 403. This allows the system to automatically identify and display an alternative location based on the registered location information and image to determine whether the location where the user is currently located is similar to a specific location registered or specified by the user.
[0080] (3-2) Automatic Identification of Applicable Objects (Information Leak Media) In "Automatic Identification of Applicable Objects (Information Leak Media)", you can select (3-2-1) Automatic Selection, or (3-2-2) Specifying the Automatic Identification Object (Information Leak Media).
[0081] (3-2-1) Automatic Selection Images captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 are analyzed, and an information leaking medium to be displayed as an alternative is automatically selected (automatic setting: for all information leaking media registered by default (e.g., surveillance cameras, people), identification and alternative display are performed automatically based on the images of the information leaking media registered by default). This allows control to automatically identify information leaking media and display alternatives.
[0082] (3-2-2) Designation of automatic identification target (information leaking medium) Images captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 are analyzed, and information leaking media registered and designated in advance by the user are automatically identified based on the image of the registered information leaking medium and displayed as an alternative (e.g., surveillance camera, person. Additional targets can be added, such as mobile terminals). This allows control to automatically identify and display as an alternative specific information leaking medium registered and designated in advance by the user. Information leaking media may be added by pressing the "Automatic Identification Target Registration Settings" button 404.
[0083] FIG. 17 shows a user setting screen for the detailed alternative display function.
[0084] 17A, the user can set detailed application conditions for the alternative display function. Specifically, the user can select whether to use the presence or absence of an "obstruction" and / or the "affiliation of the person and the device used" as application conditions.
[0085] "Shielding object" can be applied when "Applicable location (information security: low) automatic identification" is checked on the setting screen 400 of FIG.
[0086] "Affiliation of person and device used" can be applied when "Designate target for automatic identification (information leak medium)" and "Person" are checked on the setting screen 400 in Fig. 16. When "Person" is checked, people other than nearby users who do not belong to the affiliation are identified and displayed as substitutes.
[0087] Pressing the "Affiliation Information Registration Settings" button 411 opens an affiliation information registration settings screen 420 in Fig. 17(b). On the affiliation information registration settings screen 420, edit the affiliation information of each person and device used, and press the "Registration Settings" button 421 to proceed to the affiliation information details screen 430 in Fig. 18. Here, Figs. 17(b) and 18 show an example in which information relating to "affiliation of person / device used" is classified by the same affiliation, but the way in which information relating to "affiliation of person / device used" is classified does not need to be limited to this example, and it may also be classified, for example, by person or device used.
[0088] FIG. 18 is the affiliation information registration setting screen. Each item on the affiliation information details screen 430 will be explained below. (1) Affiliation name...any affiliation name. (2) Affiliation information...specific affiliation (company (including department information, etc.)), family, club / circle, etc.) It is desirable that affiliation information can be specified in several stages in order to perform the alternative display control of FIG. 19 described below. (3) Applicable person...person who belongs to this affiliation (register personal identification information that can uniquely identify a person, such as an image or sound). (4) Used device...device used by this affiliation (PC, mobile terminal, etc.). (5) Specific confidential characters for non-applicable persons...specific confidential characters (XX department, △△ meeting, etc.). (6) Detailed conditions for applying the alternative display function
[0089] The affiliation information details screen 430 is provided with “registration setting buttons” 431, 432, 433, 434, and 435 for registering after editing each item of (1) affiliation name, (2) affiliation information, (3) relevant person, (4) equipment used, and (5) specific confidential characters for non-relevant people.
[0090] The above (6) "Detailed alternative display function application conditions" can be selected from (6-1) "Non-applicable person identification (user basis)" and (6-2) "Non-applicable person identification (device used basis)."
[0091] (6-1) "Non-matching person identification (user basis)" The affiliation of the user using a PC, etc. is determined to be the same as the affiliation of other people around the user, and alternative display control is performed based on the result of the determination. (6-2) "Non-matching person identification (device used basis)" The affiliation of the organization (affiliation) that manages the device, such as a PC, used by the user is determined to be the same as the affiliation of other people around the user, and alternative display control is performed based on the result of the determination.
[0092] In both the user-based and device-based cases, by selecting "specific confidential characters for non-relevant persons," a screen such as an application screen containing specific confidential characters is displayed instead for non-relevant persons.
[0093] This allows detailed alternative display control to be performed according to the relationship between the user or the device used by the user and nearby people other than the user.
[0094] Figure 19 is a diagram showing an example of alternative display control rule information that is applied when either "Affiliation of person / device used" on the screen of Figure 17(a) or "Non-matching person identification (user basis)" or "Non-matching person identification (device used basis)" on the screen of Figure 18 is selected.
[0095] The "affiliation 1" and "affiliation 2" in the alternative display control rule information 440 in Fig. 19 match the affiliation hierarchy defined in Fig. 18. In Fig. 19, the affiliation hierarchy and the content of alternative display control are linked.
[0096] For example, the first line in FIG. 19 associates the entire screen with a "person not corresponding to department 1," that is, a person who is not an employee of the company.
[0097] In the second line, for "a person who corresponds to department 1 but does not correspond to department 1 + 2...", that is, an employee of the company but a stranger in another department, a call / conference application screen or an application screen containing characters or symbols indicating that the document is confidential is displayed instead.
[0098] In the third line, for "people who fall under affiliation 1+2... but are not the user," that is, employees of the company and other people in the same department, the user's private information is displayed instead, as it is considered that they are equally obligated to maintain confidentiality of business information. There is an application screen that contains the user's name, ID, and password as private information of the user.
[0099] (Substitute Display Control Procedure) FIG. 20 is a flowchart (first half) showing the processing flow of the substitute display system according to this embodiment, and FIG. 21 is a flowchart (second half) showing the processing flow of the substitute display system according to this embodiment.
[0100] When the wearable device 1 starts the alternative display control, the alternative display control unit 125 checks the setting information (S101).
[0101] If multiple application conditions for the alternative display function are set, the process of determining whether or not alternative display is required in step S108, which will be described later, is performed in accordance with the order set in the "priority setting" in Fig. 16, so priority setting information is also acquired in step S101. If multiple application conditions are set but no priority is set, the system may be set so that the determination of whether or not the application conditions are required is performed in a predetermined order.
[0102] If the setting is "always not applied," the process ends. If the setting is "always applied" or "applied as needed," the alternative display control unit 125 transmits alternative display start / continuation information to the non-wearable device 2 (S102).
[0103] The alternative display start / continuation information also includes request information for data required to determine the conditions for applying the alternative display defined in the setting information (see FIG. 16). For example, if "surveillance camera" is included in "automatic identification of applicable object (information leak medium)," the information includes a request for capturing an image by the non-wearable device 2.
[0104] Furthermore, if "person" is included in the "automatic identification of target (information leak medium)," in addition to requesting an image to be captured by the non-wearable device 2, if the non-wearable device 2 has a distance sensor, it may also request the acquisition of distance information.
[0105] The non-wearable device 2 receives the alternative display start / continuation information (S103), and based on that, collects information used to determine whether or not alternative display is necessary (S104).
[0106] In the non-wearable device 2, an image is taken using the camera 206 mounted on the non-wearable device 2, and if it is necessary to measure the distance to a person as an information leak medium, the distance to the person in the image is measured (S104) and transmitted to the wearable device 1 (S105).
[0107] If "always applied" is selected, after the alternative display start / continuation information is transmitted and received (S102, S103), the display 212 of the non-wearable device 2 is switched to non-display mode (skip to S112).
[0108] The wearable device 1 also collects information to be used to determine whether or not an alternative display is required (S106). In addition to the position information obtained from the image capturing, distance measuring, and positioning sensor 107, the wearable device 1 also collects the user's voice using the microphone 113 within a range necessary to determine whether or not an alternative display is required.
[0109] The wearable device 1 acquires information about the user's location collected by the wearable device 1 and the non-wearable device 2 (position information detected by the positioning sensor 107, images captured by the cameras 106 and 206), information about surrounding information leaking media (images captured by the cameras 106 and 206), user information (user affiliation information read from the setting information of the wearable device 1, audio picked up by the microphone 113, etc.), and device information received from the non-wearable device 2 (S107), and uses this information in a process of determining whether or not an alternative display is required (S108). Details of the process of determining whether or not an alternative display is required will be described later (S108).
[0110] The process for determining whether an alternative display is necessary includes "alternative display control based on location information of the location and information about the surrounding environment as information about the location" (FIG. 22), "alternative display control based on a surveillance camera as a medium for leaking information" (FIG. 23), "alternative display control based on people other than the user as a medium for leaking information" (FIG. 24), "alternative display control based on the person's affiliation" (FIG. 25), and "alternative display control based on the affiliation of the device used" (FIG. 26). These are processed according to the priority information read in S101.
[0111] If the result of the process to determine whether or not an alternative display is required is that an alternative display is required (S109: Yes), the wearable device 1 specifies the screen area for the alternative display and transmits alternative display instruction information indicating that screen area to the non-wearable device 2 (S110).
[0112] The non-wearable device 2 receives the alternative display instruction information (S111), switches the screen area for alternative display to hidden (S112), and transmits the hidden display data 300 to the wearable device 1 (S113), which receives it (S114).
[0113] The wearable device 1 displays the received information related to the alternative display on the display 112 of the wearable device 1 (S115). If the alternative display is to be continued (S116: No), the process returns to step S102, and information to be used in the process of determining whether or not the alternative display is required is collected by each of the non-wearable device 2 and the wearable device 1. If "always apply" is selected, the process returns to step S112.
[0114] If the alternative display control is to be ended (S116: Yes), alternative display end information is transmitted from the wearable device 1 to the non-wearable device 2 (S117) and is received by the non-wearable device 2 (S118).
[0115] The non-wearable device 2 returns from non-display to normal display (S119) and stops transmitting display data to the wearable device 1. Then, the alternative display control of the wearable device 1 and the non-wearable device 2 ends.
[0116] (Alternative Display Control Based on Location Information of a Place and Information on the Surrounding Environment as Location-related Information) FIG. 22 is a flowchart showing the flow of processing for alternative display control based on location information of a place and information on the surrounding environment as location-related information.
[0117] The alternative display control unit 125 acquires the user's position information measured by the positioning sensor 107, an image showing the surrounding environment captured by the camera 206 or 106, and distance information measured by the distance measurement sensor 108, and determines whether the current position or the surrounding environment is an application location for alternative display control by referring to the setting information (S201). If the determination result is negative (S201: No), the alternative display necessity determination process is output (S205) so as to proceed to a process in which alternative display is not to be executed (S109: No).
[0118] If the determination result is positive (S201: Yes), the alternative display control unit 125 refers to the setting information. If a condition based on an obstruction is set (S202: Yes), the image recognition unit 121 analyzes the image captured by the camera 106 of the wearable device 1 or the camera 206 of the non-wearable device 2 to detect the obstruction, and the obstruction determination unit 122 determines the area of the screen to be hidden depending on the obstruction (S203). The result of the process for determining whether or not an alternative display is required is then output (S205), so as to proceed to the process for executing an alternative display (S109: Yes). In analyzing the image, the image recognition unit 121 detects the captured area of the obstruction reflected in the image. The obstruction determination unit 122 then determines the area of the screen to be hidden depending on the height, opacity, and placement position of the obstruction.
[0119] If no conditions are set due to an obstruction (S202: No), the entire display 212 of the non-wearable device 2 is determined to be a non-display area (S204), and the alternative display control unit 125 outputs the result of the process to determine whether or not alternative display is required (S205) so as to proceed to the process for executing alternative display (S109: Yes).
[0120] This allows the necessity of alternative display control to be determined based on the location information of the location and information about the surrounding environment, and further allows the non-display area to be determined based on information about the surrounding environment of the location, such as the height of obstructions.
[0121] (Alternative Display Control Based on a Surveillance Camera as an Information Leaking Medium) FIG. 23 is a flowchart showing the flow of processing of alternative display control based on a surveillance camera as an information leaking medium.
[0122] The image recognition unit 121 analyzes the image captured by the camera 106 of the wearable device 1 or the image captured by the camera 106 of the non-wearable device 2 to detect a surveillance camera, and the information leak medium determination unit 124 determines whether the surveillance camera corresponds to an information leak medium based on the position and orientation of the surveillance camera (S301). If the determination result is negative (S301: No), the result of the process for determining whether or not an alternative display is required is output (S303) so as to proceed to a process for not executing an alternative display (S109: No).
[0123] If the judgment result is positive (S301: Yes), the information leakage medium judgment unit 124 decides to hide the entire screen of the display 212 of the non-wearable terminal 2 (S302), and the alternative display control unit 125 outputs the result of the process to judge whether or not an alternative display is necessary (S303) so as to proceed to the process for executing the alternative display (S109: Yes).
[0124] This allows for an alternative display to be provided if there is a risk of information displayed on the display 212 of the non-wearable device 2 being leaked from the surveillance camera based on the position or orientation of the surveillance camera, thereby improving information security.
[0125] (Alternative Display Control Based on Others than the User as Information Leaking Media) FIG. 24 is a flowchart showing the flow of processing of alternative display control based on other people than the user as information leaking media.
[0126] The image recognition unit 121 analyzes an image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 to determine whether or not a person other than the user is captured (S401). If the determination result is negative (S401: No), the image recognition unit 121 outputs the result of the process for determining whether or not an alternative display is required (S405) so that the process proceeds to a process for not performing an alternative display (S109: No).
[0127] If the determination result is positive (S401: Yes), the information leaking medium determination unit 124 determines whether the distance from the non-wearable device 2 to another person is within a first distance range for determining whether it is possible to read information on the display 212 (S402). If the determination result is positive (S402: Yes), the information leaking medium determination unit 124 decides to hide the entire screen of the display 212 (S403), and the alternative display control unit 125 outputs the result of the process for determining whether or not an alternative display is required (S405) so as to proceed to the process for executing an alternative display (S109: Yes).
[0128] If the distance from the non-wearable terminal 2 to the other person is greater than the first distance range (S402: No), the information leakage medium determination unit 124 decides to hide the entire screen (S403) if the other person's face is facing the display 212 (S404: Yes), and the alternative display control unit 125 outputs the result of the process to determine whether or not an alternative display is required (S405) so as to proceed to the process for executing the alternative display (S109: Yes).
[0129] On the other hand, if the distance from the non-wearable terminal 2 to the other person is greater than the first distance range (S402: No), the information leakage medium determination unit 124 outputs the result of the process to determine whether or not an alternative display is required (S405) so that if the other person's face is not facing the display 212 (S404: No), the process proceeds to the process for not performing the alternative display (S109: No).
[0130] This allows an alternative display to be provided when another person is near the user or when the other person's face is facing the display 212 of the non-wearable device 2, thereby improving information security.
[0131] (Alternative Display Control Based on Person's Affiliation) FIG. 25 is a flowchart showing the flow of processing for alternative display control based on person's affiliation.
[0132] The image recognition unit 121 analyzes an image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 to determine whether or not a person other than the user is captured (S501). If the determination result is negative (S501: No), the image recognition unit 121 outputs the result of the process for determining whether or not an alternative display is required (S503) so that the process proceeds to a process for not performing an alternative display (S109: No).
[0133] If the determination result is positive (S501: Yes), the alternative display control unit 125 refers to the affiliation information set on the affiliation information details screen 430 (see FIG. 18) and determines whether the user's affiliation is the same as that of other people (S502).The alternative display control unit 125 then refers to the alternative display control rule information 440 (see FIG. 19), determines the content of alternative display control, and outputs the result of the alternative display necessity determination process (S503) so as to proceed to the process for executing alternative display (S109: Yes).
[0134] As a result, when a stranger is near the user, an alternative display is made according to the affiliation of the stranger and the user, thereby improving information security.
[0135] (Alternative Display Control Based on Affiliation of Used Device) FIG. 26 is a flowchart showing the flow of processing for alternative display control based on affiliation of a person.
[0136] The image recognition unit 121 analyzes an image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 to determine whether or not a person other than the user is captured (S601). If the determination result is negative (S601: No), the image recognition unit 121 outputs the result of the process for determining whether or not an alternative display is required (S603) so that the process proceeds to a process for not performing an alternative display (S109: No).
[0137] If the determination result is positive (S601: Yes), the alternative display control unit 125 references the affiliation information set on the affiliation information details screen 430 (see FIG. 18 ) and determines whether the organization (affiliation) that manages the non-wearable device 2 is the same as the affiliation of other people (S602). Then, the alternative display control unit 125 references the alternative display control rule information 440 (see FIG. 19 ) and outputs the result of the process for determining whether or not alternative display is required (S603) so as to proceed to the process for determining whether or not alternative display is required (S109: Yes) in which alternative display control content is determined and alternative display is executed.
[0138] This allows an alternative display to be made when there is someone who does not belong to the organization (affiliation) that manages the non-wearable device, thereby improving information security.
[0139] According to this embodiment, the display of the non-wearable device can be switched to a dark screen or a masked screen depending on the location where the user is using the non-wearable device and the surrounding conditions (degree of need for an alternative display), and information that needs to be prevented from leaking can be displayed on the display of the wearable device, thereby preventing information leaks by others sneaking a peek or peeking at the display screen of the non-wearable device and improving the information security of the non-wearable device.
[0140] The present invention is not limited to the present embodiment, and any combination of the examples shown in the above embodiments is included in the present invention. Furthermore, modifications that add further functions to the above embodiments are also possible.
[0141] For example, in this embodiment, the alternative display program 120 is installed in the wearable terminal 1, but the alternative display program 120 may be installed in the non-wearable terminal 2, and after the wearable terminal 1 and the non-wearable terminal 2 are connected, the non-wearable terminal 2 may determine whether or not to execute alternative display control.
[0142] Furthermore, the non-display processing for the display 212 of the non-wearable device 2 in this embodiment may be considered to include brightness control, masking processing, mosaic processing, and the like for the display 212 of the non-wearable device 2.
[0143] Furthermore, the numerical values, messages, etc. appearing in the text and figures are merely examples, and the effects of the present invention will not be impaired even if different ones are used.
[0144] The programs described in each processing example may be independent programs, or multiple programs may constitute a single application program. The order in which each process is performed may also be changed.
[0145] The functions of the present invention described above may be realized in part or in whole by hardware, for example, by designing an integrated circuit, a general-purpose processor, or an application-specific processor. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. Alternatively, the functions may be realized by software, such as by a processor unit interpreting and executing an operating program that realizes each function. Hardware and software may also be used together.
[0146] Furthermore, the control lines and information lines shown in the diagram are those considered necessary for explanation, and do not necessarily represent all of the control lines and information lines on the product. In reality, it can be assumed that almost all components are interconnected.
[0147] The embodiments include the following: (First Aspect) A wearable terminal comprising: a display; a communication device that receives display data of a non-wearable terminal; and a processor, wherein the processor transmits a control signal to the non-wearable terminal via the communication device to cause the received display data to be hidden, and receives display data of the non-wearable terminal and performs alternative display control to display the display data on the display.
[0148] (Form of the second aspect) An integrated display system including a wearable terminal and a non-wearable terminal, wherein the wearable terminal comprises: a first display; a first communication device that receives display data of the non-wearable terminal; and a first processor; the non-wearable terminal comprises: a second display; a second communication device that transmits display data to the wearable terminal; and a second processor; the first processor transmits a control signal to the non-wearable terminal via the first communication device to hide the display data, and performs alternative display control to receive the display data of the non-wearable terminal and display the display data on the first display; and the second processor receives the control signal via the second communication device, hides the display data on the second display, and transmits the display data to the wearable terminal.
[0149] (Form of the third aspect) A linked display method executed between a wearable terminal and a non-wearable terminal, comprising: a step of transmitting a control signal from the wearable terminal to the non-wearable terminal to hide display data displayed on a display of the non-wearable terminal; a step of hiding the display data on the display of the non-wearable terminal and transmitting the display data to the wearable terminal; a step of the wearable terminal receiving the display data from the non-wearable terminal; and a step of displaying the display data on a display provided in the wearable terminal.
[0150] 1: Wearable terminal, 2: Non-wearable terminal, 2A: Notebook computer, 2C: Mobile terminal, 4: Server, 5: External network, 10: Alternative display system, 100: HMD, 100s: AR glasses, 101: Processor, 102: Memory, 103: Storage, 104: Operation input interface, 106: Camera, 107: Positioning sensor, 108: Distance measurement sensor, 109: Acceleration sensor, 110: Gyro sensor, 111: Geomagnetic sensor, 112: Display, 113: Microphone, 114: Speaker, 115: Timer, 116: Network communication device, 117: BT communication device, 118 : Bus, 120: Alternative display program, 121: Image recognition unit, 122: Obstruction determination unit, 123: Non-display area determination unit, 124: Information leakage medium determination unit, 125: Alternative display control unit, 126: Display data receiving unit, 127: Virtual reality object display unit, 130: Data, 131: Location information, 132: Information leakage medium information, 133: Alternative display control information, 140: Non-display switching program, 141: Display switching unit, 142: Display data transmission unit, 201: Processor, 202: Memory, 203: Storage, 204: Operation input interface, 206: Camera, 212: Display, 212A: Display, 212B: Display, 212C: Display, 216: Network communication device, 217: BT communication device, 218: Bus, 300: Display data, 301: Application screen, 320: Obstruction, 320a: Obstruction, 320b: Obstruction, 350: Surveillance camera, 360: Other people, 400: Setting screen, 401: Priority setting button, 402: Non-applicable location registration setting button, 403: Automatic recognition location registration setting button, 404: Automatic recognition location registration setting button, 410: User setting screen, 411: Affiliation information registration setting button, 420: Affiliation information registration setting screen, 421: Registration setting button, 430: Affiliation information details screen, 431: Registration setting button, 432: Registration setting button, 433: Registration setting button, 434: Registration setting button, 435: Registration setting button, 440: Alternative display control rule information
Claims
1. A wearable device, A display and A communication device that receives display data of a non-wearable device; Memory, a processor; The processor, transmit a control signal to the non-wearable device via the communication device to hide the received display data based on the information related to the location or the information related to the information leak medium stored in the memory, and execute alternative display control to receive the display data of the non-wearable device and display the display data on the display. Wearable device.
2. The wearable terminal according to claim 1, A positioning sensor for detecting position information; A camera for capturing an image of the surrounding environment, The memory stores, as the information about the location, position information detected by the positioning sensor or an image captured by the camera. Wearable device.
3. The wearable terminal according to claim 2, the memory stores the position information detected by the positioning sensor or the image captured by the camera as pre-registration information for executing the alternative display control; the processor executes the alternative display control when it determines that the location of the user is not recorded in the pre-registration information; Wearable device.
4. The wearable terminal according to claim 2, The processor analyzes an image captured by the camera to recognize an obstruction located around the display of the non-wearable terminal; determining a screen area to be hidden on a display of the non-wearable terminal according to at least one of a height, a transparency, or a position of the obstruction relative to the non-wearable terminal; Wearable device.
5. The wearable terminal according to claim 1, A camera; The processor analyzes at least one of an image captured by the camera and an image captured by a camera mounted on the non-wearable terminal based on information about the information leaking medium, thereby recognizing an information leaking medium located around the display of the non-wearable terminal; executing the alternative display control in response to at least one of a position and an orientation of the information leaking medium with respect to the non-wearable device; Wearable device.
6. The wearable terminal according to claim 5, The information leak medium is a surveillance camera or a person other than the user of the wearable device. Wearable device.
7. The wearable terminal according to claim 5, the memory stores user information associating an organization to which the user of the wearable device belongs with identification information of other people who belong to the organization; The processor analyzes an image captured by the camera to determine whether a person captured by the camera is identical to the other person who belongs to an organization to which the user belongs and is included in the user information, and executes the alternative display control based on the determination result. Wearable device.
8. The wearable terminal according to claim 5, the memory stores user information associating an organization to which the user of the wearable device belongs with identification information of other people who belong to the organization; the processor analyzes an image captured by the camera, compares the person captured by the camera with the user information, determines whether an organization to which the user belongs is identical to an organization to which the person captured by the camera belongs, and executes the alternative display control based on a result of the determination. Wearable device.
9. The wearable terminal according to claim 5, The memory stores affiliation information of the wearable device that associates an organization that manages the wearable device with identification information of other people that belong to the organization; The processor analyzes an image captured by the camera, compares the person captured by the camera with affiliation information of the device used, determines whether an organization managing the wearable device is identical to an organization to which the person captured by the camera belongs, and executes the alternative display control based on the determination result. Wearable device.
10. A linked display system including a wearable terminal and a non-wearable terminal, Wearable devices are A first display; A first communication device that receives display data of a non-wearable device; a first processor, Non-wearable devices: A second display; and A second communication device that transmits display data to the wearable terminal; A second processor, The first processor executes an alternative display control to transmit a control signal to the non-wearable terminal via the first communication device to hide the display data, receive display data of the non-wearable terminal, and display the display data on the first display; The second processor receives the control signal via the second communication device, hides the display data on the second display, and transmits the display data to the wearable terminal. Linked display system.
11. The linked display system according to claim 10, The wearable terminal further comprises a memory; The first processor executes the alternative display control based on the information related to the location or the information related to the information leaking medium stored in the memory. Linked display system.
12. A linkage display method executed between a wearable terminal and a non-wearable terminal, comprising: A step of transmitting a control signal from the wearable terminal to a non-wearable terminal to make the non-wearable terminal hide display data displayed on a display of the non-wearable terminal based on information about a location or information about an information leak medium stored in a memory of the wearable terminal; hiding the display data on a display of the non-wearable terminal and transmitting the display data to the wearable terminal; receiving the display data by the wearable terminal from the non-wearable terminal; Displaying the display data on a display provided in the wearable terminal; A link display method including.