Display control method using wearable terminal
By integrating image recognition and location-aware alternative display control, the wearable device prevents information leakage from non-wearable devices, enhancing security and usability.
Patent Information
- Application Number
- JP2025121822
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-07-22
- Publication Date
- 2025-09-30
AI Technical Summary
Existing display technologies fail to effectively prevent information leakage from non-wearable devices by simply displaying output data on a wearable device, neglecting the user's location and surrounding conditions, thus compromising security.
A wearable device wirelessly connects to a non-wearable device and employs image recognition, obstruction detection, and location awareness to determine when and where to hide or display content, using alternative display control to prevent others from viewing sensitive information.
Enhances information security by ensuring that sensitive information on non-wearable devices is not visible to unauthorized viewers, thereby increasing the commercial value and usability of these devices.
Smart Images

Figure 2025142227000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a display control method for a wearable terminal, and more particularly to a display technology that links a wearable display terminal and a non-wearable display terminal. [Background technology]
[0002] Regarding a linked display system using multiple displays, Patent Document 1 states, "A first device coupled to a first display and an image sensor receives output data from a second device having a second display different from the first display. The output data represents content displayable by the second device on the second display. The first device uses the image sensor to determine the position of the second display relative to the first device, and causes the first display to display content based on the output data received from the second device and the determined position of the second display relative to the first device. (Abstract excerpt)" [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Special Publication No. 2020-536311 Summary of the Invention [Problem to be solved by the invention]
[0004] The display screens of non-wearable devices such as desktop computers, laptops, and tablets can be viewed by people other than the user of the non-wearable device. Although there are anti-peeping filters to prevent this, depending on the angle at which the screen is viewed, it is possible to read the information on the screen through the filter, so there is a demand for an effective way to prevent information leaks.
[0005] Therefore, it is conceivable to use the display technology of Patent Document 1, but in Patent Document 1, when a user makes a choice or when it is determined that the user is viewing a PC or mobile device using an HMD, the image on the screen of the PC or mobile device is simply displayed on the HMD screen so as to match the screen position of the PC or mobile device, and no consideration is given to preventing information leakage depending on the location or surrounding conditions where the user uses a non-wearable device such as a PC. Therefore, security cannot be maintained by simply displaying output data from a first device on a second device.
[0006] The present invention has been made in view of the above points, and has as its object to improve information security by preventing others from peeking at the screen. [Means for solving the problem]
[0007] In order to solve the above problems, the present invention has the configurations described in the claims. [Effects of the Invention]
[0008] According to the present invention, it is possible to prevent others from peeking at the screen, thereby improving information security. Objects, configurations, and effects other than those described above will become apparent from the following embodiments. [Brief explanation of the drawings]
[0009] [Figure 1A] 1 is a schematic configuration diagram of an alternative display system according to an embodiment of the present invention. [Figure 1B] FIG. 1 is a schematic configuration diagram of a non-wearable terminal. [Figure 2] These are external views of wearable devices, where (a) shows an HMD and (b) shows AR glasses. [Figure 3] FIG. 2 is a functional block diagram of an alternative display system. [Figure 4] FIG. 10 is a diagram showing the field of view of other people and the user during alternative display when a laptop computer is used as a non-wearable terminal. [Figure 5]FIG. 10 is a diagram showing the field of view of other people and the user during alternative display when a desktop computer is used as a non-wearable terminal. [Figure 6] 10A and 10B are diagrams showing the field of view of other people and the user during alternative display when a mobile terminal is used as a non-wearable terminal. [Figure 7] The diagram shows examples of alternative display control based on location information and information about the surrounding environment as location-related information. (a) shows an example of use in a non-private office space, (b) in one's own room, and (c) in an office. [Figure 8] 10A and 10B are diagrams showing examples of alternative display control based on the presence or absence of an obstruction, which are modifications of alternative display control based on location information of a place and information about the surrounding environment as information about a place. [Figure 9] 10A and 10B show an example of alternative display control according to the height of an obstruction, where (a) shows the case where the obstruction is not high enough, and (b) shows the user's field of view. [Figure 10] 10A and 10B are diagrams showing an example of alternative display control according to the depth of an obstruction, where (a) shows a case where the obstruction is not close, and (b) shows the user's field of view. [Figure 11] 10A and 10B are diagrams showing examples of alternative display control in a space where a surveillance camera is installed as an information leak medium, where (a) is an example where an alternative display is performed, and (b) is an example where an alternative display is not performed. [Figure 12] FIG. 12 is a diagram showing a situation in which a surveillance camera is not installed in the same space as in FIG. [Figure 13] 10A and 10B are diagrams illustrating an example of alternative display control based on a person other than the user as an information leak medium. [Figure 14] 10A and 10B are diagrams showing examples of alternative display control when another person is present at a location farther than the first distance, where (a) is an example in which an alternative display is performed, and (b) is an example in which an alternative display is not performed. [Figure 15] FIG. 10 is a diagram showing an example in which a substitute display is not performed when another person is located at a location farther than the first distance. [Figure 16] 10 shows an example of a user setting screen for the alternative display function. [Figure 17] 10 is a user setting screen for the detailed alternative display function. [Figure 18] 10 is an affiliation information registration setting screen. [Figure 19] FIG. 10 is a diagram illustrating an example of alternative display control rule information. [Figure 20] 1 is a flowchart (first half) showing the flow of processing of an alternative display system according to the present embodiment. [Figure 21] 10 is a flowchart (second half) showing the flow of processing of the alternative display system according to the present embodiment. [Figure 22] 10 is a flowchart showing the flow of processing for alternative display control based on location information of a place and information about the surrounding environment as information about a place. [Figure 23] 10 is a flowchart showing the flow of processing of alternative display control based on a surveillance camera as an information leak medium. [Figure 24] 10 is a flowchart showing the flow of processing of alternative display control based on people other than the user as information leak media. [Figure 25] 10 is a flowchart showing the flow of processing for alternative display control based on a person's affiliation. [Figure 26] 10 is a flowchart showing the flow of processing for alternative display control based on a person's affiliation. DETAILED DESCRIPTION OF THE INVENTION
[0010] The present invention is useful for preventing the leakage of information displayed on non-wearable devices, thereby increasing the commercial value of non-wearable devices to which the present invention is applied, and is therefore expected to contribute to the United Nations' Sustainable Development Goal 8.2 (increasing economic productivity through diversification, technological improvement, and innovation, particularly in industries that increase the value of goods and services and those that are labor-intensive).
[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The same components are designated by the same reference numerals throughout the drawings, and redundant explanations will be omitted.
[0012] (Outline of alternative display system) Fig. 1A is a schematic diagram of an alternative display system according to this embodiment. Fig. 1B is a schematic diagram of a non-wearable device. Fig. 2 is an external view of a wearable device, where (a) shows an HMD and (b) shows AR glasses.
[0013] 1A is configured by wirelessly connecting a wearable device 1 and a non-wearable device 2. The wireless communication connection may be a direct connection between the wearable device 1 and the non-wearable device 2 using short-range wireless communication such as Bluetooth (registered trademark), or an indirect connection via a LAN.
[0014] The wearable device 1 used in the alternative display system 10 may be a device whose screen can be seen only by the user wearing the wearable device 1, and specific examples include the HMD 100 shown in Figure 2(a) and the AR glasses 100s shown in Figure 2(b).
[0015] Returning to FIG. 1, the wearable terminal 1 includes a processor 101 (corresponding to the first processor), a memory 102, a storage 103, an operation input interface 104, a camera 106, a positioning sensor 107, a distance measurement sensor 108, an acceleration sensor 109, a gyro sensor 110, a geomagnetic sensor 111, a display 112 (corresponding to the first display), a microphone 113, a speaker 114, a timer 115, a network communication device 116, and a BT communication device 117 (BT: Bluetooth (registered trademark)), which are connected to each other via a bus 118.
[0016] The storage 103 stores an alternative display program 120, which the processor 101 loads and saves in the memory 102 and executes.
[0017] Furthermore, the storage 103 stores data 130 generated in the process and as a result of executing the alternative display program 120. The data 130 includes location information 131, information leak medium information 132, and alternative display control information 133. The location information 131, information leak medium information 132, and alternative display control information 133 are input from a setting screen 400 (see FIG. 16), a user setting screen 410 (FIG. 17(a)), an affiliation information registration setting screen 420 (FIG. 17(b)), and an affiliation information detail screen 430 (FIG. 18), respectively, which will be described later.
[0018] The distance measurement sensor 108 is a sensor that outputs distance information to a physical object to be measured. For example, it may be a sensor that calculates distance to a feature point such as the outline of a physical object using images with parallax, such as a stereo camera, and outputs distance information. It may also be a sensor that measures distance by irradiating a measurement object with light rays two-dimensionally, such as a TOF (Time of Flight) method.
[0019] The network communication device 116 is a communication device that realizes a communication function for wireless communication using the Wi-Fi (registered trademark) standard, etc. The network communication device 116 may be communicatively connected to the server 4 via a LAN or an external network 5. Update programs may be downloaded from the server 4.
[0020] The BT communication device 117 is a communication device that uses Bluetooth (registered trademark) and performs short-range wireless communication with a non-wearable terminal 2 that performs alternative display processing, such as a personal computer (including a laptop computer or desktop computer) or a mobile terminal (including a smartphone or tablet).
[0021] Display 112 is a see-through display. The user sees the real world viewed through display 112 and the virtual reality objects displayed on display 112 are superimposed on the real world.
[0022] The non-wearable device 2 is a device whose screen can be viewed by a person other than the user of the wearable device 1, and is, for example, a desktop computer connected to a monitor, a laptop computer, a smartphone, or a tablet.
[0023] As shown in FIG. 1B, the non-wearable terminal 2 includes a processor 201 (corresponding to a second processor), a memory 202, a storage 203, an operation input interface 204, a camera 206, a display 212 (corresponding to a second display), a network communication device 216, and a BT communication device 217, which are connected to each other via a bus 218.
[0024] When a smartphone or tablet is used as the non-wearable terminal 2, in addition to the above configuration, it also has a ranging sensor, a positioning sensor, etc., but the non-wearable terminal 2 used in the alternative display system 10 does not necessarily need to have a ranging sensor or a positioning sensor, so they are omitted from Figure 1B.
[0025] When a control signal for hiding display data that is currently being displayed or will be displayed on the display 212 is received from the wearable terminal 1, the non-display switching program 140 stored in the storage 203 hides the display data that is currently being displayed or will be displayed on the display 212, and transmits the display data to the wearable terminal 1.
[0026] In this embodiment, an alternative display program 120 is installed in the wearable terminal 1, and the wearable terminal 1 determines whether or not to execute alternative display control. A non-display switching program 140 installed in the non-wearable terminal 2 mainly executes display control to hide the display 212 of the non-wearable terminal 2 in response to a control signal from the wearable terminal 1.
[0027] FIG. 3 is a functional block diagram of the alternative display system.
[0028] The alternative display program 120 includes an image recognition unit 121 , an obstruction determination unit 122 , a non-display area determination unit 123 , an information leak medium determination unit 124 , an alternative display control unit 125 , a display data receiving unit 126 , and a virtual reality object display unit 127 .
[0029] The image recognition unit 121 analyzes the image captured by the camera 106, 206 mounted on the wearable device 1 or the non-wearable device 2, and performs subject recognition processing.
[0030] The obstructing object determining unit 122 determines the height, position, opacity, etc. of the obstructing object when the obstructing object is captured as a subject.
[0031] The non-display area determination unit 123 determines a non-display area according to the obstruction based on the determination result by the obstruction determination unit 122 .
[0032] The information leaking medium determining unit 124 determines whether or not the subject corresponds to an information leaking medium.
[0033] The alternative display control unit 125 determines when to start and end the alternative display, and whether or not alternative display control is required based on position information and image information.
[0034] The display data receiving unit 126 receives display data for performing an alternative display from the non-wearable device 2.
[0035] The virtual reality object display unit 127 detects the position of the display 212 of the non-wearable device 2 based on the image captured by the camera 106 of the wearable device 1, and displays the display data on the display 112 of the wearable device 1 so that it overlaps the display 212 of the non-wearable device 2. As a result, the display data is displayed on the display 112 as a virtual reality object.
[0036] The non-display switching program 140 includes a display switching unit 141 and a display data transmission unit 142 .
[0037] The display switching unit 141 switches between displaying and hiding the display 212 based on a control signal from the wearable terminal 1 that instructs the start and end of the alternative display.
[0038] The display data transmission unit 142 transmits to the wearable device 1 display data for performing alternative display.
[0039] (Comparing the view of others with the view of the user) The user's field of view during alternative display will be described with reference to Figures 4, 5, and 6. Figure 4 is a diagram showing the field of view of other people and the user during alternative display using a laptop computer. Figure 5 is a diagram showing the field of view of other people and the user during alternative display using a desktop computer. Figure 6 is a diagram showing the field of view of other people and the user during alternative display using a mobile device.
[0040] 4, during alternative display, the display 212A of the notebook computer 2A is hidden, and the information that the user originally wanted to view is not displayed. Therefore, in the field of view of others, the display 212 of the notebook computer 2A is a hidden screen. The notebook computer 2A transmits the display data 300 that was supposed to be displayed on the display 212A to the wearable device 1.
[0041] The wearable terminal 1 detects the position of the display 212A, and displays the display data 300 on the display 112 of the wearable terminal 1 so that it overlaps with a position where the display 212A is visible through the display 112. Therefore, from the perspective of the user wearing the wearable terminal 1, the display data 300 appears to be displayed on the display 212A of the notebook computer 2A.
[0042] FIG. 5 shows a state in which a desktop personal computer (not shown) and the wearable terminal 1 are connected for communication, and a display 212B connected to the desktop personal computer is displayed on the wearable terminal 1 instead.
[0043] FIG. 6 shows a state in which the mobile terminal 2C and the wearable terminal 1 are connected for communication and the display 212C of the mobile terminal 2C is displayed on the wearable terminal 1 instead.
[0044] 4, 5, and 6, the user sees display data 300 displayed on display 112 of wearable device 1 superimposed on display 212 of non-wearable device 2 in the real world as viewed through display 112 of wearable device 1. Meanwhile, display 212 of non-wearable device 2 is hidden, so that display data 300 appears to the user as being displayed on display 212 of non-wearable device 2, but is not visible to others.
[0045] (Alternative display control based on location information and information about the surrounding environment as location information) Figure 7 shows examples of alternative display control based on location information and information about the surrounding environment as location-related information. (a) shows a non-private office space, (b) shows one's own room, and (c) shows an example of use in an office.
[0046] Figure 7(a) shows an example of use without prior registration, such as in a non-private office space. In this case, an alternative display is provided.
[0047] FIG. 7(b) shows an example of use in one's own room (pre-registered), and FIG. 7(c) shows an example of use in an office (pre-registered). Places where others do not enter, such as one's own room, and offices are considered to have high information security because they are subject to the same confidentiality obligations as the user. Therefore, location information and images showing the surrounding environment of places with high information security are acquired using the positioning sensor 107 and camera 106 and pre-registered, and the substitute display function is controlled not to operate in pre-registered places, but to operate in places not pre-registered. This makes it possible to control the substitute display function based on location information and images of pre-registered places and the user's current location as location information.
[0048] (Variation of alternative display control based on location information and information about the surrounding environment as location information: Obstruction) Figure 8 is a modified example of alternative display control based on location information of the location and information about the surrounding environment as information about the location, and shows an example of alternative display control based on the presence or absence of an obstruction to the non-wearable device 2 as information about the surrounding environment.
[0049] If there are opaque obstructions 320, such as partitions or walls, on either side of the display 212 of the non-wearable device 2 used by the user, the display 212 of the non-wearable device 2 cannot be seen from the seat next to the user (FIG. 8 illustrates the state of the display 212 of the non-wearable device 2 so that it is clear), and therefore the information security of the location where the user is located is higher than when there is no partition or wall. Therefore, the image captured by the camera 106 of the wearable device 1 or the camera 206 of the non-wearable device 2 may be analyzed to determine whether or not there is a partition, and if it is determined that there is an obstruction 320 that prevents the display 212 from being seen, control may be exercised to prevent the alternative display from being displayed.
[0050] 9 is a diagram showing an example of alternative display control depending on the height of an obstruction relative to the non-wearable device 2, where (a) shows a case where the obstruction is not high enough, and (b) shows the user's field of view. FIG. 10 is a diagram showing an example of alternative display control depending on the depth of an obstruction relative to the non-wearable device 2, where (a) shows a case where the obstruction is not close, and (b) shows the user's field of view. The area of the display 212 that can be seen from outside changes depending on the height and depth of the obstruction (FIGS. 9 and 10 are illustrated so that the state of the display 212 of the non-wearable device 2 can be seen), and therefore the information security of the location differs.
[0051] When the height of the non-transparent portion of the shielding object 320a is low, information security is higher compared to when there is no shielding object, but information security is lower compared to when the shielding object is sufficiently high. In this case, an alternative display of an application screen relating to the area where the display 212 of the non-wearable device 2 is visible from the left and right may be performed. For example, in FIG. 9(a), the height of the shielding object 320a is lower than the upper end of the display 212 of the non-wearable device 2. Therefore, the application screen relating to the area above half of the non-wearable device 2 is hidden.
[0052] Display data 300 of the hidden application screen is transmitted to and alternatively displayed on the wearable device 1, and therefore, to the user wearing the wearable device 1, the application screen alternatively displayed on the wearable device 1 appears to be superimposed on the display 212 of the non-wearable device 2, as shown in Fig. 9(b). On the other hand, the application screen 301 is displayed on the display 212 of the non-wearable device 2, and is therefore not displayed on the wearable device 1. The user can see the application screen 301 actually displayed on the display 212 of the non-wearable device 2 through the display 112 of the wearable device 1.
[0053] 10 is a diagram showing an example of alternative display control depending on the depth of an obstruction relative to the non-wearable device 2. The height of the obstruction 320b, a partition, is equal to or higher than the top end of the non-wearable device 2, but is short in the depth direction, and the partition does not obstruct the area from the front of the desk to the center in the depth direction. Therefore, since the bottom left of the non-wearable device 2 is obstructed by the partition, alternative display is not performed and application screen 301 is displayed, but the application screen above half and to the right of the display 212 is alternatively displayed.
[0054] Display data 300 of the hidden application screen is transmitted to and alternatively displayed on the wearable device 1, and therefore, to the user wearing the wearable device 1, the application screen alternatively displayed on the wearable device 1 appears to be superimposed on the display 212 of the non-wearable device 2, as shown in Fig. 10(b). On the other hand, the application screen 301 is displayed on the display 212 of the non-wearable device 2, and is therefore not displayed on the wearable device 1. The user can see the application screen 301 actually displayed on the display 212 of the non-wearable device 2 through the display 112 of the wearable device 1.
[0055] This allows alternative display control to be performed based on information about the transparency and shape of an object obscuring the non-wearable device 2 as information about the surrounding environment of the location where the user operates the non-wearable device 2, and control can be performed to alternatively display only an application screen that spans a partial area of the display 212 of the non-wearable device 2 that is difficult to obscure based on the transparency and shape of the object obscuring. If the performance, such as image quality, of the screen of a wearable device 1 such as an HMD or AR glasses is poorer than that of a non-wearable device 2 such as a PC, alternative display may be a factor that impairs usability of the non-wearable device 2 for the user. Therefore, by limiting the area of the screen on which alternative display is performed to only the necessary part, it is possible to improve information security while suppressing a decrease in usability of the non-wearable device 2 for the user.
[0056] (Alternative display control based on surveillance cameras as a medium for information leakage) As information on information leaking media, an example of alternative display control depending on the presence or absence of surveillance cameras will be described. Fig. 11 shows an example of alternative display control in a space where surveillance cameras are installed, where (a) is an example where alternative display is performed and (b) is an example where alternative display is not performed. Fig. 12 shows a situation where surveillance cameras are not installed in the same space as Fig. 11.
[0057] 11(a) and 11(b), a surveillance camera 350 is installed in the room of a user who operates a non-wearable device 2. The surveillance camera 350 is an example of an information leak medium.
[0058] If the screen of the display 212 of the non-wearable device 2 is within the field of view of the surveillance camera 350, the display data displayed on the screen of the display 212 of the non-wearable device 2 will be reflected in the image of the surveillance camera 350, leading to information leakage.
[0059] Therefore, alternative display control may be performed based on the presence or absence of the surveillance camera 350 as information about the information leak medium.
[0060] 11(a), the surveillance camera 350 is captured in an image captured by the camera 206 mounted on the non-wearable device 2. Therefore, since there is a possibility that the screen of the display 212 of the non-wearable device 2 may be reflected in the image of the surveillance camera 350, an alternative display is performed. Alternatively, the image may be captured by the camera 106 of the wearable device 1. In this case, the relationship between the position and orientation of the display 212 of the non-wearable device 2 and the surveillance camera 350 is analyzed based on the image captured by the camera 106 and the distance measurement results measured by the distance sensor 108.
[0061] 11(b), surveillance camera 350 is captured in the image captured by camera 106 of wearable device 1, but surveillance camera 350 is not captured in the image captured by camera 206 mounted on non-wearable device 2. Therefore, in FIG. 11(b), it can be determined that the orientation (shooting direction) of surveillance camera 350 is such that it cannot capture the screen of display 212, and therefore no alternative display is performed.
[0062] 12 shows the same space as FIG. 11, but no surveillance camera is installed. Therefore, when the presence or absence of a surveillance camera 350 is determined based on the image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1, it is determined to be "not present," and no alternative display is performed.
[0063] According to this example, alternative display control can be performed for information about information leaking media depending on whether or not there is a surveillance camera 350 around the user or non-wearable device 2 and the lens direction (shooting direction) of the surveillance camera 350.
[0064] (Alternative display control based on other people than the user as a medium for information leakage) FIG. 13 is a diagram showing an example of alternative display control based on people other than the user as information leak media.
[0065] If a person 360 other than the user is captured in an image captured by the camera 206 of the non-wearable device 2, the non-wearable device 2 measures the distance to that person. This distance measurement can be performed using distance information from a distance sensor if the non-wearable device 2 is equipped with one. If a distance sensor is not equipped, the distance can be estimated from the image captured by the camera 206. In this case, for example, if the ratio between the size of the user's face and the size of the other person's face is a predetermined ratio, the distance to the user and the distance to the other person can be determined to be approximately equal, using the non-wearable device 2 as a reference. Furthermore, the camera 106 and distance sensor 108 of the wearable device 1 can capture an image and measure distance. In this case, the relationship between the position and orientation of the person 360 other than the user and the display 212 of the non-wearable device 2 is analyzed based on the image captured by the camera 106 and the distance measurement results measured by the distance sensor 108.
[0066] Substitute display is performed if the distance from the non-wearable device 2 to another person is within a first distance range for determining whether it is possible to read information on the display 212. For example, the first distance range is set to a distance approximately equal to the distance between the user and the non-wearable device 2.
[0067] FIG. 14 is a diagram showing an example of alternative display control when another person 360 is present at a location farther than the first distance, where (a) is an example in which alternative display is performed, and (b) is an example in which alternative display is not performed.
[0068] 14(a) shows a case where another person 360 is located further away than the first distance range and the face of the other person 360 is in a position where it can be seen from the display 212 of the non-wearable device 2. If the image of the other person is recognized by analyzing an image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1, an alternative display is performed.
[0069] 14(b) shows a case where another person 360 is located further away than the first distance range, and the face of the other person 360 cannot be seen from the display 212 of the non-wearable device 2. In this case, the display 212 is hidden by the user's shadow from the other person 360, and there is a high possibility that the information will be unreadable, so no alternative display is performed.
[0070] FIG. 15 is a diagram showing an example in which another person 360 is present at a location farther than the first distance and no alternative display is performed.
[0071] 15, another person 360 is outside the first distance range. Furthermore, the other person has their back to the non-wearable device 2, so the data displayed on the display 212 cannot be read. Therefore, in this case, no alternative display is performed.
[0072] This allows alternative display control to be performed based on the presence, position, and orientation of other people 360 present around the user or non-wearable terminal 2 as information about the information leaking medium.
[0073] (Settings screen) The alternative display setting is performed on the wearable device 1, but may also be performed on the non-wearable device 2 and the setting information transmitted after pairing with the wearable device 1. Fig. 16 shows an example of a user setting screen for the alternative display function.
[0074] In the setting screen 400 of FIG. 16, the following major items are (1) “Non-applicable (OFF)” (2) "Always apply (ON)" (3) “Timely application” Select the pattern to be applied.
[0075] (3) If you select "Apply as appropriate," (3-1) Whether to apply it in a timely manner based on the application location ("Automatic identification of application location (information security: low)"); (3-2) Whether to apply it in a timely manner based on the target of application ("Automatic identification of target of application (media for information leakage)") It is possible to select both. In that case, the priority of the application location and the application target may be set using the "priority setting" button 401. Using the priority, it is possible to set whether to control the alternative display depending on whether one of the conditions is met, or whether to control the alternative display by giving priority to one of the conditions. This makes it possible to prevent inconsistencies in the alternative display control. It is possible to control the alternative display according to the priority of the application conditions set by the user.
[0076] (3-1) Automatic identification of applicable locations (information security: low) "Applicable location (information security: low) automatic identification" (3-1-1) "Excluding registered locations (information security: high)" which excludes locations registered in advance, (3-1-2) "Automatic selection" of applicable locations, (3-1-3) "Automatic identification location designation", You can select.
[0077] (3-1-1) Excluding the registered location (information security: high) Press the "Non-applicable location registration setting" button 402 to acquire position information and images of locations where alternative display control is not performed, such as home or one's own room, as locations with high information security using the positioning sensor 107 or camera 106 and pre-register them. Then, when "Exclude registered locations (information security: high)" is selected, alternative display control is not performed in the pre-registered locations based on the position information and images of the pre-registered locations and the location where the user is currently located.
[0078] (3-1-2) Automatic selection Automatically selects a location to display as an alternative (automatic setting: automatically identifies whether the user's current location is similar to all locations registered by default (e.g., coffee shop, train, etc.) based on location information and images registered by default, and displays the alternative). This allows the system to automatically select locations with low information security and control the display of alternative locations.
[0079] (3-1-3) Location designation by automatic machine The user specifies in advance the locations for automatic identification and alternative display. Spaces that can be identified as applicable locations include "coffee shop," "library," "in a car," and "in a train," but additional locations for automatic identification can be set by pressing the "automatic identification location registration setting" button 403. This allows the system to automatically identify and alternatively display the location based on the registered location information and image, depending on whether the location where the user is currently located is similar to a specific location registered or specified by the user.
[0080] (3-2) Automatic identification of applicable objects (information leakage media) "Automatic identification of applicable objects (information leakage media)" (3-2-1) Automatic selection, (3-2-2) Designation of automatic identification target (information leakage medium), You can select.
[0081] (3-2-1) Automatic selection Images captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 are analyzed, and an information leaking medium to be displayed as an alternative is automatically selected (automatic setting: for all information leaking media registered by default (e.g., surveillance cameras, people), identification and alternative display are performed automatically based on the images of the information leaking media registered by default). This allows control to automatically identify information leaking media and display alternatives.
[0082] (3-2-2) Designation of automatic identification target (information leakage medium) Images captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 are analyzed, and information leaking media registered and designated in advance by the user are automatically identified based on the images of the registered information leaking media, and an alternative display is performed (e.g., surveillance cameras, people. Additional targets can be added, such as mobile devices). This allows control so that specific information leaking media registered and designated in advance by the user are automatically identified and an alternative display is performed. Information leaking media may also be added by pressing the "Automatic Identification Target Registration Settings" button 404.
[0083] FIG. 17 shows the user setting screen for the detailed alternative display function.
[0084] 17(a), the user can set detailed application conditions for the alternative display function. Specifically, the user can select whether to use the presence or absence of an "obstruction" and / or the "affiliation of the person and the device being used" as application conditions.
[0085] "Shielding object" can be applied when "Applicable location (information security: low) automatic identification" is checked on the setting screen 400 of FIG.
[0086] "Affiliation of person and device used" can be applied when "Designate target for automatic identification (information leak medium)" and "Person" are checked on the setting screen 400 in Fig. 16. When "Person" is checked, people other than nearby users who do not belong to the affiliation are identified and displayed as an alternative.
[0087] Pressing the "Affiliation information registration settings" button 411 opens an affiliation information registration settings screen 420 in Fig. 17(b). On the affiliation information registration settings screen 420, edit the affiliation information of individual people and devices used, and press the "Registration settings" button 421 to proceed to the affiliation information details screen 430 in Fig. 18. Here, Figs. 17(b) and 18 show an example in which information relating to "affiliation of person and device used" is classified by affiliation, but the way in which information relating to "affiliation of person and device used" is classified does not have to be limited to this example, and it may also be classified, for example, by person or device used.
[0088] 18 shows the affiliation information registration setting screen. Each item on the affiliation information details screen 430 will be explained below. (1) Affiliation name…Optional affiliation name. (2) Affiliation information: specific affiliation (company (including department information, etc.)), family, club / circle, etc. In order to perform the alternative display control shown in FIG. 19, which will be described later, it is desirable that the affiliation information can be specified in several stages. (3) Relevant person: A person who belongs to our organization (register personal identification information that can uniquely identify a person, such as an image or voice). (4) Equipment used: Equipment used by this department (PC, mobile device, etc.). (5) Specific confidential characters for non-applicable persons: Specific confidential characters (XX Department, △△ Meeting, etc.). (6) Detailed conditions for applying the alternative display function
[0089] The affiliation information details screen 430 has “registration setting buttons” 431, 432, 433, 434, and 435 for registering after editing each of the following items: (1) affiliation name, (2) affiliation information, (3) relevant person, (4) equipment used, and (5) specific confidential characters for non-relevant people.
[0090] The above (6) "Detailed alternative display function application conditions" is (6-1) "Non-matching person identification (user criteria)" (6-2) "Non-applicable person identification (device use criteria)" can be selected.
[0091] (6-1) "Non-matching person identification (user criteria)" The system determines whether the affiliation of the user using a PC or the like is the same as that of other people around the user, and performs alternative display control based on the result of the determination. (6-2) "Non-applicable person identification (device use criteria)" The system determines whether the organization (affiliation) that manages the device, such as the PC, used by the user is the same as the affiliation of other people around the user, and performs alternative display control based on the results of this determination.
[0092] In both the user-based and device-based cases, by selecting "specific confidential characters for non-relevant persons," a screen such as an application screen containing specific confidential characters is displayed instead for non-relevant persons.
[0093] This allows detailed alternative display control to be performed according to the relationship between the user or the device used by the user and nearby people other than the user.
[0094] FIG. 19 is a diagram showing an example of alternative display control rule information that is applied when either “Affiliation of person / device used” on the screen of FIG. 17(a) or “Non-matching person identification (user basis)” or “Non-matching person identification (device used basis)” on the screen of FIG. 18 is selected.
[0095] "Affiliation 1" and "Affiliation 2" in the alternative display control rule information 440 in Fig. 19 match the affiliation hierarchy defined in Fig. 18. In Fig. 19, the affiliation hierarchy and the content of alternative display control are linked.
[0096] For example, the first line in FIG. 19 is linked to displaying the entire screen instead for "people who do not belong to department 1," that is, people who are not employees of the company.
[0097] In the second line, for "people who fall under affiliation 1 but do not fall under affiliation 1+2~", i.e., employees of the company but from other departments, the application screen for calls and conferences or an application screen containing characters or symbols indicating that the document is confidential is displayed instead.
[0098] In the third line, for "people who fall under affiliation 1+2~ but are not the user", that is, employees of the company and other people in the same department, the user's private information is displayed as an alternative, as it is considered that they have the same obligation to maintain confidentiality of business information. There is an application screen that contains the user's name, ID, and password as private information of the user.
[0099] (Alternative display control procedure) FIG. 20 is a flowchart (first half) showing the flow of processing in the alternative display system according to this embodiment, and FIG. 21 is a flowchart (second half) showing the flow of processing in the alternative display system according to this embodiment.
[0100] When the wearable device 1 starts the alternative display control, the alternative display control unit 125 checks the setting information (S101).
[0101] If multiple application conditions for the alternative display function are set, the process of determining whether or not alternative display is required in step S108, which will be described later, is performed in accordance with the order set in "Priority Setting" in Fig. 16, so priority setting information is also acquired in step S101. If multiple application conditions are set but no priority is set, the application conditions may be set to determine whether or not the conditions are required in a predetermined order.
[0102] If it is set to "always not applied," the process ends. If it is set to "always applied" or "applied as needed," the alternative display control unit 125 transmits alternative display start / continuation information to the non-wearable device 2 (S102).
[0103] The alternative display start / continuation information also includes request information for data required to determine the conditions for applying the alternative display specified in the setting information (see Figure 16). For example, if "surveillance camera" is included in "automatic identification of applicable object (information leak medium)," it includes a request for capturing images by non-wearable device 2.
[0104] Furthermore, if "person" is included in "automatic identification of target (information leak medium)," in addition to requesting an image to be captured by the non-wearable device 2, if the non-wearable device 2 has a distance sensor, it may also request the acquisition of distance information.
[0105] The non-wearable device 2 receives the alternative display start / continuation information (S103), and based on that, collects information used to determine whether or not alternative display is necessary (S104).
[0106] In the non-wearable device 2, an image is taken using the camera 206 mounted on the non-wearable device 2, and if it is necessary to measure the distance to a person as an information leak medium, the distance to the person in the image is measured (S104) and transmitted to the wearable device 1 (S105).
[0107] If "always apply" is selected, after the alternative display start / continuation information is transmitted and received (S102, S103), the display 212 of the non-wearable device 2 is switched to non-display (skip to S112).
[0108] The wearable device 1 also collects information to be used to determine whether or not an alternative display is required (S106). In addition to location information obtained from the image capture, distance measurement, and positioning sensor 107, the wearable device 1 also collects the user's voice using the microphone 113 to the extent necessary to determine whether or not an alternative display is required.
[0109] The wearable device 1 acquires (S107) information about the user's location collected by the wearable device 1 and the non-wearable device 2 (position information detected by the positioning sensor 107, images captured by the cameras 106 and 206), information about nearby information leaking media (images captured by the cameras 106 and 206), user information (user affiliation information read from the setting information of the wearable device 1, audio picked up by the microphone 113, etc.), and device information received from the non-wearable device 2, and uses this information in a process of determining whether or not an alternative display is required (S108). Details of the process of determining whether or not an alternative display is required will be described later (S108).
[0110] The process for determining whether or not an alternative display is necessary includes "alternative display control based on location information about the location and information about the surrounding environment as information about the location" (Fig. 22), "alternative display control based on surveillance cameras as information leak media" (Fig. 23), "alternative display control based on people other than the user as information leak media" (Fig. 24), "alternative display control based on the person's affiliation" (Fig. 25), and "alternative display control based on the affiliation of the device used" (Fig. 26). These are processed according to the priority information read in S101.
[0111] If the result of the process to determine whether or not an alternative display is required is that an alternative display is required (S109: Yes), the wearable device 1 specifies the screen area to be used for the alternative display and transmits alternative display instruction information indicating that screen area to the non-wearable device 2 (S110).
[0112] The non-wearable device 2 receives the alternative display instruction information (S111), switches the screen area to be alternatively displayed to hidden (S112), and transmits the hidden display data 300 to the wearable device 1 (S113), which is received by the wearable device 1 (S114).
[0113] The wearable device 1 displays the received information related to the alternative display on the display 112 of the wearable device 1 (S115). If the alternative display is to be continued (S116: No), the process returns to step S102, and information to be used in the process of determining whether or not the alternative display is required is collected by each of the non-wearable device 2 and the wearable device 1. If "always apply" is selected, the process returns to step S112.
[0114] If the alternative display control is to be ended (S116: Yes), alternative display end information is transmitted from the wearable device 1 to the non-wearable device 2 (S117), and is received by the non-wearable device 2 (S118).
[0115] The non-wearable device 2 returns from non-display to normal display (S119) and stops transmitting display data to the wearable device 1. Then, the alternative display control of the wearable device 1 and the non-wearable device 2 ends.
[0116] (Alternative display control based on location information and information about the surrounding environment as location information) FIG. 22 is a flowchart showing the flow of processing for alternative display control based on location information of a place and information about the surrounding environment as information about a place.
[0117] The alternative display control unit 125 acquires the user's position information measured by the positioning sensor 107, an image showing the surrounding environment captured by the camera 206 or 106, and distance information measured by the distance measurement sensor 108, and determines whether the current position or the surrounding environment is an application location for alternative display control by referring to the setting information (S201). If the determination result is negative (S201: No), the alternative display necessity determination process result is output (S205) so as to proceed to a process when alternative display is not to be executed (S109: No).
[0118] If the determination result is positive (S201: Yes), the alternative display control unit 125 refers to the setting information. If a condition based on an obstruction is set (S202: Yes), the image recognition unit 121 analyzes the image captured by the camera 106 of the wearable device 1 or the camera 206 of the non-wearable device 2 to detect the obstruction, and the obstruction determination unit 122 determines the area of the screen to be hidden depending on the obstruction (S203). Then, the result of the process to determine whether or not an alternative display is necessary is output (S205) so as to proceed to the process for executing an alternative display (S109: Yes). In analyzing the image, the image recognition unit 121 detects the captured area of the obstruction reflected in the image. Then, the obstruction determination unit 122 determines the area of the screen to be hidden depending on the height, opacity, and placement position of the obstruction.
[0119] If no conditions are set due to obstructions (S202: No), the entire display 212 of the non-wearable device 2 is determined to be the non-display area (S204), and the alternative display control unit 125 outputs the result of the process to determine whether or not alternative display is required (S205), so as to proceed to the process for executing alternative display (S109: Yes).
[0120] This allows the necessity of alternative display control to be determined based on the location information of the location and information about the surrounding environment, and further allows the non-display area to be determined based on information about the surrounding environment of the location, such as the height of obstructions.
[0121] (Alternative display control based on surveillance cameras as a medium for information leakage) FIG. 23 is a flowchart showing the flow of processing for alternative display control based on a surveillance camera as an information leak medium.
[0122] The image recognition unit 121 analyzes the image captured by the camera 106 of the wearable device 1 or the image captured by the camera 106 of the non-wearable device 2 to detect a surveillance camera, and the information leak medium determination unit 124 determines whether the surveillance camera corresponds to an information leak medium based on the position and orientation of the surveillance camera (S301). If the determination result is negative (S301: No), the result of the process for determining whether or not an alternative display is required is output (S303) so that the process continues to a process for not executing an alternative display (S109: No).
[0123] If the judgment result is positive (S301: Yes), the information leakage medium judgment unit 124 decides to hide the entire screen of the display 212 of the non-wearable terminal 2 (S302), and the alternative display control unit 125 outputs the result of the process to judge whether or not an alternative display is necessary (S303) so as to proceed to the process for executing the alternative display (S109: Yes).
[0124] This allows for an alternative display to be provided if there is a risk of information displayed on the display 212 of the non-wearable device 2 being leaked from the surveillance camera based on the position or orientation of the surveillance camera, thereby improving information security.
[0125] (Alternative display control based on other people than the user as a medium for information leakage) FIG. 24 is a flowchart showing the flow of processing for alternative display control based on people other than the user as information leak media.
[0126] The image recognition unit 121 analyzes an image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 to determine whether or not a person other than the user is captured (S401). If the determination result is negative (S401: No), the image recognition unit 121 outputs the result of the process for determining whether or not an alternative display is required (S405), so that the process proceeds to a process for not performing an alternative display (S109: No).
[0127] If the determination result is positive (S401: Yes), the information leaking medium determination unit 124 determines whether the distance from the non-wearable terminal 2 to another person is within a first distance range for determining whether information on the display 212 can be read (S402). If the determination result is positive (S402: Yes), the information leaking medium determination unit 124 decides to hide the entire screen of the display 212 (S403), and the alternative display control unit 125 outputs the result of the process for determining whether or not an alternative display is required (S405) so as to proceed to the process for executing an alternative display (S109: Yes).
[0128] If the distance from the non-wearable terminal 2 to the other person is greater than the first distance range (S402: No), the information leakage medium determination unit 124 decides to hide the entire screen (S403) if the other person's face is facing the display 212 (S404: Yes), and the alternative display control unit 125 outputs the result of the process to determine whether or not an alternative display is required (S405) so as to proceed to the process for executing an alternative display (S109: Yes).
[0129] On the other hand, if the distance from the non-wearable terminal 2 to the other person is greater than the first distance range (S402: No), the information leakage medium determination unit 124 outputs the result of the process to determine whether or not an alternative display is required (S405), so that if the other person's face is not facing the display 212 (S404: No), the process proceeds to the process for not performing an alternative display (S109: No).
[0130] This allows an alternative display to be performed when another person is near the user or when the face of another person is facing the display 212 of the non-wearable terminal 2, thereby improving information security.
[0131] (Alternative display control based on person's affiliation) FIG. 25 is a flowchart showing the flow of processing for alternative display control based on the affiliation of a person.
[0132] The image recognition unit 121 analyzes an image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 to determine whether or not a person other than the user is captured (S501). If the determination result is negative (S501: No), the image recognition unit 121 outputs the result of the process for determining whether or not an alternative display is required (S503), so that the process proceeds to a process for not performing an alternative display (S109: No).
[0133] If the determination result is positive (S501: Yes), the alternative display control unit 125 refers to the affiliation information set on the affiliation information details screen 430 (see FIG. 18) and determines whether the user's affiliation is the same as that of other people (S502).Then, the alternative display control unit 125 refers to the alternative display control rule information 440 (see FIG. 19), determines the content of alternative display control, and outputs the result of the alternative display necessity determination process (S503) so as to proceed to the process for executing alternative display (S109: Yes).
[0134] As a result, when a stranger is near the user, an alternative display is made according to the affiliation of the stranger and the user, thereby improving information security.
[0135] (Alternative display control based on the device used) FIG. 26 is a flowchart showing the flow of processing for alternative display control based on the affiliation of a person.
[0136] The image recognition unit 121 analyzes an image captured by the camera 206 of the non-wearable device 2 or the camera 106 of the wearable device 1 to determine whether or not a person other than the user is captured (S601). If the determination result is negative (S601: No), the image recognition unit 121 outputs the result of the process for determining whether or not an alternative display is required (S603), so that the process proceeds to a process for not performing an alternative display (S109: No).
[0137] If the determination result is positive (S601: Yes), the alternative display control unit 125 refers to the affiliation information set on the affiliation information details screen 430 (see FIG. 18) and determines whether the organization (affiliation) that manages the non-wearable device 2 is the same as the affiliation of the other person (S602).The alternative display control unit 125 then refers to the alternative display control rule information 440 (see FIG. 19) and outputs the result of the process for determining whether or not alternative display is necessary (S603) so as to proceed to the process for determining whether or not alternative display is necessary (S109: Yes) in which alternative display control content is determined and alternative display is executed.
[0138] This allows for an alternative display to be made when there is someone who does not belong to the organization (affiliation) that manages the non-wearable device, thereby improving information security.
[0139] According to this embodiment, the display of the non-wearable device is switched to a dark screen or a masked screen depending on the location where the user is using the non-wearable device and the surrounding conditions (degree of need for an alternative display), and information that needs to be prevented from leaking is displayed on the display of the wearable device, thereby preventing information leaks caused by others peeking or peeking at the display screen of the non-wearable device and improving the information security of the non-wearable device.
[0140] The present invention is not limited to the present embodiment, and any combination of the examples shown in the above embodiments is included in the present invention. Furthermore, modifications that add further functions to the above embodiments are also possible.
[0141] For example, in this embodiment, the alternative display program 120 is installed in the wearable terminal 1, but the alternative display program 120 may be installed in the non-wearable terminal 2, and after the wearable terminal 1 and the non-wearable terminal 2 are connected, the non-wearable terminal 2 may determine whether or not to execute alternative display control.
[0142] Furthermore, the non-display processing for the display 212 of the non-wearable terminal 2 in this embodiment may be considered to include brightness control, masking processing, mosaic processing, and the like for the display 212 of the non-wearable terminal 2.
[0143] Furthermore, the numerical values, messages, etc. appearing in the text and figures are merely examples, and the effects of the present invention will not be impaired even if different ones are used.
[0144] The programs described in each processing example may be independent programs, or multiple programs may constitute a single application program. The order in which each process is performed may also be changed.
[0145] The functions of the present invention described above may be realized in part or in whole by hardware, for example, by designing an integrated circuit, a general-purpose processor, or an application-specific processor. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. Alternatively, the functions may be realized by software, such as by a processor unit interpreting and executing an operating program that realizes each function. Hardware and software may also be used together.
[0146] Furthermore, the control lines and information lines shown in the diagram are those considered necessary for explanation, and do not necessarily represent all of the control lines and information lines on the product. In reality, it can be assumed that almost all components are interconnected.
[0147] The above embodiment includes the following aspects. (First aspect) A wearable device, The display and a communication device that receives display data from the non-wearable device; a processor, The processor: transmitting a control signal to the non-wearable device via the communication device to cause the received display data to be hidden, and performing alternative display control to receive the display data of the non-wearable device and display the display data on the display; Wearable device.
[0148] (Second Aspect) A linked display system including a wearable terminal and a non-wearable terminal, Wearable devices are A first display; a first communication device that receives display data of the non-wearable device; a first processor, Non-wearable devices are A second display; a second communication device that transmits display data to the wearable device; a second processor, the first processor transmits a control signal to the non-wearable terminal via the first communication device to cause the display data to be hidden, receives display data from the non-wearable terminal, and performs alternative display control to display the display data on the first display; the second processor receives the control signal via the second communication device, hides the display data on the second display, and transmits the display data to the wearable terminal; Linked display system.
[0149] (Third Aspect) A linked display method executed between a wearable terminal and a non-wearable terminal, comprising: transmitting a control signal from the wearable terminal to the non-wearable terminal to hide the display data displayed on the display of the non-wearable terminal; hiding the display data on a display of the non-wearable terminal and transmitting the display data to the wearable terminal; receiving the display data by the wearable terminal from the non-wearable terminal; displaying the display data on a display provided in the wearable terminal; Continuity display methods, including [Explanation of symbols]
[0150] 1: Wearable device, 2: Non-wearable device, 2A: Notebook computer, 2C: Mobile device, 4: Server, 5: External network, 10: Alternative display system, 100: HMD, 100s: AR glasses, 101: processor, 102: memory, 103: storage, 104: operation input interface, 106: camera, 107: positioning sensor, 108: distance measurement sensor, 109: acceleration sensor, 110: gyro sensor, 111: geomagnetic sensor, 112: display, 113: microphone, 114: speaker, 115: timer, 116: network communication device, 117: BT communication device, 118 : Bus, 120: Alternative display program, 121: Image recognition unit, 122: Obstruction determination unit, 123: Non-display area determination unit, 124: Information leakage medium determination unit, 125: Alternative display control unit, 126: Display data receiving unit, 127: Virtual reality object display unit, 130: Data, 131: Location information, 132: Information leakage medium information, 133: Alternative display control information, 140: Non-display switching program, 141: Display switching unit, 142: Display data transmission unit, 201: Processor, 202: Memory, 203: Storage, 204: Operation input interface, 206: Camera, 212: Display, 212A: Display, 212B: Display, 212C: Display, 216: Network communication device, 217: Bluetooth communication device, 218: Bus, 300: Display data, 301: Application screen, 320: Obstruction, 320a: Obstruction, 320b: Obstruction, 350: Surveillance camera, 360: Other people, 400: Settings screen, 401: Priority setting button, 402: Non-applicable location registration setting button, 403: Automatic recognition location registration setting button, 404: Automatic recognition location registration setting button, 410: User setting screen, 411: Affiliation information registration setting button, 420: Affiliation information registration setting screen, 421: Registration setting button, 430: Affiliation information details screen, 431: Registration setting button, 432: Registration setting button, 433: Registration setting button, 434: Registration setting button, 435: Registration setting button, 440: Alternative display control rule information
Claims
1. A display control method for a wearable terminal including a display, a communication device that receives display data of a non-wearable terminal, a memory, and a processor, the method comprising: a step in which the processor transmits a control signal to the non-wearable device via the communication device to hide the received display data based on the information about the location or the information about the information leaking medium stored in the memory, and executes alternative display control to receive the display data of the non-wearable device and display the display data on the display; A display control method using a wearable terminal, comprising:
2. A display control method for a wearable terminal according to claim 1, The wearable terminal includes: a positioning sensor for detecting position information; a camera for capturing an image of the surrounding environment; a step of the processor storing, as information about the location, position information detected by the positioning sensor or an image captured by the camera; A display control method using a wearable terminal, comprising:
3. A display control method for a wearable terminal according to claim 2, the processor: storing the position information detected by the positioning sensor or the image captured by the camera as pre-registered information for executing the alternative display control; executing the alternative display control when the location of the user is not recorded in the pre-registration information; A display control method using a wearable terminal, comprising:
4. A display control method for a wearable terminal according to claim 2, the processor: analyzing the image captured by the camera to recognize an obstruction located around the display of the non-wearable device; determining a screen area to be hidden on a display of the non-wearable device according to at least one of a height, a transparency, or a position of the obstructing object relative to the non-wearable device; A display control method using a wearable terminal, comprising:
5. A display control method for a wearable terminal according to claim 1, the wearable terminal further comprises a camera; the processor: a step of analyzing at least one of an image captured by the camera and an image captured by a camera mounted on the non-wearable device based on information about the information-leaking medium, and recognizing an information-leaking medium located around the display of the non-wearable device; executing the alternative display control in accordance with at least one of a position and an orientation of the information leaking medium relative to the non-wearable device; A display control method using a wearable terminal, comprising:
6. A display control method for a wearable terminal according to claim 5, The information leak medium is a surveillance camera or a person other than the user of the wearable device. A display control method using a wearable device.
7. A display control method for a wearable terminal according to claim 5, the processor: storing user information that associates an organization to which the user of the wearable device belongs with identification information of other people who belong to the organization; analyzing an image captured by the camera to determine whether the person captured by the camera is the same person as the other person who belongs to an organization to which the user belongs and is included in the user information, and executing the alternative display control based on the determination result; A display control method using a wearable terminal, comprising:
8. A display control method for a wearable terminal according to claim 5, the processor: storing user information that associates an organization to which the user of the wearable device belongs with identification information of other people who belong to the organization; analyzing an image captured by the camera, comparing the person captured by the camera with the user information, determining whether the organization to which the user belongs is identical to the organization to which the person captured by the camera belongs, and executing the alternative display control based on the determination result; A display control method using a wearable terminal, comprising:
9. A display control method for a wearable terminal according to claim 5, the processor: storing affiliation information of the wearable device in association with an organization that manages the wearable device and identification information of other people who belong to the organization; analyzing an image captured by the camera, comparing the person captured by the camera with the affiliation information of the device used, determining whether the organization managing the wearable device is the same as the organization to which the person captured by the camera belongs, and executing the alternative display control based on the determination result; A display control method using a wearable terminal, comprising:
Citation Information
Patent Citations
Medical image display device and medical image display method
JP2008036005A
Electronic apparatus, system and method
JP2015172884A
Operation display device, image forming apparatus, program, and operation display system
JP2016130916A
Controlled display of content on wearable displays
US20160239091A1
Privacy Screen
JP2020536311A