Wearable terminal and information display system

Abstract

This wearable terminal is provided with a display, a camera that captures an image of the surroundings, and a processor. The processor acquires information within a user's field of view from the image of the surroundings captured by the camera, and determines whether or not the information includes information specified by the user. If the acquired information includes the specified information, the processor controls the display to change the representation of the acquired information and display the resulting information.

Description

Wearable terminal and information display system

[0001] The present invention relates to a wearable terminal and an information display system.

[0002] Patent Literature 1 discloses a technique for detecting differences between a real object and a reference model corresponding to the real object, and superimposing an AR image showing an annotation on the real object. Patent Literature 1 discloses a technique for indicating the location of changes or differences between the turbine 202 and a turbine CAD model 204 on the turbine 202, for example.

[0003] Japanese Patent Application Laid-Open No. 2021-131853

[0004] However, the above document does not disclose anything about suppressing the viewing of predetermined information within the user's field of view, changing the presentation of the information to be more user-friendly, etc. From this perspective, there is room for improvement in providing a technology for more appropriate display.

[0005] According to the present invention, as an example, the following wearable terminal is provided. The wearable terminal includes a display, a camera that captures images of the surroundings, and a processor. The processor acquires information within the user's field of view from an image of the surroundings captured by the camera and determines whether the information includes specified information designated by the user. If the acquired information includes the specified information, the processor controls the display to change the presentation of the acquired information and display it.

[0006] Furthermore, according to the present invention, the following information display system is provided as an example. The information display system includes a wearable device and an information processing device capable of communicating with the wearable device. The wearable device includes a camera that captures images of the surroundings. The information processing device acquires information within the field of view of the user of the wearable device from an image of the surroundings captured by the camera and transmitted from the wearable device, and determines whether the information includes specified information designated by the user. If the acquired information includes the specified information, the information processing device generates data that changes the representation of the acquired information and transmits the generated data to the wearable device. The wearable device performs display based on the data transmitted from the information processing device.

[0007] According to the present invention, a technology is provided that allows a user to appropriately view acquired information by modifying the acquired information, for example, by suppressing the display of predetermined information in the user's field of view or softening the expression of the information. Note that problems, configurations, and effects other than those described above will become clear from the following description of the embodiment of the invention.

[0008] 8A is a diagram illustrating an example of a wearable terminal. FIG. 8B is a diagram illustrating an example of the configuration of a wearable terminal. FIG. 8C is a diagram for explaining an example of the functional configuration of a wearable terminal. FIG. 8D is a diagram for explaining an example of a usage situation of a wearable terminal. FIG. 8E is a diagram illustrating an example of the configuration of an information processing device. FIG. 8F is a diagram for explaining an example of the functional configuration of an information processing device. FIG. 8G is a diagram for explaining an example of a usage situation of a wearable terminal. FIG. 8H is a diagram illustrating an example of user-specified information. FIG. 8H is a diagram illustrating a part of FIG. 8A. FIG. 8F is a flowchart illustrating an example of processing of a wearable terminal. FIG. 8H is a diagram for explaining an example of visual recognition suppression processing. FIG. 8H is a flowchart illustrating an example of processing of a wearable terminal. FIG. 8I is a diagram for explaining an example of visual recognition suppression processing. FIG. 8I is a flowchart illustrating an example of processing of a wearable terminal. FIG. 8I is a diagram for explaining an example of visual recognition suppression processing. FIG. 8I is a flowchart illustrating an example of processing of a wearable terminal. FIG. 8I is a diagram for explaining an example of visual recognition suppression processing. 1 is a flowchart showing an example of processing of a wearable terminal. FIG. 2 is a diagram for explaining an example of visual recognition suppression processing. FIG. 3 is a diagram for explaining an example of a usage status of a wearable terminal. FIG. 4 is a flowchart showing an example of processing of a wearable terminal. FIG. 5 is a diagram for explaining an example of a usage status of a wearable terminal. FIG. 6 is a flowchart showing an example of processing of a wearable terminal. FIG. 7 is a diagram showing an example of a status in which visual recognition suppression processing has been released. FIG. 8 is a flowchart showing an example of processing of a wearable terminal. FIG. 9 is a diagram for explaining an example of a usage status of a wearable terminal. FIG. 10 is a flowchart showing an example of processing of a wearable terminal. FIG. 11 is a diagram for explaining an example of a usage status of a wearable terminal.

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The embodiment is an example for explaining the present invention, and for clarity of explanation, appropriate omissions and simplifications have been made. The present invention can be implemented in various other forms. Unless otherwise specified, each component may be singular or plural.

[0010] In order to facilitate understanding of the invention, the position, size, shape, range, etc. of each component shown in the drawings may not represent the actual position, size, shape, range, etc. Therefore, the present invention is not necessarily limited to the position, size, shape, range, etc. disclosed in the drawings.

[0011] Examples of various information may be described using expressions such as "table," "list," "queue," and "file," but the various information may also be expressed using data structures other than these. For example, various information such as "XX table," "XX list," "XX queue," and "XX file" may also be referred to as "XX information." When describing identification information, expressions such as "identification information," "identifier," "name," "ID," and "number" are used, but these are interchangeable. When there are multiple components having the same or similar functions, they may be described using the same reference numeral with different subscripts. Furthermore, when there is no need to distinguish between these multiple components, the subscripts may be omitted.

[0012] In the embodiments, processing performed by executing a program may be described. Here, a computer executes the program using a processor (e.g., a CPU or a GPU) and performs processing defined by the program using storage resources (e.g., a memory) and interface devices (e.g., a communication port). Therefore, the entity performing the processing by executing the program may be the processor. Similarly, the entity performing the processing by executing the program may be a controller, device, system, computer, or node having a processor. The entity performing the processing by executing the program may be any computing unit, and may include a dedicated circuit that performs specific processing. Here, the dedicated circuit may be, for example, an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), a CPLD (Complex Programmable Logic Device), or the like.

[0013] A program may be installed on a computer from a program source. The program source may be, for example, a program distribution server or a computer-readable storage medium. When the program source is a program distribution server, the program distribution server may include a processor and storage resources for storing the program to be distributed, and the processor of the program distribution server may distribute the program to be distributed to other computers. In addition, in an embodiment, two or more programs may be realized as one program, or one program may be realized as two or more programs.

[0014] In the embodiment, a technology is described that can suppress the display of predetermined information in the user's field of view, or soften the expression of the information so that the user can view the information appropriately.

[0015] An example of the configuration of a wearable device will be described with reference to FIGS. 1 to 3. As shown in FIG. 1, a wearable device (information display device) is a device worn on the user's head. The wearable device is also a device that can superimpose and display images related to augmented reality in real space. Examples of the wearable device include AR (Augmented Reality) glasses 100a and an HMD (Head Mounted Display) 100b. The wearable device can display images using an optical see-through method, a video see-through method, or the like.

[0016] Furthermore, the wearable terminal may be, for example, a device in which a device such as a smartphone or tablet is attached to a frame worn on the user's head. In this case, the wearable terminal displays information on the display of the device.

[0017] As shown in FIG. 2 , the wearable terminal 100 includes an outer camera 101, an inner camera 102, a distance measurement sensor 103, an acceleration sensor 104, a gyro sensor 105, a geomagnetic sensor 106, a positioning sensor 107, a microphone 108, and a speaker 109.

[0018] The outer camera 101 captures an image by converting light incident from a lens into an electrical signal using an imaging element such as a CCD image sensor or a CMOS image sensor. The outer camera 101 can be positioned so as to capture an image of the surroundings of the wearable device 100.

[0019] For example, the in-camera 102 detects the gaze direction of the user when the wearable device 100 is worn. Note that the in-camera 102 may include, for example, a left-eye gaze sensor for the left eye and a right-eye gaze sensor for the right eye. The left-eye gaze sensor detects the user's left eye and detects the movement of the left eye, the movement of the gaze direction, etc., to capture the viewpoint of the left eye at the gaze point. The right-eye gaze sensor detects the user's right eye and detects the movement of the right eye, the movement of the gaze direction, etc., to capture the viewpoint of the right eye at the gaze point.

[0020] The wearable terminal 100 may perform predetermined processing using gaze information acquired from the in-camera 102. The wearable terminal 100 may display, for example, an input operation screen such as an operation menu on the display 111. The wearable terminal 100 may then acquire, as input operation information, the position of an icon, button, or the like on the input operation screen at which the user's gaze is directed, and perform predetermined processing.

[0021] The process of detecting eye movement may utilize well-known techniques commonly used for eye tracking. For example, in a method using corneal reflex, infrared light is emitted from an infrared light-emitting diode (LED) toward the face, and an image is captured by an infrared camera, which is an example of an eye-gaze sensor. Then, using the light reflection point on the cornea as a reference point, eye movement (eye direction) can be estimated from changes in eye position and other geometric features.

[0022] The ranging sensor 103 is a sensor that can measure the distance from the wearable device 100 to an object, the object's position, and capture the three-dimensional shape of the object. Examples of the ranging sensor 103 include a LiDAR (Light Detection and Ranging) sensor that irradiates an object with laser light such as infrared light and measures the scattered light that bounces back; a TOF (Time of Flight) sensor that measures distance by measuring the reflection time of pulsed light irradiated on the object for each pixel; and a millimeter-wave radar that emits millimeter-wave radio waves and captures the reflected waves. The ranging sensor 103 may also be a sensor that performs measurements based on the angle at which light reflected by the object is received. That is, the ranging sensor 103 may be a triangulation sensor. The ranging sensor 103 may also be a stereo camera that performs measurements based on parallax images, and the outer camera 101 may also be a stereo camera. Note that when information regarding the distance to an object and the position of the object is acquired without using the distance measuring sensor 103, the distance measuring sensor 103 may be omitted.

[0023] The acceleration sensor 104 can detect, for example, the tilt and direction of the wearable device 100. The gyro sensor 105 is a sensor that detects angular velocity or angular acceleration in the rotational direction and can capture the posture of an object. Therefore, the acceleration sensor 104 and the gyro sensor 105 can be used to detect the posture, such as the tilt and direction, of the wearable device 100. The geomagnetic sensor 106 is a sensor that detects the Earth's magnetic force and detects the direction in which the wearable device 100 is facing. A three-axis type sensor that detects geomagnetic fields in the up and down directions in addition to the front-back and left-right directions can be used to detect the movement of the wearable device 100 by capturing changes in geomagnetic field in response to the movement of the wearable device 100. The wearable device 100 can obtain information about the user's posture and movement using these sensors.

[0024] The positioning sensor 107 is, for example, a GPS (Global Positioning System) receiver. In this case, by receiving satellite radio waves from GPS satellites and performing positioning calculations, it is possible to detect, for example, the coordinates on the Earth at which the wearable device 100 is located. The positioning calculations may be performed by the GPS receiver, or by other components (such as the processor 112 of the wearable device 100 or an external device). The wearable device 100 may also acquire location information using other methods. For example, the wearable device 100 may determine its current location by analyzing an image captured by the outer camera 101 and / or three-dimensional point cloud data measured by the ranging sensor 103; for example, techniques such as SLAM (Simultaneous Localization and Mapping) are known. When position information is acquired without using the positioning sensor 107, the positioning sensor 107 may be omitted.

[0025] Also, known technologies include a visual positioning system (VPS) that identifies a location by analyzing camera images. The wearable device 100 may acquire location information by the VPS using images captured by the outer camera 101. The wearable device 100 may also transmit the images captured by the outer camera 101 to an external device. The external device may then acquire location information based on the VPS using the captured images and deliver the acquired location information to the wearable device 100. Note that when acquiring location information without using the positioning sensor 107, the positioning sensor 107 may be omitted.

[0026] The wearable device 100 may also acquire location information by Pedestrian Dead Reckoning (PDR) using, for example, the acceleration sensor 104, the gyro sensor 105, etc. When acquiring location information without using the positioning sensor 107, the positioning sensor 107 may be omitted.

[0027] The microphone 108 collects the user's own voice, external sounds, and the like, and converts them into audio data. For example, the user may speak a voice related to instructions such as input operations, and the wearable device 100 may acquire the voice data collected by the microphone 108 as instruction information for input operations, etc., and execute predetermined processing.

[0028] The speaker 109 outputs sound based on the audio data, and can notify the user of notification information by sound, for example. The wearable terminal 100 can notify the user by outputting a warning message by sound from the speaker 109, for example. By notifying the user by sound, usability can be improved.

[0029] The wearable terminal 100 also includes an operation interface (operation I / F 110) and a display 111. The operation I / F 110 is an interface that realizes input means using, for example, gaze, a hand, a pointer, or even a keyboard, key buttons, touch keys, or other operating devices separate from the wearable terminal 100, and information that the user wishes to input is input via the operation I / F 110.

[0030] The wearable terminal 100 may display an input operation screen such as an operation menu on the display screen of the display 111, acquire the position on the input operation screen at which the user's gaze is directed as input operation information, and perform an operation according to the input operation information. The wearable terminal 100 may also display a cursor such as a hand or a pointer on the input operation screen, acquire the user's operation using the cursor as input operation information, and perform an operation according to the input operation information. The wearable terminal 100 may also acquire the user's gesture as input operation information and perform an operation according to the input operation information. In the case of input using an input operation device such as a keyboard, key buttons, or touch keys, the input operation device may be connected to the wearable terminal 100 main body using a wired cable or wirelessly.

[0031] Examples of user input operations include input operations for various information. For example, user-specified information, which will be described later, is input by the user. Examples of user input operations include operations on applications and various setting operations such as volume adjustment.

[0032] The display 111 can be configured using a display such as a liquid crystal display, a touch panel display, or an organic EL display, and displays virtual objects, camera-captured images, etc. For example, if the wearable terminal is an immersive HMD, the display 111 is configured using a liquid crystal panel, a display that displays holographic images, etc., and displays virtual objects, camera-captured images, etc.

[0033] The wearable terminal 100 also includes a processor 112, a memory 113, and a communicator 114. The processor 112 is responsible for executing predetermined processes and is configured using an appropriate semiconductor device such as a CPU (Central Processing Unit). As shown in the figure, each component of the wearable terminal 100 is connected to the processor 112 via a bus 120. The processor 112 executes an operating system (OS) and application programs for operation control, etc., stored in the memory 113, thereby controlling each component of the wearable terminal 100 and realizing the functions of the OS, middleware, applications, etc.

[0034] The memory 113 is composed of a main storage device, a non-volatile storage device, etc., and stores various programs 121 and information data (data 122) handled by the processor 112, etc. An example of the information data will be described later. The memory 113 stores, as the programs 121, for example, an operating system and various application programs for controlling operations used by the processor 112. The memory 113 may also store various setting contents, contents set by the user, etc.

[0035] The communicator 114 is a device related to an interface used for communication with the outside world by the wearable terminal 100. The communicator 114 may include, for example, a short-range wireless communication interface, a network communication interface, and the like.

[0036] The short-range wireless communication interface is a communication interface that performs short-range wireless communication with a device within a range where short-range wireless communication is possible (for example, a television, which is an example of an information processing device described later). Short-range wireless communication is performed using, for example, an electronic tag, but is not limited to this. If the wearable terminal 100 is located near a device that is at least capable of wireless communication, short-range wireless communication may be performed using Bluetooth (registered trademark), IrDA (Infrared Data Association, registered trademark), Zigbee (registered trademark), HomeRF (Home Radio Frequency, registered trademark), or a wireless LAN (IEEE802.11a, IEEE802.11b, IEEE802.11g).

[0037] The network communication interface is a communication interface that performs wireless communication with an external information server or the like via an external network using base station communication or the like. The network communication interface can receive various information stored in the information server. Note that long-distance wireless communication such as W-CDMA (Wideband Code Division Multiple Access) or GSM (Global System for Mobile communications) can be used as base station communication.

[0038] The wearable terminal 100 may also include a wired connection input / output interface. The wired connection input / output interface is a component used for wired connection and is connected to a wired connection destination device or the like via a wired cable. The wearable terminal 100 may also include a battery serving as a power source. A charging device or the like may be connected as the wired connection destination device, and the wired connection input / output interface may be an input / output interface that inputs or outputs power via the wired cable. A battery may be connected to the wearable terminal 100 as the wired connection destination device, and the wired connection input / output interface may be an input / output interface that inputs or outputs power via the wired cable. The wearable terminal 100 may also be connected to an external power source and receive power from the wired connection input / output interface. The wired connection input / output interface may also be used for communication with the wired connection destination device. The wired connection input / output interface may also be configured to be connected via Power over Ethernet (PoE; Ethernet is a registered trademark).

[0039] In addition, devices that can be connected via a wired connection using a wired connection input / output interface include display devices such as monitors, televisions, personal computers, and charging devices, which are examples of information processing devices described below, as well as audio devices such as earphones or loudspeakers, and input operation devices such as keyboards, key buttons, and touch keys.

[0040] The wearable terminal 100 may also include a timer 115. The wearable terminal 100 may use the timer 115 to manage processing time, processing start time, and the like.

[0041] Next, an example of information data and an example of the functional configuration of a wearable terminal will be described with reference to FIG.

[0042] As shown in FIG. 3, the memory 113 can store, as an example, user-specified information 301, visual suppression processing information 302, image information 303, distance measurement information 304, audio information 305, and communication information 306 as information data.

[0043] The user-specified information 301 is information designated (registered) by a user. The user-specified information 301 includes, for example, information for identifying specific information that is to be suppressed from being viewed or that is to be softened in expression. The user-specified information 301 is, for example, an example of information for this identification, and may be information including user dislike information, which will be described later. The user-specified information 301 may also include information used to soften expression, and may be information including, for example, user preference information, which will be described later.

[0044] The visibility suppression processing information 302 is information about a target for which visibility suppression processing is performed and the processing content of the visibility suppression processing. The wearable device 100 acquires the visibility suppression processing information by, for example, extracting information about a target for which visibility suppression processing is performed from an image acquired by the outer camera 101 based on the user-specified information 301.

[0045] The image information 303 is information about an image acquired by the wearable terminal 100, and includes, for example, information about an image of real space acquired by the outer camera 101 and information about an image acquired by the distance measurement sensor 103. Note that the image information 303 may also include information about an image used to acquire position information of the wearable terminal 100. Furthermore, field of view information and line of sight information may be the image information 303.

[0046] The ranging information 304 is information relating to the distance to an object around the wearable device 100, and includes, for example, information relating to the distance to the object measured by the ranging sensor 103. The ranging information 304 may also include information relating to the position of the object acquired using the ranging sensor 103. The ranging information 304 may also include information relating to the shape of the object acquired using the ranging sensor 103.

[0047] The audio information 305 relates to audio data input from the microphone 108 and audio data output from the speaker 109 .

[0048] The communication information 306 is data input through communication and data output through communication. The wearable terminal 100 can communicate with an external device, a network, a server, or the like via a wired or wireless interface, and can acquire various data such as control data through communication.

[0049] 3, the wearable terminal 100 includes, as an example, a user-specified information processing unit 311, a visual recognition suppression processing unit 312, an image information processing unit 313, a visual field information and line of sight information processing unit 314, a distance measurement information processing unit 315, an audio information processing unit 316, and a communication information processing unit 317. These components are realized by the processor 112 storing data such as programs in the main storage device of the memory 113 and processing the data. Note that other components (sensors, interfaces, etc.) may also be used to realize these components.

[0050] The user-specified information processing unit 311 acquires the user-specified information 301. The user-specified information 301 can be registered by the user using, for example, the operation I / F 110. Note that the user-specified information processing unit 311 may acquire the user-specified information 301 based on data registered in the information processing device by communicating with the information processing device, which will be described in detail later.

[0051] Furthermore, the user-specified information processing unit 311 acquires predetermined information to be suppressed from being viewed or to be softened in expression as visibility suppression processing information 302. For example, the user-specified information processing unit 311 extracts the information from the image acquired by the outer camera 101 based on the user-specified information 301. Furthermore, the user-specified information processing unit 311 may acquire visibility suppression processing information acquired by the information processing device through communication with the information processing device.

[0052] The visibility suppression processing unit 312 performs visibility suppression processing on the visibility suppression processing information extracted based on the user-specified information. As the visibility suppression processing, the wearable terminal 100 displays, for example, a mask on the display 111 to suppress viewing of predetermined information. Furthermore, as the visibility suppression processing, the wearable terminal 100 displays, for example, the predetermined information in a softened expression.

[0053] The image information processing unit 313 processes the image information. The visual field information and line of sight information processing unit 314 processes the visual field information and line of sight information. Note that the visual field information and line of sight information may be processed by the image information processing unit 313. The distance measurement information processing unit 315 processes the distance measurement information 304.

[0054] The audio information processing unit 316 processes audio data input from the microphone 108. The audio information processing unit 316 also processes the audio data and outputs a predetermined sound from the speaker 109. The communication information processing unit 317 performs communication and processes data acquired from an external device through communication. The communication information processing unit 317 also processes data to be transmitted to an external device and transmits the data to an external device.

[0055] Next, an example of how the wearable device is used will be described with reference to Fig. 4. The user wears the wearable device 100 and watches an image displayed on an information processing device 400, such as a television. When visibility suppression processing information is displayed on the display screen, the wearable device 100 causes the user-specified information processing unit 311 to extract information to be subjected to visibility suppression processing from an image acquired by the outer camera 101, and the visibility suppression processing unit 312 to perform visibility suppression processing on the extracted information.

[0056] Next, an example of the configuration of an information processing device will be described with reference to Figures 5 and 6. As described above, the information processing device 400 is, for example, a television. As shown in Figure 5, the information processing device 400 includes a display 401, a microphone 402, a speaker 403, and an outer camera 404.

[0057] The display 401 can be configured using a display such as a liquid crystal display or an organic EL display, and displays images. The microphone 402 acquires audio from the outside. The speaker 403 outputs audio to the outside. The outer camera 404 acquires images of the surroundings of the information processing device 400.

[0058] The information processing device 400 also includes an operation interface (operation I / F 405). The operation I / F 405 is an interface that realizes an input means, for example, an operation button or a remote control that is an operation device separate from the information processing device, and information that the user wants to input is input via the operation I / F 405.

[0059] Examples of user operation input include input operations for various types of information. For example, user-specified information, which will be described later, is input by the user. Examples of user operation input include various setting operations such as volume adjustment. User-specified information may also be input by the user.

[0060] The information processing device 400 includes a processor 406, a memory 407, and a communication device 408. The processor 406 is responsible for executing predetermined processes and is configured using an appropriate semiconductor device such as a CPU. As shown in the figure, each component of the information processing device 400 is connected to the processor 406 via a bus 410. The processor 406 executes an operating system (OS) and application programs for operation control, etc., stored in the memory 407, thereby controlling each component of the information processing device 400 and realizing the functions of the OS, middleware, applications, etc.

[0061] The memory 407 is composed of a main storage device, a non-volatile storage device, etc., and stores various programs 411 and information data (data 412) handled by the processor 406, etc. An example of the information data will be described later. The memory 407 stores, as the programs 411, for example, an operating system and various application programs for controlling operations used by the processor 406. The memory 407 may also store various setting contents, contents set by the user, etc.

[0062] The communicator 408 is a device related to an interface used by the information processing device 400 for communication with the outside. The communicator 408 may include, for example, a short-range wireless communication interface, a network communication interface, etc. The short-range wireless communication interface and the network communication interface may be the same communication interfaces as those in the wearable terminal 100 described above.

[0063] The information processing device 400 may also include a wired connection input / output interface. The wired connection input / output interface is a configuration used for wired connection, and is connected to a device that is a wired connection destination via a wired cable. The wired connection input / output interface may also be an input / output interface that inputs or outputs power via a wired cable. The wired connection input / output interface may also be used for communication with the device that is a wired connection destination.

[0064] The information processing device 400 may also include a timer 409. The information processing device 400 may use the timer 409 to manage processing time, processing start time, and the like.

[0065] Next, an example of information data and an example of the functional configuration of an information processing device will be described with reference to FIG. 6. In the above example, the wearable device 100 acquired information on the target of the visual recognition suppression process and performed the process, but the information processing device 400 may also perform the same process. That is, user-specified information may be registered in the information processing device 400. The information processing device 400 may then acquire information on the target of the visual recognition suppression process, generate data for display based on the visual recognition suppression process, transmit the generated data to the wearable device 100, and the wearable device 100 may perform display based on the received data.

[0066] In this visibility suppression process, the information processing device 400 does not perform processing to suppress or soften the expressions in the image displayed on the display 401, and a normal image is displayed on the display 401. Therefore, for example, when a person who is not wearing the wearable terminal 100 views the display 401 of the information processing device 400, the person can view a normal image without any suppression of expressions due to the visibility suppression process.

[0067] As shown in FIG. 6, the memory 407 can store, as an example, user-specified information 601, visual suppression processing information 602, image information 603, distance measurement information 604, audio information 605, and communication information 606 as information data.

[0068] The user-specified information 601 is similar to the above, and includes information designated (registered) by the user and used to identify predetermined information for which the visual suppression process is performed. The user-specified information 601 may also include information used to soften expressions. The user-specified information 601 may include, for example, user dislike information, which will be described later. The user-specified information may also include, for example, user preference information, which will be described later.

[0069] The visibility suppression processing information 602 is similar to that described above and is information regarding the target of the visibility suppression processing and the processing content of the visibility suppression processing. The information processing device 400 acquires the visibility suppression processing information 602 from, for example, an image captured by the outer camera 101 acquired from the wearable device 100 via communication.

[0070] The image information 603 is information about an image acquired by the information processing device 400, and includes, for example, information about an image of real space acquired by the outer camera 404. The information processing device 400 may also acquire the image information 303 of the wearable terminal 100 by communicating with the wearable terminal 100. Note that the field of view information and line of sight information acquired from the wearable terminal 100 may be the image information 603.

[0071] The distance measurement information 604 is information relating to the distance to an object around the wearable terminal 100 , and the information processing device 400 can acquire the distance measurement information 604 by communicating with the wearable terminal 100 .

[0072] The audio information 605 relates to audio data input from the microphone 402 and audio data output from the speaker 403 .

[0073] The communication information 606 is data input through communication and data output through communication. The information processing device 400 can communicate with an external device, a network, a server, or the like via a wired or wireless interface, and can acquire various data such as control data and data of content to be played through communication.

[0074] 6, the information processing device 400 includes, as an example, a user-specified information processing unit 611, a visual suppression processing unit 612, an image information processing unit 613, a visual field information and line of sight information processing unit 614, a distance measurement information processing unit 615, an audio information processing unit 616, and a communication information processing unit 617. These components are realized by the processor 406 storing data such as programs in the main storage device of the memory 407 and processing the data. Note that other components (sensors, interfaces, etc.) may be used to realize these components.

[0075] The user-specified information processing unit 611 acquires the user-specified information 601. The user-specified information 601 can be registered by the user using, for example, the operation I / F 405. Note that the user-specified information processing unit 611 may acquire the user-specified information 601 based on data registered in the wearable terminal 100 through communication with the wearable terminal 100.

[0076] The user-specified information processing unit 611 also acquires predetermined information that is to be suppressed from being viewed or that is to be softened in expression, as the view suppression processing information 602. The user-specified information processing unit 611 acquires the view suppression processing information 602, for example, by extracting information that is to be subjected to the view suppression processing from data of the content to be played (e.g., a content scenario) based on the user-specified information 601. The user-specified information processing unit 611 may acquire the view suppression processing information acquired by the wearable terminal 100 through communication with the wearable terminal 100. The user-specified information processing unit 611 may also acquire image information of the outer camera 101 acquired by the wearable terminal 100 through communication with the wearable terminal 100. The information processing device 400 may then extract predetermined information that is to be suppressed from being viewed or that is to be softened in expression, as the view suppression processing information 602, from an image acquired by the outer camera 101 of the wearable terminal 100, based on the user-specified information 601.

[0077] The visibility suppression processing unit 612 performs visibility suppression processing on the acquired visibility suppression processing information 602. As the visibility suppression processing, the information processing device 400 generates, for example, data for displaying a mask that suppresses the viewing of predetermined information on the display 111 of the wearable terminal 100. Furthermore, as the visibility suppression processing, the information processing device 400 generates, for example, data for displaying, on the wearable terminal 100, a softened version of the predetermined information.

[0078] The image information processing unit 613 processes the image information. The visual field information and line of sight information processing unit 614 processes the visual field information and line of sight information. Note that the visual field information and line of sight information may be processed by the image information processing unit 613. The ranging information processing unit 615 processes the ranging information.

[0079] The audio information processing unit 616 processes audio data input from the microphone 402. The audio information processing unit 616 also processes the audio data and outputs a predetermined sound from the speaker 403. The communication information processing unit 617 performs communication and processes data acquired from an external device through communication. The communication information processing unit 617 also processes data to be transmitted to an external device and transmits the data to an external device.

[0080] An example of how a wearable device is used will be described with reference to Fig. 7. As shown in Fig. 7, a user wearing the wearable device 100 watches the display screen of an information processing device 400, such as a television, through the display 111 of the wearable device 100.

[0081] Next, specific examples of user-specified information will be described with reference to Figures 8A and 8B. As described above, the user can set (register) specific information to be used as the user-specified information, for example, to suppress or soften expressions. Furthermore, the user can set (register) information to replace the target information in the softening process. Here, we will describe an example of the former, user dislike information related to information for which the user wishes to change the expression, and an example of the latter, user preference information.

[0082] The user-specified information (301, 601) may include, for example, user dislike information regarding a high wave scene (1A) and user preference information regarding a rippling wave scene (1B) linked to this information.

[0083] Here, the wearable device 100 may perform a mask display on the display 111 to hide the high wave scene (1A) so that it overlaps the high wave scene (1A) as seen by the user.

[0084] Furthermore, the wearable device 100 may soften the high wave scene (1A) by, for example, displaying a ripple scene (1B) on the display 111 so that it overlaps the high wave scene (1A). Here, the wearable device 100 may display a background image so that it overlaps the specific information to be suppressed, and then display a softened image on top of that. That is, in this example, the wearable device may display a background image so that it overlaps the high wave scene (1A), and then display the ripple scene (1B) on top of that. This allows the specific information to be suppressed to be obscured by the background image, and allows the softened image to be displayed satisfactorily.

[0085] The wearable device may also display an image of the high wave scene (1A) that has been processed to soften the appearance of the high wave scene (1A) so that it is superimposed on the high wave scene (1A). In this case, the appearance can be softened without using a replacement image. Similarly to the above, the wearable device may display a base image so that it is superimposed on the specified information to be suppressed, and then display an image on top of that. This makes it possible to obscure the specified information to be suppressed in the base image, thereby allowing the softened image to be displayed satisfactorily.

[0086] As shown in the figure, the user-specified information (301, 601) may include, for example, user dislike information regarding an earthquake scene (2A) and user preference information regarding a normal scene (2B) linked to this information.

[0087] The user-specified information (301, 601) may include, for example, user dislike information regarding the collapse scene (3A) and user preference information regarding the normal scene (3B) linked to this information.

[0088] The user-specified information (301, 601) may include, for example, user dislike information regarding a high-altitude scene (4A) and user preference information regarding a low-altitude scene (4B) linked to this information.

[0089] The user-specified information (301, 601) may include, for example, user aversion information regarding sharp scenes (5A) including sharp parts, and user preference information regarding non-sharp scenes (5B) linked to this information.

[0090] The user-specified information (301, 601) may include, for example, user dislike information regarding a thunder scene (6A) and user preference information regarding a cloudy scene (6B) linked to this information.

[0091] The user-specified information (301, 601) may include, for example, user dislike information regarding a realistic scene (7A) and user preference information regarding a non-realistic illustrated scene (7B) associated with this information.

[0092] The user-specified information (301, 601) may include, for example, user dislike information regarding violent scenes (8A) and user preference information regarding non-violent scenes (8B) linked to this information.

[0093] The user-specified information (301, 601) may include, for example, user aversion information regarding pathological scenes (9A) and user preference information regarding non-pathological scenes (9B) linked to this information.

[0094] The user-specified information (301, 601) may include, for example, user aversion information regarding a threatening scene (10A) and user preference information regarding a non-threatening scene (10B) associated with this information.

[0095] The user-specified information (301, 601) may include, for example, user dislike information regarding a defamatory scene (11A) and user preference information regarding a non-defamatory scene (11B) linked to this information.

[0096] The user-specified information (301, 601) may include, for example, user dislike information regarding a discriminatory scene (12A) and user preference information regarding a non-discriminatory scene (12B) linked to this information.

[0097] The user-specified information (301, 601) may include, for example, user aversion information regarding religious scenes (13A) and user preference information regarding non-religious scenes (13B) linked to this information.

[0098] The user-specified information (301, 601) may include, for example, user aversion information regarding a sexual scene (14A) and user preference information regarding a non-sexual scene (14B) linked to this information.

[0099] The user-specified information (301, 601) may include, for example, user dislike information regarding scenes that are estimated to be disliked by the user (user-relevant estimated scenes 15A), and user preference information regarding scenes that are estimated to be preferred by the user linked to this information (user-relevant estimated scenes 15B).

[0100] In addition, the user-specified information (301, 601) may include, for example, user dislike information regarding scenes (user-specified scenes) that contain specific information (e.g., specific language), and user preference information linked to this information.

[0101] Furthermore, with regard to this predetermined information (here, user-disliked information), the wearable device 100 may also perform a mask display that hides the predetermined information on the display 111 so that it overlaps the portion of the predetermined information as seen by the user. As described above, the wearable device 100 may soften the expression of the predetermined information by displaying a replacement image (here, user preference information) or a processed image on the display 111 so that it overlaps the portion of the predetermined information as seen by the user. Here, the wearable device 100 may perform the display on top of a base image.

[0102] The display position on the display 111 is a position overlapping with the predetermined information. The wearable terminal 100 may calculate the display position on the display 111 using an image including the predetermined information acquired by the outer camera 101, and display the information at the calculated display position.

[0103] Additionally, the user-specified information (301, 601) may include specific voice information, specific text information, etc. as information for identifying predetermined information (here, user aversion information).

[0104] 8A and 8B are merely examples. For example, the user-specified information (301, 601) is not limited to the types of information shown as examples, and other types of information may be registered.

[0105] For example, the wearable terminal 100 or the information processing device 400 may generate user-specified information by acquiring history information such as user operations, voice, and facial expressions in addition to pre-registration, and estimating the user's likes and dislikes. Here, for example, a machine learning model may be used to estimate the user's likes and dislikes based on the user's operations, voice, and facial expressions.

[0106] In the user-specified information (301, 601), image data is registered as an example of data for identifying predetermined information to be suppressed or softened. However, data in other formats (such as audio) may also be registered as the data.

[0107] Next, an example of processing by the wearable terminal will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of processing by the wearable terminal.

[0108] When the wearable terminal 100 is powered on (S901), the wearable terminal 100 acquires external world information based on image data acquired by the outer camera 101. The wearable terminal 100 also acquires visual field information of the user (S902).

[0109] Here, the user's visual field information can be acquired based on an appropriate method. For example, the wearable device 100 may acquire the user's line of sight direction using the in-camera 102, and acquire, as the user's visual field information, an area within a predetermined angle range (e.g., ±30°, ±60°, ±100°) based on the acquired line of sight direction.

[0110] Then, the wearable device 100 determines whether the user's designated information 301 is present within the user's field of view (S903). That is, the wearable device 100 determines whether predetermined information registered as user designated information is included within an image of the user's field of view acquired using the outer camera 101. If user dislike information is registered in the user designated information 301, in S903 the wearable device 100 determines whether information registered as user dislike information is present.

[0111] In addition, if audio information is registered in the user-specified information 301, the wearable terminal 100 may determine whether the audio data acquired from the microphone 108 contains the registered audio information, and if the registered audio information is included, determine that the registered specified information is included in an image within the user's field of view.

[0112] In S903, if the wearable terminal 100 determines that the user's designated information is present within the user's field of view (S903-YES), the process proceeds to S904. On the other hand, if the wearable terminal 100 determines that the user's designated information is not present within the user's field of view (S903-NO), the process proceeds to S902.

[0113] The wearable terminal 100 performs a visibility suppression process on the user-specified information in the user's field of view (S904). That is, the wearable terminal 100 performs a process to suppress the display of predetermined information registered as user-specified information in the user's field of view, or to soften the expression of the information.

[0114] The wearable terminal 100 determines whether the user's specified information 301 is present within the user's field of view or the display range of the wearable terminal 100's display 111 (S905), and if it determines that the user's specified information 301 is not present (S905-NO), it cancels the visibility suppression processing (S906).

[0115] In this way, it is possible to perform a visibility suppression process on the user's designated information (e.g., user aversion information) in the user's field of view, thereby preventing the user from viewing the user's designated information (e.g., user aversion information) that exists in the user's field of view.

[0116] Next, an example of the visibility suppression process will be described with reference to FIG. 10 . For example, it is determined that the user's designated information (in this example, high wave scene (1A)) is present within the user's field of view. Here, as an example of the visibility suppression process, the wearable device 100 displays a ripple scene (1B), which is information associated with the high wave scene (1A), at a position on the display 111 where the high wave scene (1A) is visible. In this way, by changing from the high wave scene (1A) to the ripple scene (1B), the user's degree of aversion to the information that the user dislikes can be alleviated and made visible. Note that, as an example of the visibility suppression process, the wearable device 100 may display information that has been processed to soften the expression of the user's designated information.

[0117] To make the information that is the target of visibility suppression less visible, a background image may be displayed that overlaps the target, and softened information may be displayed that overlaps the background image.

[0118] Furthermore, as an example of the visibility suppression process, the wearable device 100 displays a mask (mask display M) of the high wave scene (1A) at a position on the display 111 where the high wave scene (1A) is visible. By masking the high wave scene (1A) in this way, it is possible to completely prevent the user from viewing information that the user dislikes.

[0119] Next, an example of processing by a wearable device will be described with reference to FIGS. 11 and 12 . FIG. 11 is a flowchart showing an example of processing by a wearable device. In this example, visibility suppression processing is performed according to the position of predetermined information within the field of view. As shown in FIG. 12 , the first field of view range FR1 is a range in the peripheral field of view in which general movement can be identified. The second field of view range FR2 is a range in the effective field of view in which an object can be identified. The third field of view range FR3 is a range in the central field of view in which the shape, color, etc. of an object can be clearly recognized. As an example, the central field of view is considered to be within ±2° from the line of sight. The effective field of view is considered to be outside the central field of view and within ±30° from the line of sight. The peripheral field of view is considered to be outside the central field of view and the effective field of view and within ±100° from the line of sight.

[0120] As described above, when the wearable terminal 100 is powered on (S1101), the wearable terminal 100 acquires external world information based on image data acquired by the outer camera 101. The wearable terminal 100 also acquires visual field information of the user (S1102).

[0121] Then, the wearable device 100 determines whether user-specified information is present in the user's second or third field of view range (FR2, FR3) (S1103). That is, the wearable device 100 determines whether predetermined information registered as user-specified information 301 is included in the image of the user's second or third field of view range (FR2, FR3) acquired using the outer camera 101. If user-dislike information is registered in the user-specified information 301, in S1103, the wearable device 100 determines whether information registered as user-dislike information is present.

[0122] If the user's designated information exists in the user's second or third field of view range (FR2, FR3) (S1103-YES), the process proceeds to S1104. On the other hand, if the user's designated information does not exist in the user's second or third field of view range (FR2, FR3), the process proceeds to S1102. Note that, for example, if the user's designated information exists across the user's first field of view range FR1 and the user's second field of view range FR2, it may be determined that the user's designated information exists in the user's second field of view range FR2, which is the area closer to the center of the user's field of view (S1103-YES).

[0123] The wearable device 100 determines whether the user's designated information is present in the user's second field of view FR2 (S1104). If the user's designated information is present in the user's second field of view FR2 (YES in S1104), the wearable device 100 performs a first visual suppression process on the user's designated information (S1105). On the other hand, if the user's designated information is not present in the user's second field of view FR2 (NO in S1104), the wearable device 100 performs a second visual suppression process on the user's designated information present in the user's third field of view FR3 (S1106). Note that if the user's designated information exists across both the user's second field of view FR2 and the user's third field of view FR3, the wearable device 100 may determine that the user's designated information is present in the user's third field of view FR3, which is the area closer to the center of the user's field of view (NO in S1104). The first visibility suppression process is a process of softening the user-specified information, and the second visibility suppression process is a process of completely preventing the user-specified information. Therefore, the first visibility suppression process may involve a process of softening the expression, and the second visibility suppression process may involve a process related to the mask display M. As described above, if user-disliked information is registered in the user-specified information 301, in S1104, the wearable device 100 determines whether or not there is information registered as user-disliked information.

[0124] When the wearable terminal 100 performs the first visual recognition suppression process, the wearable terminal 100 determines whether the user's designated information exists in the user's second or third visual field range (FR2, FR3) (S1107). When the wearable terminal 100 determines that the user's designated information does not exist (S1107-NO), the wearable terminal 100 cancels the visual recognition suppression process (S1109), and the process ends.

[0125] Furthermore, when the wearable terminal 100 performs the second visual recognition suppression process, the wearable terminal 100 determines whether the user's designated information exists in the user's second or third visual field range (FR2, FR3) (S1108). If the wearable terminal 100 determines that the user's designated information does not exist (S1108-NO), the wearable terminal 100 cancels the visual recognition suppression process (S1110), and the process ends.

[0126] As described above, if user dislike information is registered in the user-specified information 301, in S1107 and S1108, the wearable device 100 determines whether or not there is information registered as user dislike information.

[0127] In this way, by performing a visual suppression process (first and second visual suppression processes) according to the position of the user's specified information within the user's field of view, it is possible to, for example, allow the user to see the information to an extent that does not cause disgust, while increasing the degree of visual suppression as necessary.

[0128] Next, a specific example of processing by the wearable device will be described with reference to FIGS. 13 and 14. FIG. 13 shows a situation in which user-specified information exists within the first field of view range. In this case, the wearable device 100 does not perform visibility suppression processing on the user-specified information. In other words, the wearable device does not perform visibility suppression processing on the user-specified information 301 that exists within the first field of view range FR1. In this example, visibility suppression processing is not performed on the high wave scene (1A) registered in the user-specified information 301.

[0129] On the other hand, as shown in FIG. 14 , when the user-specified information 301 is present within the second field of view range FR2 (for example, when the user-specified information 301 falls within the second field of view range FR2), the wearable device 100 performs a process (first visibility suppression process) to soften the expression of the user-specified information 301. In this example, the visibility suppression process replaces the high wave scene (1A) registered in the user-specified information 301 with the ripple scene (1B) registered in the user-specified information 301. Furthermore, when the user-specified information 301 is present within the third field of view range FR3 (for example, when the user-specified information 301 falls within the third field of view range FR3), the wearable device 100 performs a process (second visibility suppression process) to suppress the expression of the user-specified information 301. In this example, the visibility suppression process is performed to hide the user-specified information 301 with a mask display M.

[0130] In addition, in the second field of view range FR2, the expression of the target of visibility suppression may be gradually softened as one moves from the first field of view range FR1 to the third field of view range FR3. For example, the transmittance of the image displayed at the boundary with the first field of view range FR1 may be set high, and the transmittance of the image displayed may be set lower as one moves from this position toward the third field of view range FR3.

[0131] In addition, the transmittance of the image displayed at the boundary with the first field of view range FR1 may be set high, and the transmittance of the image (or mask) displayed may be set lower the closer it is to the center of the user's field of view range from this position.

[0132] Next, an example of processing by the wearable device will be described with reference to Fig. 15. Fig. 15 is a flowchart showing an example of processing by the wearable device. In this example, a visual recognition suppression process is executed in accordance with the movement speed in the approach direction to the user-specified information.

[0133] As described above, when the wearable terminal 100 is powered on (S1501), the wearable terminal 100 acquires external world information based on image data acquired by the outer camera 101. The wearable terminal 100 also acquires visual field information of the user (S1502).

[0134] The wearable device 100 then determines whether user-specified information (e.g., user-disliked information) is present in the external world. If user-specified information is present in the external world, the wearable device 100 determines whether the user's moving speed in the direction of approaching the specified information is equal to or greater than a predetermined value (S1503). That is, the wearable device 100 determines whether the image acquired using the outer camera 101 contains predetermined information registered as user-specified information 301. If the predetermined information is contained, the wearable device 100 determines whether the user's moving speed in the direction of approaching the information is equal to or greater than a predetermined value. The user's moving speed is acquired, for example, by a known method using a sensor provided in the wearable device 100.

[0135] If the user's designated information exists in the external world and the user's movement speed in the direction of approaching the information is equal to or greater than a predetermined value (S1503-YES), the process proceeds to S1504. If not (S1503-NO), the process proceeds to the flow shown in FIG.

[0136] The wearable terminal 100 determines whether user-specified information exists within the user's field of view (S1504). That is, the wearable terminal 100 determines whether predetermined information registered as user-specified information 301 is included within an image of the user's field of view acquired using the outer camera 101. If user-specified information exists, the process proceeds to S1505.

[0137] The wearable device 100 determines whether the user's designated information is present in the user's first field of view FR1 (S1505). If the user's designated information is present in the user's first field of view FR1 (YES in S1505), the wearable device 100 performs a third visual suppression process on the user's designated information (S1506). On the other hand, if the user's designated information is not present in the user's first field of view FR1 (NO in S1505), the wearable device 100 performs a fourth visual suppression process on the user's designated information present in the user's second or third field of view (FR2, FR3) (S1507). Note that the third visual suppression process is a process that softens the user's designated information, and the fourth visual suppression process is a process that completely blocks the user's designated information. Therefore, the third visual suppression process may soften the expression, and the fourth visual suppression process may perform a process related to masking.

[0138] When the wearable terminal 100 performs the third visual recognition suppression process, the wearable terminal 100 determines whether user-specified information exists within the user's field of view or the display range of the display 111 of the wearable terminal 100 (S1508), and if it determines that the user-specified information 301 does not exist (S1508—NO), it cancels the visual recognition suppression process (S1510). When the wearable terminal 100 performs the fourth visual recognition suppression process, the wearable terminal 100 determines whether user-specified information exists within the user's field of view or the display range of the display 111 of the wearable terminal 100 (S1509), and if it determines that the user-specified information 301 does not exist (S1509—NO), it cancels the visual recognition suppression process (S1511).

[0139] In this way, it is possible to perform visual recognition suppression processes (third and fourth visual recognition suppression processes) according to the user's movement speed in the direction of approaching the designated information and the position of the user's designated information within the user's field of view. Note that the user's movement speed in the direction of approaching the designated information may be an absolute speed. Alternatively, the movement speed may be a relative speed between the user's designated information and the user. The wearable terminal 100 may acquire the user's movement speed in the direction of approaching the designated information based on, for example, a change per unit time in the data acquired by the positioning sensor 107 and the ranging sensor 103.

[0140] Next, a specific example of processing by a wearable device will be described with reference to FIG. 16 . As shown in FIG. 16 , when the user's movement speed in the direction of approaching the designated information is equal to or greater than a predetermined value, a visual suppression process is performed. Here, a softened display is performed within the first field of view range FR1, and a mask display M is performed within the second or third field of view range (FR2, FR3). Therefore, compared to the process shown in FIG. 11 , the range in which the visual suppression process is performed is one step larger. Also, compared to the process shown in FIG. 11 , the region in which the visual suppression process is performed is larger.

[0141] Next, an example of processing by the wearable device will be described with reference to Fig. 17. Fig. 17 is a flowchart showing an example of processing by the wearable device. In this example, visual recognition suppression processing is performed in consideration of audio information.

[0142] As described above, when the wearable terminal 100 is powered on (S1701), the wearable terminal 100 acquires external world information based on image data acquired by the outer camera 101. The wearable terminal 100 also acquires visual field information of the user (S1702).

[0143] The wearable terminal 100 then determines whether user-specified information (e.g., user-dislike information) exists in the external world. The wearable terminal 100 also determines whether a voice registered in the user-specified information 301 has been detected (S1703). That is, the wearable terminal 100 determines whether predetermined information registered as the user-specified information 301 is included in an image acquired using the outer camera 101. The wearable terminal 100 also determines whether a voice registered in the user-specified information 301 has been input to the microphone 108.

[0144] If user-specified information exists in the external world and the voice registered in the user-specified information 301 is detected (YES in S1703), the process proceeds to S1704. Otherwise (NO in S1703), the process proceeds to the flow shown in FIG.

[0145] The wearable terminal 100 determines whether user-specified information is present within the user's field of view (S1704). That is, the wearable terminal 100 determines whether predetermined information registered as user-specified information 301 is included within an image of the user's field of view acquired using the outer camera 101. If user-specified information is present, the process proceeds to S1705.

[0146] The wearable device 100 determines whether the user's designated information is present in the user's first field of view FR1 (S1705). If the user's designated information is present in the user's first field of view FR1 (YES in S1705), the wearable device 100 performs a fifth visual suppression process on the user's designated information (S1706). On the other hand, if the user's designated information is not present in the user's first field of view FR1 (NO in S1705), the wearable device 100 performs a sixth visual suppression process on the user's designated information present in the user's second or third field of view (FR2, FR3) (S1707). Note that the fifth visual suppression process is a process for softening the user's designated information, and the sixth visual suppression process is a process for completely blocking the user's designated information. Therefore, the fifth visual suppression process may soften the expression, and the sixth visual suppression process may perform a process related to masking.

[0147] When the wearable terminal 100 performs the fifth visual recognition suppression process, the wearable terminal 100 determines whether user-specified information exists within the user's field of view or the display range of the display 111 of the wearable terminal 100 (S1708), and if it determines that the user-specified information 301 does not exist (S1708—NO), it cancels the visual recognition suppression process (S1710). When the wearable terminal 100 performs the sixth visual recognition suppression process, the wearable terminal 100 determines whether user-specified information exists within the user's field of view or the display range of the display 111 of the wearable terminal 100 (S1709), and if it determines that the user-specified information 301 does not exist (S1709—NO), it cancels the visual recognition suppression process (S1711).

[0148] In this way, it is possible to execute visual suppression processing (fifth and sixth visual suppression processing) that takes audio information into consideration. Note that if the volume is equal to or less than a predetermined value, the visual suppression processing may not be executed. Furthermore, if audio related to user-specified information is output from the speaker 109, processing to suppress the audio may be executed in the visual suppression processing (fifth and sixth visual suppression processing).

[0149] Next, a specific example of processing by a wearable device will be described with reference to FIG. 18 . As shown in FIG. 18 , when user-specified information is present in the user's field of view and audio user-specified information is detected, visual suppression processing is performed. Here, a softened display is performed within the first field of view FR1, and a masked display is performed within the second or third field of view range (FR2, FR3). Therefore, compared to the processing shown in FIG. 11 , the range in which visual suppression processing is performed is one step larger. Also, compared to the processing shown in FIG. 11 , the region in which visual suppression processing is performed is larger.

[0150] Next, an example of processing by the wearable device will be described with reference to Fig. 19. Fig. 19 is a flowchart showing an example of processing by the wearable device. In this example, the degree of visual recognition suppression is adjusted.

[0151] Steps S1901 to S1906 shown in FIG. 19 are the same as steps S1101 to S1106 described above.

[0152] After performing the first visual suppression process on the user-specified information 301 of the second visual field range FR2, the wearable terminal 100 determines whether the user has selected a visual suppression process portion (S1907). The visual suppression process portion is the portion that is the target of the visual suppression process. The user selects the visual suppression process portion using, for example, the operation I / F 110. When the user inputs the visual suppression process portion, the wearable terminal 100 performs a seventh visual suppression process on the information of the visual suppression process portion instead of the first visual suppression process (S1909).

[0153] Furthermore, after performing the second visual suppression processing on the user-specified information 301 of the third visual field range FR3, the wearable terminal 100 determines whether the user has selected a visual suppression processing portion (S1908). The visual suppression processing portion is a portion that is subject to the visual suppression processing as described above, and the user selects the visual suppression processing portion using, for example, the operation I / F 110. When the user inputs the visual suppression processing portion, the wearable terminal 100 performs the eighth visual suppression processing on the information of the visual suppression processing portion instead of the second visual suppression processing (S1910).

[0154] The seventh visibility suppression process is a process in which the degree of softening of the expression is reduced compared to the first visibility suppression process, and the eighth visibility suppression process is a process in which the transmittance of the mask is increased compared to the second visibility suppression process.

[0155] When the wearable terminal 100 has performed the first or seventh visual recognition suppression process, the wearable terminal 100 determines whether the user's designated information is present in the user's second or third visual field range (FR2, FR3) (S1911). If the wearable terminal 100 determines that the user's designated information is not present (S1911-NO), the wearable terminal 100 cancels the visual recognition suppression process (S1913), and the process ends.

[0156] Furthermore, when the wearable terminal 100 performs the second or eighth visual recognition suppression process, the wearable terminal 100 determines whether the user's designated information is present in the user's second or third visual field range (FR2, FR3) (S1912). If the wearable terminal 100 determines that the user's designated information is not present (S1912-NO), the visual recognition suppression process is canceled (S1914), and the process ends.

[0157] In this example, the user can determine whether the degree of visual suppression processing is appropriate while suppressing or alleviating the expression of information that is the target of visual suppression processing.

[0158] Next, a specific example of processing by the wearable device will be described with reference to Fig. 20. As shown in Fig. 20, when user-specified information 301 (in this example, a display image of a ripple scene (1B) in which the high wave scene (1A) has been softened by the first visibility suppression process) within the second field of view FR2 is selected as the visibility suppression process portion, an image (in this example, an image of waves (1C) that are weaker than high waves and stronger than ripples) in which the expression is softened to a lesser extent than in the first visibility suppression process is displayed in the seventh visibility suppression process.

[0159] Here, in the seventh visual recognition suppression process, the wearable terminal 100 may, for example, generate an image similar to an image of information for which an expression registered in the user's specified information is to be suppressed or softened, and display the generated image. Furthermore, in the seventh visual recognition suppression process, the wearable terminal 100 may, for example, display an image that gradually approaches an image of information for which an expression registered in the user's specified information is to be suppressed or softened. That is, the wearable terminal 100 may gradually cancel the visual recognition suppression process.

[0160] When user-specified information 301 (in this example, the mask display M applied to the high wave scene (1A) by the second visibility suppression process) within the third field of view range FR3 is selected as the visibility suppression process portion, a mask (in this example, a semi-transparent mask M1) with a higher transmittance than the second visibility suppression process is displayed. Note that in this figure, for convenience, the semi-transparent mask is shown using hatching.

[0161] Here, in the eighth visibility suppression process, the wearable terminal 100 may, for example, display a mask with a predetermined transmittance. Furthermore, in the eighth visibility suppression process, the wearable terminal 100 may, for example, perform a process of gradually increasing the transmittance of the mask. In other words, the wearable terminal 100 may gradually cancel the visibility suppression process.

[0162] Next, an example of processing by the wearable device will be described with reference to Fig. 21. Fig. 21 is a flowchart showing an example of processing by the wearable device. In this example, information related to visual suppression can be notified to the user without the user being able to visually recognize the information that is subject to visual suppression.

[0163] Steps S2101 to S2106 shown in FIG. 21 are the same as steps S1101 to S1106 described above.

[0164] When the wearable device 100 executes the first visibility suppression process on the user's designated information in the user's second field of view range FR2, the wearable device 100 displays the first additional information at a position different from the position of the visibility suppression process portion, which is the portion that is the target of the visibility suppression process (S2107). When the wearable device 100 executes the second visibility suppression process on the user's designated information in the user's third field of view range FR3, the wearable device 100 displays the second additional information at the position of the visibility suppression process portion, which is the portion that is the target of the visibility suppression process (S2108). Here, the first additional information and the second additional information are, for example, information indicating the content of the visibility suppression process.

[0165] When the wearable terminal 100 performs the first visual recognition suppression process, the wearable terminal 100 determines whether the user's designated information is present in the user's second or third visual field range (FR2, FR3) (S2109). When the wearable terminal 100 determines that the user's designated information is not present (S2109-NO), the wearable terminal 100 cancels the visual recognition suppression process (S2111), and the process ends. Note that the first additional information may be hidden in response to the cancellation of the visual recognition suppression process.

[0166] Furthermore, when the wearable terminal 100 performs the second visual recognition suppression process, the wearable terminal 100 determines whether the user's designated information is present in the user's second or third visual field range (FR2, FR3) (S2110). When the wearable terminal 100 determines that the user's designated information is not present (S2110-NO), the wearable terminal 100 cancels the visual recognition suppression process (S2112), and the process ends. Note that the second additional information may be hidden in response to the cancellation of the visual recognition suppression process.

[0167] In this example, by performing the visual recognition suppression process and displaying the first or second additional information, it is possible to notify the user of information related to visual recognition suppression without allowing the user to visually recognize the information targeted for visual recognition suppression.

[0168] Next, a specific example of processing by the wearable device will be described with reference to FIG. 22 . As shown in FIG. 22 , when the wearable device 100 displays an image (in this example, a ripple scene (1B)) in which the user-specified information (in this example, a high wave scene (1A)) has been softened within the second field of view FR2, the content of the visibility suppression processing (i.e., the modification content) is displayed as first additional information I1. Here, the first additional information I1 can be, for example, a message indicating information before and after the visibility suppression processing. As shown in the figure, the first additional information I1 may include, for example, information describing the high wave scene (1A) before the visibility suppression processing and information describing the ripple scene (1B) after the visibility suppression processing. Furthermore, the first additional information I1 may be displayed so that the location of the visibility suppression processing portion can be identified. As shown in the figure, the first additional information I1 may be displayed in a manner that indicates, for example, the location of the visibility suppression processing portion (in this example, the location where the high wave scene (1A) was modified).

[0169] When the wearable device 100 applies a mask display M to the user-specified information 301 (in this example, the high wave scene (1A)) within the third field of view FR3, the content of the visibility suppression process (i.e., the modification content) is displayed as second additional information I2. Here, the second additional information I2 can be, for example, a message indicating information before and after the visibility suppression process. As shown in the figure, the second additional information I2 may include, for example, information describing the high wave scene (1A) before the visibility suppression process (i.e., information describing the information under the mask) and information explaining that the mask display M was performed. Furthermore, the second additional information I2 may be displayed so that the location of the visibility suppression process portion can be identified. As shown in the figure, the second additional information I2 may be displayed, for example, at the location of the visibility suppression process portion (i.e., the position of the mask display M overlapping the high wave scene (1A)).

[0170] Next, an example of processing by the wearable terminal will be described with reference to Fig. 23. Fig. 23 is a flowchart showing an example of processing by the wearable terminal. In this example, the user can be prompted to take appropriate action in response to user-specified information.

[0171] Steps S2301 to S2306 shown in FIG. 23 are the same as steps S1101 to S1106 described above.

[0172] When the wearable device 100 has performed the first visual suppression process on the user's designated information in the user's second field of view range FR2, the wearable device 100 displays a recommendation message urging the user to take appropriate action with respect to the user's designated information (S2307).Furthermore, when the wearable device 100 has performed the second visual suppression process on the user's designated information in the user's third field of view range FR3, the wearable device 100 displays a recommendation message urging the user to take appropriate action with respect to the user's designated information (S2308).

[0173] When the wearable terminal 100 performs the first visual recognition suppression process, the wearable terminal 100 determines whether the user's designated information is present in the user's second or third visual field range (FR2, FR3) (S2309). When the wearable terminal 100 determines that the user's designated information is not present (S2309-NO), the visual recognition suppression process is canceled (S2311), and the process ends. Note that the recommendation message may be hidden in response to the cancellation of the visual recognition suppression process.

[0174] Furthermore, when the wearable terminal 100 performs the second visual recognition suppression process, the wearable terminal 100 determines whether the user's designated information is present in the user's second or third visual field range (FR2, FR3) (S2310). When the wearable terminal 100 determines that the user's designated information is not present (S2310-NO), the visual recognition suppression process is canceled (S2312), and the process ends. Note that the recommendation message may be hidden in response to the cancellation of the visual recognition suppression process.

[0175] In this example, a recommendation message is displayed that prompts the user to take appropriate action for the user-specified information, so that the user can take appropriate action for the user-specified information.

[0176] Next, a specific example of processing by the wearable device will be described with reference to Fig. 24. As shown in Fig. 24, the wearable device 100 displays, as a recommendation message RM that encourages the user to take appropriate action in response to the specified information, a message that recommends not removing the wearable device 100 (in this example, the AR glasses). Note that it is sufficient to provide a notification that encourages the user to take appropriate action in response to the specified information, and the wearable device may, for example, output the content of the recommendation message RM as sound from the speaker 109 instead of or in addition to displaying the recommendation message RM.

[0177] Next, an example of processing by the wearable device will be described with reference to Fig. 25. Fig. 25 is a flowchart showing an example of processing by the wearable device. In this example, visibility suppression processing is performed in accordance with the state of user-specified information in the user's field of view range.

[0178] Steps S2501 to S2504 shown in FIG. 25 are the same as steps S901 to S904 described above.

[0179] The wearable terminal 100 stores information about the visual recognition suppression process (S2505). Here, the wearable terminal 100 stores, for example, information about the relevant part of the user-specified information and its surrounding area (captured image, distance measurement data).

[0180] Then, the wearable terminal 100 executes a visual recognition suppression process (ninth visual recognition suppression process) according to the state of the user-specified information source in the user's field of view range (S2506). In the ninth visual recognition suppression process, if the state of the user-specified information source changes from the state saved in S2505 and returns to the state saved in S2505, the wearable terminal 100 performs visual recognition suppression from a timing shortly before returning to the state saved in S2505.

[0181] The wearable terminal 100 determines whether the user's specified information is present within the user's field of view or the display range of the wearable terminal 100's display 111 (S2507), and if it determines that the user's specified information is not present (S2507-NO), it cancels the visibility suppression processing (S2508).

[0182] In this example, when the visibility suppression process is performed once, the state of the user's designated information at that time is saved, and if the state of the user's designated information (position, orientation, etc.) changes and returns to the saved state, the visibility suppression process is performed from a timing just before the saved state is restored. In other words, when modification / masking is performed once, information (captured image, ranging data) of the corresponding part and surrounding parts of the user's designated information is saved, and then, even if the user's designated information falls outside the imaging and ranging range (i.e., the orientation of the user's designated information changes, etc.), masking / modification is performed from a state just before the original state of the user's designated information returns to its original state (a state in which the user's designated information is visible). This further improves the accuracy of visibility suppression for the user's designated information.

[0183] Next, a specific example of processing by the wearable terminal will be described with reference to Fig. 26. Fig. 26 shows a situation in which a user rotates a smartphone SP on which user setting information is displayed. As shown in (a) of the same figure, if the user looks at the display screen of the smartphone SP and user-specified information is displayed, the wearable terminal 100 performs a visibility suppression process (in this example, a mask display M) on the user-specified information. At this time, the wearable terminal 100 saves information (captured image and ranging data) on the corresponding part of the user-specified information and its surrounding area as information for the visibility suppression process.

[0184] Then, when the user rotates the smartphone SP from the state (b) in the same figure to the state (c) in the same figure, and then rotates the smartphone SP so as to return it to the saved state (i.e., the state shown in (b) in the same figure), the wearable terminal 100 performs the visual recognition suppression process from a state just before the saved state (in this example, the state shown in (d) in the same figure). Here, in the ninth visual recognition suppression process, the wearable terminal 100 may start the visual recognition suppression process, for example, at a timing when the deviation from the saved state is equal to or less than a predetermined value.

[0185] Fig. 27 shows an example of how the wearable device is used. The wearable device 100 may perform visibility suppression processing not only on objects displayed on the display screen of an information processing device 400 such as a television, but also on real objects. Fig. 27 shows a situation in the real world where a user wearing the wearable device 100 is looking at real high waves W. The wearable device 100 may perform visibility suppression processing on these real high waves W, for example.

[0186] Next, an example of processing by the wearable device will be described with reference to Fig. 28. Fig. 28 is a flowchart showing an example of processing by the wearable device. In this example, visibility suppression processing is performed on designated information of the actual user.

[0187] Steps S2801 to S2803 shown in FIG. 28 are the same as steps S901 to S903 described above.

[0188] The wearable device 100 determines whether the user's specified information is real (S2804). If it is determined that the user's specified information is real (S2804—YES), the wearable device 100 executes a tenth visual recognition suppression process for the user's specified information (S2805). If the user's specified information is not real (S2804—NO), the process proceeds to the flow shown in FIG. 11 , etc. Here, in the tenth visual recognition suppression process, the wearable device 100 displays a semi-transparent mask so as to overlap the user's specified information, as an example. Note that the wearable device 100 determines whether the user's specified information is real based on, for example, a change in the position of the user's specified information in an image acquired from the outer camera 101, a change in distance measurement data acquired from the distance measurement sensor 103, etc.

[0189] The wearable terminal 100 determines whether the user's specified information is present within the user's field of view or the display range of the wearable terminal 100's display 111 (S2806), and if it determines that the user-specified information 301 is not present (S2806-NO), it cancels the visibility suppression processing (S2807).

[0190] In this example, a visibility suppression process (tenth visibility suppression process) is performed depending on whether the user-specified information in the user's field of view is real or not. Here, for example, as shown in Fig. 29 , the wearable device 100 displays a semi-transparent mask M1 in the visibility suppression process, thereby enabling the user to both view the information to avoid danger and suppress visibility by softening the expression.

[0191] The wearable device 100 may also perform a viewing suppression process based on the distance from the specified information of the real user. Fig. 30 shows an example of a usage state of a wearable device. In this example, the user wearing the wearable device 100 views the specified information of the real user (in this example, the real threatening scene (R10A)) at a distance D from the specified information. Here, if the distance D is equal to or less than a predetermined value, the wearable device 100 may not perform the viewing suppression process and may allow the user to view the specified information of the real user in order to avoid danger.

[0192] Next, an example of processing by the wearable device will be described with reference to Fig. 31. Fig. 31 is a flowchart showing an example of processing by the wearable device. In this example, the target is information specified by a real user, and visibility suppression processing is performed depending on the distance to the information specified by the real user.

[0193] 31 are the same as S901 to S903 described above. Also, S3104 is the same as S2804 described above.

[0194] The wearable device 100 determines whether the distance between the user and the actual user's designated information is equal to or greater than a predetermined value (S3105). If it determines that the distance is equal to or greater than the predetermined value (S3105—YES), it executes an eleventh visibility suppression process targeting the user's designated information (S3106). Here, in the eleventh visibility suppression process, the wearable device 100, as an example, displays the user's designated information with a softer expression, or displays a semi-transparent mask so as to overlap the user's designated information. Note that the wearable device 100 determines the distance between the user and the actual user's designated information using, for example, an image acquired from the outer camera 101 and distance measurement data acquired from the distance sensor 103.

[0195] After S3106, the wearable terminal 100 determines whether the distance between the user and the actual user's designated information is equal to or greater than a predetermined value (S3107), and if it determines that the distance is equal to or greater than the predetermined value (S3107—YES), it determines whether the user's designated information is present in the user's field of view or the display range of the display 111 of the wearable terminal 100 (S3108).If the wearable terminal 100 determines that the user's designated information is not present (S3108—NO), it cancels the visibility suppression process (S3109).

[0196] On the other hand, if the wearable device 100 determines in S3107 that the distance between the user and the designated information of the actual user is not equal to or greater than a predetermined value (S3107—NO), it cancels the visibility suppression process (S3110).The wearable device 100 then determines whether the distance between the user and the designated information of the actual user is equal to or greater than a predetermined value (S3111), and if it determines that the distance is equal to or greater than the predetermined value (S3111—YES), it returns to S3106 and performs the visibility suppression process (S3106).

[0197] In this example, a visual suppression process (eleventh visual suppression process) can be performed according to the distance between the actual user's designated information and the user in the user's field of view. For example, when the distance is equal to or less than a predetermined value, the visual suppression process is not performed (or, as shown in FIG. 32 , the visual suppression process is canceled), and the user is allowed to visually recognize dangers that exist at a distance equal to or less than the predetermined value to avoid them.

[0198] Next, an example of processing by the wearable device will be described with reference to Fig. 33. Fig. 33 is a flowchart showing an example of processing by the wearable device. In this example, visual recognition suppression processing is performed in consideration of time.

[0199] Steps S3301 and S3302 shown in FIG. 33 are the same as steps S901 and S902 described above.

[0200] Then, information is registered in the user's specified information that associates the target for visual suppression processing (in the figure, the target for visual suppression processing) with the time for which visual suppression processing is to be performed, and the wearable terminal 100 acquires the information registered by the user (S3303).

[0201] The wearable device 100 determines whether a target for visibility suppression processing is present within the user's field of view (S3304). That is, the wearable device 100 determines whether a target for visibility suppression processing is included in an image of the user's field of view acquired using the outer camera 101.

[0202] If the user's setting information (here, the target of the visual recognition suppression process) is present within the user's field of view (YES in S3304), the wearable device 100 executes a twelfth visual recognition suppression process on the user's designated information (here, the target of the visual recognition suppression process) (S3305). If the user's setting information (here, the target of the visual recognition suppression process) is not present within the user's field of view (NO in S3304), the process returns to S3302. Here, in the twelfth visual recognition suppression process, the wearable device 100, as an example, executes visual recognition suppression process for a set period of time on the target of the visual recognition suppression process based on the user's setting information. In the twelfth visual recognition suppression process, the wearable device 100, for example, suppresses or softens the expression as described above.

[0203] The wearable terminal 100 determines whether user-specified information (here, the target of the visual recognition suppression process) is present within the user's field of view or the display range of the wearable terminal 100's display 111 (S3306). If it determines that the user-specified information 301 (here, the target of the visual recognition suppression process) is not present (S3306—NO), it cancels the visual recognition suppression process (S3307). If it determines that the user-specified information 301 (here, the target of the visual recognition suppression process) is present (S3306—YES), it determines whether the set time (set in S3303) has elapsed (S3308). If it determines that the set time (set in S3303) has not elapsed (S3308—NO), the process returns to S3306. If it determines that the set time (set in S3303) has elapsed (S3308—YES), it cancels the visual recognition suppression process (S3307).

[0204] Next, a specific example of processing by a wearable device will be described with reference to Fig. 34. As shown in Fig. 34(a), in a situation where a user visually recognizes English words and their Japanese translations, the user registers each English word as a target for visual suppression processing. The user registers each target for visual suppression processing by associating it with the time for which visual suppression processing will be performed. In this example, the English words library, hospital, always, and famous are registered as targets for visual suppression processing, and always and famous are registered so that the time for visual suppression processing will be longer than that for library and hospital.

[0205] Then, as shown in (b) of the same figure, the wearable device 100 starts the visibility suppression process on the visibility suppression process target. In this example, the wearable device 100 performs a mask display M to hide the visibility suppression process target. After that, as shown in (c) of the same figure, the time set for library and hospital elapses, and the visibility suppression process for library and hospital is released. After that, as shown in (d) of the same figure, the time set for always and famous elapses, and the visibility suppression process for always and famous is released.

[0206] In this way, by masking words that have corresponding meanings between different languages ​​and then removing the masking M after a predetermined time has elapsed, it is possible to improve the efficiency of a user's language learning, for example.

[0207] 35 shows an example of a usage status of a wearable terminal. The wearable terminal 100 may transmit information to the outside. For example, the wearable terminal 100 may transmit information obtained from various sensors such as the outer camera 101, information input by the user, information obtained through communication, etc. to the outside. For example, a device around the wearable terminal 100 may obtain the information transmitted from the wearable terminal and perform processing such as displaying the information.

[0208] The information processing device 400 may perform a visual suppression process using information obtained from the wearable terminal 100, and the information processing device 400 may transmit data to be displayed based on the visual suppression process to the wearable terminal 100, and the wearable terminal may perform a display based on the data obtained from the information processing device 400.

[0209] Furthermore, for example, the information processing device 400 may perform a visual suppression process on the user-specified information displayed by the information processing device 400, transmit data to be displayed based on the visual suppression process to the wearable terminal 100, and the wearable terminal 100 may display information based on the data obtained from the information processing device 400.

[0210] Next, an example of processing by the wearable device will be described with reference to Fig. 36. Fig. 36 is a flowchart showing an example of processing by the wearable device. In this example, visual recognition suppression processing is performed on user-specified information to be transmitted to the outside.

[0211] Steps S3601 and S3602 shown in FIG. 36 are the same as steps S901 and S902 described above.

[0212] The wearable terminal 100 executes communication with the outside (S3603). Then, the wearable terminal 100 determines whether the information to be transmitted to the outside includes information designated by a user present in the user's field of view (S3604).

[0213] In S3604, if the wearable terminal 100 determines that the information to be transmitted to the outside includes user-specified information present in the user's field of view (S3604-YES), the process proceeds to S3605. The wearable terminal 100 executes a thirteenth visual recognition suppression process on the user-specified information to be transmitted (S3605). The thirteenth visual recognition suppression process, for example, performs a process of suppressing the display of the user-specified information on an external device. Furthermore, the thirteenth visual recognition suppression process, for example, performs a process of softening the display of the user-specified information displayed on the external device.

[0214] In this example, by performing a visual suppression process (13th visual suppression process) on the user's specified information to be sent externally, the visual suppression of the user's specified information can also be applied to other users who use the destination device.

[0215] Furthermore, for example, when information that a user sees is transmitted in real time (for example, when a user wears a wearable terminal 100 and the wearable terminal 100 broadcasts live to another device), if the information transmitted to the outside includes information specified by the user, a viewing suppression process (the 13th viewing suppression process) can be performed on the user's specified information.

[0216] Next, a specific example of processing by the wearable device will be described with reference to Fig. 37. As shown in Fig. 37(a), the wearable device 100 may perform a visibility suppression process to disable transmission of user-specified information that is present in the user's field of view and that is to be transmitted to the outside. The wearable device 100 may display a screen DI1 on the display 111 indicating that transmission is disabled.

[0217] Also, as shown in (b) of the same figure, with regard to user-specified information present in the user's field of view that is to be transmitted to the outside, the wearable terminal 100 may display a screen DI2 on the display 111 to prompt the user to confirm whether or not it is okay to transmit the information.

[0218] Furthermore, as shown in (c) of the same figure, with regard to user-specified information present in the user's field of view that is to be transmitted externally, the wearable terminal 100 may display a screen DI3 on ​​the display 111, prompting the user to confirm whether or not to transmit the information with information indicating that the user's specified information is included. Note that the wearable terminal 100 may transmit display data in which the user's specified information is accompanied by information indicating that the user's specified information is included. Furthermore, the destination device may obtain data from the wearable terminal 100 that displays information indicating that the user's specified information is included, and perform display processing of the information.

[0219] Furthermore, as shown in (d) of the same figure, the wearable terminal 100 may display a screen DI4 on the display 111 to prompt the user to confirm whether it is okay to transmit user-specified information that is within the user's field of view and that is to be transmitted to the outside after performing image modification processing (for example, processing to suppress or soften the expression).

[0220] The wearable terminal 100 may perform visual recognition suppression processing (thirteenth visual recognition suppression processing) on ​​transmission of user-specified information to a device depending on whether or not pairing with the wearable terminal 100 has been performed. In this case, for example, the wearable terminal 100 does not perform visual recognition suppression processing (thirteenth visual recognition suppression processing) on ​​transmission of user-specified information to a device that is not paired. This allows the user to classify devices into those that reflect visual recognition suppression processing on the user-specified information and those that do not.

[0221] Although the above describes the embodiments, the present invention is not limited to the above-described embodiments and includes various modifications and equivalent configurations. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, for example, some of the configurations of the embodiments may be added, deleted, or replaced with other configurations. Furthermore, the numerical values, messages, etc. appearing in the text and figures are merely examples, and are not particularly limited as long as the effects of the present invention are not impaired by using different ones. Furthermore, the programs described in each processing example may be independent programs, or multiple programs may form a single application program. Furthermore, the order of each process may be changed as long as the effects of the present invention are not impaired. Furthermore, some or all of the above-described configurations, functions, processing units, processing means, etc. may be implemented in hardware, for example, by designing an integrated circuit, a general-purpose processor, or an application-specific processor. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. Furthermore, each of the above configurations, functions, etc. may be realized by software, with a processor interpreting and executing a program that realizes each function. Information such as the program and tables that realize each function may be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD, or may be stored in a device on a communication network. Furthermore, the control lines and information lines shown are those considered necessary for explanation, and do not necessarily represent all control lines and information lines in the product. In reality, it can be assumed that almost all configurations are interconnected.

[0222] The information processing device 400 may estimate scenes that the user dislikes from information (audio, subtitles, etc.) of the content being played, and perform a viewing suppression process for the scenes that the user dislikes. Here, the information processing device 400 may perform the estimation using a machine learning model that outputs an estimation result of whether the information is disliked by the user based on input such as audio information and text information. In this case, the information processing device 400 can perform the viewing suppression process without using user-specified information. Therefore, for example, the information processing device 400 may be configured not to have user-specified information.

[0223] This embodiment includes the following invention: (Supplementary Note 1) A wearable terminal comprising: a display; a camera that captures images of the surroundings of the wearable terminal; and a processor, wherein the processor acquires information within the field of view of a user of the wearable terminal from an image of the surroundings captured by the camera, determines whether the acquired information includes specified information specified by the user, and, if the acquired information includes the specified information, controls the display to change the presentation of the acquired information and display it. (Supplementary Note 2) An information display system comprising: a wearable terminal; and an information processing device capable of communicating with the wearable terminal; wherein the wearable terminal comprises a camera that captures images of the surroundings of the wearable terminal; the information processing device acquires information within the field of view of a user of the wearable terminal from an image of the surroundings captured by the camera and transmitted from the wearable terminal; determines whether the acquired information includes specified information specified by the user; and, if the acquired information includes the specified information, generates data that changes the expression of the acquired information and transmits the generated data to the wearable terminal; and the wearable terminal performs display based on the data transmitted from the information processing device. (Supplementary Note 3) An information display method comprising: capturing an image of the surroundings of a wearable device; acquiring information within the field of view of a user of the wearable device from the captured image of the surroundings; determining whether the acquired information includes specified information specified by the user; and, if the acquired information includes the specified information, changing the presentation of the acquired information and displaying it on the wearable device.

[0224] REFERENCE SIGNS LIST 100 Wearable terminal 101 Outer camera 102 Inner camera 103 Distance measurement sensor 111 Display 112 Processor 113 Memory 114 Communication device 400 Information processing device

Claims

1. A wearable terminal comprising: a display; a camera that captures images of the surroundings of the wearable terminal; and a processor, wherein the processor acquires information within the field of view of the user of the wearable terminal from the surrounding images captured by the camera; determines whether the acquired information includes specified information designated by the user; and, if the acquired information includes the specified information, controls the display to change the presentation of the acquired information and display it.

2. A wearable terminal according to claim 1, characterized in that the processor changes the presentation of the acquired information by a process of suppressing the presentation of the acquired information or a process of softening the presentation of the acquired information.

3. A wearable terminal as described in claim 2, wherein the field of view includes a first field of view, a second field of view, and a third field of view, and wherein the processor, if the specified information is included in the first field of view, does not perform a process to suppress the expression of the acquired information or a process to soften the expression of the acquired information, if the specified information is included in the second field of view, performs a process to soften the expression of the acquired information, and if the specified information is included in the third field of view, performs a process to suppress the expression of the acquired information.

4. A wearable terminal as described in claim 2, further comprising a sensor for detecting a movement speed of the wearable terminal, wherein the processor, when determining based on the movement speed detected by the sensor that the movement speed of the wearable terminal in the direction of approach to the specified information is equal to or greater than a predetermined value, performs processing to soften the expression of the acquired information if the specified information is included in the first field of view, and performs processing to suppress the expression of the acquired information if the specified information is included in the second field of view.

5. A wearable terminal as described in claim 2, further comprising a microphone for inputting voice, wherein the processor, when determining that the voice input by the microphone is voice designated by the user, performs processing to soften the expression of the acquired information if the designated information is included in the first field of view, and performs processing to suppress the expression of the acquired information if the designated information is included in the second field of view.

6. A wearable terminal according to claim 2, characterized in that, when the processor has performed a process of suppressing the presentation of the acquired information or a process of softening the presentation of the acquired information, the processor gradually cancels the process.

7. A wearable terminal according to claim 2, wherein the processor controls the display to display information before and after the process of suppressing or softening the presentation of the acquired information when the processor has performed the process of suppressing or softening the presentation of the acquired information.

8. A wearable terminal as described in claim 2, characterized in that the processor controls the display to display a message recommending to the user an action to be taken regarding the specified information when the processor has performed a process to suppress the presentation of the acquired information or a process to soften the presentation of the acquired information.

9. A wearable terminal as claimed in claim 2, characterized in that the processor performs processing to suppress or soften the expression of information when the state relating to the position and / or orientation of the information whose expression has been suppressed or softened changes and approaches said state again.

10. A wearable terminal as described in claim 2, characterized in that, when the acquired information is the specified information and is real, the processor performs processing to soften the expression of the acquired information by displaying a semi-transparent mask over the acquired information.

11. A wearable terminal as described in claim 2, wherein the processor performs processing to suppress the expression of the acquired information or processing to soften the expression of the acquired information when the acquired information is the specified information and the distance from the specified information is equal to or greater than a predetermined value.

12. A wearable terminal as described in claim 2, further comprising a timer, wherein the processor, after performing a process of suppressing the expression of the acquired information or a process of softening the expression of the acquired information, cancels the process when it determines using the timer that a predetermined time has elapsed.

13. A wearable terminal as described in claim 2, wherein the processor controls the display to display a message prompting the user to confirm whether or not it is OK to transmit the acquired information to the outside when the acquired information is the specified information and the acquired information is to be transmitted to the outside.

14. A wearable terminal as described in claim 2, wherein the processor controls the display to display a message that, when the acquired information is the specified information and the acquired information is to be transmitted to the outside, the display suppresses the expression of the acquired information or softens the expression of the acquired information before transmitting the information to the outside.

15. An information display system comprising a wearable terminal and an information processing device capable of communicating with the wearable terminal, wherein the wearable terminal is equipped with a camera that captures images of the surroundings of the wearable terminal, the information processing device acquires information within the field of view of the user of the wearable terminal from an image of the surroundings captured by the camera and transmitted from the wearable terminal, determines whether the acquired information includes specified information specified by the user, and if the acquired information includes the specified information, generates data that changes the expression of the acquired information and transmits the generated data to the wearable terminal, and the wearable terminal performs display based on the data transmitted from the information processing device.

Images