Artificial reality device having light blocking capability and projecting visual content on light blocking area

Abstract

An artificial reality device having light blocking capability and projecting visual content on a light blocking area is provided. A head mounted display includes an optical filter that at least partially blocks light emitted from a light source. In some examples, the light source may be a liquid crystal display that emits polarized light, and the filter may be a polarizing component. The head-mounted display may filter out light sources directed toward the head-mounted display using an optical filter. The filtered-out regions may appear as grayscale regions or blackened regions that are mixed with the real-world environment. When the head-mounted display is in the form of an augmented reality device, the head-mounted display may project visual content onto the filtered-out area using the display while allowing viewing of the real-world environment. The visual content may include images, one or more videos, and / or text, wherein the images, one or more videos, and / or text are related to the user.

Description

[0001] Cross - Reference to Related Applications

[0002] This application claims the benefit of priority to U.S. Non - Provisional Patent Application No. 18 / 459,330, filed on August 31, 2023, the entire content of which is incorporated herein by reference. Technical Field

[0003] This application relates to artificial reality devices, and more particularly, to a head - mounted display at one or more positions corresponding to one or more blocked light sources that can block certain light sources and project content onto a display. Background Art

[0004] Artificial reality devices (e.g., augmented reality devices) can project visual content onto a glass lens, thereby allowing the artificial reality device to blend the real - world environment with the visual content. Thus, a user of the artificial reality device can, for example, see computer - generated images superimposed on the user's real - world environment. Summary of the Invention

[0005] Some examples of the present disclosure relate to a head - mounted display that can include multiple displays that can be tiled together to provide an artificial reality experience to a user. One of the multiple displays can include a relatively low - resolution display, while another display can include a high - resolution display.

[0006] In one example aspect, a head - mounted display is provided. The head - mounted display can include one or more processors. The head - mounted display can further include a memory coupled to the one or more processors. The memory can store multiple executable instructions that, when executed by the one or more processors, cause the head - mounted display to: filter light incident on a lens from a light source; obtain visual content; and cause the display to project the visual content onto the lens at a position corresponding to the filtered light.

[0007] In another example aspect, a head - mounted display is provided. The head - mounted display can include a lens that includes a first surface and a second surface opposite the first surface. The head - mounted display can further include a filter disposed on the first surface. The filter can be configured to block polarized light incident on the lens. The head - mounted display can further include a display configured to project visual content onto the second surface at a position corresponding to the blocked polarized light.

[0008] In yet another exemplary aspect, a method is provided. The method can include obtaining light from a polarized light source. The method can further include filtering the light. The method can further include projecting visual content onto the filtered light by a head-mounted display.

[0009] Additional advantages will be set forth in part in the description that follows, or may be learned by practice. These advantages will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Certain features of the subject technology are set forth in the appended claims. However, for explanatory purposes, several examples of the subject technology are set forth in the following drawings.

[0011] Figure 1 An example of an artificial reality device in accordance with aspects of the present disclosure is shown.

[0012] Figure 2 and Figure 3 An alternative view of an artificial reality device in accordance with aspects of the present disclosure is shown.

[0013] Figure 4 A schematic diagram of an artificial reality device in accordance with aspects of the present disclosure is shown.

[0014] Figure 5 and Figure 6 An example application of an artificial reality device in an environment in accordance with aspects of the present disclosure is shown.

[0015] Figure 7 An additional example application of an artificial reality device in an environment in accordance with aspects of the present disclosure is shown.

[0016] Figure 8 An additional example application of an artificial reality device in an environment in accordance with aspects of the present disclosure is shown.

[0017] Figure 9 A flowchart showing one or more operations of an artificial reality device in accordance with aspects of the present disclosure is shown.

[0018] Figure 10 An alternative flowchart showing one or more operations of an artificial reality device in accordance with aspects of the present disclosure is shown. DETAILED DESCRIPTION

[0019] Some embodiments of the present disclosure will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all, embodiments of the present disclosure are shown. In fact, the various embodiments of the present disclosure may be implemented in many different forms and should not be construed as limited to the embodiments set forth herein. Like reference numerals refer to like elements throughout. As used herein, according to the embodiments of the present disclosure, the terms "data", "content", "information" and similar terms may be used interchangeably to refer to data that can be sent, received, and / or stored. In addition, as used herein, the term "exemplary" is not provided to convey any qualitative assessment, but is merely used to convey the illustration of an example. Therefore, the use of any such term should not be used to limit the spirit and scope of the embodiments of the present application. It should be understood that the methods and systems described herein are not limited to specific methods, specific components or specific embodiments.

[0020] As defined herein, a "computer-readable storage medium", which refers to a non-transitory physical or tangible storage medium (e.g., a volatile storage device or a non-volatile storage device), can be distinguished from a "computer-readable transmission medium", which refers to an electromagnetic signal.

[0021] As referred to herein, the Metaverse may represent an immersive virtual space or world in which various devices can be used in a network, in which there may or may not be one or more social connections between users in the network or with the environment in the virtual space or world. The Metaverse or Metaverse network may be associated with three-dimensional (3D) virtual worlds, online games (e.g., video games), one or more content items (e.g., images, videos, non-fungible tokens (NFTs)), and in which content items can be purchased, for example, with digital currency (e.g., cryptocurrency) and other suitable currencies. In some examples, the Metaverse or Metaverse network may enable the generation and provision of an immersive virtual space in which remote users can socialize, collaborate, learn, shop, and / or participate in various other activities, including the full use of Augmented Reality (AR) / Virtual Reality (VR) / Mixed Reality (MR).

[0022] In addition, as used in the specification including the appended claims, unless the context clearly dictates otherwise, the singular forms "a", "an", and "the" include the plural, and references to a particular numerical value include at least that particular numerical value. As used herein, the term "plurality" means more than one. When a range of values is expressed, another embodiment includes starting from a particular value and / or ending at another particular value. Similarly, when a value is expressed as an approximation by use of the antecedent "about", it will be understood that the particular value forms another embodiment. All ranges are inclusive and combinable. It will be understood that the terms used herein are for the purpose of describing particular aspects only and are not intended to be limiting.

[0023] It will be recognized that, for clarity, certain features of the disclosed subject matter described herein in the context of separate embodiments may also be provided in combination in a single embodiment. In contrast, for brevity, various features of the disclosed subject matter described in the context of a single embodiment may also be provided separately or in any sub-combination. Additionally, any reference to a value stated in a range includes each value within that range. For any and all purposes, any document cited herein is incorporated herein by reference in its entirety.

[0024] It will be understood that the methods and systems described herein are not limited to a particular method, particular components, or particular embodiments. It will also be understood that the terms used herein are for the purpose of describing particular embodiments only and are not intended to be limiting.

[0025] As used herein, the phrase "at least one of" following a list of items, together with the term "and" or "or" used to separate any of the items in the list, modifies the entire list rather than each element (i.e., each item) of the list. The phrase "at least one of" does not require selection of at least one from each item in the list; rather, the phrase allows the following meanings: including at least one of any one of the items, and / or at least one of any combination of the items, and / or at least one of each of the items. By way of example, the phrases "at least one of A, B, and C" or "at least one of A, B, or C" both mean: only A, only B, or only C; any combination of A, B, and C; and / or at least one of each of A, B, and C.

[0026] The predicative words "configured to", "operable to", and "programmed to" do not imply any specific physical or intangible modification of the subject, but are intended to be used interchangeably. In one or more embodiments, a processor configured to monitor and control an operation or component may also mean a processor programmed to monitor and control the operation, or a processor operable to monitor and control the operation. Similarly, a processor configured to execute code may be interpreted as a processor programmed to execute code or operable to execute code.

[0027] Phrases such as on the one hand, that aspect, on the other hand, some aspects, one or more aspects, one embodiment, that embodiment, another embodiment, some embodiments, one or more embodiments, one example, that example, another example, some examples, one or more examples, one configuration, that configuration, another configuration, some configurations, one or more configurations, the present subject matter, the disclosure, this disclosure, their other variations, and similar terms are for convenience and do not mean that the disclosure associated with one or more such phrases is essential to the present subject matter, nor does it mean that such disclosure applies to all configurations of the present subject matter. The disclosure associated with one or more such phrases may apply to all configurations, or to one or more configurations. The disclosure associated with one or more such phrases may provide one or more examples. Phrases such as on the one hand or some aspects may refer to one or more aspects, and vice versa, and the same applies to the other phrases mentioned above.

[0028] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration". Any embodiment described herein as "exemplary" or described as an "example" is not necessarily to be construed as more preferred or advantageous than other embodiments. Further, for cases where the terms "comprising" or "having" etc. are used in the specification or claims, such terms are intended to be inclusive in a manner similar to the term "including" as it is construed when used as a transitional word in a claim. In this specification, a reference to "an example" or "one example" etc. may mean that the particular feature, function, or characteristic described is included in at least one example of the present embodiment. The occurrence of such phrases in this specification does not necessarily all refer to the same example, nor are they necessarily mutually exclusive.

[0029] When an element is referred to herein as being "connected" or "coupled" to another element, it will be understood that the element can be directly connected to the other element, or there may be intervening elements present between these elements. In contrast, when an element is referred to as being "directly connected" or "directly coupled" to another element, it should be understood that there are no intervening elements in the "direct" connection between these elements. However, the presence of a direct connection does not exclude other connections where intervening elements may be present.

[0030] All structural and functional equivalents of the elements of the various aspects described throughout this disclosure that are known or later become known to those of ordinary skill in the art are hereby expressly incorporated by reference and are intended to be covered by the claims. In addition, nothing disclosed herein is intended to be dedicated to the public, whether or not such disclosure is expressly recited in the claims.

[0031] The present subject matter relates to an artificial reality device (e.g., an AR device, an MR device) designed to present visual content over one or more light-blocking regions. For example, the artificial reality devices described herein may include a filter (e.g., a polarizing film) that blocks or at least partially blocks certain types of light, such as polarized light. "Polarized light" may refer to light oscillating in a predetermined direction from a light source. As a non-limiting example, a liquid crystal display (LCD) may produce polarized light. One or more locations of the light blocked or partially blocked by the filter may generally appear as a "blank slate" (e.g., a grayscale region, a blackened region) on one or more lenses of the artificial reality device, where the blank slate is surrounded by the real-world environment. In addition, the artificial reality devices described herein may include a display (e.g., a projector) designed to present visual content on the one or more lenses, and specifically, to present the visual content at one or more locations corresponding to the blank slate, for example, by overlaying the visual content on the blank slate.

[0032] The visual content presented by the artificial reality devices described herein may be beneficial in several applications. For example, light sources (e.g., polarized light sources such as televisions or monitors) in public places (e.g., airports, waiting areas, restaurants) may present undesirable or unappealing visual content. However, the artificial reality devices described herein may present visual content such as moving images (e.g., videos) requested by a user, or moving images (e.g., videos) determined to be desirable visual content based on an artificial intelligence engine communicating with the artificial reality device. As a non-limiting example, the requested or desirable visual content may include moving images from a server communicating with a video streaming service or a social media service with which the user holds an account, or moving images from content stored on the memory of the artificial reality device. Advantageously, the artificial reality devices described herein may use a filter to effectively block undesirable visual content from a light source, or otherwise render the user of the artificial reality device insensitive to undesirable visual content from the light source, and replace the undesirable visual content with visual content that the user is more likely to desire.

[0033] In another example, the light source includes a monitor that presents visual content in the form of arrival and departure information for an airport (e.g., a city and an associated arrival time or departure time). Generally speaking, people at an airport are interested in a particular arrival or departure. The artificial reality device described herein can effectively block light from a light source (e.g., arrival and departure information for an airport) and present visual content corresponding to the relevant arrival or departure on the blocked light. The artificial reality device described herein can obtain relevant flight information in various ways. For example, the artificial reality device can obtain relevant information by communicating with a user account held by a social media service; communicating with a user account associated with relevant flight information held by an airline; or receiving information from a user's digital schedule. Alternatively, as a non-limiting example, the artificial reality device can use one or more image sensors (e.g., cameras) to capture one or more images of a monitor and determine text information (e.g., arrival and departure information) from the one or more images based on optical character recognition (OCR). Once the artificial reality device determines the text information, the artificial reality device can obtain relevant information through one or more of the aforementioned approaches.

[0034] In yet another example, the light source includes a monitor that presents visual content in the form of a restaurant's menu. Some users may be interested in a set of selected or limited menu items offered by the restaurant. Advantageously, the artificial reality device described herein can effectively block light from the light source (e.g., a full menu) and present visual content corresponding to the set of selected / limited menu items on the blocked light. The artificial reality device described herein can obtain relevant menu items in various ways. For example, the artificial reality device can obtain relevant information by: requesting user food preferences (e.g., meat, vegetarian) from the user; communicating with a user account held by a social media service; or communicating with a restaurant associated with the menu. Alternatively, as a non-limiting example, the artificial reality device can use one or more image sensors (e.g., cameras) to capture one or more images of the monitor and determine text information (e.g., menu information) from the one or more images based on OCR. Once the artificial reality device determines the text information, the artificial reality device can obtain relevant information through one or more of the aforementioned approaches. As yet another example, the artificial reality device may use one or more image sensors to locate a marker (e.g., a restaurant's logo, a code such as a QR code, etc.) that provides the artificial reality device with an indication of the menu (or how to obtain data corresponding to the menu). The logo may be associated with a franchise restaurant, or the code may provide a Uniform Resource Locator (URL), either of which may allow the artificial reality device to connect to a server to obtain data corresponding to a menu associated with the restaurant.

[0035] For user privacy purposes, the artificial reality devices described herein may provide the user with the option to opt-in and share the user's account information, such as that stored on a social media service, a digital calendar associated with the user, a video streaming service, or other account airline account.

[0036] Reference below Figures 1 to 10 These and other embodiments are discussed. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes only and should not be construed as limiting.

[0037] Figure 1An example AR device or MR device in the form of a head-mounted display (HMD) 100 associated with artificial reality content is shown. The HMD 100 may include a housing 102 (e.g., a spectacle frame). The HMD 100 may also include lenses 104a and 104b, each of the two lenses being held by the housing 102. In some examples, the HMD 100 is implemented in the form of augmented reality glasses. Thus, each of the lenses 104a and 104b may be at least partially transparent to visible light to allow a user of the HMD 100 to view the real-world environment through each of the lenses 104a and 104b. Alternatively, the lenses 104a and 104b may be used as image combiners that combine virtual content (e.g., computer-generated images) with the real-world environment. In this regard, as non-limiting examples of image combiners, each of the lenses 104a and 104b may take the form of a waveguide or a partially reflective surface.

[0038] As shown, the lens 104a and the lens 104b may respectively include filters 106a and 106b. The filters 106a and 106b may respectively adjust the light passing through the lens 104a and the lens 104b. In some examples, each of the filters 106a and 106b is a polarization component (e.g., a polarizer) that serves as an optical filter and is designed to respectively block or at least partially block polarized light incident on the lens 104a and the lens 104b. As a non-limiting example, each of the filters 106a and 106b may block polarized light from a polarized light source (e.g., an LCD monitor). Additionally, in some examples, each of the filters 106a and 106b is a global polarizer that generally blocks polarized light incident on the lens 104a and the lens 104b at a given angle in a predetermined manner. Alternatively, in some examples, each of the filters 106a and 106b is a switchable polarizer (e.g., an electrically controllable switchable polarizer) that serves as an adjustable polarizer to change their respective light-blocking capabilities (e.g., increasing or decreasing light blocking). When the filters 106a and 106b take the form of switchable polarizers, the filters 106a and 106b may form a switchable polarizer array.

[0039] The HMD 100 may also include a display 108 (e.g., a projector) that is designed to project visual content onto lens 104a and / or lens 104b, which can then be reflected to the user's eyes. As a non-limiting example, the visual content may include text information, still images, and / or moving images (e.g., video). Thus, when the HMD 100 takes the form of augmented reality glasses, the user can view the real-world environment as well as the visual content provided by the display 108 that is superimposed on the real-world environment. Additionally, at one or more locations where the filters 106a and 106b block or partially block light from the light source, the display 108 may project the visual content onto one or more locations on lens 104a and / or lens 104b that correspond to the blocked light, where the "locations" are based on the following portions of lens 104a and / or lens 104b: the portions where light is blocked by filter 106a and / or filter 106b, respectively. In other words, the display 108 may superimpose the visual content on lens 104a and / or lens 104b at locations corresponding to the blocked light. This will be shown and described in more detail below.

[0040] Additionally, the HMD 100 may include one or more image sensors. For example, the HMD 100 may include image sensors 110a and 110b, each of which may represent one or more additional image sensors. Each of the image sensors 110a and 110b may be referred to as a front camera that is used to capture the environment (e.g., the real-world environment) that the user of the HMD 100 is viewing. The HMD 100 may also include, for example, an image sensor 110c (e.g., a rear camera, an eye-tracking system) that is used to track the vergence movement of the user wearing the HMD 100.

[0041] In addition, the HMD 100 may include an audio device 112. In some examples, the audio device 112 takes the form of one or more microphones that are designed to receive ambient sounds and / or user-based sounds and convert these sounds into electrical signals. In some examples, the audio device 112 takes the form of one or more audio speakers that are designed to convert electrical signals into sound waves (e.g., acoustic energy). In some examples, the audio device 112 may be a combination of a microphone and one or more audio speakers. Thus, the audio device 112 can provide electrical signals and / or sound waves in combination with the artificial reality content. The audio device 112 is shown at a single specific location on the housing 102. However, the audio device 112 can generally be located at other locations on the housing 102. Additionally, the HMD 100 may include additional audio devices having any of the features shown and described for the audio device 112 and can be located at different locations on the housing 102.

[0042] Although a particular design of the HMD 100 is shown, the HMD 100 can take other forms. For example, the HMD 100 can include a bar or strap that wraps around the user's head. Alternatively or in combination, the HMD 100 can include a single lens.

[0043] Figure 2 A bird's-eye view of the HMD 100 is shown. During operation, the display 108 can project visual content (represented by the dashed line) onto the lenses 104a and / or 104b. As Figure 2 shown, the display 108 projects visual content onto each of the lenses 104a and 140b.

[0044] Figure 3 A cross-sectional view of the HMD 100 taken along Figure 2 line 3-3 in is shown. As shown, the lens 104a is located within the housing 102. The lens 104a can include a surface 116a and a surface 116b opposite the surface 116a. The surface 116a of the lens 104a can provide a surface onto which visual content from the display 108 (as Figure 2 shown) is projected. Additionally, the surface 116b of the lens 104a provides a surface onto which the filter 106a can be set or applied. In this regard, the lens 104a can be located between the filter 106a and the visual content projected onto the surface 116a of the lens 104a. It should be noted that the lens 104b (as Figure 1 and Figure 2 shown) can include any of the features and / or functions shown and described herein for the lens 104a.

[0045] Figure 4A schematic diagram of the HMD 200 is shown. The HMD 200 can be part of an artificial reality device similar to those shown and / or described herein. Additionally, the HMD 200 can include any of the features described herein for an HMD. The HMD 200 can include one or more processors 220. The one or more processors 220 can include one or more microcontrollers, one or more micro electromechanical systems (MEMS), a central processing unit, a graphics processing unit, an integrated circuit (e.g., a system on a chip or SOC), or a combination thereof.

[0046] The HMD 200 can also include a memory 222. The memory 222 can include read-only memory (ROM) and / or random access memory (RAM). The memory 222 can store instructions executable by the one or more processors 220. For example, the memory 222 can store instructions executable by the one or more processors 220 for VR applications, AR applications, and / or MR applications, etc. Additionally, the one or more processors 220 and the memory 222 can be incorporated into the HMD 200 (e.g., a device similar to Figure 1 the HMD 100 in). Alternatively, the one or more processors 220 and the memory 222 can be incorporated into a computing device (e.g., a smartphone), which can be separate from the HMD 200 and communicate with the HMD 200. The HMD 200 can also include a wireless communication circuit 224 configured to establish and transmit connections with other devices via a wireless communication protocol (e.g., connection, connection).

[0047] The HMD 200 can also include one or more image sensors 210 for acquiring images external to the HMD 200 (e.g., still images, moving images (videos)). In some examples, the one or more image sensors 210 include one or more cameras designed to capture images of the real-world environment external to the HMD 200. In some examples, the one or more image sensors 210 are used to track the eye movements of the user of the HMD 200. In some examples, the one or more image sensors 210 are used to capture images of text (e.g., written language) located on one or more of the captured images. The one or more image sensors 210 of the HMD 200 can perform any or all of the foregoing functions.

[0048] The HMD 200 may also include one or more audio devices 212. The one or more audio devices 212 may be in the form of one or more audio transducers. In some examples, the one or more audio devices 212 include a microphone designed to convert received sound waves into electrical signals. Additionally, in some examples, the one or more audio devices 212 include an audio speaker designed to convert electrical signals into sound waves audible to a user of the HMD 200. The one or more audio devices 212 may include a combination of one or more microphones and one or more audio speakers.

[0049] The HMD 200 may also include an optical character recognition (OCR) engine 226 designed to recognize text information (e.g., words, phrases) from images. The HMD 200 may use the OCR engine 226 to analyze images captured by one or more image sensors 210 to obtain text information. In some examples, the OCR engine 226 is stored on the memory 222. Additionally, in some examples, the OCR engine 226 is implemented in hardware and runs on one or more processors 220.

[0050] The HMD 200 may also include a display 208 designed to present visual content, for example, by projecting the visual content onto one or more lenses ( Figure 4 not shown) of the HMD 200. The display 208 may include a projector, a microdisplay, and / or relay optics for projecting visual content onto one or more lenses, where the visual content is reflected to one or both eyes of the user. One or more processors 220 may generate instructions and provide these instructions to the display 208 such that the display 208 projects the visual content.

[0051] The HMD 200 may also include one or more filters 206 that respectively cover one or more lenses. In some examples, the one or more filters 206 include polarization components. In this regard, the one or more filters 206 may include polarizing sheets designed to block or at least partially block light by filtering polarized light from a polarized light source. As Figure 4 shown, the one or more filters 206 are coupled (e.g., electrically coupled) to one or more processors 220 and take the form of one or more switchable polarizers that act as adjustable polarizers based on instructions from one or more processors 220 to change the light blocking ability. However, in other examples, the one or more filters 206 are passive polarizers that maintain a constant polarization ability and are thus not controlled by the one or more processors 220.

[0052] To determine one or more types of visual content to be presented, the HMD 200 may also include a content engine 228. The content engine 228 may determine the visual content and provide instructions to the display 208 via one or more processors 220 to present the visual content. The content engine 228 may determine which one or more types of visual content are to be presented from various sources. For example, the HMD 200 may include one or more input / output (I / O) devices 230 (e.g., buttons), and the one or more I / O devices 230 allow the user to provide input to the one or more processors 220 via the one or more I / O devices 230, thereby allowing the user to request specified visual content. Alternatively, one or more audio devices 212 may capture spoken language from the user, and the one or more processors 220 may use an automatic speech recognition (ASR) service to convert the spoken language into text recognizable by the one or more processors 220, thereby allowing the user to speak a request for visual content. In addition, in some examples, the content engine 228 is implemented in hardware and runs on one or more processors 220.

[0053] The visual content may be stored on the memory 220 as a multimedia file. Alternatively, the HMD 200 may communicate with a server 234 via a network 232 (e.g., the Internet) to retrieve data corresponding to the visual content. In some examples, the server 234 hosts a video streaming service, thereby allowing the HMD 200 to download or stream content from the user's account 235 (e.g., a video streaming account) via the wireless communication circuitry 224 through the video streaming service. As a non-limiting example, the video streaming service may include live (e.g., real-time or near real-time) content or on-demand content. In some examples, the server 234 hosts a social media service, thereby allowing the HMD 200 to download or stream content from the user's account 235 (e.g., a social media account) via the wireless communication circuitry 224 through the social media service. In some examples, the server 234 hosts cloud-based information of the user from a user's mobile device (e.g., a smartphone), thereby allowing the HMD 200 to download or stream content from an account 235 associated with the user's mobile device (e.g., the user's cloud storage account, the user's email account, the user's digital calendar).

[0054] In addition, the HMD 200 may also include an artificial intelligence (AI) engine 236 designed to predict or determine a user's preference for visual content. The AI engine 236 may include a machine learning (ML) engine 238 and training data 240 for training the ML engine 238. As a non-limiting example, the training data 240 may include the user's viewing history (of visual content) with or without using the HMD 200, the viewing history of collective users of a video streaming service, or a combination thereof. The content engine 228 may use the AI engine 236 to select visual content and provide instructions via one or more processors 220 to the display 208 to present the selected visual content.

[0055] In addition, the HMD 200 may also include a power supply 242. The power supply 242 may include one or more batteries, including one or more rechargeable batteries. In this regard, the I / O device 230 may also include a port for receiving electrical energy, for example, from a power outlet, to operate the HMD 200 and / or charge the power supply 242.

[0056] Figures 5 to 8 Exemplary applications of an HMD having a filter designed to block light from a light source are shown and described. One or more exemplary light sources may include a light source that generates or otherwise emits polarized light, which may be blocked or at least partially blocked by one or more filters of the HMD shown and / or described herein. In addition, Figures 5 to 8 the HMD shown and / or described herein may include any of the components and associated features shown and / or described herein for the HMD.

[0057] Figure 5 An example is shown in which a user 348 is in an environment 350 (e.g., a real-world environment). As shown, the user 348 is wearing an HMD 300. In addition, the user 348 is viewing light sources 352a and 352b, each of which emits polarized light. In some examples, each of the light sources 352a and 352b includes an LCD monitor. The environment 350 may include a public transportation area, such as an airport or a train station (as non-limiting examples). In this regard, the light sources 352a and 352b respectively generate lights 354a and 354b, where the lights 354a and 354b present visual content (e.g., text information) in the form of departure information for several departures from the public transportation area. Generally, the user 348 is only interested in one departure (e.g., the departure of a flight or a train that the user 348 has booked).

[0058] The magnified view 356 represents what a user 348 may see when viewing the environment 350 through one or more lenses 304 of the HMD 300. For example, based on one or more filters (e.g., polarization filters, such as Figure 4 one or more of the filters 206 shown in

[0059] ), light 354a from light source 352a and light 354b from light source 352b are respectively blocked, thereby creating positions 358a and 358b of the blocked light on one or more lenses 304. In other words, light 354a and light 354b in the environment 350 are visible to users other than the user 348 (not wearing the HMD 300), but may appear as positions 358a and 358b of the blocked light at one or more lenses 304 to the user 348.

[0059] In some examples, the HMD 300 may include one or more image sensors (e.g., Figure 4 one or more of the image sensors 210 shown in Figure 4 ), which identify the light sources 352a and 352b, and more specifically, identify the light sources 352a and 352b as polarized light sources. For example, each of the light sources 352a and 352b includes a model number (e.g., model XYZ) that can be acquired by one or more image sensors. The HMD 300 may use this model number, for example, by means of a look-up table stored in a memory (e.g., Figure 4 the memory 222 shown in Figure 4 ), or by communicating via a network with a server (e.g., Figure 4 the server 234 and network 232 shown in Figure 5 ). Alternatively or in combination, the HMD 300 may identify positions 358a and 358b on or at the one or more lenses 304 as gray-scale regions (as shown in Figure 5 ) or blackened regions. In this regard, the gray-scale regions or blackened regions may generate light of a specified frequency or a predetermined frequency that can be acquired by one or more image sensors and identified by the HMD 300.

[0060] Figure 6 shows that the HMD 300 generates and presents the visual content 360a and the visual content 360b by respectively superimposing the visual content 360a and the visual content 360b onto the positions 358a and 358b as shown in Figure 5 . In other words, the HMD 300 may use a display (e.g., Figure 4The display 208 shown in [FIGURE] projects visual content 360a and visual content 360b onto one or more lenses 304 and respectively covers light 354a and light 354b as shown in FIG. 5. Both light 354a and light 354b can be described as blocked light. Additionally, visual content 360a and visual content 360b can be visual content related to user 348. For example, visual content 360a (e.g., "Flight 162 to Fort Myers") can include the flight number of the flight that user 348 has booked and the location / destination of user 348, and visual content 360b (e.g., "Gate: C17, Departure Time: 3:50 PM, Status: On Time") can include gate information, departure time, and the status of the booked flight. Thus, when viewing through HMD 300, user 348 may be staring in the direction of light sources 352a and 352b but viewing visual content 360a and visual content 360b (e.g., relevant information) provided by HMD 300. Additionally, HMD 300 can present visual content 360a and visual content 360b in various font types, font sizes, font colors, etc. (user 348 can select several of them if not all). Advantageously, HMD 300 provides user 348 with information relevant to user 348 and effectively blocks information in the environment 350 that is irrelevant to user 348 while also allowing user 348 to see the environment 350 around visual content 360a and visual content 360b.

[0061] To determine relevant information of user 348, HMD 300 can obtain user input in several ways. For example, HMD 300 can obtain input through one or more I / O devices (e.g., Figure 4 one or more I / O devices 230 shown in [FIGURE]) that allow user 348 to input relevant information into HMD 300. As another example, HMD 300 can access an account held by user 348 that includes relevant information (e.g., Figure 4 account 235 shown in [FIGURE]). In this regard, HMD 300 can access user 348's social media account, schedule, or airline account. As yet another example, HMD 300 can include an AI engine (e.g., Figure 4 AI engine 236 shown in [FIGURE]) for predicting relevant information, which predicts user 348's departure information, for example, based on past trips and / or by obtaining information from user 348's account. As yet another example, HMD 300 can include one or more audio devices (e.g., Figure 4 one or more audio devices 212 shown in [FIGURE]) that can receive speech from user 348, thus allowing user 348 to speak relevant information to HMD 300.

[0062] To determine information from light sources 352a and 352b, the HMD 300 may include one or more image sensors (e.g., one or more image sensors 210 as shown in Figure 4 ) for acquiring images of text information from light 354a and 354b. Additionally, the HMD 300 may include an OCR engine (e.g., the OCR engine 226 as shown in Figure 4 ) designed to determine text information based on the acquired images of light 354a and 354b. Alternatively, the HMD 300 may communicate with a data server (e.g., the server 234 as shown in Figure 4 ) hosting data corresponding to departure information and obtain the departure information.

[0063] Figure 7 An example is shown where the user 448 is in an environment 450 (e.g., a real - world environment). As shown, the user 448 is wearing the HMD 400. Additionally, the user 448 is viewing a light source 452 (e.g., an LCD monitor) that is emitting polarized light. As a non - limiting example, the environment 450 may include a public waiting area. As shown, the light source 452a generates light 454, where the light 454 presents visual content (e.g., moving images or video) in the form of a news broadcast that the user 448 may not be interested in.

[0064] The magnified view 456 represents what the user 448 may see when viewing the environment 450 through one or more lenses 404 of the HMD 400. For example, based on one or more filters (e.g., one or more filters 206 as shown in Figure 4 ), the light 454 is blocked, and a resultant position of the blocked light is established at one or more lenses 404 (e.g., similar to the positions 358a and 358b as shown in Figure 5 ). The HMD 400 may generate and present visual content 460 by superimposing the visual content 460 on the light 454 that is blocked by the HMD 400 when viewed by the user 448. Additionally, the visual content 460 may be visual content that the user 448 is more interested in or that attracts the user more. The visual content 460 may include visual content stored by the user 448 on the memory (e.g., the memory 222 as shown in Figure 4 ) of the HMD 400 based on user preferences. As another example, the HMD 400 may access an account (e.g., Figure 4the account shown in to obtain visual content from a video streaming service or a social media service associated with the user 448. As another example, the HMD 400 may receive an input from the user 448 to determine the presented visual content 460, or the HMD 400 may include an AI engine (e.g., Figure 4 the AI engine 236 shown in ) for predicting or suggesting the visual content 460 to be presented by the HMD 400. As another example, the HMD 400 may include one or more audio devices (e.g., Figure 4 one or more audio devices 212 shown in ), which may receive speech from the user 448, thereby allowing the user 448 to speak relevant information to the HMD 400. In addition, the one or more audio devices may generate sound waves (e.g., expected audio) in combination with the visual content 460. Thus, when the user 448 is viewing through the HMD 400, the user may appear to others around the user 448 to be looking at / watching the light 454 from the light source 452, and thus watching the same content as others. However, advantageously, the user 448 views the visual content 460 without others knowing, and the visual content may be content that is relatively attractive to the user 448.

[0065] In some examples, the HMD 400 may include one or more image sensors (e.g., one or more image sensors 210) for collecting the light 454 (e.g., medium) presented by the light source 452 and determining the content presented on the light source 452. The HMD 400 may also include an AI engine (e.g., Figure 4 the AI engine 236 shown in ) for predicting whether the visual content from the light source 452 is undesirable.

[0066] Figure 8 An example is shown where the users 548a and 548b are in an environment 550 (e.g., a real-world environment). As shown, each of the users 548a and 548b is wearing an HMD 500a and an HMD 500b, respectively. In addition, each of the users 548a and 548b is viewing a light source 552 (e.g., an LCD monitor) that emits polarized light. As a non-limiting example, the environment 550 may include a restaurant. As shown, the light source 552 generates light 554, where the light 554 presents visual content (e.g., text information and static images) in the form of a restaurant menu, and at least one of the users 548a or 548b may not be interested in some options of the menu, while at least one of the users 548a or 548b is more interested in other options of the menu.

[0067] The magnified view 556a represents what the user 548a might see when viewing the environment 550 through one or more lenses 504a of the HMD 500a. For example, based on one or more filters (e.g., Figure 4 one or more of the filters 206 in), light 554 is blocked, and a resulting position of the blocked light is established at one or more lenses 504a of the HMD 500a (e.g., similar to Figure 5 the positions 358a and 358b shown in). The HMD 500a can generate and present visual content 560a by superimposing the visual content 560a on the light 554 that is blocked by the HMD 500a when viewed by the user 548a. Additionally, the visual content 560a can be visual content that the user 548a is more interested in or that attracts the user more. For example, the visual content 560a can include a portion of a menu that is attracting the user 548a (e.g., "Vegetarian Menu"). Although the light source 552 provides the entire menu with meat-based options and vegetarian options, the user 548a may be a vegetarian and thus only interested in the vegetarian options. In this regard, the HMD 500a can present the visual content 560a in the form of the user 548a's desired menu options.

[0068] To determine the dietary preferences of the user 548a, the user 548a can store the dietary preferences in the memory of the HMD 500a (e.g., Figure 4 the memory 222 shown in). As another example, the HMD 500a can access an account (e.g., Figure 4 the account 235 shown in) to obtain information about the dietary preferences of the user 548a from a social media service associated with the user 548a. As yet another example, the HMD 500a can receive input from the user 548a for determining dietary preferences through one or more I / O devices (e.g., Figure 4 one or more of the I / O devices 230 shown in); or the HMD 500a can include an AI engine (e.g., Figure 4 the AI engine 236 shown in) that is used to predict or suggest dietary preferences presented by the HMD 500a based in part on the user 548a's past orders at a particular restaurant and / or other restaurants. Thus, when the user 548a is viewing through the HMD 500a, it can appear to the user 548b (and other users) that the user 548a is looking at / watching the light 554 from the light source 552. However, advantageously, the user 548a is viewing the visual content 560a, which can be content that is relatively attractive to the user 548a.

[0069] To obtain information (e.g., menu information) from the light source 552, each of the HMDs 500a and 500b may include one or more image sensors (e.g., one or more image sensors 210) for capturing an image of text information from the light 554. Alternatively, the respective one or more image sensors of the HMDs 500a and 500b may detect one or more markers in the environment 550 for obtaining restaurant menu information. For example, the one or more image sensors may observe a marker 562 (e.g., a QR code) provided by the light source 552 (or printed and posted elsewhere) for guiding the HMDs 500a and 500b to a URL to obtain restaurant menu information. Alternatively, the one or more image sensors may observe a marker 564 (e.g., a restaurant logo or trademark) in the environment, where the marker 564 provides an indication of the restaurant, thereby guiding the HMDs 500a and 500b to a lookup table or server (e.g., server 234) to obtain restaurant menu information associated with the restaurant. Additionally, each of the HMDs 500a and 500b may include an OCR engine (e.g., OCR engine 226) designed to determine text information from the captured image of the light 554. Alternatively, each of the HMDs 500a and 500b may communicate with a server (e.g., server 234) hosting restaurant menu information and obtain the restaurant menu information.

[0070] Additionally, the magnified view 556b represents what the user 548b may see when viewing the environment 550 through one or more lenses 504b of the HMD 500b. For example, based on one or more filters (e.g., Figure 4 one or more of the filters 206 in), the light 554 is blocked, and a resulting position of the blocked light is established at one or more lenses 504b of the HMD 500b (e.g., similar to Figure 5 the positions 358a and 358b shown in). The HMD 500b may generate and present visual content 560b by superimposing the visual content 560b on the light 554 that is blocked by the HMD 500b when viewed by the user 548b. Additionally, the visual content 560b may be established or initiated by the restaurant. For example, the visual content 560b may include an advertisement or promotion from the restaurant (e.g., "All chicken meals are 10% off"), which is provided to the user 548b through the HMD 500b, for example, when the user 548b is waiting behind the user 548a to order from the menu. This may be supplementary to one or more menu items of the restaurant (e.g., "chicken menu"). To communicate with the restaurant, the HMD 500b may include wireless communication circuitry for obtaining broadcast information from the restaurant (e.g., Figure 4The wireless communication circuit 224) shown in []. Additionally, the visual content 560b can be created or initiated by a third party in the form of additional advertisements or promotions and obtained by the HMD 500b through the wireless communication circuit. For example, the visual content 560b can include a movie being screened at a cinema (e.g., "The new movie being shown at Cinema A"). The visual content 560b can include advertisements or promotions targeted at the user 548b. In this regard, the visual content 560b can be determined by input regarding the user preferences of the user 548b from the user 548b to the HMD 500b. Alternatively, the HMD 500b can communicate with a server (e.g., Figure 4 the server 234) shown in []) to access the account of the user 548b (e.g., account 235), such as the social media account of the user 548b. As yet another alternative, the HMD 500b can include an AI engine (e.g., Figure 4 the AI engine 236) shown in []) that is used to predict or suggest advertisement preferences to be presented by the HMD 500b based in part on the past interests of the user 548b. Additionally, the user 548a may not see the advertisements and / or menu options presented by the HMD 500b to the user 548b. Thus, different HMDs (e.g., HMD 500a and HMD 500b) viewing the same light source (e.g., light source 552) can provide different options tailored to the respective users (e.g., users 548a and 548b) of the HMD 500a and HMD 500b. Advantageously, the utility of the HMDs shown and / or described herein can be significantly enhanced.

[0071] Furthermore, in some instances, the light source may emit non-polarized light. In this regard, a polarizer can be applied to the light source so that the light source effectively emits polarized light. Thus, the HMDs described herein can operate in the manner described with a modified light source that emits non-polarized light.

[0072] Figure 9 An example flowchart 600 showing the operation of a device that can include the HMDs shown and / or described herein is shown. The HMD can include one or more processors (e.g., Figure 4 one or more of the processors 220 in []) and a memory (e.g., Figure 4 the memory 222 shown in []) that stores a plurality of executable instructions that, when executed by the one or more processors, cause the head-mounted display to perform one or more operations. At operation 602, filter the light source (e.g., Figure 6 one or more of the lenses 304 shown in []) incident on the lens (e.g., Figure 6 the light source 352a shown in []). For example, the polarized light from the light source can be filtered by a filter (e.g., Figure 4One or more filters 206) shown in block or at least partially block. At operation 604, visual content is obtained (e.g., Figure 6 The visual content 360a) shown in. At operation 606, a display (e.g., Figure 4 The display 208) in is caused or directed to project the visual content onto a position on the lens corresponding to the filtered light source. This position may correspond to a gray-scale area or a blackened area on the lens caused by the blocked light.

[0073] Figure 10 An example flowchart 700 showing the operation of a device that may include an HMD shown and / or described herein is shown. At operation 702, light is obtained from a polarized light source. This light may be emitted from a light source (e.g., Figure 7 The light source 452) shown in. At operation 704, the light is filtered by a filter (e.g., Figure 4 The filter 206) shown in. At operation 706, visual content (e.g., Figure 7 The visual content 460) shown in is projected onto the filtered light. For example, the visual content may be superimposed on the position of the filtered light (e.g., a gray-scale area or a blackened area).

[0074] The foregoing description has been presented to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects. Thus, the claims are not intended to be limited to the aspects shown herein, but are to be accorded the full scope consistent with the language of the claims, where elements recited in the singular are not intended to mean "one and only one" but "one or more" unless specifically stated otherwise. The term "some," unless specifically stated otherwise, means one or more. Masculine pronouns (e.g., his) include feminine and neuter pronouns (e.g., her and its), and vice versa. Headings and subheadings (if any) are used for convenience only and do not limit the disclosure of the subject matter.

[0075] Alternative embodiments

[0076] The foregoing description of the embodiments has been presented for purposes of illustration; it is not intended to be exhaustive or to limit the patent rights to the precise forms disclosed. Many modifications and variations will be apparent to those of ordinary skill in the relevant art in light of the above disclosure.

[0077] Some parts of this specification describe embodiments in terms of applications and symbolic representations of operations on information. These application descriptions and representations are commonly used by those skilled in the art of data processing to effectively communicate the substance of their work to others skilled in the art. Although these operations are described functionally, computationally, or logically, they can be understood to be implemented by a computer program, or equivalent circuitry, or microcode, etc. Additionally, without loss of generality, it has sometimes proven convenient to refer to these operational arrangements as modules. The described operations and their associated modules can be implemented in software, firmware, hardware, or any combination thereof.

[0078] Any of the steps, operations, or processes described herein can be performed or implemented individually or in combination with other devices by one or more hardware or software modules. In one embodiment, a software module is implemented using a computer program product that includes a computer-readable medium containing computer program code that can be executed by a computer processor to perform any or all of the steps, operations, or processes described.

[0079] The embodiments can also relate to apparatuses for performing the operations herein. The apparatus can be specially constructed for the required purposes, and / or the apparatus can include a computing device selectively activated or reconfigured by a computer program stored in a computer. Such a computer program can be stored in a non-transitory, tangible computer-readable storage medium, or in any type of medium suitable for storing electronic instructions, which can be coupled to a computer system bus. Additionally, any computing system mentioned in the specification can include a single processor, or can be an architecture that employs a multi-processor design to increase computing power.

[0080] The embodiments can also relate to products produced by the computing processes described herein. Such products can include information produced by the computing process, where the information is stored on a non-transitory, tangible computer-readable storage medium, and can include any embodiment of the computer program product or other data combinations described herein.

[0081] Finally, the language used in the specification has been principally selected for readability and guidance, and the language may not have been selected to interpret or limit the subject matter of the invention. Accordingly, it is intended that the scope of the patent rights not be limited by this detailed description, but rather by any claims that are published based thereon in this application. Thus, the disclosure of the embodiments is intended to be illustrative, rather than limiting the scope of the patent rights set forth in the claims above.

Claims

1. A head-mounted display, comprising: One or more processors; And A memory coupled to the one or more processors, the memory storing executable instructions that, when executed by the one or more processors, cause the head-mounted display to: Filter light incident on a lens from a light source; Obtain visual content; And Cause a display to project the visual content onto a position on the lens corresponding to the filtered light.

2. The head-mounted display according to claim 1, further comprising: A filter disposed on the lens, the filter configured to generate the filtered light by at least partially blocking the light source, wherein the executable instructions, when executed by the one or more processors, further cause the head-mounted display to: obtain a position on the lens corresponding to the filtered light.

3. The head-mounted display according to claim 1, wherein, The executable instructions, when executed by the one or more processors, further cause the head-mounted display to: Adjust the output of the filter that generates a position corresponding to the filtered light.

4. The head-mounted display according to claim 1, wherein, The executable instructions, when executed by the one or more processors, further cause the head-mounted display to: Obtain the visual content associated with an account of a user of the head-mounted display.

5. The head-mounted display according to claim 4, wherein, The executable instructions, when executed by the one or more processors, further cause the head-mounted display to: Cause the display to present the visual content based on a social media account or a video stream account, and the social media account or the video stream account is associated with the account.

6. The head-mounted display according to claim 1, further comprising: One or more image sensors, wherein the executable instructions, when executed by the one or more processors, further cause the head-mounted display to: Obtain information from the one or more image sensors from the light source; Filter the light source to generate the filtered light; and Use the information to generate the visual content.

7. The head-mounted display according to claim 6, wherein, The executable instructions, when executed by the one or more processors, further cause the head-mounted display to: Obtain the information from a second display that generates the light source, and the information includes information related to a user of the head-mounted display.

8. The head-mounted display according to claim 1, wherein, The executable instructions, when executed by the one or more processors, further cause the head-mounted display to: Obtain the position based on a gray scale area or a blackened area; and Cause the display to superimpose visual content on the gray scale area or the blackened area.

9. A head-mounted display, comprising: A lens including a first surface and a second surface opposite the first surface; A filter disposed on the first surface, the filter configured to block polarized light incident on the lens; A display configured to project visual content onto a position on the second surface corresponding to the blocked polarized light.

10. The head-mounted display according to claim 9, wherein, The filter includes a polarization component.

11. The head-mounted display according to claim 10, wherein, The polarization component includes a polarizer.

12. The head-mounted display according to claim 10, wherein, The polarization component includes at least one of the following: one or more switchable polarizers; or an array of switchable polarizers.

13. The head-mounted display according to claim 9 further comprises: One or more image sensors configured to obtain information from the polarized light.

14. The head-mounted display according to claim 13 further comprises: One or more processors; And A memory coupled to the one or more processors, the memory storing executable instructions that, when executed by the one or more processors, cause the head-mounted display to project the visual content based on the information obtained from the one or more image sensors.

15. The head-mounted display according to claim 14, wherein: The one or more image sensors are further configured to obtain an image corresponding to a reference; and The executable instructions, when executed by the one or more processors, further cause the head-mounted display to project the visual content based on the reference.

16. The head-mounted display according to claim 9 further comprises: One or more processors configured to cause the display to project the visual content as a moving image.

17. A method for presenting content from a head-mounted display, the method comprising: Obtaining light from a polarized light source; Filtering the light; And Projecting, by the head-mounted display, visual content onto the filtered light.

18. The method according to claim 17 further comprises: Determining a position where the light is incident on a lens; And Projecting the visual content at the position.

19. The method according to claim 17, wherein Projecting the visual content includes: Obtaining information from the light source; and Projecting the visual content based on the obtained information.

20. The method according to claim 17, wherein: Filtering the light includes adjusting the output of a switchable polarizer.

Images