Method, information processing device and product for extended reality content exclusion

By identifying and excluding important objects in the field of view in the information processing equipment, dynamically adjusting and displaying the actual content is solved, and the problem of users' difficulty in adjusting the content in a timely manner to avoid obstructing important objects in the field of view is improved, and operational safety and efficiency are improved.

CN111311754BActive Publication Date: 2025-01-14LENOVO (SINGAPORE) PTE LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN201911000020.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-12-12
Filing Date
2019-10-21
Publication Date
2025-01-14
Estimated Expiration
2040-07-12

AI Technical Summary

Technical Problem

When displaying extended reality content, it may be difficult for users to adjust the content in a timely manner to avoid obscuring important field of view objects, especially in rapidly changing environments, resulting in inconvenient and potentially dangerous operation.

Method used

By receiving visual content indications in the information processing device, identifying objects that should not be displayed and dynamically exclude extended realistic content displayed on them, using object detection and image analysis techniques to determine important objects in the visual field, and adjusting display settings based on user context data .

Benefits of technology

It automatically prevents content from being displayed on important objects in the user's field of view, reduces the need for manual adjustments, and improves operational safety and efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111311754B_ABST
    Figure CN111311754B_ABST
Patent Text Reader

Abstract

The present invention discloses a method, an information processing device, and a product for extended reality content exclusion. One embodiment provides a method for extended reality content exclusion, the method comprising: receiving an indication at an information processing device for displaying extended reality content in a field of view; using a processor to identify at least a portion of the field of view where the extended reality content should not be displayed; and responsive to the identification, excluding the display of the extended reality content on the at least a portion of the field of view. Other aspects are described and claimed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a method, an information processing device and a product for extended reality content exclusion. Background Art

[0002] Advances in technology have led to the development of information processing devices ("devices") such as smart phones, tablet devices, head-mounted wearable headsets, etc. that can display various different types of extended reality ("XR") content, such as augmented reality ("AR") content, mixed reality ("MR") content, virtual reality ("VR") content, combinations thereof, etc. These XR-enabled devices can provide a real-time view of virtual elements superimposed onto a physical real-world environment. The virtual elements can be spatially registered with the physical world so that the virtual elements can be perceived as immersive aspects of the physical world. Summary of the invention

[0003] In summary, on the one hand, a method for extended reality content exclusion is provided, the method comprising: receiving an indication at an information processing device for displaying extended reality content in a field of view; using a processor to identify at least a portion of the field of view where the extended reality content should not be displayed; and in response to the identification, excluding the display of the extended reality content on the at least a portion of the field of view.

[0004] On the other hand, an information processing device for extended reality content exclusion is provided, which includes: a processor; a memory device storing instructions that can be executed by the processor to perform the following operations: receiving an indication for displaying extended reality content in a field of view; identifying at least a portion of the field of view where the extended reality content should not be displayed; and in response to the identification, excluding the display of the extended reality content on the at least a portion of the field of view.

[0005] On the other hand, a product for extended reality content exclusion is provided, comprising: a storage device storing code, the code being executable by a processor and comprising: code receiving an indication for displaying extended reality content in a field of view; code identifying at least a portion of the field of view where the extended reality content should not be displayed; and code excluding display of the extended reality content on the at least a portion of the field of view.

[0006] The foregoing is a summary and thus may contain simplifications, generalizations, and omissions of detail; consequently, those skilled in the art will appreciate that the summary is illustrative only and is not intended to be in any way limiting.

[0007] For a better understanding of the embodiments, together with other and further features and advantages of these embodiments, reference is made to the following description taken in conjunction with the accompanying drawings.The scope of the invention will be pointed out in the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 An example of information handling device circuitry is shown.

[0009] Figure 2 Another example of information handling device circuitry is shown.

[0010] Figure 3 An example method of excluding content from a selection object in a user's field of view is shown. DETAILED DESCRIPTION

[0011] It will be readily appreciated that, in addition to the described example embodiments, the components of the embodiments generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations. Therefore, the following more detailed description of the example embodiments as illustrated in the drawings is not intended to limit the scope of the claimed embodiments, but is merely representative of example embodiments.

[0012] References throughout this specification to "one embodiment" or "an embodiment" (etc.) mean that a particular feature, structure, or characteristic described in conjunction with the embodiment is included in at least one embodiment. Thus, the phrases "in one embodiment" or "in an embodiment", etc., appearing in various places throughout this specification are not necessarily all referring to the same embodiment.

[0013] In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a thorough understanding of the embodiments. However, those skilled in the relevant art will recognize that various embodiments may be practiced without one or more specific details or using other methods, components, materials, etc. In other cases, well-known structures, materials or operations are not shown or described in detail to avoid confusion.

[0014] Using XR-enabled devices, users can visualize and interact with XR content in new and unique ways. However, in some cases, the display of XR content may be annoying and / or dangerous to the user. For example, a user wearing an XR-enabled headset may find that XR content is projected into the user's field of view. Depending on the characteristics of the XR content (e.g., size, shape, color, position, etc.), the XR content may interfere with the user's ability to function normally in the real world by obscuring important objects in the user's field of view. For example, a large application window may be projected in front of the user's face, which may obscure one or more objects (e.g., one or more mirrors, individuals, signs, other electronic devices, etc.). In this case, the user may not be able to obtain any visual information provided by these objects when they are obscured.

[0015] Traditionally, users can manually adjust one or more characteristics of the displayed XR content. For example, users can reposition or minimize applications, adjust the transparency of XR objects, etc. However, although users have a certain degree of control over how XR content is displayed, they may not be able to make adjustments in a timely manner, especially when their context changes quickly. For example, if XR content is displayed on certain mirrors (e.g., rearview mirrors, one or two side mirrors, etc.) or instrument clusters (e.g., speedometers, fuel gauges, navigation screens, etc.) of a vehicle, users operating the vehicle may find it inconvenient. Although XR content can be repositioned, users must temporarily divert their attention from the road to do so. In addition, users may miss important information (e.g., speed information, surrounding traffic information, etc.) during the time when the vehicle object is obscured. Therefore, providing adjustment input for repositioning XR content is time-consuming, cumbersome, and potentially dangerous.

[0016] Therefore, an embodiment provides a method for dynamically preventing content from being displayed on certain objects in a user's field of view. In an embodiment, a device may receive an indication for displaying content in a user's field of view. The content may be any type of XR content (e.g., augmented reality content, mixed reality content, virtual reality content, etc.), digital content (e.g., time display, device battery display, etc.), a combination thereof, etc. An embodiment may determine at least a portion of the content that should not be displayed in the field of view. For example, the determination may be made by analyzing the objects present in the user's field of view and determining whether any object is associated with an excluded object (i.e., a known object on which content is not displayed). In response to identifying an excluded object in the field of view, an embodiment may exclude content from being displayed on a portion of the field of view associated with the excluded object. For example, in a non-limiting example use case, a user operating a vehicle while wearing an augmented reality headset may not want any augmented reality content to appear on its rearview mirror. If an embodiment detects (e.g., by one or more object detection and / or object recognition techniques, etc.) a rearview mirror in the user's field of view, the embodiment may prevent any content from being displayed on the portion of the headset lens corresponding to the rearview mirror. Such a method may prevent content from being displayed on objects or locations that the user considers important.

[0017] The illustrated example embodiments will be best understood by referring to the drawings.The following description is intended to be by way of example only and illustrates only certain example embodiments.

[0018] With respect to smartphone and / or tablet circuit system 100, various other circuits, circuit systems, or components may be utilized in an information processing device. Figure 1The example shown includes a system-on-chip design such as that found in a tablet or other mobile computing platform. The software and processor are combined in a single chip 110. As is well known in the art, the processor includes internal arithmetic units, registers, cache memory, bus, I / O ports, etc. The internal bus, etc., depend on different vendors, but essentially all peripherals (120) can be attached to a single chip 110. The circuit system 100 combines the processor, memory control, and I / O controller hub all into a single chip 110. In addition, this type of system 100 does not typically use SATA or PCI or LPC. Common interfaces include, for example, SDIO and I2C.

[0019] There is a power management chip 130 such as a battery management unit BMU that manages power supplied, for example, via a rechargeable battery 140, which can be recharged by connection to a power source (not shown). In at least one design, a single chip such as 110 is used to provide BIOS-like functions and DRAM memory.

[0020] The system 100 typically includes one or more of a WWAN transceiver 150 and a WLAN transceiver 160 for connecting to various networks such as telecommunication networks and wireless Internet devices such as access points. In addition, a device 120 is typically included, for example, an image sensor such as a camera, an audio capture device such as a microphone, a motion sensor such as an accelerometer or gyroscope, a thermal sensor, etc. The system 100 typically includes one or more touch screens 170 for data input and display / presentation. The system 100 also typically includes various memory devices, such as flash memory 180 and SDRAM 190.

[0021] Figure 2 A block diagram depicting another example of an information handling device circuit, circuitry, or component. Figure 2 The examples depicted in the examples may correspond to computing systems such as the THINKPAD series of personal computers or other devices sold by Lenovo (USA) Inc. of Morrisville, North Carolina. As will be apparent from the description herein, embodiments may include other features or Figure 2 Only some of the features of the examples shown in FIG.

[0022] Figure 2Examples include a so-called chipset 210 (a group of integrated circuits or chips that work together, a chipset) having an architecture that may vary depending on the manufacturer (e.g., INTEL, AMD, ARM, etc.). INTEL is a registered trademark of Intel Corporation in the United States and other countries. AMD is a registered trademark of Advanced Micro Devices, Inc. in the United States and other countries. ARM is an unregistered trademark of ARM Holdings, Inc. in the United States and other countries. The architecture of the chipset 210 includes a core and memory control group 220 and an I / O controller hub 250, which exchange information (e.g., data, signals, commands, etc.) via a direct management interface (DMI) 242 or a link controller 244. Figure 2 In the embodiment of the present invention, DMI 242 is a chip-to-chip interface (sometimes referred to as the link between the "North Bridge" and the "South Bridge"). The core and memory control group 220 includes one or more processors 222 (e.g., single core or multi-core) and a memory controller hub 226 that exchange information via a front-side bus (FSB) 224; note that the components of group 220 can be integrated into a chip that replaces the traditional "North Bridge" architecture. As is known in the art, one or more processors 222 include internal arithmetic units, registers, cache memory, buses, I / O ports, etc.

[0023] exist Figure 2 , the memory controller hub 226 interfaces with the memory 240 (e.g., to provide support for a type of RAM that may be referred to as "system memory" or "memory"). The memory controller hub 226 also includes a low voltage differential signaling (LVDS) interface 232 for a display device 292 (e.g., a CRT, a flat panel, a touch screen, etc.). Block 238 includes some technologies that may be supported via the LVDS interface 232 (e.g., serial digital video, HDMI / DVI, display port). The memory controller hub 226 also includes a PCI-express (PCI-E) interface 234 that may support a discrete graphics card 236.

[0024] exist Figure 2In the embodiment, the I / O hub controller 250 includes a SATA interface 251 (e.g., for HDD, SDD, etc. 280), a PCI-E interface 252 (e.g., for wireless connection 282), a USB interface 253 (e.g., for devices 284 such as digitizers, keyboards, mice, cameras, phones, microphones, storage devices, other connected devices, etc.), a network interface 254 (e.g., LAN), a GPIO interface 255, an LPC interface 270 (for ASIC 271, TPM 272, Super I / O 273, firmware hub 274, BIOS support 275, and various types of memory 276 such as ROM 277, flash memory 278, and NVRAM 279), a power management interface 261, a clock generator interface 262, an audio interface 263 (e.g., for speakers 294), a TCO interface 264, a system management bus interface 265, and a SPI flash memory 266, which may include a BIOS 268 and a boot code (Boot Code) 290. I / O hub controller 250 may include Gigabit Ethernet support.

[0025] The system, when powered on, may be configured to execute boot code 290 for BIOS 268 stored within SPI flash memory 266 and thereafter process data under the control of one or more operating systems and application software (e.g., stored in system memory 240). The operating system may be stored in any of a variety of locations and accessed, for example, according to instructions from BIOS 268. As described herein, a device may include a computer program product that is compatible with the computer program product. Figure 2 The system may have fewer or more features than those shown.

[0026] For example, in Figure 1 or Figure 2 The information processing device circuit system outlined in the invention may be used in electronic devices such as smartphones, tablet computers, headsets with extended reality capabilities, general personal computer devices, and / or devices capable of capturing world view image data and displaying extended reality content on one or more display screens of the device. For example, the invention may be implemented in a tablet or smartphone embodiment. Figure 1 The circuit system outlined in the embodiment of the present invention can be implemented in a laptop computer. Figure 2 The circuit system outlined in .

[0027] Now refer to Figure 3, an embodiment may automatically exclude displaying content on top of certain real-world objects in the user's field of view. At 301, an embodiment may receive an instruction to display content in the user's field of view. In the context of the present application, content may refer to almost any type of extended reality content (e.g., augmented reality content, mixed reality content, virtual reality content, etc.), digital content (e.g., time display, device battery display, etc.), combinations thereof, etc. The content may be displayed on one or more displays of an XR-enabled device (e.g., a smartphone or tablet capable of displaying XR content on a display screen of the device, a wearable XR headset capable of displaying content on a transparent or translucent goggles or display lens of a headset, etc.). In the context of the present application, a user's field of view may correspond to an observable area that a user can see through their eyes or through a transparent or translucent screen associated with a device (e.g., a lens or goggles of an XR headset, etc.). Additionally or alternatively, a user's field of view may correspond to a static or dynamic image captured by an optical device (e.g., a camera, etc.) and provided to a user on a display screen of a device (e.g., a smartphone, tablet, etc.). For simplicity, most of the discussion herein will relate to displaying AR content on an AR headset. However, it should be understood that such generalization is not limiting, and processing for potential applications may be performed using any XR-enabled device.

[0028] In an embodiment, the indication may be associated with a command provided by the user to display content. For example, a user may provide a gesture command for activating an AR application (e.g., an AR-based word processing application, an AR-based Internet browsing application, etc.). Alternatively, in another embodiment, the indication may be associated with the detection and / or recognition of certain types of contextual data captured by one or more sensors associated with the device (e.g., a camera, a microphone, etc.). For example, in response to detecting or recognizing a road sign (e.g., a speed limit sign, a stop sign, etc.), an embodiment may automatically display an AR representation of the sign to the user (e.g., a notification that the sign has been detected, an image of the sign, etc.). As another example, in response to detecting or recognizing that the ambient light level in the user's environment has dropped below a predetermined threshold, an embodiment may automatically activate a night vision filter.

[0029] At 302, an embodiment may identify at least a portion of the content that should not be displayed in the user's field of view. In an embodiment, the portion may be identified before the content is actually displayed in the user's field of view. In an embodiment, the identification may be performed by first identifying an object in the field of view and then determining whether the object is associated with an excluded object. In the context of the present application, an excluded object may refer to an object on which content should not be displayed or above. An excluded object is contrasted with an included object, which in the context of the present application may refer to an object on which content may be displayed or above. In the context of the present application, displaying content "on or above" an object may refer to displaying content on a portion of a display screen of a device corresponding to the position of the object. In an embodiment, the determination and / or identification of an object may be accomplished by using one or more conventional image analysis techniques. For example, an embodiment may first capture (e.g., using one or more camera sensors, etc.) a world view image corresponding to the user's field of view. Thereafter, an embodiment may access a database including a plurality of stored objects, and thereafter determine whether any of these stored objects exists in the user's field of view.

[0030] In response to identifying one or more objects in the user's field of view, an embodiment may compare the identified objects with a stored list of objects (e.g., stored in a local or remotely accessible database, etc.) to determine whether the identified object is associated with an excluded object or an included object. In an embodiment, each object in the stored list may include a designation associated with an excluded object or an included object. In an embodiment, the designation may be established by the manufacturer of the system and / or may be created and adjusted by the user. In an embodiment, in response to receiving certain types of contextual data, the designation may be dynamically changed / updated. For example, a user driving a vehicle may not want any type of content to be displayed on any of its mirrors (e.g., rearview mirrors, side mirrors, etc.). However, when the vehicle is parked or not in motion, the user does not mind whether the content is displayed on its mirror. Therefore, an embodiment may receive contextual data from various sources to determine whether the vehicle is in motion (e.g., GPS movement data from one or more devices, etc.), and thereafter may adjust the designation of the mirror object based on the received data (e.g., designating the mirror as an excluded object when the vehicle is in motion, and changing the designation to an included object when the vehicle is not in motion, etc.).

[0031] An embodiment may infer whether the identified object is an excluded object or an included object by determining whether the identified object matches an object in a list. In an embodiment, if the identified object shares a predetermined level of similarity with an object in a list, it may be identified as a "match." For example, in an embodiment, if the identified object shares a predetermined level of physical similarity with an object in a list (e.g., greater than 50% similarity, greater than 75% similarity, etc.), the embodiment may infer that the two objects are a match. Alternatively, as another example, even though the two objects may not be physically similar, if the two objects are of the same type, the two objects may be identified as a match. For example, although the identified object may not be physically similar to an object in a stored list, it may be identified as the same thing because they perform the same function, serve the same purpose, etc.

[0032] In response to identifying a portion of the user's field of view where content should not be displayed at 302, an embodiment may exclude content from being displayed on or above the portion at 304. For example, in response to identifying that the identified object is associated with an excluded object in a stored list, an embodiment may not display the content on or above the identified object. Alternatively, if content is already displayed on or above an included object and the designation of the object changes to an excluded object, an embodiment may dynamically remove the content from the user's field of view, reposition the content to another location not associated with the excluded object, increase the transparency of the content so that the object is visible to the user, etc. In the same manner, if content is being displayed in the user's field of view and the user's field of view changes to include an excluded object on which content was previously being displayed, an embodiment may remove or reposition the content from the portion of the user's field of view associated with the newly identified excluded object. For example, if the user has an activated AR infrared screen on their headset and turns their head to face another person and talk to the other person, an embodiment may remove the AR infrared screen above the portion of the user's field of view occupied by the other person.

[0033] In contrast to the foregoing, in response to identifying at 302 that there is no portion of the user's field of view where the content cannot be displayed, an embodiment may display the content in any portion of the user's field of view at 303 .

[0034] Therefore, the various embodiments described herein represent a technological advancement of conventional content exclusion techniques. Using the techniques described herein, embodiments may receive an indication for displaying extended reality content in a user's field of view. In embodiments, at least a portion of a user's field of view may be identified as being associated with a portion on or above which extended reality content should not be displayed. The at least a portion may correspond to an object in the user's field of view. In response to identifying a portion on or above which content should not be displayed, an embodiment may then dynamically exclude displaying extended reality content on or above that portion. Such an approach may prevent content from being displayed on or above a portion of the user's field of view that the user considers important. In addition, such an approach eliminates the need for the user to provide manual adjustment input to remove or reposition content that has been displayed above an object that they consider important.

[0035] As will be appreciated by those skilled in the art, various aspects may be implemented as systems, methods or device program products. Thus, various aspects may take the form of a complete hardware implementation or an implementation including software, which may all be collectively referred to herein as a "circuit," "module," or "system." Additionally, various aspects may take the form of a device program product implemented in one or more device-readable media containing device-readable program code.

[0036] It should be noted that the various functions described herein may be implemented using instructions executed by a processor and stored on a device-readable storage medium such as a non-signal storage device. The storage device may be, for example, a system, device or device (e.g., an electronic, magnetic, optical, electromagnetic, infrared or semiconductor system, device or device) or any suitable combination of the foregoing. More specific examples of storage devices / media include the following: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a storage device is not a signal, and "non-transient" includes all media except signal media.

[0037] Program code embodied on a storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0038] The program code for performing the operation can be written in any combination of one or more programming languages. The program code can be executed completely on a single device, partially on a single device, as an independent software package, partially on a single device and partially on another device, or completely on other devices. In some cases, the device can be connected by any type of connection or network (including a local area network (LAN) or a wide area network (WAN)), or can be connected by other devices (for example, by using the Internet of an Internet service provider), by wireless connection such as near field communication or by hard wire connection such as by USB connection.

[0039] Example embodiments are described herein with reference to the accompanying drawings showing exemplary methods, devices, and program products according to various example embodiments. It should be understood that actions and functions can be implemented at least in part by program instructions. These program instructions can be provided to a processor of a device, a special information processing device, or other programmable data processing device to produce a machine so that the instructions executed by the processor of the device implement the specified function / action.

[0040] It is worth noting that although specific blocks are used in the figures and a specific order of blocks is shown, these are non-limiting examples. In some contexts, two or more blocks can be combined, a block can be divided into two or more blocks, or some blocks can be reordered or reorganized as appropriate, because the examples explicitly shown are for descriptive purposes only and should not be interpreted as limiting.

[0041] As used herein, the singular forms "a," "an," and "an" may be construed as including the plural forms "one or more" unless explicitly stated otherwise.

[0042] The present disclosure is presented for the purpose of illustration and description, but the present disclosure is not intended to be exhaustive or limiting. Many modifications and variations will be apparent to those of ordinary skill in the art. The exemplary embodiments are selected and described to illustrate the principles and practical applications, and to enable others of ordinary skill in the art to understand the present disclosure to implement various embodiments with various modifications suitable for the intended specific use.

[0043] Thus, although illustrative exemplary embodiments have been described herein with reference to the accompanying drawings, it should be understood that the description is not limiting and that various other changes and modifications may be made by those skilled in the art without departing from the scope or spirit of the present disclosure.

Claims

1. A method for extended reality content exclusion, comprising: receiving, at a telematics device operated in a vehicle, an instruction to display augmented reality content in a field of view; Using a processor to identify whether at least a portion of the augmented reality content is not displayed in the field of view includes: determining a mobility context associated with the vehicle; identifying a real-world object present in the at least one portion; accessing a database comprising a stored list of real-world objects, wherein each real-world object in the stored list comprises a designation as one of an excluded object and an included object, wherein the designation is affected by the movement context; and designating the real-world object as an excluded object or an included object based on the movement context and when comparing the identified real-world object to the accessed database, wherein the designation in the stored list is changed or updated based on whether the vehicle is in motion as determined by the movement context, and the identified real-world object is determined to be the excluded object or the included object based on whether the identified real-world object shares a physical similarity greater than 50% with the excluded object or the included object, or does not share a physical similarity greater than 50% with the excluded object or the included object but is of the same type and performs the same function; and In response to identifying that the real-world object is designated as an excluded object, display of the augmented reality content on the at least a portion of the field of view is excluded.

2. The method according to claim 1, wherein: The extended reality content includes content selected from the group consisting of: augmented reality content, mixed reality content, and virtual reality content.

3. The method according to claim 1, wherein: The information processing device is associated with at least one of a head-mounted wearable device and a handheld smart device.

4. The method according to claim 1, wherein: The indication is associated with at least one of a user command and a context detection.

5. The method according to claim 1, wherein: The identifying includes: performing the identifying before displaying the augmented reality content.

6. The method according to claim 1, wherein: The excluding comprises an action selected from the group consisting of: removing the extended reality content from the user's field of view; repositioning the extended reality content to another portion of the user's field of view; and increasing the transparency of the extended reality content by a predetermined amount.

7. The method according to claim 1, further comprising: displaying the augmented reality content in a field of view not associated with the at least one portion; After the displaying, detecting a change from the field of view to another field of view; Recognizing that the extended reality content is displayed on the excluded object in the other field of view; as well as The augmented reality content is automatically removed from the excluded objects.

8. An information processing device for extended reality content exclusion, wherein: The information processing device is operated in a vehicle, and the information processing device includes: processor; a memory device storing instructions executable by the processor to: receiving an instruction to display extended reality content in a field of view; Identify whether there is at least a portion of the extended reality content that should not be displayed in the field of view, wherein the identification includes: determining a mobility context associated with the vehicle; identifying a real-world object present in the at least one portion; accessing a database comprising a stored list of real-world objects, wherein each real-world object in the stored list comprises a designation as one of an excluded object and an included object, wherein the designation is affected by the movement context; and designating the real-world object as an excluded object or an included object based on the movement context and when comparing the identified real-world object to the accessed database, wherein the designation in the stored list is changed or updated based on whether the vehicle is in motion as determined by the movement context, and the identified real-world object is determined to be the excluded object or the included object based on whether the identified real-world object shares a physical similarity greater than 50% with the excluded object or the included object, or does not share a physical similarity greater than 50% with the excluded object or the included object but is of the same type and performs the same function; and In response to identifying that the real-world object is designated as an excluded object, display of the augmented reality content on the at least a portion of the field of view is excluded.

9. The information processing device according to claim 8, wherein: The extended reality content includes content selected from the group consisting of: augmented reality content, mixed reality content, and virtual reality content.

10. The information processing device according to claim 8, wherein: The information processing device is associated with at least one of a head-mounted wearable device and a handheld smart device.

11. The information processing device according to claim 8, wherein: The instructions executable by the processor to perform the identification include instructions executable by the processor to perform the identification before displaying the augmented reality content.

12. The information processing device according to claim 8, wherein: Instructions executable by the processor to perform exclusion include actions selected from the group consisting of: removing the extended reality content from the user's field of view; repositioning the extended reality content to another portion of the user's field of view; and increasing the transparency of the extended reality content by a predetermined amount.

13. The information processing device according to claim 8, wherein: The instructions are also executable by the processor to: displaying the augmented reality content in a field of view not associated with the at least one portion; After the displaying, detecting a change from the field of view to another field of view; identifying that the extended reality content is displayed on the excluded object in the other field of view; as well as The augmented reality content is automatically removed from the excluded objects.

14. A product for extended reality content exclusion, comprising: A storage device storing code, the code being executable by a processor and comprising: receiving code for displaying an instruction for displaying augmented reality content in a field of view of a telematics device operating in a vehicle; Identify whether there is a code in the field of view that at least a portion of the augmented reality content should not be displayed, wherein the identifying comprises: determining a mobility context associated with the vehicle; identifying a real-world object present in the at least one portion; accessing a database comprising a stored list of real-world objects, wherein each real-world object in the stored list comprises a designation as one of an excluded object and an included object, wherein the designation is affected by the movement context; and designating the real-world object as an excluded object or an included object based on the movement context and when comparing the identified real-world object to the accessed database, wherein the designation in the stored list is changed or updated based on a determination of whether the vehicle is in motion based on the movement context, and the identified real-world object is determined to be the excluded object or the included object based on whether the identified real-world object shares a physical similarity greater than 50% with the excluded object or the included object, or does not share a physical similarity greater than 50% with the excluded object or the included object but is of the same type and performs the same function; and In response to identifying that the real-world object is designated as an excluded object, code excludes display of the augmented reality content on the at least a portion of the field of view.

Citation Information

Patent Citations

  • Information processing device, information processing method, and program

    WO2018008210A1