22 results about "Screen reader" patented technology

Touchscreen devices, designed with an assumed range of user abilities and interaction patterns, often present challenges for individuals with diverse abilities to operate independently. Prior efforts to improve accessibility through tools or algorithms necessitated alterations to touchscreen hardware or software, making them inapplicable for the large number of existing legacy devices. This disclosure introduces a hardware interaction proxy that performs physical interactions on behalf of users while allowing them to continue utilizing accessible interfaces, such as screen readers and assistive touch on smartphones, for interface exploration and command input. The proxy maintains an interface model for accurate target localization and utilizes exchangeable actuators for physical actuation across a variety of device types, effectively reducing user workload and minimizing the risk of mistouch. Evaluations reveal that this approach lowers the mistouch rate and empowers visually and motor impaired users to interact with otherwise inaccessible physical touchscreens more effectively.

In some implementations, a browser extension may receive a setting indicating a level of verbosity and may receive an image and a set of words associated with the image. The browser extension may identify a foreground of the image and a background of the image and may identify, within the foreground of the image, a set of objects. The browser extension may rank the set of objects based on one or more properties of the set of objects and the set of words and may select a subset of objects from the set of objects based on the setting and the ranking. Accordingly, the browser extension may generate descriptions of the selected subset of objects based on the setting and may input the generated descriptions to a text to speech algorithm.

In certain embodiments, a computer-implemented method includes instructing display of a user interface that includes a multiselect component having open and closed states and providing an ability to select multiple options from an options list that includes plural options, a first portion of which is displayed in the open state. The method includes detecting activation of a control to transition from the closed to the open state and instructing, in response to detecting, in the open state, navigation to a particular option, playback by a screen reader of an announcement indicating a name of the particular option and whether the particular option is selected. The method includes instructing, in response to detecting, in the open state, selection of a first option of the first portion, playback by a screen reader of an announcement indicating a name of the first option and that the first option has been selected.

A screen reader application traverses each node in a document object model (DOM) for the text stylization. Properties for foreground color, background color, font type, font size and font stylization are algorithmically reduced to an identifier. Each node in the DOM with the same identifier has the same text stylization. Unique and infrequent text stylizations by a webpage author signal a point of interest. The screen reader application locates and navigates to that node in the DOM on behalf or in response to the end user. Points of interest are further identified by a number of additional factors. A first includes percentage of text of having the text stylization versus total text in the DOM. A second includes excluding candidate point of interest nodes having more than 250 characters. Others include imposing minimum font sizes and text contrast ratios to qualify as a point of interest.

Disclosed are systems and method for securely communicating sensitive information on a client device that receives sensitive information. An application running on the client device determines a positive enablement status of a screen reader on the client device and determines a negative connection status of the client device to an audio device. The client device generates a prompt to connect an audio device to the client device based on the negative connection status. The application triggers a number of wait periods and determines a persistence of the negative connection status after each period of the number of wait periods. The client device generates another prompt to input a passcode via the client device based on the persistence of the negative connection status. The system includes a terminal device or online platform, the client device, and a server coupled to the client device and the terminal device or the online platform.

A screen reader application traverses each node in a document object model (DOM) for the text stylization. Properties for foreground color, background color, font type, font size and font stylization are algorithmically reduced to an identifier. Each node in the DOM with the same identifier has the same text stylization. Unique and infrequent text stylizations by a webpage author signal a point of interest. The screen reader application locates and navigates to that node in the DOM on behalf or in response to the end user. Points of interest are further identified by a number of additional factors. A first includes percentage of text of having the text stylization versus total text in the DOM. A second includes excluding candidate point of interest nodes having more than 250 characters. Others include imposing minimum font sizes and text contrast ratios to qualify as a point of interest.

In some implementations, a browser extension may receive a setting indicating a level of verbosity and may receive an image and a set of words associated with the image. The browser extension may identify a foreground of the image and a background of the image and may identify, within the foreground of the image, a set of objects. The browser extension may rank the set of objects based on one or more properties of the set of objects and the set of words and may select a subset of objects from the set of objects based on the setting and the ranking. Accordingly, the browser extension may generate descriptions of the selected subset of objects based on the setting and may input the generated descriptions to a text to speech algorithm.

The invention discloses an automatic generation method for barrier-free description of Android application icons. The Android application program package is used as input, and the Android application program package embedded with the barrier-free description is used as output. After the user starts the barrier-free service, the operating system can read the barrier-free description of the icon in the application page by using the built-in screen reader, so that the user is helped to understand the current page content. The method comprises the following steps: firstly, automatically exploring a key page screenshot and a document object model in an Android application as a context; and then, according to the questioning method based on the thinking chain, the large model is required to generate corresponding barrier-free descriptions for the icon components in the page and write the barrier-free descriptions into an Android application package so as to achieve the purpose of automatically generating the barrier-free descriptions of the icons. The method provided by the invention is effective and efficient, and accurate barrier-free description can be generated for the icon component in the Android software at a relatively high speed.

Techniques for accessibility-enabled application switching are provided. In an example method, a processing device receives a status indication of a screen reader browsing content using a first application. The processing device receives a context switch indication from the screen reader, including a designation of a second application as a target application based on context switch accessibility code. The processing device generates a token comprising a client device identifier and identifiers of the source and target applications. The processing device then receives a status indication of the screen reader browsing content using the second application and a second context switch indication. The processing device accesses the token based on the client device identifier and determines the source application. The processing device updates the identifiers of the source and target applications. The processing device then receives a status indication of the screen reader browsing the content using the first application.

In some embodiments, a system may process a user interface to identify textual or graphical items in the interface, and may prepare a plurality of audio files containing spoken representations of the items. As the user navigates through the interface, different ones of the audio files may be selected and played, to announce text associated with items selected by the user. A computing device may periodically determine whether a cache offering the interface to users stores audio files for all of the interface's textual items, and if the cache is missing any audio files for any of the textual items, the computing device may take steps to have a corresponding audio file created.

The application discloses an automatic generation method for barrier-free description of Android application icons. The Android application package is taken as the input, and the Android application package embedded with barrier-free description is taken as the output. When the user starts the barrier-free service, the operating system will use its built-in screen reader to read the barrier-free description of the icon in the application page, thereby helping the user to understand the current page content. The application first automatically explores the key page screenshots and document object models in the Android application as the context, and then requires the large model to generate the corresponding barrier-free description for the icon components in the page based on the questioning method of the thinking chain and write it into the Android application package to achieve the purpose of automatically generating the barrier-free description of the icons. The method provided by the application is effective and efficient, and can generate accurate barrier-free description for the icon components in the Android software at a relatively fast speed.

The techniques disclosed herein enable systems to translate three-dimensional experiences into user accessible experiences to improve accessibility for users with disabilities. This is accomplished by extracting components from a three-dimensional environment such as user avatars and furniture. The components are organized into component groups based on shared attributes. The component groups are subsequently organized into a flow hierarchy. The flow hierarchy is then presented to the user in an accessibility environment that enables interoperability with various accessibility tools such as screen readers, simplified keyboard inputs, and the like. Selecting a component group, and subsequently, a component through the accessibility environment accordingly invokes functionality within the three-dimensional environment. In this way, users with disabilities are empowered to fully interact with three-dimensional experiences.

To provide an information processing system causing a screen reader to read out a display screen displaying a text superimposed on a background image in an easy-to-understand manner for users.SOLUTION: An information processing system 1 includes an image display element Eg, a text display element Et and a readout text arrangement element Er. The image display element Eg is assigned with access information for accessing to a background image G, and displays the background image G. The text display element Et displays a display text Td, superimposing it on a prescribed area of the background image G. The readout text arrangement element Er arranges a readout text Tr readable by the screen reader Sr, with it superimposed on the background image G adjacent to the display text Td in a substantially non-display state on the display screen Sc.SELECTED DRAWING: Figure 2

In some implementations, a user device may receive a set of words, for conversion to speech, including a plurality of subsets of the set of words, where each subset of the plurality of subsets is associated with one or more corresponding formatting properties. The user device may identify, within the set of words, a first subset of the plurality of subsets as relevant based on the one or more corresponding formatting properties associated with the first subset. Additionally, the user device may identify, within the set of words, a second subset of the plurality of subsets as not relevant based on the one or more corresponding formatting properties associated with the second subset. Accordingly, the user device may input the first subset to a text-to-speech algorithm.

A method, system and computer program product for automated screen reader customization is described. The method includes decomposing a screen composition into readable elements and exporting the readable elements to a list. One or more objects in the screen composition are associated with one or more readable elements in the list. A screen reader application is forced to read from the list for the one or more associated objects in the screen composition when the one or more associated objects appear in the screen composition.

An aspect of the disclosure related to methods and systems configured to access connected device data from a connected device, the connected device data comprising a manufacturer identifier, a model identifier, an identifier of a year of manufacturer, browser type, and / or browser release / version. Using the connected device data, a version of code is selected comprising interpreter code configured to provide the connected device with accessibility functionality in accordance with a specification attributes and roles that enables enhanced screen reader functionality that the connected device is natively lacking. The selected version of the code is downloaded to the connected device, wherein the selected version of the code is configured to enable the connected device to generate enhanced audible announcements relative to announcements that the connected device would natively provide.

To provide an information processing system causing a screen reader to read out a display screen displaying a text superimposed on a background image in an easy-to-understand manner for users.SOLUTION: An information processing system 1 includes an image display element Eg, a text display element Et and a readout text arrangement element Er. The image display element Eg is assigned with access information for accessing to a background image G, and displays the background image G. The text display element Et displays a display text Td, superimposing it on a prescribed area of the background image G. The readout text arrangement element Er arranges a readout text Tr readable by the screen reader Sr, with it superimposed on the background image G adjacent to the display text Td in a substantially non-display state on the display screen Sc.SELECTED DRAWING: Figure 2

Implementations are described herein for hierarchical interfaces for screen reader users (SRUs). In various implementations, a first subtree of leaf nodes of a hierarchical data structure may be populated with content extracted or otherwise derived from digital content item(s), which may or may not be responsive to a search query. Generative model(s) may be used to process the content of the first subtree of leaf nodes to generate a first summary of the content used to populate the first subtree of leaf nodes. A first branch node above the subtree of leaf nodes may be populated with the first summary. The generative model(s) may be used to process first summary and a second summary to generate second tier output that includes a third summary of the first and second summaries. A screen reader interface may be provided and may be operable to facilitate navigation of the hierarchical data structure.

A screen reader application traverses each node in a document object model (DOM) for the text stylization. Properties for foreground color, background color, font type, font size and font stylization are algorithmically reduced to an identifier. Each node in the DOM with the same identifier has the same text stylization. Unique and infrequent text stylizations by a webpage author signal a point of interest. The screen reader application locates and navigates to that node in the DOM on behalf or in response to the end user. Points of interest are further identified by a number of additional factors. A first includes percentage of text of having the text stylization versus total text in the DOM. A second includes excluding candidate point of interest nodes having more than 250 characters. Others include imposing minimum font sizes and text contrast ratios to qualify as a point of interest.

To provide a system in which an appropriate accessibility setting and an AI technique are combined in order to allow a visually impaired person to more smoothly perform web browsing.SOLUTION: A system includes: means for providing appropriate accessibility settings in order to use a screen reader when a visually impaired user browses a web page; and means for providing an AI technique for performing visual description / manipulation of the web page.SELECTED DRAWING: Figure 1

Implementations are described herein for hierarchical interfaces for screen reader users (SRUs). In various implementations, a first subtree of leaf nodes of a hierarchical data structure may be populated with content extracted or otherwise derived from digital content item(s), which may or may not be responsive to a search query. Generative model(s) may be used to process the content of the first subtree of leaf nodes to generate a first summary of the content used to populate the first subtree of leaf nodes. A first branch node above the subtree of leaf nodes may be populated with the first summary. The generative model(s) may be used to process first summary and a second summary to generate second tier output that includes a third summary of the first and second summaries. A screen reader interface may be provided and may be operable to facilitate navigation of the hierarchical data structure.