Improve the accessibility of topology map related applications

By generating and providing connection information and description information of topology map elements in topology-related applications, the shortcomings of existing applications in providing accessibility are solved, and the disabled users' understanding and operational capabilities of topology maps are significantly improved.

CN115087960BActive Publication Date: 2025-02-25MICROSOFT TECHNOLOGY LICENSING LLC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202080095928.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-06-16
Publication Date
2025-02-25
Estimated Expiration
2040-06-16

AI Technical Summary

Technical Problem

Existing topology graph-related applications have shortcomings in providing accessibility, especially for disabled users, which are difficult to understand, build or edit topology graphs.

Method used

By generating connection information corresponding to the connection status of topology map elements in the target application and providing description information to the accessibility assistance application, including the element's connection information, basic information and executable operations, helping disabled users understand and navigate by generating connection information in the target application and providing description information to the accessibility assistance application, including the element's connection information, basic information and executable operations, it helps disable users to understand and navigate. Topology diagram.

Benefits of technology

It significantly enhances the accessibility of topology map-related applications, helps disabled users to understand and build topology maps more easily, and improves the operating experience of disabled users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115087960B_ABST
    Figure CN115087960B_ABST
Patent Text Reader

Abstract

The present disclosure provides a method and apparatus for enhancing the accessibility of a target application, the target application being used to process a topology map. An indication of selecting a target element in a topology map may be received. A connection state of the target element may be determined based on topology information of the topology map. Connection information of the target element corresponding to the connection state of the target element may be generated. Description information of the target element may be provided to an accessibility auxiliary application, the description information of the target element at least including the connection information of the target element.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0001] The accessibility of an application is intended to enable various users, including those with disabilities (e.g., visually impaired users, mobility-impaired users, etc.), to access the application. For example, web accessibility has been proposed to guide the development or provision of web-based applications, content, etc. that are more friendly and accessible to disabled users. In this article, the term "accessibility of an application" can broadly include the accessibility of various applications, such as the accessibility of web-based applications, the accessibility of non-web applications, etc. In addition, the term "application" can broadly cover various software, computer programs, widgets, etc. Summary of the invention

[0002] This summary is provided to introduce a set of concepts that will be further described in the following detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

[0003] Embodiments of the present disclosure propose a method and apparatus for enhancing the accessibility of a target application, the target application being used to process a topology map. An indication of selecting a target element in a topology map may be received. A connection state of the target element may be determined based on topology information of the topology map. Connection information of the target element corresponding to the connection state of the target element may be generated. Descriptive information of the target element may be provided to an accessibility auxiliary application, the descriptive information of the target element including at least the connection information of the target element.

[0004] It should be noted that one or more of the above aspects include the features specifically pointed out in the following detailed description and claims. The following description and drawings set forth in detail certain illustrative features of the one or more aspects. These features are merely indicative of the various ways in which the principles of various aspects may be implemented, and the present disclosure is intended to include all such aspects and their equivalents. BRIEF DESCRIPTION OF THE DRAWINGS

[0005] The disclosed aspects will be described below in conjunction with the accompanying drawings, which are provided to illustrate rather than limit the disclosed aspects.

[0006] Figure 1 An exemplary scenario for implementing application accessibility according to an embodiment is shown.

[0007] Figure 2 An exemplary user interface (UI) of a topology map related application is shown.

[0008] Figure 3An exemplary process for enhancing the accessibility of a target application according to an embodiment is shown.

[0009] Figure 4 An exemplary process for enhancing the accessibility of a target application according to an embodiment is shown.

[0010] Figure 5 An example of enhancing application accessibility according to an embodiment is shown.

[0011] Figure 6 Another example of enhancing application accessibility according to an embodiment is shown.

[0012] Figure 7 An exemplary process for utilizing predefined keyboard shortcuts to assist disabled users in building a topology map according to an embodiment is shown.

[0013] Figure 8 An example of enhancing application accessibility according to an embodiment is shown.

[0014] Fig. 9 A flow chart of an exemplary method for enhancing accessibility of a target application according to an embodiment is shown.

[0015] Fig.10 An exemplary apparatus for enhancing accessibility of a target application according to an embodiment is shown.

[0016] Fig.11 An exemplary apparatus for enhancing accessibility of a target application according to an embodiment is shown. DETAILED DESCRIPTION

[0017] The present disclosure will now be discussed with reference to several exemplary embodiments. It should be understood that the discussion of these embodiments is only used to enable those skilled in the art to better understand and thereby implement the embodiments of the present disclosure, and does not imply any limitation on the scope of the present disclosure.

[0018] Various methods have been proposed to achieve the accessibility of applications. In one aspect, a target application that provides accessibility can be developed by providing layout, content, operation controls, etc. in a way that is easy to be understood or operated by disabled users. In another aspect, accessibility auxiliary applications or tools can be used to further enhance the accessibility of target applications. For example, visually impaired users can use voice-based accessibility auxiliary applications to understand the content in the target application. Voice-based accessibility auxiliary applications can read out or tell the content or elements in the user interface (UI) of the target application in voice form, so that visually impaired users can hear information that helps understand the content or perform operations. Voice-based accessibility auxiliary applications can be, for example, screen readers, voice assistants, etc. In addition, for example, a mobility-disabled user can use a dedicated keyboard as an accessibility auxiliary tool to navigate or perform operations in the target application without a mouse. Many dedicated keyboards have been designed for mobility-disabled users to assist them in using the target application.

[0019] Some target applications can be applied to process topology-based graphs, for example, to construct, edit or present topology graphs. It is important and necessary to achieve accessibility for these topology graph-related applications, because topology graphs usually contain a lot of visual, structural and logical information, and it is more difficult for disabled users to understand, construct or edit topology graphs than for normal users. Existing topology graph-related applications can only provide limited accessibility for disabled users in traditional ways, even with the assistance of accessibility assistance applications or tools.

[0020] Embodiments of the present disclosure propose to enhance the accessibility of a target application in a more efficient manner, wherein the target application is a topology-related application for processing a topology map. In this article, a topology map may refer to various graphs containing multiple elements or components logically connected according to a specific topological structure. An example of a topology map is a directed acyclic graph (DAG), which is a directed graph with a topological order. In embodiments of the present disclosure, topology maps may broadly include, for example, flow charts, organizational charts, data flow diagrams, workflow diagrams, audit diagrams, and the like. According to embodiments of the present disclosure, a topology-related target application may prepare and provide rich descriptive information related to elements in a topology map to help disabled users make full use of the application, for example, to understand the topology map, to build or edit the topology map, and the like.

[0021] In one aspect, the description information of the elements in the topology map can help disabled users understand the structure, elements, connection relationships, processing flows, etc. in the topology map. The description information can be based on at least the topology information of the topology map, and the topology information can include various information about the topology structure, such as elements, connections between elements, processing flows, etc. In the case of using an accessibility assistance application such as a screen reader, the accessibility assistance application can read out or tell the description information from the target application in voice form, so that disabled users such as visually impaired users can hear the desired useful information while navigating the topology map in the target application.

[0022] Accessibility assistance can be implemented in an interactive manner, wherein disabled users can be guided to navigate and understand the topology map according to the connection relationship between the elements in the topology map. If the topology map is navigated along the connection between the elements, it will be easier and more intuitive for disabled users to understand the topology map. For example, in response to a user's selection of an element in the topology map, the target application can provide at least the connection information of the element in the description information, which can help the user intuitively understand the topological structure of the graph and guide the user to navigate to the next element connected to the currently selected element. The description information may also include various other useful information of the selected element, such as name, type, function, running status, etc. In addition, prompts for executable operations may also be provided in the description information.

[0023] In another aspect, when a disabled user is constructing a topology map, embodiments of the present disclosure may utilize description information to assist the user in performing operations. For example, when an element is being edited, information about candidate connections for the element may be presented to the user, for example, through a screen reader, thereby helping the user to efficiently set connections for the edited element.

[0024] In another aspect, keyboard shortcuts can be predefined in the target application to facilitate disabled users (e.g., visually disabled users, mobility disabled users, etc.) to perform editing operations in the target application. In addition, disabled users can also use voice input or voice commands to interact with the target application and perform operations.

[0025] According to an embodiment of the present disclosure, descriptive information related to the topological information of the topological map can be provided to an accessibility assistance application and then presented to a disabled user. Keyboard shortcuts can be defined and adopted to facilitate disabled users to perform various operations in the target application. Therefore, the accessibility of the application based on the topological map can be significantly enhanced in terms of both understanding and constructing the topological map.

[0026] Figure 1 An exemplary scenario 100 for implementing application accessibility according to an embodiment is shown.

[0027] Assume that user 102 is using target application 120 through terminal device 110. User 102 may be a disabled user, for example, a visually disabled user. Target application 120 is a topology map-related application that can provide accessibility for disabled users. Topology map 122 is currently being navigated or edited by user 102. It should be understood that target application 120 may be an application locally installed on terminal device 110, a web application accessible via a browser in terminal device 110, and the like. In addition, target application 120 may be a dedicated software for diagram design (e.g., machine learning model / architecture construction or design software, etc.), or a productivity tool (e.g., Visio, etc.) that supports viewing or building topology maps, or any other type of application or software related to topology maps.

[0028] The user 102 may provide input to the target application 120 through an input unit 130, such as a keyboard, in the terminal device 110. In addition, the UI of the target application 120 and the topology map 122 may be presented by a display unit 140, such as a display screen, in the terminal device 110.

[0029] Since visual impairment may cause the user 102 to be unable to accurately observe the content displayed on the display unit 140 and to obtain complete information of the topology map 122 from the display unit 140, the accessibility assistance application 150 on the terminal device 110 may be called and run during the user 102 using the target application 120. The accessibility assistance application 150 may assist the user 102 in knowing what is displayed on the display unit 140, what element in the topology map 122 is being operated by the user 102, and so on. For example, when the user 102 selects an element in the topology map 122 through the input unit 130, the target application 120 may provide the description information of the selected element to the accessibility assistance application 150, and the accessibility assistance application 150 may tell the description information in the form of voice to form a voice clip 152. When the user 102 hears the voice clip 152, the user 102 may know the relevant information of the selected element, so that any further operation may be performed.

[0030] It should be understood that scenario 100 is only exemplary, and there may be any other scenarios for implementing application accessibility. For example, instead of inputting through a keyboard, user 102 may interact with target application 120 through voice input or voice instructions. In this case, input unit 130 may be a voice input unit having a microphone for collecting user voice. For example, although input unit 130 is shown as being included in terminal device 110, it may also be an external device connectable to terminal device 110. In addition, for example, when user 102 is a mobility-disabled user who can clearly see the content displayed on display unit 140 but cannot use a mouse, input unit 130 may be a dedicated keyboard designed for mobility-disabled users as an accessibility aid, and voice-based accessibility assistance application 150 may not run.

[0031] Figure 2 An exemplary UI 200 of a topology map-related application is shown. The topology map-related application is an exemplary dedicated software for designing or building a machine learning model / framework.

[0032] UI 200 may include a module list 210. Module list 210 includes a plurality of modules that may be selected to be added to a topology map.

[0033] UI 200 may include a canvas area 220, in which a topology map may be presented, constructed, etc. Typically, a topology map may include three types of elements, including nodes, ports, and connecting lines. A node is a functional unit for performing a specific process and realizing a specific function, which is also referred to as a "module" and may be selected from a module list 210. A port refers to a portion of a node that is responsible for establishing a connection between the node and other nodes. A connecting line is a directed connection path between two nodes or two ports. As shown in canvas area 220, a topology map includes a node 222 "selecting columns in a data set", a port 224 of the node 222, a connecting line 226 from the port 224 to the port 228 of the node "splitting data", and the like.

[0034] The UI 200 may include a control panel 230. The control panel 230 includes various buttons, icons, menus, etc. for performing control operations when processing the topology map in the canvas area 220.

[0035] UI 200 may also include Figure 2 The side panel can be shown or hidden in the topology diagram. The side panel can be used to set parameters of elements in the topology diagram, etc.

[0036] It should be understood that all components and their layouts in UI 200 are exemplary, and UI 200 may be changed in various ways depending on actual application requirements and designs. In addition, different topology map-related applications may have their own UIs. Figure 2 However, the embodiments of the present disclosure are not limited to such exemplary applications and UIs, but can be implemented for any other topology map related applications and their respective UIs.

[0037] Figure 3 An exemplary process 300 for enhancing accessibility of a target application according to an embodiment is shown. The process 300 can be performed in the target application to help disabled users understand the topology map in the target application.

[0038] At 310, the topology map may be loaded into a target application, which is a topology map related application. For example, the topology map 312 may be opened by the target application and displayed in a canvas area of ​​a UI of the target application. The topology map 312 may be, for example, a DAG.

[0039] After the topology map 312 is loaded, a user may wish to navigate and understand the topology map 312 .

[0040] At 320, an indication of selecting a target element in the topology map 312 may be received. The selection indication may be a keyboard input or a voice input by the user through an input unit. For example, when the user wants to know information about an element in the topology map 312, the user may select the element by pressing a specific button or shortcut on the keyboard, and then the element may be focused as a target element in the UI.

[0041] If the target element is a node 322 in the topology map 312, basic information 322-2 of the node 322 may be identified, including, for example, the name, type, function, running state, etc. of the node 322. The name of the node 322 may be the same as the corresponding module in the module list of the target application, or may be the name shown in the topology map 312. The type of the node 322 may indicate the type of function in terms of what function the node 322 performs, such as data processing, model, evaluation, etc. The function of the node 322 may include a detailed description of what the node 322 does, how the node 322 operates, etc. The running state of the node 322 may include status information about the operation of the node, such as whether it has been run or not run, failed or succeeded, etc. Different node status information may be defined for different types of topology maps.

[0042] If the target element is a port 324 of a node in the topology map 312, basic information 324-2 of the port 324 may be identified, including, for example, a name, a type, etc. of the port 324. The name of the port 324 may be an index of the port 324 in the node containing the port 324. For example, the node may include one or more ports, and each port may be assigned a corresponding index, such as a numerical value, a letter, etc. The type of the port 324 may correspond to the type of the node containing the port 324, the type of data transmitted through the port 324, and the like.

[0043] If the target element is a connection line 326 in the topology map 312, basic information 326-2 of the connection line 326 may be identified, including, for example, the name of the connection line 326. The name of the connection line 326 may be an index of the connection line 326 in the topology map 312, or a short phrase formed using information of two connected nodes or ports.

[0044] It should be understood that the basic information of the target element is not limited to the above examples, but may include any other information of the target element.

[0045] At 330, the connection state of the target element can be determined based on the topology information of the topology map 312. The target application can identify the topology information from the loaded topology map 312 by, for example, identifying the elements contained in the topology map 312, the connections between the elements, the processing flow, etc. The topology information can be used to determine the connection state of the target element. For example, it can be determined from the topology information which node and / or port the target element is connected to.

[0046] Assuming that the target element is a node 322 and the node 322 has two ports, such as "port 1" and "port 2", the connection state 332 of the node 322 may include nodes and / or ports connected by each of the ports 1 and 2. For example, the connection state 332 may include: a connected node corresponding to port 1 and / or a connected port of the connected node, a connected node corresponding to port 2 and / or a connected port of the connected node, and so on.

[0047] Assuming that the target element is the port 324, the connection state 334 of the port 324 may include, for example, a connected node corresponding to the port 324 and / or a connected port of the connected node, and so on.

[0048] Assuming that the target element is a connection line 326, the connection state 336 of the connection line 326 may include two nodes and / or ports connected by the connection line 326, for example, a source node and / or a source port of the source node, a destination node and / or a destination port of the destination node, etc. The source node and / or port is the starting point of the connection line 326, and the destination node and / or port is the end point of the connection line 326.

[0049] At 340, connection information corresponding to the connection state of the target element may be generated. In one embodiment, the connection information may include the name of the connected node and / or port. For example, for connection state 332, connection information 342 may be generated, and connection information 342 may include, for example, the name of the connected node and / or port corresponding to port 1 of node 322, the name of the connected node and / or port corresponding to port 2 of node 322, and the like. For example, for connection state 334, connection information 344 may be generated, and connection information 344 may include, for example, the name of the connected node and / or port corresponding to port 324, and the like. For example, for connection state 336, connection information 346 may be generated, and connection information 346 may include, for example, the name of the source node and / or port, the name of the destination node and / or port, and the like. It should be understood that the connection information of the target element is not limited to the above examples, but may include any information about the connection state of the target element.

[0050] In one embodiment, optionally, the process 300 may also include: determining at least one executable operation based on the connection information of the target element. The executable operation may be various suggested operations for guiding the user to navigate the topology map 312 along the topological structure of the topology map 312. For example, the connection information of the target element indicates the connected nodes and / or ports corresponding to the target element, and therefore, the executable operation may be intended to guide the user to navigate to the connected nodes and / or ports. For example, in response to the generated connection information 342, an executable operation 322-4 for navigating to port 1 and port 2 via a specific keyboard shortcut may be determined. For example, in response to the generated connection information 344, an executable operation 324-4 for going to the connected node or port via a specific voice instruction may be determined. For example, in response to the generated connection information 346, an executable operation 326-4 for navigating to the destination node or port via a specific keyboard shortcut may be determined.

[0051] At 350, description information of the target element may be created and provided to an accessibility assistance application. The description information may include connection information of the target element, and optionally basic information of the target element and / or suggested executable operations. The accessibility assistance application may be used to provide accessibility assistance by narrating the description information. In one embodiment, optionally, in order to make the description information more comprehensive, process 300 may also include: wording the connection information, basic information, executable operations, etc. in the form of natural language through any known natural language processing technology.

[0052] When the user hears the narrated description information of the selected target element, the user can learn relevant information of the target element and decide to perform further operations accordingly. As an example, a second indication of selecting a second target element can be received from the user, wherein the second selection indication can be based on the connection information in the description information of the current target element provided at 350. For example, the second target element can be a connected node or port corresponding to the current target element. Then, steps 320 to 350 in process 300 can be performed again to further provide description information of the second target element.

[0053] By iteratively executing steps 320 to 350 in process 300 to provide accessibility of the target application in an interactive manner, the user can be guided to navigate the topology map 312 according to the connection relationship between elements, so that the topology map 312 can be easily understood.

[0054] Figure 4 An exemplary process 400 for enhancing the accessibility of a target application according to an embodiment is shown. The process 400 is Figure 3 A variation of process 300 in FIG.

[0055] At 410, the topology map may be loaded into a target application.

[0056] At 420 , all elements in the topology map and the topological structure of the topology map may be identified from the topology map.

[0057] At 430, descriptive information for each element may be determined. For example, the descriptive information for each element may be determined in a manner similar to creating descriptive information for a target element as discussed above in conjunction with process 300.

[0058] At 440 , an indication to select a target element in the topology map may be received.

[0059] At 450 , in response to the received selection indication, the description information of the target element can be provided to the accessibility assistance application. The description information of the target element can be retrieved from the description information of all elements determined at 430 .

[0060] Steps 440 and 450 in process 400 may be iteratively performed in response to receiving further selection indications.

[0061] Through process 400, once the topology map is loaded, the description information of all elements in the topology map can be determined and prepared. Therefore, when a selection indication of a target element is received, the description information of the target element can be directly provided at a faster speed.

[0062] Figure 5 An example 500 of enhancing application accessibility according to an embodiment is shown. Example 500 is intended to illustrate an example of enhancing application accessibility according to an embodiment. Figure 3 Course 300 or Figure 4 The process 400 in the example is used to help disabled users understand the topology diagram in the target application. Example 500 is a reference Figure 2 For ease of illustration, in example 500, only the canvas area in the UI of the target application is shown.

[0063] In the exemplary screenshot 510 of the canvas area, the topology map is shown as having been loaded into the target application.

[0064] Then, the target application can receive an indication of selecting a target element (e.g., node "split data") in the topology map. In the exemplary next screen shot 520 of the canvas area, the node "split data" is focused on in the topology map and highlighted by a dotted box 522, which indicates that the node is currently selected.

[0065] The target application can be based on Figure 3 Course 300 or Figure 4 In process 400 in the above example, the descriptive information of the node "Split Data" is provided to the accessibility assistance application. As shown in the exemplary next screenshot 530 of the canvas area, the content in the canvas area remains the same as the screenshot 520, but the accessibility assistance application narrates the descriptive information of the node "Split Data" in the voice clip 540. For example, the descriptive information in the voice clip 540 may include the name "Split Data", the type "Data Processing", the function "Split the Data Set... and the Test Set (0.3)", the connection information "This node has three ports... Port 3 is connected to the 'Score Model' node as the source port", and the executable operation "Use the Tab key to navigate the ports".

[0066] Figure 6 Another example 600 of enhancing application accessibility according to an embodiment is shown. Example 600 is Figure 5 Continuation of Example 500 in .

[0067] Assume that the user follows Figure 5 If the executable operation "Use Tab key to navigate ports" is performed as suggested in the description information of the topology diagram, an exemplary screenshot 610 of the canvas area may appear accordingly. As shown in the screenshot 610, port 3 of the node "Split Data" is focused in the topology diagram and highlighted by a dotted box 612, which indicates that the port is currently selected.

[0068] The target application can be based on Figure 3 Course 300 or Figure 4 In the process 400 in FIG. 4 , the description information of port 3 of the node “Split Data” is provided to the accessibility assistance application. As shown in the exemplary next screenshot 620 of the canvas area, the content in the canvas area remains the same as the screenshot 610, but the accessibility assistance application speaks the description information of port 3 in the voice clip 630. As an example, the description information in the voice clip 630 may include the name “Port 3”, the type “Dataset”, the connection information “Port 3 is connected to port S of the ‘Score Model’ node”, and the executable operation “Use Alt+C to set a new connection”.

[0069] It should be understood that Figure 5 Example 500 and Figure 6 All details in the example 600 are exemplary, and various changes can be made to these examples. For example, although the target element is shown as being highlighted by a dotted frame, the target element can also be highlighted in any other visual manner.

[0070] According to an embodiment of the present disclosure, the accessibility of an application based on a topology map can also be enhanced in terms of building a topology map. The target application can receive at least one editing operation from a disabled user, and in response to a series of editing operations, a topology map can be built in the target application. The editing operation can be provided by a predefined keyboard shortcut, voice command, etc. The editing operation can include various operations involved in the construction or editing of the topology map, such as selecting an element, setting the connection of an element, setting the parameters of an element, and the like. During the construction of the topology map by the disabled user, the description information of the edited element can also be presented to the user through an accessibility auxiliary application to help the user efficiently complete the editing operation. For example, when a port of a node is selected and focused, and an editing operation for setting a connection for the focused port is received, information about at least one candidate node and / or port to which the focused port can be connected can be provided to the accessibility auxiliary application in the description information of the focused port, and the information is then narrated by the accessibility auxiliary application, whereby the user can efficiently set a connection for the focused port by referring to the candidate connectable nodes / ports suggested in the narrated description information. Optionally, the candidate nodes / ports may also be highlighted in the canvas area to facilitate the user to set up the connection. It should be understood that the candidate connectable nodes / ports may be determined based on, for example, a match between the types of two elements. For example, if the type of a node / port matches the focused port, i.e., a connection may be established between them, then the node / port may be determined as a candidate node / port.

[0071] Figure 7 An exemplary process 700 for utilizing predefined keyboard shortcuts to assist a disabled user in building a topology map is shown according to an embodiment.

[0072] At 710, various keyboard shortcuts may be predefined for the target application. In one embodiment, a shortcut for switching focus between the canvas area and the module list in the UI of the target application or for switching focus between modules in the module list may be defined, for example, a combination of the keys "Ctrl", "Shift", and "F6". In one embodiment, a shortcut for inserting a selected node into the canvas area may be defined, for example, the key "Enter". In one embodiment, a shortcut for starting to set up a connection may be defined, for example, a combination of the keys "Alt" and "C". In one embodiment, a shortcut for opening a side panel for setting parameters of an element may be defined, for example, a combination of the keys "Ctrl", "Shift", and "E". It should be understood that all of the above shortcuts are exemplary, and any other shortcuts for making it easy for disabled users to build a topology map may be defined.

[0073] At 720 , the predefined shortcuts may be publicly documented so that all users may be aware of the predefined shortcuts.

[0074] At 730 , during the user building or editing the topology map, the target application may recognize a shortcut input via the keyboard, which may be an editing operation desired by the user.

[0075] At 740 , the target application may perform an operation corresponding to the recognized shortcut input, thereby completing the desired editing operation.

[0076] By iteratively executing steps 730 and 740 , a keyboard user (eg, a disabled user) can construct a topology map through the keyboard.

[0077] It should be understood that voice instructions may also be predefined and used by voice input users to construct topology maps in a manner similar to process 700. In addition, keyboard shortcuts and voice instructions may also be used in combination to provide a more flexible input method.

[0078] Figure 8 An example 800 of enhancing application accessibility according to an embodiment is shown. Example 800 is intended to illustrate a process of helping a disabled user to build a topology map in a target application. Example 800 is a reference to Figure 2 For ease of illustration, in example 800, only the canvas area in the UI of the target application is shown.

[0079] In the exemplary screenshot 810 of the canvas area, port 3 of the node "Split Data" is focused and highlighted by a dashed box 812, indicating that the port is currently being selected and edited.

[0080] Assume then that a keyboard shortcut input 814 is recognized, for example, a combination of keys "Alt" and "C", which corresponds to an edit operation to set a connection for focused port 3.

[0081] In the next exemplary screenshot 820 of the canvas area, two candidate ports are highlighted with dashed circles 822 and 824, for example, port Q of the node "train model" and port S of the node "score model", which indicates that the two ports can be connected by the focused port 3 of the node "split data". At the same time, the target application can provide the accessibility assistance application with description information of port 3 of the node "split data", which includes information of the two candidate ports. The accessibility assistance application narrates the description information of port 3 in the voice clip 826. As an example, the description information in the voice clip 826 may include the name "port 3", the type "dataset", the connection information "port 3 can be connected to port Q of the 'train model' node or port S of the 'score model' node", the executable operation "press Alt+1 to select port Q of the 'train model' node, or press Alt+2 to select port S of the 'score model' node", and the like. The information of the two candidate ports is at least included in the connection information part and the executable operation part in the description information of port 3.

[0082] Assume that keyboard shortcut input 828 is then recognized, for example, a combination of keys "Alt" and "1", which corresponds to the user selecting port Q of the node "Train Model" that is desired to be connected to the focused port 3. The target application can then automatically set up a connection from port 3 of the node "Split Data" to port Q of the node "Train Model", as shown by connection line 832 in the exemplary next screenshot 830 of the canvas area.

[0083] It should be understood that Figure 8 All details in example 800 are exemplary, and various changes may be made to the example. For example, although the candidate ports are shown as being highlighted by dashed circles, the candidate ports may be highlighted in any other visual manner. For example, instead of suggesting connectable candidate ports in the description information of the focused port 3, connectable candidate nodes may also be suggested in the description, such as the node "training model" and the node "scoring model". For example, although only keyboard shortcuts are involved in example 800, the user may alternatively employ voice instructions or a combination of keyboard shortcuts and voice instructions.

[0084] Fig. 9 A flow chart of an exemplary method 900 for enhancing accessibility of a target application according to an embodiment is shown. The target application may be used to process a topology map.

[0085] At 910, an indication to select a target element in a topology map can be received.

[0086] At 920 , a connection state of the target element may be determined based on the topology information of the topology map.

[0087] At 930 , connection information of the target element corresponding to the connection state of the target element may be generated.

[0088] At 940 , description information of the target element may be provided to an accessibility assistance application, the description information of the target element including at least the connection information of the target element.

[0089] In one implementation, the target element may be one of the following: a node, a port, and a connection line.

[0090] In one embodiment, determining the connection status of the target element may include: identifying at least one node and / or port to which the target element is connected. The connection information may include: a name of the at least one node and / or port.

[0091] In one implementation, the description information may further include at least one of the following items: the name of the target element, the type of the target element, the function of the target element, and the running status of the target element.

[0092] In one implementation, the description information may further include at least one executable operation.

[0093] In one embodiment, the method 900 may further include: receiving a second indication of selecting a second target element indicated by the connection information of the target element; and providing description information of the second target element to the accessibility assistance application.

[0094] The method 900 may further include: determining a connection state of the second target element based on the topology information of the topology map; and generating connection information of the second target element corresponding to the connection state of the second target element. The description information of the second target element may include at least the connection information of the second target element.

[0095] In one implementation, the indication may be provided via keyboard input or voice input.

[0096] In one implementation, the method 900 may further include: receiving at least one editing operation; and constructing the topology map in response to the at least one editing operation.

[0097] The at least one editing operation may be provided via a predefined keyboard shortcut and / or a voice command.

[0098] The at least one editing operation may include an operation of setting a connection for the focused port of the node. The method 900 may also include: providing the accessibility assistance application with information of at least one candidate node and / or port to which the focused port can be connected.

[0099] The method 900 may further include: highlighting the at least one candidate node and / or port.

[0100] In one implementation, the accessibility assistance application may be used to provide accessibility assistance by speaking the description information.

[0101] In one implementation, the topology graph may be a directed acyclic graph (DAG).

[0102] It should be understood that the method 900 may also include any steps / processes for enhancing the accessibility of the target application related to the topology map according to the above-mentioned embodiments of the present disclosure.

[0103] Fig.10 An exemplary apparatus 1000 for enhancing accessibility of a target application according to an embodiment is shown. The target application may be used to process a topology map.

[0104] The device 1000 may include: an indication receiving module 1010, used to receive an indication of selecting a target element in a topology map; a connection status determination module 1020, used to determine the connection status of the target element based on the topology information of the topology map; a connection information generation module 1030, used to generate connection information of the target element corresponding to the connection status of the target element; and a description information providing module 1040, used to provide description information of the target element to an accessibility assistance application, the description information of the target element at least including the connection information of the target element.

[0105] In one implementation, the connection status determination module 1020 may be used to: identify at least one node and / or port to which the target element is connected. The connection information may include: a name of the at least one node and / or port.

[0106] In one implementation, the description information may further include at least one of the following items: the name of the target element, the type of the target element, the function of the target element, and the running status of the target element.

[0107] In one implementation, the description information may further include at least one executable operation.

[0108] In one implementation, the instruction receiving module 1010 may be configured to receive a second instruction for selecting a second target element indicated by the connection information of the target element. The description information providing module 1040 may be configured to provide the accessibility assistance application with description information of the second target element.

[0109] In one embodiment, the apparatus 1000 may further include: an editing operation receiving module, configured to receive at least one editing operation; and a graph building module, configured to build the topology graph in response to the at least one editing operation.

[0110] In addition, the apparatus 1000 may further include any other modules configured to enhance the accessibility of a target application related to a topology map according to the above-mentioned embodiments of the present disclosure.

[0111] Fig.11 An exemplary apparatus 1100 for enhancing accessibility of a target application according to an embodiment is shown. The target application may be used to process a topology map.

[0112] The apparatus 1100 may include at least one processor 1110 and a memory 1120 storing computer executable instructions. When executing the computer executable instructions, the at least one processor 1110 may perform any operation of the method for enhancing the accessibility of a target application related to a topology map according to the above-mentioned embodiment of the present disclosure.

[0113] The embodiments of the present disclosure may be implemented in a non-transitory computer-readable medium. The non-transitory computer-readable medium may include instructions that, when executed, cause one or more processors to perform any operation of the method for enhancing the accessibility of a target application related to a topology map according to the above-mentioned embodiments of the present disclosure.

[0114] It should be understood that all operations in the methods described above are merely exemplary, and the present disclosure is not limited to any operations in these methods or the order of these operations, but should cover all other equivalent transformations under the same or similar concepts.

[0115] It should also be understood that all modules in the above described device can be implemented in various ways. These modules can be implemented as hardware, software, or a combination thereof. In addition, any module in these modules can be further divided into submodules or combined together functionally.

[0116] Processors have been described in conjunction with various devices and methods. These processors can be implemented using electronic hardware, computer software or any combination thereof. Whether these processors are implemented as hardware or software will depend on specific application and the overall design constraints imposed on the system. As an example, the processor provided in the present disclosure, any part of the processor or any combination of processors can be implemented as a microprocessor, a microcontroller, a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a state machine, a gate logic, a discrete hardware circuit, and other suitable processing components configured to perform the various functions described in the present disclosure. The function of the processor provided in the present disclosure, any part of the processor or any combination of processors can be implemented as software performed by a microprocessor, a microcontroller, a DSP or other suitable platforms.

[0117] Software should be broadly considered to mean instructions, instruction sets, codes, code segments, program codes, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, running threads, processes, functions, etc. Software can reside in a computer-readable medium. A computer-readable medium can include, for example, a memory, which can be, for example, a magnetic storage device (e.g., a hard disk, a floppy disk, a magnetic stripe), an optical disk, a smart card, a flash memory device, a random access memory (RAM), a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a register, or a removable disk. Although the memory is shown as being separate from the processor in the various aspects provided in the present disclosure, the memory can also be located inside the processor (e.g., a cache or a register).

[0118] The above description is provided to enable any person skilled in the art to implement the various aspects described herein. Various modifications to these aspects are apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects. Therefore, the claims are not intended to be limited to the aspects shown herein. All structural and functional equivalents of the elements of the various aspects described in this disclosure that are known or to be known to those skilled in the art will be covered by the claims.

Claims

1. A method for enhancing the accessibility of a target application, the target application being used to process a topology map, wherein: The topology graph includes three types of elements, including nodes, ports and connection lines, and the method includes: Receiving an instruction to select a target element in a topology graph, wherein the target element is one of: a node, a port, and a connection line; Determining a connection state of the target element based on topology information of the topology graph; generating connection information of the target element corresponding to the connection state of the target element; and The description information of the target element is provided to an accessibility assistance application, wherein the description information of the target element at least includes the connection information of the target element, wherein the accessibility assistance application is used to provide accessibility assistance to the target application by telling the description information.

2. The method according to claim 1, wherein: Determining the connection status of the target element includes: identifying at least one node and / or port to which the target element is connected, The connection information includes: the name of the at least one node and / or port.

3. The method according to claim 1, wherein: The description information further includes at least one of the following items: the name of the target element, the type of the target element, the function of the target element, and the running status of the target element.

4. The method according to claim 1, wherein: The description information also includes at least one executable operation.

5. The method according to claim 1, further comprising: receiving a second indication for selecting a second target element indicated by the connection information of the target element; as well as The description information of the second target element is provided to the accessibility assistance application.

6. The method according to claim 5, further comprising: determining a connection state of the second target element based on the topology information of the topology map; as well as generating connection information of the second target element corresponding to the connection state of the second target element, and The description information of the second target element at least includes the connection information of the second target element.

7. The method according to claim 1, wherein: The indication is provided by keyboard input or voice input.

8. The method according to claim 1, further comprising: receiving at least one edit operation; as well as In response to the at least one editing operation, the topology map is constructed.

9. The method according to claim 8, wherein: The at least one editing operation is provided through a predefined keyboard shortcut and / or a voice command.

10. The method according to claim 8, wherein: The at least one editing operation comprises an operation to set a connection for the focused port of the node, and The method further includes providing the accessibility assistance application with information of at least one candidate node and / or port to which the focused port can be connected.

11. The method according to claim 10, further comprising: The at least one candidate node and / or port is highlighted.

12. The method according to claim 1, wherein: The topology graph is a directed acyclic graph (DAG).

13. A device for enhancing the accessibility of a target application, the target application being used to process a topology map, wherein: The topology graph includes three types of elements, including nodes, ports and connection lines, and the apparatus includes: An instruction receiving module, used to receive an instruction for selecting a target element in a topology graph, wherein the target element is one of the following: a node, a port, and a connection line; A connection status determination module, configured to determine the connection status of the target element based on the topology information of the topology graph; a connection information generating module, configured to generate connection information of the target element corresponding to the connection state of the target element; and A description information providing module is used to provide description information of the target element to an accessibility assistance application, wherein the description information of the target element at least includes the connection information of the target element, wherein the accessibility assistance application is used to provide accessibility assistance to the target application by telling the description information.

14. The device according to claim 13, wherein: The connection status determination module is used for: identifying at least one node and / or port to which the target element is connected, The connection information includes: the name of the at least one node and / or port.

15. The device according to claim 13, wherein: The description information further includes at least one of the following items: the name of the target element, the type of the target element, the function of the target element, and the running status of the target element.

16. The device according to claim 13, wherein: The description information also includes at least one executable operation.

17. The device according to claim 13, wherein: The instruction receiving module is used to receive a second instruction to select a second target element indicated by the connection information of the target element; and The description information providing module is used to provide the accessibility assistance application with description information of the second target element.

18. The apparatus according to claim 13, further comprising: An editing operation receiving module, used for receiving at least one editing operation; as well as A graph construction module is used to construct the topology graph in response to the at least one editing operation.

Citation Information

Patent Citations

  • Topological graph editing method and topological graph editor

    CN103413002A

  • Circuit topological graph generation method, system and device and storage medium

    CN109583064A