Audio menu navigation and option selection via display device

Abstract

Communication methods, devices, and systems are described for supporting audio menu navigation and option selection via a display device. To support audio menu navigation and option selection via a display device, a communication connection is established between an automated voice menu system and a user device, one or more option selections corresponding to an option menu are determined, a user interface is generated at the user device including an arrangement of elements corresponding to the one or more option selections, input is received from a user via the user interface, and a response is sent from the user device to the automated voice menu system via the communication connection based at least in part on the input received from the user, wherein the response is responsive to audio feedback and indicates a selection of a subset of the determined one or more option selections.

Description

[0001] Cross-references

[0002] This patent application claims priority to U.S. patent application No. 15 / 930,114 filed by Johnson on May 12, 2020, entitled “AUDIO MENU NAVIGATION AND OPTION SELECTION VIA DISPLAY DEVICE,” which is assigned to the assignee of the present application and is expressly incorporated herein by reference. Technical Field

[0003] The disclosure relates generally to database systems and communications, and more particularly to audio menu navigation and option selection via a display device. Background Art

[0004] Many users can use cloud platforms (i.e., computing platforms for cloud computing) to store, manage, and process data using a shared network of remote servers. Users can develop applications on cloud platforms to address data storage, management, and processing. In some cases, cloud platforms can utilize multi-tenant database systems. Users can access cloud platforms using a variety of user devices (e.g., desktop computers, laptops, smartphones, tablets, or other computing systems, etc.).

[0005] In one example, a cloud platform might support a customer relationship management (CRM) solution. This might include support for sales, service, marketing, community, analytics, applications, and the Internet of Things. A user might leverage a cloud platform to help manage the user's contacts. For example, managing the user's contacts might include analyzing data, storing and preparing communications, and tracking opportunities and sales.

[0006] The cloud platform can support communication between the user device and the automatic voice menu system. For example, the user can communicate with the automatic voice menu system via the user device to access a predetermined menu of options presented in a format that the user can understand and can be selected by input from the user. However, before the user's desired option is presented to the user by the automatic voice menu system, the user may have to listen to a large list of options. In addition, the user's selection of an option may result in the user being presented with an additional audio menu of options that the user may have to listen to. In addition, if the user wishes to hear the option again, they may have to listen to the entire list of options before hearing the option they want again, which may limit the user's efficient and effective interaction with the automatic menu system. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 An example of a system for supporting communication of audio menu navigation and option selections through a display device according to aspects of the disclosure is shown.

[0008] Figure 2 An example of a system supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown.

[0009] Figure 3 An example of a system supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown.

[0010] Figure 4 An example of a system supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown.

[0011] Figure 5 An example of a system supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown.

[0012] Figure 6 An example of a process flow for supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown.

[0013] Figure 7 A block diagram of a device supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown.

[0014] Figure 8 A block diagram of a communications manager supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown.

[0015] Fig. 9 A schematic diagram of a system including a device supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown.

[0016] Figures 10 to 16 A flow chart illustrating a method of supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. DETAILED DESCRIPTION

[0017] The cloud platform may support communication between the user device and the automatic voice menu system. For example, the cloud platform may support establishing a communication connection between the automatic voice menu system and the user device, so that the user device can determine one or more option selections corresponding to an option menu presented to the user device by the automatic voice menu system, present the determined one or more option selections to the user, receive input from the user corresponding to the determined one or more option selections, and send a response to the automatic voice menu corresponding to the input from the user.

[0018] The automatic voice menu system may generate audio feedback indicating an option menu in response to a communication connection established between the automatic voice menu system and a user device. Based on the audio feedback, the user device may determine an option selection, and may generate a user interface including an arrangement of elements presented to the user for selection and corresponding to the determined option selection. The user device may then receive user input selecting one or more elements through the user interface, and may send a response to the automatic voice menu system based at least in part on the input received from the user, the response being in response to the audio feedback generated by the automatic voice menu system.

[0019] The described technology includes converting audio feedback including one or more option selections generated by an automated voice menu system into option selections that can be presented to a user in a visual format via a user device to facilitate the user to quickly identify and select the one or more option selections. The option selections can be presented on a user interface of the user device via an application on the user device or by replacing a dial pad on the user interface with an arrangement of elements corresponding to the one or more option selections. In some cases, the user device can send a capability message to the automated voice menu system to indicate that the user device has the capability to generate a user interface based on the option selections presented by the automated voice menu system to further facilitate the efficient presentation of the option selections to the user.

[0020] In some cases, the user may select one or more desired option selections using one or more of touch input, language input, gesture or expression input, and any combination of these inputs. In other cases, input from the user selecting one or more of the displayed elements may result in a second element arrangement being displayed on the user interface to request additional input from the user. In addition, the user device may determine the receiving capabilities of the automatic voice menu system, and may send a response to the automatic voice menu system based on the received input and the determined receiving capabilities of the automatic voice menu system.

[0021] Aspects of the disclosure are initially described in the context of an environment supporting on-demand database services. Additional aspects are described with reference to a system supporting audio menu navigation and option selection through a display device. Aspects of the disclosure are also illustrated and described by device diagrams, system diagrams, and flow charts related to audio menu navigation and option selection through a display device.

[0022] Figure 1An example of a system 100 for cloud computing according to various aspects of the disclosure is shown, which supports audio menu navigation and option selection through a display device. System 100 includes a cloud client 105, a contact 110, a cloud platform 115, and a data center 120. Cloud platform 115 can be an example of a public or private cloud network. Cloud client 105 can access cloud platform 115 through network connection 135. The network can implement transmission control protocol and Internet protocol (TCP / IP), such as the Internet, or can implement other network protocols. Cloud client 105 can be an example of a user device, such as a server (e.g., cloud client 105-a), a smart phone (e.g., cloud client 105-b), or a laptop computer (e.g., cloud client 105-c). In other examples, cloud client 105 can be a desktop computer, a tablet computer, a sensor, or another computing device or system capable of generating, analyzing, sending or receiving communications. In some examples, cloud client 105 can be operated by a user who is part of a business, enterprise, non-profit organization, start-up, or any other type of organization.

[0023] The cloud client 105 may interact with multiple contacts 110. The interactions 130 may include communications, opportunities, purchases, sales, or any other interactions between the cloud client 105 and the contacts 110. Data may be associated with the interactions 130. The cloud client 105 may access the cloud platform 115 to store, manage, and process data associated with the interactions 130. In some cases, the cloud client 105 may have an associated security or permission level. The cloud client 105 may access certain applications, data, and database information within the cloud platform 115 based on the associated security or permission level, and may not access other applications, data, and database information.

[0024] Contact 110 can interact with cloud client 105 in person or by phone, email, web, text message, mail or any other suitable form of interaction (e.g., interaction 130-a, 130-b, 130-c and 130-d). Interaction 130 can be a business-to-business (B2B) interaction or a business-to-consumer (B2C) interaction. Contact 110 can also be referred to as a consumer, potential customer, leader, customer or some other suitable term. In some cases, contact 110 can be an example of a user device, such as a server (e.g., contact 110-a), a laptop (e.g., contact 110-b), a smartphone (e.g., contact 110-c) or a sensor (e.g., contact 110-d). In other cases, contact 110 can be another computing system. In some cases, contact 110 can be operated by a user or user group. A user or user group can be associated with an enterprise, a manufacturer or any other suitable organization.

[0025] The cloud platform 115 can provide on-demand database services to the cloud client 105. In some cases, the cloud platform 115 can be an example of a multi-tenant database system. In this case, the cloud platform 115 can serve multiple cloud clients 105 with a single instance of the software. However, other types of systems can be implemented, including but not limited to client-server systems, mobile device systems, and mobile network systems. In some cases, the cloud platform 115 can support CRM solutions. This may include support for sales, services, marketing, communities, analysis, applications, and the Internet of Things. The cloud platform 115 can receive data associated with contact interactions 130 from the cloud client 105 via a network connection 135, and can store and analyze the data. In some cases, the cloud platform 115 can directly receive data from the interaction 130 between the contact 110 and the cloud client 105. In some cases, the cloud client 105 can develop an application to run on the cloud platform 115. The cloud platform 115 can be implemented using a remote server. In some cases, the remote server can be located at one or more data centers 120.

[0026] Data center 120 may include multiple servers. Multiple servers may be used for data storage, management, and processing. Data center 120 may receive data from cloud platform 115 via connection 140, or directly from cloud client 105 or interaction 130 between contact 110 and cloud client 105. Data center 120 may utilize multiple redundancies for security purposes. In some cases, data stored at data center 120 may be backed up by copies of data at different data centers (not shown).

[0027] Subsystem 125 may include cloud client 105, cloud platform 115, and data center 120. In some cases, data processing may occur at any component of subsystem 125, or at a combination of these components. In some cases, a server may perform data processing. The server may be cloud client 105 or located in data center 120.

[0028] This article describes technologies for supporting audio menu navigation and option selection through a display device. The technology can provide for establishing a communication connection between an automatic voice menu system and a user device so that the user device can determine one or more option selections corresponding to an option menu presented to the user device by the automatic voice menu system, present the determined one or more option selections to the user, receive input from the user corresponding to the determined one or more option selections, and send a response to the automatic voice menu corresponding to the input from the user. These technologies can facilitate efficient communication between the automatic voice menu system and the user to facilitate the user to correctly and quickly obtain a desired contact or information source through the automatic voice menu system without the need for an operator.

[0029] The system 100 including the cloud platform 115 can support audio menu navigation and option selection through a display device such as one or more cloud clients 105. For example, the audio feedback generated by the automatic voice menu system can be identified by at least a portion of the system 100, and one or more option selections can be determined from the option menu presented by the audio feedback. The system 100 can also generate a user interface in a certain part of the system 100 based at least in part on the one or more option selections determined, for the user to interact with the arrangement of elements on the user interface. The system 100 can also receive input from the user to select one or more elements corresponding to the one or more option selections, and a response can be sent to another part of the system 100, which is based on the user's selection of one or more elements, and in response to the audio feedback presented by the automatic voice menu system.

[0030] Using audio menu navigation and option selection of display devices such as user devices, it can include that the user contacts an enterprise or organization (e.g., bank, IRS, utility company) to obtain information or provide information (e.g., pay bills, provide meter readings, obtain account balance). In some examples, the user can make a telephone call to the enterprise, and the enterprise can use the automatic voice menu system to guide the user's communication to the appropriate department or operator. In such an example, the automatic voice menu system can provide audio feedback in response to the user's communication with the system via its user device, and the user device can determine possible options from the audio feedback, and the determined options can be presented to the user. In the example that the user wishes to obtain their account balance, they can select the option corresponding to obtaining their account balance displayed on their user device. Selecting this option on the display device can send the answer to the received audio feedback, and indicate to the automatic voice menu system that the user wishes to obtain his account balance. If the enterprise has no further options, the user may communicate with the operator or some other entity that can provide the required information. If there are additional options that the user must select to proceed, the additional options will be determined by the user device from the additional audio feedback from the automated voice menu system and will be presented to the user on the user interface as additional elements corresponding to the additional options for selection. Thus, the user can reach a desired communication location within the enterprise without having to listen to one or more audio menus to select their desired option.

[0031] By enabling audio menu navigation and option selection via a display device, the user experience of contacting an enterprise or organization in order to reach a specific department or obtain specific information can be improved by more efficiently and effectively facilitating users to obtain the correct information sources within the enterprise or organization, while reducing the need for human operators and reducing the time users may have to wait to select options to obtain desired information sources.

[0032] Those skilled in the art will appreciate that one or more aspects of the disclosure may be implemented in the system 100 to additionally or alternatively address other issues in addition to the above-mentioned issues. In addition, various aspects of the disclosure may provide technical improvements to the "traditional" systems or processes described herein. However, the description and drawings include only exemplary technical improvements resulting from the implementation of the disclosure, and therefore do not represent all technical improvements provided within the scope of the claims.

[0033] Figure 2 An example of a system 200 for supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown. The system 200, which can be an example of a system for communication, includes a data center 205, an automated voice menu system 210, a user device 215, a data center connection 220 extending between the data center 205 and the automated voice menu system 210, and a communication connection 225 extending between the automated voice menu system 210 and the user device 215. The system 200 can be implemented as described in reference Figure 1 Aspects of the system 100 described herein are provided to support audio menu navigation and option selection via a display device such as a user device 215 to facilitate efficient interaction with audio menus and navigation through any number of option selections or additional menus. For example, the automated voice menu system 210 may be an example of a single server, a server cluster, a database server, a cloud-based server, a virtual machine, a container, or any other device or system that supports communications.

[0034] The automatic voice menu system 210 may be a central server that stores at least a portion of the data related to the system 200 (i.e., audio feedback or audio menus in the form of files) and may exchange data with the user device 215 once a communication connection is established between the automatic voice menu system 210 and the user device 215. In addition, the user device 215 may be an example of a cloud client 105 or a contact 110, and the data center 205 may implement, for example, reference Figure 1 Aspects of one or more of the data center 120 or cloud platform 115 are described.

[0035] The data center 205 may store one or more voice menus for access by the automatic voice menu system 210 via the data center connection 220. In this case, the automatic voice menu system 210 may request the one or more voice menus from the data center 205 in response to one or more communication connections 225 established between the automatic voice menu system 210 and the user device 215, or the automatic voice menu system 210 receiving input from the user device 215 via the communication connection 225. In some cases, the automatic voice menu system 210 may store the one or more voice menus, including any associated data, for communication with the user device 215 via the communication connection 225. In addition, the user device 215 may present information related to the one or more voice menus generated by the automatic voice menu system 210 on a user interface associated with the user device 215. The user device 215 may also request input from the user regarding a selection of one or more elements presented on the user interface, the one or more elements corresponding to one or more option selections generated by the user device and corresponding to options presented in an audible format by the automatic voice menu system.

[0036] In some cases, the user device 215 can determine one or more option selections corresponding to the audio option menu by determining the option selections in real time from the audio feedback. In other cases, the user device 215 can determine one or more option selections from a memory associated with the system 200 (containing a storage record of previously determined option selections). In this case, during a previous communication connection with the automatic voice menu system 210, the previously determined option selections may have been determined by the user device 215, or the previously determined option selections may have been determined and stored in the memory by an additional user device 215 not associated with the current user. In addition, in some cases, the automatic voice menu system 210 can determine that the user device 215 is capable of presenting a visual representation of the option selection to the user, and a digital signal can be sent to the user device 215 so that the user device 215 can present the determined option selections to the user through the user device 215 while establishing a communication connection 225 between the user device 215 and the automatic voice menu system 210.

[0037] Figure 3 An example of a system 300 for supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown. The system 300, which can be an example of a system for communication, includes a data center 305, an automated voice menu system 310, a user device 315, a data center connection 320 extending between the data center 305 and the automated voice menu system 310, and a communication connection 325 extending between the automated voice menu system 310 and the user device 315. The system 300 can be implemented as described in reference Figure 1 and Figure 2Aspects of the described systems 100 or 200 may be used to support audio menu navigation and option selection via a display device such as a user device 315 to facilitate efficient interaction with audio menus and navigation through any number of option selections or additional menus. For example, the automated voice menu system 310 may be an example of a single server, a server cluster, a database server, a cloud-based server, a virtual machine, a container, or any other device or system that supports communications.

[0038] The automatic voice menu system 310 may be a central server that stores at least a portion of the data related to the system 300 (i.e., audio feedback or audio menus in the form of files) and may exchange data with the user device 315 once a communication connection is established between the automatic voice menu system 310 and the user device 315. In addition, the user device 315 may be an example of a cloud client 105 or a contact 110, and the data center 305 may implement, for example, reference Figure 1 Aspects of one or more of the data center 120 or cloud platform 115 are described.

[0039] The data center 305 may store one or more voice menus for access by the automated voice menu system 310 via the data center connection 320. In this case, the automated voice menu system 310 may request the one or more voice menus from the data center 305 in response to one or more communication connections 325 established between the automated voice menu system 310 and the user device 315, or the automated voice menu system 310 receiving input from the user device 315 via the communication connection 325. In some cases, the automated voice menu system 310 may store the one or more voice menus, including any associated data, for communication with the user device 315 via the communication connection 325.

[0040] The user device 315 may present information related to one or more voice menus generated by the automatic voice menu system 310 on a user interface 330 associated with the user device 315. The user interface 330 may be generated by the user device 315 based at least in part on one or more option selections determined by the user device 315 and corresponding to the menu of options presented by the automatic voice menu system 310. The user device 315 may additionally solicit input from the user regarding a selection of one or more elements 340 presented on the user interface 330 as part of an arrangement of elements 335, the one or more elements 340 corresponding to the one or more option selections generated by the user device 315 (corresponding to options presented in an audible format by the automatic voice menu system 310 as part of the one or more voice menus).

[0041] User interface 330 can support audio menu navigation and option selection as described herein. In some cases, user interface 330 can provide a single view to the user, which represents and corresponds to the current voice menu presented to the user by automatic voice menu system 310 for user selection. User interface 330 includes the arrangement of elements 340, and element 340 includes elements 340-a, 340-b, 340-c, 340-d, 340-e, 340-f, 340-g, 340-h, 340-i and 340-j. In this example, each element 340 corresponds to the option selection determined by user device 315 from the first voice menu. In some cases, user interface 330 can be the user interface of the application at user device 315. In this case, establishing a communication connection 325 with automatic voice menu system 310 can result in opening the application on the user interface 330 of user device 315, so that the user can view element 340 and provide input to select one or more elements 340.

[0042] One or more of the elements 340-a, 340-b, 340-c, 340-d, 340-e, 340-f, 340-g, 340-h, 340-i, and 340-j may be selected by the user through input from the user to the user device 315 via the user interface 330. The user may provide input to the user interface 330 to select one or more elements 340 through touch input, voice input, expression input, gesture input, or a combination thereof. In the case where the user has provided non-touch input, the user device 315 may convert the non-touch input into a corresponding equivalent touch input for selecting one or more elements 340. In other cases, the user device 315 may convert the non-verbal input from the user into a corresponding language input corresponding to the equivalent language input from the user. In addition, the user device 315 may send one or both of a language response from the user (which corresponds to one or more of the received touch input, expression input, gesture input, or a combination thereof) and a non-verbal response from the user based on the receiving capability of the automatic voice menu system 310.

[0043] Based on the response received from the user device 315 via the communication connection 325, the automatic voice menu system 310 can perform an action corresponding to the input from the user contained in the response. In some cases, based on the received response, the automatic voice menu system 310 can connect the user of the user device 315 with an operator or technician (they are associated with the option selection selected by the user input selecting one or more elements 340). In other cases, based on the received response, the automatic voice menu system 310 can advance to the second audio menu and provide audio feedback indicating the second option menu. In this case, the user device 315 can determine one or more option selections based on the second option menu, and can present the determined one or more option selections to the user in the form of additional elements 340 through the user interface 330.

[0044] Figure 4 An example of a system 400 for supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown. The system 400, which can be an example of a system for communication, includes a data center 405, an automated voice menu system 410, a user device 415, a data center connection 420 extending between the data center 405 and the automated voice menu system 410, and a communication connection 425 extending between the automated voice menu system 410 and the user device 415. The system 400 can be implemented as described in reference Figures 1 to 3 Aspects of the described systems 100, 200, or 300 may be used to support audio menu navigation and option selection via a display device such as a user device 415 to facilitate efficient interaction with audio menus and navigation through any number of option selections or additional menus. For example, the automated voice menu system 410 may be an example of a single server, a server cluster, a database server, a cloud-based server, a virtual machine, a container, or any other device or system that supports communications.

[0045] The automatic voice menu system 410 may be a central server that stores at least a portion of the data related to the system 400 (i.e., audio feedback or audio menus in the form of files) and may exchange data with the user device 415 once a communication connection is established between the automatic voice menu system 410 and the user device 415. In addition, the user device 415 may be an example of a cloud client 105 or a contact 110, and the data center 405 may implement, for example, reference Figure 1 Aspects of one or more of the data center 120 or cloud platform 115 are described.

[0046] The data center 405 may store one or more voice menus for access by the automated voice menu system 410 via the data center connection 420. In this case, the automated voice menu system 410 may request the one or more voice menus from the data center 405 in response to one or more communication connections 425 established between the automated voice menu system 410 and the user device 415, or the automated voice menu system 410 receiving input from the user device 415 via the communication connection 425. In some cases, the automated voice menu system 410 may store the one or more voice menus, including any associated data, for communication with the user device 415 via the communication connection 425.

[0047] The user device 415 may present information related to one or more voice menus generated by the automatic voice menu system 410 on a user interface 430 associated with the user device 415. The user interface 430 may be generated by the user device 415 based at least in part on one or more option selections determined by the user device 415 and corresponding to the menu of options presented by the automatic voice menu system 410. The user device 415 may additionally solicit input from the user regarding a selection of one or more elements 440 presented on the user interface 430, the one or more elements 440 corresponding to the one or more option selections generated by the user device 415 (corresponding to options presented in an audible format by the automatic voice menu system 410 as part of the one or more voice menus).

[0048] The user interface 430 may support audio menu navigation and option selection as described herein. In some cases, the user interface 430 may provide a single view to the user that represents and corresponds to the current voice menu presented to the user by the automatic voice menu system 410 for selection by the user. The user interface 430 includes a second element arrangement 435, including elements 440-a, 440-b, 440-c, 440-d, 440-e, and 440-f. In this example, each element 440 corresponds to an option selection determined by the user device 415 from the second voice menu. For example, the second element arrangement 435 presented on the user interface 430 may be the result of the user selecting one or more elements before the user device 415 generates the second element arrangement 435, such as the one described herein with reference to FIG. Figure 3 340 in the arrangement 335 of elements depicted. In some cases, the user interface 430 may be a user interface of an application at the user device 415. In this case, establishing a communication connection with the automated voice menu system 410 may result in the application opening on the user interface 430 of the user device 415 so that the user may view the elements 440 and provide input to select one or more elements 440.

[0049] One or more of elements 440-a, 440-b, 440-c, 440-d, 440-e, and 440-f can be selected by the user through input from the user to the user device 415 via the user interface 430. The user can provide input to the user interface 430 to select one or more elements 440 through touch input, voice input, expression input, gesture input, or a combination thereof. In this case where the user has provided non-touch input, the user device 415 can convert the non-touch input into a corresponding equivalent touch input for selecting one or more elements 440. In other cases, the user device 415 can convert the non-verbal input from the user into a corresponding equivalent language input from the user. In addition, the user device 415 can send one or both of a language response from the user and a non-verbal response from the user (corresponding to one or more of the received touch input, expression input, gesture input, or a combination thereof) based on the receiving capabilities of the automatic voice menu system 410.

[0050] Based on the answer received from the user device 415 via the communication connection 425, the automatic voice menu system 410 can perform an action corresponding to the input from the user contained in the answer. In some cases, based on the received answer, the automatic voice menu system 410 can connect the user of the user device 415 with an operator or technician (they are associated with the option selection selected by the user input selecting one or more elements 440). In other cases, based on the received answer, the automatic voice menu system 410 can advance to an additional audio menu, such as the third or fourth audio menu, and provide audio feedback indicating the additional menu of the option. In this case, the user device 415 can determine one or more option selections based on the additional menu of the option, and can present the determined one or more option selections to the user in the form of additional elements 440 through the user interface 430.

[0051] Figure 5 An example of a system 500 for supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown. The system 500, which can be an example of a system for communication, includes a data center 505, an automated voice menu system 510, a user device 515, a data center connection 520 extending between the data center 505 and the automated voice menu system 510, and a communication connection 525 extending between the automated voice menu system 510 and the user device 515. The system 500 can be implemented as described in reference Figures 1 to 4Aspects of the described systems 100, 200, 300, or 400 may be used to support audio menu navigation and option selection via a display device such as a user device 515 to facilitate efficient interaction with audio menus and navigation through any number of option selections or additional menus. For example, the automated voice menu system 510 may be an example of a single server, a server cluster, a database server, a cloud-based server, a virtual machine, a container, or any other device or system that supports communications.

[0052] The automatic voice menu system 510 may be a central server that stores at least a portion of the data related to the system 500 (i.e., audio feedback or audio menus in the form of files) and may exchange data with the user device 515 once a communication connection is established between the automatic voice menu system 510 and the user device 515. In addition, the user device 515 may be an example of a cloud client 105 or a contact 110, and the data center 505 may implement, for example, reference Figure 1 Aspects of one or more of the data center 120 or cloud platform 115 are described.

[0053] The data center 505 may store one or more voice menus for access by the automated voice menu system 510 via the data center connection 520. In this case, the automated voice menu system 510 may request the one or more voice menus from the data center 505 in response to one or more communication connections 525 established between the automated voice menu system 510 and the user device 515, or the automated voice menu system 510 receiving input from the user device 515 via the communication connection 525. In some cases, the automated voice menu system 510 may store the one or more voice menus, including any associated data, for communication with the user device 515 via the communication connection 525.

[0054] The user device 515 may present information related to one or more voice menus generated by the automatic voice menu system 510 on a user interface 530 associated with the user device 515. The user interface 530 may be generated by the user device 515 based at least in part on one or more option selections determined by the user device 515 and corresponding to the menu of options presented by the automatic voice menu system 510. The user device 515 may additionally solicit input from the user regarding a selection of one or more elements 540 presented on the user interface 530, the one or more elements 540 corresponding to the one or more option selections generated by the user device 515 (corresponding to options presented in an audible format by the automatic voice menu system 510 as part of the one or more voice menus).

[0055] User interface 530 can support audio menu navigation and option selection as described herein. In some cases, user interface 530 can provide a single view to the user, which represents and corresponds to the current voice menu presented to the user by automatic voice menu system 510 for user selection. User interface 530 includes an arrangement 535 of elements, including elements 540-a, 540-b, 540-c, 540-d, 540-e, 540-f, 540-g, 540-h, 540-i, 540-j, 540-k and 540-l. In this example, each element 540 corresponds to the option selection determined by user device 515 from the voice menu. In addition, each element 540 has been generated at user interface 530 to replace the numbers or symbols of the standard twelve-element dial that interacts with the user, so that user device 515 establishes a communication connection 525 between user device 515 and automatic voice menu system 510.

[0056] For example, a user may enter (i.e., dial) a number associated with the voice menu system at the user interface 530 via a dial pad present at the user interface 530, causing the user device 510 to initiate and establish a communication connection 525 between the user device 515 and the automatic voice menu system 510. When the communication connection is established, and after the user device 515 has determined an option selection from the audio feedback generated by the automatic voice menu system 510, one or more elements present on the user interface 530 may be replaced by one or more elements 540. In some cases, the user interface 530 may be a user interface for an application at the user device 515. In this case, establishing a communication connection with the automatic voice menu system 510 may cause the application to open on the user interface 530 of the user device 515 with a visual representation of the elements that previously displayed numbers or symbols as part of the dial pad of the user device 515, so that the user can view the elements 540 and provide input to select one or more elements 540.

[0057] One or more of elements 540-a, 540-b, 540-c, 540-d, 540-e, 540-f, 540-g, 540-h, 540-i, 540-j, 540-k, and 540-1 may be selected by a user through input from the user to the user device 515 via the user interface 530. The user may provide input to the user interface 530 to select one or more of the elements 540 through touch input, voice input, expression input, gesture input, or a combination thereof. In this case where the user has provided non-touch input, the user device 515 may convert the non-touch input into a corresponding equivalent touch input for selecting one or more of the elements 540. In other cases, the user device 515 may convert the non-verbal input from the user into a corresponding equivalent language input from the user. In addition, the user device 515 may send one or both of a language response from the user and a non-verbal response from the user (which corresponds to one or more of the received touch input, expression input, gesture input, or a combination thereof) based on the receiving capability of the automatic voice menu system 510.

[0058] Based on the answer received from the user device 515 via the communication connection 525, the automatic voice menu system 510 can perform an action corresponding to the input from the user contained in the answer. In some cases, based on the received answer, the automatic voice menu system 510 can connect the user of the user device 515 with an operator or technician (they are associated with the option selection selected by the user input of one or more of the selection elements 540). In other cases, based on the received answer, the automatic voice menu system 510 can advance to an additional audio menu, such as a third or fourth audio menu, and provide audio feedback indicating the additional menu of options. In this case, the user device 515 can determine one or more option selections based on the additional menu of options, and can present the determined one or more option selections to the user through the user interface 530 in the form of an additional element 540 arranged to mimic the dial pad of the user device 515.

[0059] Figure 6 An example of a system 600 supporting audio menu navigation and option selection through a display device according to aspects of the disclosure is shown. The process flow 600 includes an automated voice menu system 605 and a user device 610. These may be reference Figures 1 to 5 Examples of corresponding devices described. The following alternative examples may be implemented in which some of the steps are performed in a different order than described, or not performed at all. In some cases, the steps may include additional features not mentioned below, or further steps may be added.

[0060] At 615, a communication connection may be established between the automatic voice menu system 605 and the user device 610. Establishment of the communication connection between the automatic voice menu system 605 and the user device 610 may be initiated by the user device 610. In some cases, the communication connection between the automatic voice menu system 605 and the user device 610 may be initiated by the automatic voice menu system 605 or some other component of the process flow 600.

[0061] At 620, the automatic voice menu system 605 may send audio feedback to the user device 610 in response to the communication connection established between the automatic voice menu system 605 and the user device 610. The audio feedback generated by the automatic voice menu system 605 may indicate a menu of options in response to the communication connection established between the automatic voice menu system 605 and the user device 610.

[0062] At 625, the user device 610 may determine one or more option selections corresponding to the menu of options. The user device 610 may determine the one or more option selections corresponding to the menu of options by analyzing the audio feedback received from the automated voice menu system 605. In some cases, the audio feedback received from the user device may include an audio signal corresponding to the determined one or more option selections.

[0063] At 630, user equipment 610 can generate a user interface at user equipment 610. The user interface can be generated based at least in part on one or more options selected to determine. The user interface may include an arrangement of elements corresponding to one or more of the one or more options selected to determine. In some cases, user equipment 610 can generate a user interface by replacing one or more keypad displays presented on the user interface with corresponding elements of the arrangement of elements. In some cases, generating a user interface at user equipment 610 may include opening an application to display on user equipment 610.

[0064] At 635, user device 610 may receive input from a user via the user interface. The received input may select one or more of the elements corresponding to the determined subset of the one or more option selections.

[0065] In some cases, the input received from the user at the user device 610 may cause the user interface to display a second element arrangement corresponding to the additional one or more determined one or more option selections. In some cases, the input received from the user at the user device 610 may include one of a voice input, an expression input, or a combination thereof.

[0066] At 640, the user device 610 may send a response via the communication connection to the automated voice menu system 605. The response may be based at least in part on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of the one or more option selections.

[0067] In some cases, the user device 610 may send a capability message to the automatic voice menu system. The capability message may indicate the capability of generating a user interface at the user device 610, including the arrangement of elements corresponding to the determined one or more option selections. In some cases, the user device 610 may send a response to the automatic voice menu system 605 based on the receiving capability of the automatic voice menu system 605. In this case, the user device 610 may send one or both of a language response from the user and a non-language response corresponding to one of the touch input, the expression input, or a combination thereof. In addition, in this case, the user device 610 may convert a language response from the user into a non-language response corresponding to a language response received from the user.

[0068] In some cases, the determined one or more option selections corresponding to the menu of options associated with the automated voice menu system can be stored by one or more components of the process flow 600. In some cases, the user device 610 can store the one or more option selections. In other cases, the automated voice menu system 605 can store the one or more option selections for use by the user device 610 at additional time contacts. In some cases, the stored determined one or more option selections associated with the automated voice menu system 605 can be shared with one or more additional user devices 610.

[0069] Figure 7 A block diagram 700 of a device 705 supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. Device 705 may include an input module 710, a communication manager 715, and an output module 745. Device 705 may also include a processor. Each of these components may communicate with each other (e.g., through one or more buses). In some cases, device 705 may be an example of a user terminal, a database server, or a system comprising multiple computing devices.

[0070] Input module 710 can manage input signals for device 705. For example, input module 710 can identify input signals based on interaction with a modem, keyboard, mouse, touch screen, or similar device. These input signals can be associated with user input or processing at other components or devices. In some cases, input module 610 can utilize such as The input module 710 may send aspects of these input signals to other components of the device 705 for processing. For example, the input module 710 may send input signals to the communication manager 715 to support audio menu navigation and option selection via a display device. In some cases, the input module 710 may be as described in reference to Fig. 9 Components of the input / output (I / O) controller 915.

[0071] The communication manager 715 may include a communication connection establisher 720, an option selection component 725, a user interface generator 730, an input component 735, and a response transmission component 740. The communication manager 715 may be a reference Figure 8 and Fig. 9 Examples of aspects of the communications manager 805 or 910 are described.

[0072] At least some of the communication manager 715 and / or its various subcomponents may be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions of the communication manager 715 and / or at least some of its various subcomponents may be performed by a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic, a discrete hardware component, or any combination thereof, designed to perform the functions described in the disclosure. At least some of the communication manager 715 and / or its various subcomponents may be physically located in various locations, including being distributed so that parts of the functions are implemented by one or more physical devices at different physical locations. In some examples, according to various aspects of the disclosure, at least some of the communication manager 715 and / or its various subcomponents may be separate and distinct components. In other examples, at least some of the communication manager 715 and / or its various subcomponents may be combined with one or more other hardware components, including but not limited to I / O components, transceivers, network servers, another computing device, one or more other components described in the disclosure, or combinations thereof according to various aspects of the disclosure.

[0073] The communication connection establisher 720 may establish a communication connection between the automatic voice menu system and the user device, wherein the automatic voice menu system is configured to generate audio feedback indicating a menu of options in response to the communication connection established between the automatic voice menu system and the user device.

[0074] Option selection component 725 can determine one or more option selections corresponding to the options menu.

[0075] The user interface generator 730 may generate a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections.

[0076] Input component 735 can receive input from a user via a user interface that selects one or more elements corresponding to a determined subset of one or more option selections.

[0077] The response transmission component 740 can transmit a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of the one or more option selections.

[0078] Output module 745 can manage output signals of device 705. For example, output module 745 can receive signals from other components of device 705 (e.g., communication manager 715) and can send these signals to other components or devices. In some specific examples, output module 745 can send output signals for display in a user interface, for storage in a database or data store, for further processing at a server or server cluster, or for any other processing at any number of devices or systems. In some cases, output module 745 can be a reference Fig. 9 Components of I / O controller 915 are described.

[0079] Figure 8 A block diagram 800 of a communication manager 805 supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. The communication manager 805 can be an example of aspects of the communication manager 715 or the communication manager 910 described herein. The communication manager 805 can include a communication connection establisher 810, an option selection component 815, a user interface generator 820, an input component 825, an answer transmission component 830, a capability transmission component 835, and a storage component 840. Each of these modules can communicate with each other directly or indirectly (e.g., through one or more buses).

[0080] The communication connection establisher 810 may establish a communication connection between the automatic voice menu system and the user device, wherein the automatic voice menu system is configured to generate audio feedback indicating a menu of options in response to the communication connection established between the automatic voice menu system and the user device.

[0081] Option selection component 815 can determine one or more option selections corresponding to the options menu.

[0082] The user interface generator 820 may generate a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections.

[0083] In some examples, user interface generator 820 may replace one or more numbers of the keypad display with corresponding elements of the arrangement of elements.

[0084] In some examples, user interface generator 820 may open an application for display on a user device.

[0085] Input component 825 can receive input from a user via a user interface that selects one or more elements corresponding to a determined subset of one or more option selections.

[0086] In some examples, input component 825 can receive input from a user via a user interface, causing the user interface to display a second element arrangement corresponding to one or more additional ones of the determined one or more option selections.

[0087] In some examples, receiving input from the user includes receiving one of touch input, voice input, expression input, and a combination thereof.

[0088] The response transmission component 830 can transmit a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of the one or more option selections.

[0089] The capability transmission component 835 can send a capability message to the automated voice menu system indicating the capability to generate a user interface at the user device, including an arrangement of elements corresponding to the determined one or more option selections.

[0090] The storage component 840 can store one or more option selections corresponding to the determination of the menu of options associated with the automated voice menu system.

[0091] Fig. 9 A schematic diagram of a system 900 including a device 905 supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. The device 905 may be an example of or include components of a user device or device 705 as described herein. The device 905 may include components for two-way data communications, including components for sending and receiving communications, including a communication manager 910, an I / O controller 915, a database controller 920, a memory 925, a processor 930, and a database 935. These components may communicate electronically via one or more buses (e.g., bus 940).

[0092] The communication manager 910 may be an example of the communication manager 715 or 805 as described herein. For example, the communication manager 910 may perform the above reference Figure 7 and Figure 8 In some cases, the communications manager 910 may be implemented in hardware, software executed by a processor, firmware, or any combination thereof.

[0093] I / O controller 915 can manage input signals 945 and output signals 950 of device 905. I / O controller 915 can also manage peripheral devices that are not integrated into device 905. In some cases, I / O controller 915 can represent a physical connection or port to an external peripheral device. In some cases, input module 510 can utilize a plurality of external peripheral devices such as 905. In some cases, the I / O controller 915 may represent or interact with a modem, keyboard, mouse, touch screen, or similar device. In some cases, the I / O controller 915 may be implemented as part of a processor. In some cases, a user may interact with the device 905 via the I / O controller 915 or via hardware components controlled by the I / O controller 915.

[0094] Database controller 920 can manage data storage and processing in database 935. In some cases, a user can interact with database controller 920. In other cases, database controller 920 can operate automatically without user interaction. Database 935 can be an example of a single database, a distributed database, multiple distributed databases, a data store, a data lake, or an emergency backup database.

[0095] The memory 925 may include random access memory (RAM) and read-only memory (ROM). The memory 925 may store computer-readable, computer-executable software including instructions that, when executed, cause the processor to perform the various functions described herein. In some cases, the memory 925 may contain, among other things, a basic input / output system (BIOS), which may control basic hardware or software operations such as interaction with peripheral components or devices.

[0096] The processor 930 may include an intelligent hardware device (e.g., a general purpose processor, a DSP, a central processing unit (CPU), a microcontroller, an ASIC, an FPGA, a programmable logic device, a discrete gate or transistor logic component, a discrete hardware component, or any combination thereof). In some cases, the processor 930 may be configured to operate a memory array using a memory controller. In other cases, the memory controller may be integrated into the processor 930. The processor 930 may be configured to execute computer-readable instructions stored in the memory 925 to perform various functions (e.g., functions or tasks that support audio menu navigation and option selection via a display device).

[0097] Fig.10 A flow chart illustrating a method 1000 for supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. The operations of the method 1000 may be implemented by a user device or components thereof as described herein. For example, as described in reference Figures 7 to 9 The operations of method 1000 may be performed by a communication manager. In some examples, the user device may execute a set of instructions to control the functional elements of the user device to perform the functions described below. Additionally or alternatively, the user device may use dedicated hardware to perform various aspects of the functions described below.

[0098] At 1005, the user device may establish a communication connection between the automatic voice menu system and the user device, wherein the automatic voice menu system is configured to generate audio feedback indicating the menu of options in response to the communication connection established between the automatic voice menu system and the user device. The operation of 1005 may be performed according to the methods described herein. In some examples, such as reference Figures 7 to 9 As described, aspects of the operation of 1005 may be performed by a communication connection establisher.

[0099] At 1010, the user device may determine one or more option selections corresponding to an option menu. The operations of 1010 may be performed according to the methods described herein. In some examples, aspects of the operations of 1010 may be described with reference to Figures 7 to 9 The options described select the component to execute.

[0100] At 1015, the user device may generate a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections. The operations of 1015 may be performed according to the methods described herein. In some examples, such as reference Figures 7 to 9 As described, aspects of the operation of 1015 may be performed by a user interface generator.

[0101] At 1020, the user device may receive input from the user via the user interface, the input selecting one or more elements corresponding to the subset of the determined one or more option selections. The operations of 1020 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1020 may be described with reference to Figures 7 to 9 The input component is executed.

[0102] At 1025, the user device may send a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of one or more option selections. The operations of 1025 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1025 may be described with reference to Figures 7 to 9 The response transmission component executes.

[0103] Fig.11 A flow chart illustrating a method 1100 for supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. The operations of the method 1100 may be implemented by a user device or components thereof as described herein. For example, as described in reference Figures 7 to 9 The operations of method 1100 may be performed by a communication manager. In some examples, the user device may execute a set of instructions to control the functional elements of the user device to perform the functions described below. Additionally or alternatively, the user device may use dedicated hardware to perform various aspects of the functions described below.

[0104] At 1105, the user device may establish a communication connection between the automatic voice menu system and the user device, wherein the automatic voice menu system is configured to generate audio feedback indicating an option menu in response to the communication connection established between the automatic voice menu system and the user device. The operations of 1105 may be performed according to the methods described herein. In some examples, aspects of the operations of 1105 may be described with reference to Figures 7 to 9 The communication connection establisher executes.

[0105] At 1110, the user device may determine one or more option selections corresponding to the options menu. The operations of 1110 may be performed according to the methods described herein. In some examples, aspects of the operations of 1110 may be described with reference to Figures 7 to 9 The options described select the component to execute.

[0106] At 1115, the user device may generate a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections. The operations of 1115 may be performed according to the methods described herein. In some examples, aspects of the operations of 1115 may be as described in reference to Figures 7 to 9 The user interface builder is executed.

[0107] At 1120, the user device may receive input from the user via the user interface, the input selecting one or more elements corresponding to the determined subset of one or more option selections. The operations of 1120 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1120 may be described with reference to Figures 7 to 9 The input component is executed.

[0108] At 1125, the user device may send a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of one or more option selections. The operations of 1125 may be performed according to the methods described herein. In some examples, aspects of the operations of 1125 may be described with reference to Figures 7 to 9 The response transmission component is used to execute.

[0109] At 1130, the user device may send a capability message to the automatic voice menu system, the capability message indicating the capability to generate a user interface at the user device, including an arrangement of elements corresponding to the determined one or more option selections. The operations of 1130 may be performed according to the methods described herein. In some examples, aspects of the operations of 1130 may be described with reference to Figures 7 to 9 The capability transfer component is used to perform the above operation.

[0110] Fig.12 A flow chart illustrating a method 1200 for supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. The operations of the method 1200 may be implemented by a user device or components thereof as described herein. For example, the operations of the method 1200 may be implemented by a user device as described in reference to Figures 7 to 9 The communication manager described herein performs. In some examples, the user device may execute a set of instructions to control the functional elements of the user device to perform the functions described below. Additionally or alternatively, the user device may use dedicated hardware to perform various aspects of the functions described below.

[0111] At 1205, the user device may establish a communication connection between the automatic voice menu system and the user device, wherein the automatic voice menu system is configured to generate audio feedback indicating an option menu in response to the communication connection established between the automatic voice menu system and the user device. The operations of 1205 may be performed according to the methods described herein. In some examples, aspects of the operations of 1205 may be described with reference to Figures 7 to 9 The communication connection establisher described herein is implemented.

[0112] At 1210, the user device may determine one or more option selections corresponding to the options menu. The operations of 1210 may be performed according to the methods described herein. In some examples, aspects of the operations of 1210 may be described with reference to Figures 7 to 9 The options described select the component to execute.

[0113] At 1215, the user device may generate a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections. The operations of 1215 may be performed according to the methods described herein. In some examples, aspects of the operations of 1215 may be as described in reference to Figures 7 to 9 The user interface builder is executed.

[0114] At 1220, the user device may receive input from the user via the user interface, the input selecting one or more elements corresponding to the determined subset of one or more option selections. The operations of 1220 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1220 may be described with reference to Figures 7 to 9 The input component is executed.

[0115] At 1225, the user device may send a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of one or more option selections. The operations of 1225 may be performed according to the methods described herein. In some examples, aspects of the operations of 1225 may be described with reference to Figures 7 to 9 The response transmission component is used to execute.

[0116] At 1230, the user device may receive input from the user via the user interface, causing the user interface to display a second element arrangement corresponding to one or more of the determined one or more option selections. The operation of 1230 may be performed according to the methods described herein. In some examples, aspects of the operation of 1230 may be described by reference to Figures 7 to 9 The input component is executed.

[0117] Fig.13A flow chart illustrating a method 1300 for supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. The operations of the method 1300 may be implemented by a user device or components thereof as described herein. For example, the operations of the method 1300 may be implemented by a user device as described in reference to Figures 7 to 9 The communication manager described herein performs. In some examples, the user device may execute a set of instructions to control the functional elements of the user device to perform the functions described below. Additionally or alternatively, the user device may use dedicated hardware to perform various aspects of the functions described below.

[0118] At 1305, the user device may establish a communication connection between the automatic voice menu system and the user device, wherein the automatic voice menu system is configured to generate audio feedback indicating an option menu in response to the communication connection established between the automatic voice menu system and the user device. The operations of 1305 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1305 may be described with reference to Figures 7 to 9 The communication connection establisher described herein is implemented.

[0119] At 1310, the user device may determine one or more option selections corresponding to an options menu. The operations of 1310 may be performed according to the methods described herein. In some examples, aspects of the operations of 1310 may be described with reference to Figures 7 to 9 The options described select the component to execute.

[0120] At 1315, the user device may generate a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections. The operations of 1315 may be performed according to the methods described herein. In some examples, aspects of the operations of 1315 may be as described in reference to Figures 7 to 9 The user interface builder is executed.

[0121] At 1320, the user device may receive input from the user via the user interface, the input selecting one or more elements corresponding to the subset of the determined one or more option selections. The operations of 1320 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1320 may be described with reference to Figures 7 to 9 The input component is executed.

[0122] At 1325, the user device may send a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of one or more option selections. The operations of 1325 may be performed according to the methods described herein. In some examples, aspects of the operations of 1325 may be described with reference to Figures 7 to 9 The response transmission component is used to execute.

[0123] At 1330, the user device may receive input from the user, including receiving one of touch input, voice input, expression input, and a combination thereof. The operation of 1330 may be performed according to the method described herein. In some examples, various aspects of the operation of 1330 may be referred to as Figures 7 to 9 The input component is executed.

[0124] Fig.14 A flow chart illustrating a method 1400 for supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. The operations of the method 1400 may be implemented by a user device or components thereof as described herein. For example, the operations of the method 1400 may be implemented by a user device as described in reference to Figures 7 to 9 The communication manager described herein performs. In some examples, the user device may execute a set of instructions to control the functional elements of the user device to perform the functions described below. Additionally or alternatively, the user device may use dedicated hardware to perform various aspects of the functions described below.

[0125] At 1405, the user device may establish a communication connection between the automatic voice menu system and the user device, wherein the automatic voice menu system is configured to generate audio feedback indicating an option menu in response to the communication connection established between the automatic voice menu system and the user device. The operations of 1405 may be performed according to the methods described herein. In some examples, aspects of the operations of 1405 may be performed as described in reference to Figures 7 to 9 The communication connection establisher executes.

[0126] At 1410, the user device may determine one or more option selections corresponding to an options menu. The operations of 1410 may be performed according to the methods described herein. In some examples, aspects of the operations of 1410 may be described with reference to Figures 7 to 9 The options described select the component to execute.

[0127] At 1415, the user device may generate a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections. The operations of 1415 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1415 may be performed as described in reference to Figures 7 to 9 The user interface builder is executed.

[0128] At 1420, the user device may receive input from the user via the user interface, the input selecting one or more elements corresponding to the subset of the determined one or more option selections. The operations of 1420 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1420 may be described with reference to Figures 7 to 9 The input component is executed.

[0129] At 1425, the user device may send a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of one or more option selections. The operations of 1425 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1425 may be described with reference to Figures 7 to 9 The response transmission component is used to execute.

[0130] At 1430, the user device may replace one or more numbers of the keypad display with corresponding elements of the arrangement of elements. The operations of 1430 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1430 may be performed as described in reference to Figures 7 to 9 The user interface builder is executed.

[0131] Fig.15 A flow chart illustrating a method 1500 for supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. The operations of the method 1500 may be implemented by a user device or components thereof as described herein. For example, the operations of the method 1500 may be implemented by a user device or components thereof as described herein. Figures 7 to 9 The communication manager described herein performs. In some examples, the user device may execute a set of instructions to control the functional elements of the user device to perform the functions described below. Additionally or alternatively, the user device may use dedicated hardware to perform various aspects of the functions described below.

[0132] At 1505, the user device may establish a communication connection between the automatic voice menu system and the user device, wherein the automatic voice menu system is configured to generate audio feedback indicating an option menu in response to the communication connection established between the automatic voice menu system and the user device. The operations of 1505 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1505 may be described with reference to Figures 7 to 9 The communication connection establisher described herein is implemented.

[0133] At 1510, the user device may determine one or more option selections corresponding to an options menu. The operations of 1510 may be performed according to the methods described herein. In some examples, aspects of the operations of 1510 may be described with reference to Figures 7 to 9 The options described select the component to execute.

[0134] At 1515, the user device may generate a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections. The operations of 1515 may be performed according to the methods described herein. In some examples, aspects of the operations of 1515 may be as described in reference to Figures 7 to 9 The user interface builder is executed.

[0135] At 1520, the user device may receive input from the user via the user interface, the input selecting one or more elements corresponding to the determined subset of one or more option selections. The operations of 1520 may be performed according to the methods described herein. In some examples, aspects of the operations of 1520 may be described with reference to Figures 7 to 9 The input component is executed.

[0136] At 1525, the user device may send a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of one or more option selections. The operations of 1525 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1525 may be described with reference to Figures 7 to 9 The response transmission component is used to execute.

[0137] At 1530, the user device may store the determined one or more option selections relative to the option menu associated with the automated voice menu system. The operations of 1530 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1530 may be performed by referring to Figures 7 to 9 The storage component is used to execute.

[0138] Fig.16 A flow chart illustrating a method 1600 for supporting audio menu navigation and option selection via a display device according to aspects of the disclosure is shown. The operations of the method 1600 may be implemented by a user device or components thereof as described herein. For example, the operations of the method 1600 may be implemented by a user device as described in reference to Figures 7 to 9 The communication manager described herein performs. In some examples, the user device may execute a set of instructions to control the functional elements of the user device to perform the functions described below. Additionally or alternatively, the user device may use dedicated hardware to perform various aspects of the functions described below.

[0139] At 1605, the user device may establish a communication connection between the automatic voice menu system and the user device, wherein the automatic voice menu system is configured to generate audio feedback indicating an option menu in response to the communication connection established between the automatic voice menu system and the user device. The operations of 1605 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1605 may be described with reference to Figures 7 to 9 The communication connection establisher described herein is implemented.

[0140] At 1610, the user device may determine one or more option selections corresponding to an options menu. The operations of 1610 may be performed according to the methods described herein. In some examples, aspects of the operations of 1610 may be described with reference to Figures 7 to 9 The options described select the component to execute.

[0141] At 1615, the user device may generate a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections. The operations of 1615 may be performed according to the methods described herein. In some examples, aspects of the operations of 1615 may be as described in reference to Figures 7 to 9 The user interface builder is executed.

[0142] At 1620, the user device may receive input from the user via the user interface, the input selecting one or more elements corresponding to the determined subset of one or more option selections. The operations of 1620 may be performed according to the methods described herein. In some examples, aspects of the operations of 1620 may be described with reference to Figures 7 to 9 The input component is executed.

[0143] At 1625, the user device may send a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the determined subset of one or more option selections. The operations of 1625 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1625 may be described with reference to Figures 7 to 9 The response transmission component is used to execute.

[0144] At 1630, the user device may open the application for display on the user device. The operations of 1630 may be performed according to the methods described herein. In some examples, various aspects of the operations of 1630 may be performed as described in reference to Figures 7 to 9 The user interface builder is executed.

[0145] A communication method is described. The method may include establishing a communication connection between an automatic voice menu system and a user device, wherein the automatic voice menu system is configured to generate audio feedback indicating an option menu in response to the communication connection established between the automatic voice menu system and the user device; determine one or more option selections corresponding to the option menu; based on the determined one or more option selections, generate a user interface at the user device, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections; receive input from a user via the user interface, the input selecting one or more elements corresponding to a subset of the determined one or more option selections; and based on the input received from the user, send a response from the user device to the automatic voice menu system via the communication connection, wherein the response is responsive to the audio feedback and indicates a selection of the subset of the determined one or more option selections.

[0146] A device for communication is described. The device may include a processor, a memory coupled to the processor, and instructions stored in the memory. The instructions are executable by the processor to cause the device to establish a communication connection between an automatic voice menu system and a user device, wherein the automatic voice menu system is configured to generate audio feedback indicating an option menu in response to the communication connection established between the automatic voice menu system and the user device; determine one or more option selections corresponding to the option menu; based on the determined one or more option selections, generate a user interface at the user device, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections; receive input from a user via the user interface, the input selecting one or more elements corresponding to a subset of the determined one or more option selections; and based on the input received from the user, send a response from the user device to the automatic voice menu system via the communication connection, wherein the response is responsive to the audio feedback and indicates a selection of the subset of the determined one or more option selections.

[0147] Another device for communication is described. The device may include means for the following functions: establishing a communication connection between an automated voice menu system and a user device, wherein the automated voice menu system is configured to generate audio feedback indicating an option menu in response to the communication connection established between the automated voice menu system and the user device; determining one or more option selections corresponding to the option menu; generating a user interface at the user device based on the determined one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections; receiving input from a user via the user interface, the input selecting one or more elements corresponding to a subset of the determined one or more option selections; and sending a response from the user device to the automated voice menu system via the communication connection based on the input received from the user, wherein the response is responsive to the audio feedback and indicates a selection of the subset of the determined one or more option selections.

[0148] A non-transitory computer-readable medium storing code for communication is described. The code may include instructions executable by a processor to establish a communication connection between an automated voice menu system and a user device, wherein the automated voice menu system is configured to, in response to the communication connection established between the automated voice menu system and the user device, generate audio feedback indicating an option menu; determine one or more option selections corresponding to the option menu; based on the determined one or more option selections, generate a user interface at the user device, wherein the user interface includes an arrangement of elements corresponding to one or more of the determined one or more option selections; receive input from a user via the user interface, the input selecting one or more elements corresponding to a subset of the determined one or more option selections; and based on the input received from the user, send a response from the user device to the automated voice menu system via the communication connection, wherein the response is responsive to the audio feedback and indicates a selection of the subset of the determined one or more option selections.

[0149] Some examples of the methods, devices, and non-transitory computer-readable media described herein may further include operations, features, means, or instructions for sending a capability message to the automated voice menu system indicating an ability to generate a user interface at a user device that includes an arrangement of elements corresponding to the determined one or more option selections.

[0150] Some examples of the methods, devices, and non-transitory computer-readable media described herein may further include operations, features, means, or instructions for receiving input from a user via a user interface, causing the user interface to display a second element arrangement corresponding to one or more additional ones of the determined one or more option selections.

[0151] In some examples of the methods, apparatuses, and non-transitory computer-readable media described herein, receiving input from a user may include operations, features, means, or instructions for receiving one of touch input, voice input, expression input, and combinations thereof.

[0152] In some examples of the methods, devices, and non-transitory computer-readable media described herein, sending a response from a user device to the automatic voice menu system may also include operations, features, means, or instructions for sending one or both of a verbal response from the user and a non-verbal response corresponding to one of a touch input, an expression input, and a combination thereof based on the receiving capabilities of the automatic voice menu system.

[0153] Some examples of the methods, apparatus, and non-transitory computer-readable media described herein may further include operations, features, means, or instructions for converting a verbal response from a user into a non-verbal response that corresponds to the verbal response from the user.

[0154] In some examples of the methods, devices, and non-transitory computer-readable media described herein, generating a user interface at a user device that includes an arrangement of elements may also include operations, features, means, or instructions for replacing one or more numbers on a keypad display with corresponding elements of the arrangement of elements.

[0155] Some examples of the methods, apparatus, and non-transitory computer-readable media described herein may further include operations, features, means, or instructions for storing the determined one or more option selections corresponding to the menu of options associated with the automated voice menu system.

[0156] Some examples of the methods, devices, and non-transitory computer-readable media described herein may further include operations, features, means, or instructions for sharing the stored determined one or more option selections associated with the automated voice menu system with one or more additional user devices.

[0157] In some examples of the methods, devices, and non-transitory computer-readable media described herein, generating a user interface including an arrangement of elements at a user device may also include an operation, feature, means, or instruction for opening an application for display on the user device.

[0158] It should be noted that the methods described above describe possible implementations, and that the operations and steps may be rearranged or otherwise modified, and that other implementations are possible. Furthermore, aspects from two or more methods may be combined.

[0159] The descriptions set forth herein in conjunction with the accompanying drawings describe example configurations and do not represent all examples that may be implemented or within the scope of the claims. The term "exemplary" as used herein means "used as an example, instance, or illustration," rather than "preferred" or "superior to other examples." The detailed description includes specific details to provide an understanding of the described techniques. However, these techniques may be practiced without these specific details. In some instances, well-known structures and devices are shown in block diagram form to avoid obscuring the concepts of the examples described.

[0160] In the accompanying figures, similar components or features may have the same reference label. In addition, various components of the same type may be distinguished by following the reference label with a dash and a second label that distinguishes between similar components. If only the first reference label is used in the specification, the description applies to any one of the similar components having the same first reference label, regardless of the second reference label.

[0161] The information and signals described herein may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, and chips referenced in the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or particles, optical fields or particles, or any combination thereof.

[0162] The various illustrative blocks and modules described in conjunction with the disclosure herein may be implemented or executed with a general purpose processor, a DSP, an ASIC, an FPGA or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof, which are designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in an alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices (e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration).

[0163] The functions described herein can be implemented by hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions can be stored on a computer-readable medium or transmitted on a computer-readable medium as one or more instructions or codes. Other examples and implementations are within the scope of the disclosure and the appended claims. For example, due to the nature of software, the above functions can be implemented using software executed by a processor, hardware, firmware, hard wiring, or any combination of these. The features that implement the functions can also be physically located in various locations, including being distributed so that parts of the functions are implemented in different physical locations. In addition, as used herein, including in the claims, the "or" used in the item list (for example, a list of items beginning with a phrase such as "at least one 'or" one or more ') indicates an inclusive list, so that, for example, a list of at least one of A, B, or C means A or B or C or AB or AC or BC or ABC (i.e., A and B and C). In addition, as used herein, the phrase "based on" should not be interpreted as a reference to a closed set of conditions. For example, an exemplary step described as "based on condition A" can be based on both condition A and condition B without departing from the scope of the disclosure. In other words, as used herein, the phrase "based on" should be interpreted in the same manner as the phrase "based at least in part on."

[0164] Computer-readable media include non-transitory computer storage media and communication media, including any media that helps transfer a computer program from one place to another. Non-transitory storage media can be any available media that can be accessed by a general or special computer. As an example and not limitation, non-transitory computer-readable media can include RAM, ROM, electrically erasable programmable read-only memory (EEPROM), compact disc (CD) ROM or other optical disc storage, disk storage or other magnetic storage device, or any other non-transitory medium that can be used to carry or store the required program code device in the form of instructions or data structures and can be accessed by a general or special computer, or a general or special processor. In addition, any connection is properly referred to as a computer-readable medium. For example, if a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL) or wireless technologies such as infrared, radio and microwaves are used to transmit software from a website, server or other remote source, then coaxial cable, fiber optic cable, twisted pair, DSL or wireless technologies such as infrared, radio and microwaves are included in the definition of medium. Disk and disc, as used herein, include CD, laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above are also included within the scope of computer-readable media.

[0165] The description herein is provided to enable those skilled in the art to make or use the disclosure. Various modifications to the disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the scope of the disclosure. Therefore, the disclosure is not limited to the examples and designs described herein, but is intended to conform to the broadest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for communication, include: establishing a communication connection between an automated voice menu system and a user device, wherein the automated voice menu system is configured to generate audio feedback indicative of a menu of options in response to establishing the communication connection between the automated voice menu system and the user device; at the user device, converting the audio feedback indicative of the menu of options into one or more option selections in a visual format, the one or more option selections corresponding to the menu of options; storing the one or more option selections corresponding to the menu of options in association with the automated voice menu system; sharing one or more stored option selections associated with the automated voice menu system with one or more additional user devices; generating, at the user device, a user interface based at least in part on the one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the one or more option selections; receiving input from a user via the user interface, the input selecting one or more of the elements corresponding to a subset of the one or more option selections; and Based at least in part on the received input from the user, a response is sent from the user device to the automated voice menu system via the communication connection, wherein the response is responsive to the audio feedback and indicates a selection of a subset of the one or more option selections.

2. The method according to claim 1, further comprising: include: A capability message is sent to the automated voice menu system indicating an ability to generate, at the user device, the user interface including the arrangement of elements corresponding to the one or more option selections. 3 . The method of claim 1 , wherein receiving the input from the user via the user interface causes the user interface to display a second element arrangement corresponding to an additional one or more of the one or more option selections. The method according to claim 1 , wherein receiving the input from the user comprises receiving one of a touch input, a voice input, an expression input, or a combination thereof.

5. The method according to claim 4, wherein the user device sends a reply to the automatic voice menu system. include: Based on the receiving capability of the automatic voice menu system, one or both of a language response from the user and a non-verbal response corresponding to one of the touch input, the expression input, or a combination thereof are sent.

6. The method according to claim 4, further comprising: include: A verbal response from the user is converted into a non-verbal response corresponding to the verbal response from the user.

7. The method according to claim 1, wherein generating the user interface including the element arrangement at the user device further comprises: include: One or more numbers of the keypad display are replaced with corresponding elements of the element arrangement.

8. The method according to claim 1, wherein generating the user interface including the element arrangement at the user device further comprises: include: An application is opened for display on the user device.

9. A device for communication, comprising a processor, a memory coupled to the processor, and instructions stored in the memory, and the instructions are executable by the processor to cause the device to: establishing a communication connection between an automated voice menu system and a user device, wherein the automated voice menu system is configured to generate audio feedback indicative of a menu of options in response to establishing the communication connection between the automated voice menu system and the user device; at the user device, converting the audio feedback indicative of the menu of options into one or more option selections in a visual format, the one or more option selections corresponding to the menu of options; storing the one or more option selections corresponding to the menu of options in association with the automated voice menu system; sharing one or more stored option selections associated with the automated voice menu system with one or more additional user devices; generating, at the user device, a user interface based at least in part on the one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the one or more option selections; receiving input from a user via the user interface, the input selecting one or more elements corresponding to a subset of the one or more option selections; and Based at least in part on the received input from the user, sending a response from the user device to the automated voice menu system via the communication connection, wherein the response is responsive to the audio feedback and indicates a selection of a subset of the one or more option selections.

10. The apparatus of claim 9, wherein the instructions are further executable by the processor to cause the apparatus to: A capability message is sent to the automated voice menu system, the capability message indicating an ability to generate, at the user device, the user interface including the arrangement of elements corresponding to the one or more option selections.

11. The device of claim 9, wherein receiving the input from the user via the user interface causes the user interface to display a second element arrangement corresponding to additional one or more of the one or more option selections.

12. The device of claim 9, wherein the instruction to receive the input from the user is executable by the processor to cause the device to receive one of a touch input, a voice input, an expression input, or a combination thereof.

13. The device of claim 12, wherein the instructions to send a response from the user device to the automated voice menu system are further executable by the processor to cause the device to: Based on the receiving capability of the automatic voice menu system, one or both of a language response from the user and a non-verbal response corresponding to one of the touch input, the expression input, or a combination thereof are sent.

14. The apparatus of claim 12, wherein the instructions are further executable by the processor to cause the apparatus to: A verbal response from the user is converted into a non-verbal response corresponding to the verbal response from the user.

15. The device of claim 9, wherein the instructions to generate the user interface including the element arrangement at the user device are further executable by the processor to cause the device to: One or more numbers of the keypad display are replaced with corresponding elements of the element arrangement.

16. A non-transitory computer-readable medium storing code for communication, the code comprising instructions executable by a processor to: establishing a communication connection between an automated voice menu system and a user device, wherein the automated voice menu system is configured to generate audio feedback indicative of a menu of options in response to establishing the communication connection between the automated voice menu system and the user device; at the user device, converting the audio feedback indicative of the menu of options into one or more option selections in a visual format, the one or more option selections corresponding to the menu of options; storing the one or more option selections corresponding to the menu of options in association with the automated voice menu system; sharing one or more stored option selections associated with the automated voice menu system with one or more additional user devices; generating, at the user device, a user interface based at least in part on the one or more option selections, wherein the user interface includes an arrangement of elements corresponding to one or more of the one or more option selections; receiving input from a user via the user interface, the input selecting one or more of the elements corresponding to a subset of the one or more option selections; and Based at least in part on the received input from the user, a response is sent from the user device to the automated voice menu system via the communication connection, wherein the response is responsive to the audio feedback and indicates a selection of a subset of the one or more option selections.

Images