Multimodal transmission of packetized data

Abstract

The invention provides a system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment. A natural language processor component can parse aninput audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.

Description

[0001] Cross References to Related Applications [0002] This application claims U.S. Patent Application No. 15 / 674,838, filed August 11, 2017, entitled "MULTIMODAL TRANSMISSION OF PACKETIZED DATA," and U.S. Patent Application No. Priority to Patent Application No. 15 / 395,703, each of which is hereby incorporated by reference in its entirety for all purposes. Background technique [0003] Sending data to a computing device that is utilizing computing resources may result in excessive packet-based or other network transmission of network traffic data and prevent the computing device from properly processing network traffic data, completing operations related to network traffic data, or responding in a timely manner Web business data. Control corresponding to network transfers of content item objects may be complicated by the large number of content item objects capable of initiating network transfers of network traffic data between computing devices. Contents of the inventio...

AI Technical Summary

Problems solved by technology

[0003] Sending data to a computing device that is utilizing computing resources may cause excessive network traffic data packet-based or otherwise and prevent the computing device from properly processing the network traffic data, completing operations related to the network traffic data, or responding in a timely manner Network business data

Control of network transfers corresponding to content item objects may be complicated by the large number of content item objects capable of initiating network transfers of network traffic data between computing devices

Images