Device for hybrid orchestration of speech processing units with local and network-based fallback functionality

Abstract

Device for hybrid orchestration of speech processing units with automatic model selection and fallback functionality, characterized in that the device comprises: a) a first speech processing unit that can be operated locally in a computing device; b) at least one second speech processing unit that can communicate with the computing device via a data communication network; c) a routing unit that is coupled to the first and the at least one second speech processing unit and is configured to make a selection between the first and the at least one second speech processing unit for processing a speech processing request based on a request complexity, availability information and latency information;andd) a quality control unit coupled to the routing unit and the first and at least one second speech processing unit, and configured to verify outputs of the selected speech processing unit based on predefined quality criteria.