MuleSoft Whisperer Connector Overview
What is MuleSoft Whisperer Connector?
MuleSoft Whisperer is a custom connector to provide MuleSoft users access to OpenAIs whisper model and whisper local models.
Features
The MuleSoft Whisperer connector offers 2 operations:
- Speech-to-Text
- Text-to-Speech
Supported Operations by Providers
Not all the operations are supported by each model provider. The following table provides a detailed view of the supported operations.
| Name | Speech to Text | Text to Speech |
|---|---|---|
| Whisperer JNI (opens in a new tab) | ✅ | ❌ |
| OpenAI (opens in a new tab) | ✅ | ✅ |
Supported Deployment Options by Providers
Whisper JNI is a java wrapper around the whisper.cpp library, which is a C++ implementation of the Whisper model. It allows you to run the Whisper model locally on your machine without needing an internet connection.
Considering the nature of Cloudhub and Cloudhub 2.0, it is not possible to run Whisper JNI on these platforms. The cause is the lack of the required system dependencies that cannot be easily installed in a managed environment.
Additional Integrations
MuleSoft Whisperer Connector integrates seamlessly with other MAC Projects AI Connectors and the MuleSoft ecosystem, offering enhanced functionalities.