Overview

FireworksLLMService provides access to Fireworks AI’s language models through an OpenAI-compatible interface. It inherits from OpenAILLMService and supports streaming responses, function calling, and context management with optimized inference infrastructure.

Installation

To use Fireworks AI services, install the required dependency:
pip install "pipecat-ai[fireworks]"

Prerequisites

Fireworks AI Account Setup

Before using Fireworks AI LLM services, you need:
  1. Fireworks Account: Sign up at Fireworks AI
  2. API Key: Generate an API key from your account dashboard
  3. Model Selection: Choose from available open-source and proprietary models

Required Environment Variables

  • FIREWORKS_API_KEY: Your Fireworks AI API key for authentication