Sambanova

The Sambanova model provides access to Sambanova’s language models.

Parameters

Parameter	Type	Default	Description
id	str	"Meta-Llama-3.1-8B-Instruct"	The id of the SambaNova model to use
name	str	"SambaNova"	The name of the model
provider	str	"SambaNova"	The provider of the model
api_key	Optional[str]	None	The API key for SambaNova (defaults to SAMBANOVA_API_KEY env var)
base_url	str	"https://api.sambanova.ai/v1"	The base URL for the SambaNova API
retries	int	0	Number of retries to attempt before raising a ModelProviderError
delay_between_retries	int	1	Delay between retries, in seconds
exponential_backoff	bool	False	If True, the delay between retries is doubled each time

SambaNova extends the OpenAI-compatible interface and supports most parameters from OpenAI.