FreeBSD.software
Home/misc/py311-litellm

py311-litellm

1.80.0

Call all LLM APIs using the OpenAI format

Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, etc.] LiteLLM manages: - Translate inputs to provider's completion, embedding, and image_generation endpoints - Consistent output, text responses will always be available at ['choices'][0]['message']['content'] - Retry/fallback logic across multiple deployments (e.g. Azure/OpenAI) - Router - Track spend & set budgets per project OpenAI Proxy Server

Origin: misc/py-litellm
Category: misc
Size: 57.3MiB
License: MIT
Maintainer: tagattie@FreeBSD.org
Dependencies: 14 packages
Required by: 1 packages
$pkg install py311-litellm

Dependencies (14)

Required By (1 packages)

More in misc