ruby_llm

Add to your Gemfile:

gem 'ruby_llm'

Then bundle install.

Configure your API keys:

# config/initializers/ruby_llm.rb
RubyLLM.configure do |config|
  config.openai_api_key = ENV['OPENAI_API_KEY']
end

• Chat: Conversational AI with RubyLLM.chat
• Vision: Analyze images and videos
• Audio: Transcribe speech with RubyLLM.transcribe and generate it with RubyLLM.speak
• Documents: Extract from PDFs, CSVs, JSON, any file type
• Image generation: Create images with RubyLLM.paint
• Embeddings: Generate embeddings with RubyLLM.embed
• Moderation: Content safety with RubyLLM.moderate
• Tools: Let AI call your Ruby methods
• Agents: Reusable assistants with RubyLLM::Agent
• Structured output: JSON schemas that just work
• Streaming: Real-time responses with blocks
• Rails: ActiveRecord integration with acts_as_chat
• Async: Fiber-based concurrency
• Model registry: 800+ models with capability detection and pricing
• Extended thinking: Control, view, and persist model deliberation
• Citations: Normalized source citations from documents, search, and grounding
• Batches: Provider-side batch processing at half price with RubyLLM.batch
• Providers: OpenAI, xAI, Anthropic, Gemini, VertexAI, Bedrock, DeepSeek, Mistral, Ollama, OpenRouter, Perplexity, GPUStack, and any OpenAI-compatible API

# Define an agent with instructions + tools
class WeatherAssistant < RubyLLM::Agent
  model "gpt-5-nano"
  instructions "Be concise and always use tools for weather."
  tools Weather
end

WeatherAssistant.new.ask "What's the weather in Berlin?"

# Get structured output
class ProductSchema < RubyLLM::Schema
  string :name
  number :price
  array :features do
    string
  end
end

response = chat.with_schema(ProductSchema).ask "Analyze this product", with: "product.txt"