Migration Guide

January 25, 20248 min read

Migrate from Anyscale to ParrotRouter

Seamlessly migrate from Anyscale to ParrotRouter in 3 simple steps. Keep your favorite models while gaining access to 100+ additional LLMs with better pricing.

Migration Progress

Track your migration from Anyscale to ParrotRouter

Better Pricing

Save up to 40% on your LLM costs with ParrotRouter's competitive pricing and smart routing.

Llama 2 70B-35%

Mixtral 8x7B-42%

CodeLlama 34B-38%

100+ Models

Access all Anyscale models plus 100+ additional LLMs from OpenAI, Anthropic, Google, and more.

GPT-4

Claude 3

Gemini Pro

Llama 3

Mistral

Drop-in Compatible

OpenAI-compatible API means minimal code changes. Most migrations take less than 5 minutes.

Same API structure

Compatible SDKs

Streaming support

Migration Steps

Follow these simple steps to migrate from Anyscale to ParrotRouter

Get Your ParrotRouter API Key

Update Your Code

Change the base URL and update model names. That's it!

base_url = "https://api.parrotrouter.com/v1"

Test and Deploy

Test with our free tier, then deploy with confidence. We offer 99.9% uptime SLA.

Code Migration Examples

See how easy it is to migrate your existing code

Anyscale (Before)

Current

import openai

# Anyscale setup
client = openai.OpenAI(
    base_url="https://api.endpoints.anyscale.com/v1",
    api_key="YOUR_ANYSCALE_API_KEY"
)

response = client.chat.completions.create(
    model="meta-llama/Llama-2-70b-chat-hf",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Hello, how are you?"}
    ],
    temperature=0.7
)

print(response.choices[0].message.content)

ParrotRouter (After)

Migrated

import openai

# ParrotRouter setup - minimal changes needed!
client = openai.OpenAI(
    base_url="https://api.parrotrouter.com/v1",
    api_key="YOUR_PARROTROUTER_API_KEY"
)

response = client.chat.completions.create(
    model="meta-llama/llama-2-70b-chat",  # Updated model name
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Hello, how are you?"}
    ],
    temperature=0.7
)

print(response.choices[0].message.content)

Key Changes

Base URL: api.endpoints.anyscale.com → api.parrotrouter.com
Model names: Remove -hf suffix from model names
API Key: Use your new ParrotRouter API key

Model Name Mapping

Find your Anyscale models in ParrotRouter

Anyscale Model	ParrotRouter Model	Status
`meta-llama/Llama-2-7b-chat-hf`	`meta-llama/llama-2-7b-chat`	Available
`meta-llama/Llama-2-13b-chat-hf`	`meta-llama/llama-2-13b-chat`	Available
`meta-llama/Llama-2-70b-chat-hf`	`meta-llama/llama-2-70b-chat`	Available
`codellama/CodeLlama-34b-Instruct-hf`	`meta-llama/codellama-34b-instruct`	Available
`mistralai/Mistral-7B-Instruct-v0.1`	`mistralai/mistral-7b-instruct`	Available
`mistralai/Mixtral-8x7B-Instruct-v0.1`	`mistralai/mixtral-8x7b-instruct`	Available

Plus: Access 100+ additional models including GPT-4, Claude 3, Gemini Pro, and more!

Advanced Migration Features

Take advantage of ParrotRouter's advanced capabilities

Automatic Fallbacks

Set up automatic fallbacks to ensure 100% uptime. If one model is unavailable, ParrotRouter automatically routes to an alternative.

{
  "model": "meta-llama/llama-2-70b-chat",
  "fallback_models": [
    "meta-llama/llama-2-13b-chat",
    "mistralai/mixtral-8x7b-instruct"
  ]
}

Cost Controls

Set spending limits and get alerts before reaching them. Perfect for managing budgets across teams.

{
  "max_cost_per_request": 0.50,
  "monthly_budget": 1000,
  "alert_threshold": 0.8
}

Response Caching

Automatically cache responses to reduce costs and latency for repeated queries.

{
  "cache": true,
  "cache_ttl": 3600,
  "cache_key": "custom-key"
}

Load Balancing

Distribute requests across multiple models or providers for optimal performance.

{
  "routing": "least-latency",
  "providers": ["openai", "anthropic"],
  "max_retries": 3
}

Frequently Asked Questions

Will my existing code work?

Yes! ParrotRouter uses the same OpenAI-compatible API format as Anyscale. You'll only need to update the base URL and model names.

What about rate limits?

ParrotRouter offers generous rate limits that scale with your usage. Most users see 2-3x higher limits compared to Anyscale.

Can I use both services during migration?

Absolutely! Many teams run both services in parallel during migration. You can gradually move traffic to ParrotRouter.

Is there migration support?

Yes! Our team provides free migration assistance for enterprise customers. Contact us at support@parrotrouter.com.

Ready to Migrate?

Join thousands of developers who've already migrated to ParrotRouter for better pricing, more models, and superior reliability.

No credit card required • $5 free credits • Migration support included

References

[1] Anyscale. "Anyscale Endpoints Documentation" (2024)
[2] ParrotRouter. "API Reference" (2024)
[3] ParrotRouter. "Migration Best Practices" (2024)