Tools and Plugins
Note: A new approach has been devised to revamp the handling of tools and plugins from scratch. The plan is to prioritize implementation for Assistants initially, followed by creating a new agent system that seamlessly integrates with various endpoints such as Anthropic, Google, and others.
Setup Instructions:
Azure AI Search
Google Search
Stable Diffusion
Wolfram|Alpha
DALL-E
- You just need an OpenAI key, and it’s made distinct from your main API key to make Chats but it can be the same one
Zapier
- You need a Zapier account. Get your API key from here after you’ve made an account
- Create allowed actions - Follow step 3 in this Start Here guide from Zapier
- ⚠️ NOTE: zapier is known to be finicky with certain actions. I found that writing email drafts is probably the best use of it
- Create allowed actions - Follow step 3 in this Start Here guide from Zapier
Browser/Scraper
- This is not to be confused with ‘browsing’ on chat.openai.com (which is technically a plugin suite or multiple plugins)
- This plugin uses OpenAI embeddings so an OpenAI key is necessary, similar to DALL-E, and it’s made distinct from your main API key to make Chats but it can be the same one
- This plugin will simply scrape html, and will not work with dynamic Javascript pages as that would require a more involved solution
- A better solution for ‘browsing’ is planned but can’t guarantuee when
- This plugin is best used in combination with google so it doesn’t hallucinate webpages to visit
SerpAPI
- An alternative to Google search but not as performant in my opinion
- You can get an API key here: https://serpapi.com/dashboard
- For free tier, you are limited to 100 queries/month
- With google, you are limited to 100/day for free, which is a better deal, and any after may cost you a few pennies