How to setup Autogen with Lm Studio's Open Source Free LLMs: Multi-Agent Framework w/o API Costs

8 months ago
153

Provided to Rumble courtesy of 🉐 "The Dojo"

Download my free AI Checklist for Businesses & Content Creators: Boost Efficiency & Creativity! - https://jonathancoates.net/ai-checklist/

Hey whatsup guys, Jonathan here, & today's AI exploration is all about maximizing your automation prowess.

In my latest video, I revisit the realm of autonomous agents within a multi-agent framework, courtesy of Microsoft.

Remember the open-ended potential I shared in that training?

Now, let's talk about cost-efficient utilization.

Enter LM Studio's Open Source Free LLMs with Autogen—an ingenious solution that liberates you from API costs.

No more worrying about iterations racking up expenses!

The key lies in harnessing LM Studio's local models, avoiding the API bottleneck.

To embark on this journey, start by downloading LM Studio tailored to your hardware—Mac, Linux, or Windows.

Consult my previous video for Autogen setup guidance.

Unlike my earlier demonstration using OpenAI's API key, today, I reveal the path to autonomy without the financial burden.

Navigate to the app.py folder and make strategic adjustments.

Use Hugging Face for a treasure trove of language models, sign up for free, and you will lay witness to a staggering array of 424,000 open-source models.

In my current setup, I'm leveraging Mistral Instruct

With LM Studio, it's not just about the what but the how.

Follow my steps to configure your autogen for local model usage.

By using LM Studio's server configurations, you'll seamlessly integrate local models into your AI ecosystem.

No more API key constraints—just a smoother, cost-effective workflow.

Stay tuned for more insights, including setting up a web UI with autogen!

I hope you enjoy the video!

https://jonathancoates.net/autogen-cr...

=== Tools & Resources Mentioned in the Video ===

Code Template for App.py File - https://docs.google.com/document/d/1X...

Lm Studio - https://lmstudio.ai/

Hugging Face - https://huggingface.co/

Autogen - https://github.com/microsoft/autogen

Autogen Getting Started Guide - https://microsoft.github.io/autogen/d...

Git - https://git-scm.com/downloads

Python - https://www.python.org/downloads/

Visual Studio Code - https://code.visualstudio.com/

Microsoft Build Studio - https://visualstudio.microsoft.com/vi...

Paypal Donations - https://paypal.me/joncoates89

Donate via Cash App - $joncoates89

Loading comments...