Open Source LLMs with ChatGPT Online Course

Open Source LLMs with ChatGPT Online Course

Explore the exciting world of Large Language Models (LLMs) in this hands-on course, covering both no-code and low-code solutions with Python. Learn to set up software for running open-source models like Google’s Gemma:7b and Llama3 locally, without internet access. Advance your skills by streaming responses from LLMs, integrating with the OpenAI API, and using function calling in ChatGPT models. Gain practical experience fetching responses in batch and streaming modes, and build a small web frontend with Streamlit for your LLM API. By the end, you’ll be able to run and harness the full potential of open-source LLMs locally.

Who should take this course?

This course is designed for AI developers, machine learning enthusiasts, and researchers who want to explore and work with open-source large language models alongside ChatGPT. It’s also ideal for professionals aiming to build custom AI solutions using open-source tools and frameworks.

What you will learn

• Configure and run local LLMs
• Use local server API endpoints for open-source models
• Integrate and utilize OpenAI API with Python
• Implement low-code solutions for streaming ChatGPT responses
• Operate the llama3 model using Python web interfaces
• Develop a small web frontend for streaming LLM APIs using Streamlit
• Experiment with various open-source models, understanding their capabilities and limitations

Course Outline

Setting Up and Exploring Local LLMs

• Download the required Software for the course
• No code chat with open-source models locally for free
• Running open-source models without code locally in the command line
• Openai API preparations
• Download python and set env variable in your code editor
• Exploring the local Server API endpoint of our open-source model
• A different way to use local server API endpoint for open source LLMs with Python

Advanced Usage and API Integrations

• Open Source LLM streaming responses locally with Python API calls
• Exploring the official openai API endpoint using Python
• Streaming openai chatgpt responses with Python low code
• Introduction to function calling with ChatGPT models in Python
• Open source llama3 model with web interface in Python
• Running No code open source LLMs locally