What you'll learn

How to run open source llm models completely local and private

How to run open source llm models like llama3 completely free

How to use the local api endpoints of open source llms in python

How to work with the chatgpt api endpoint in python

How streaming with open source llms and chatgpt works and how to implement it in python

How to run open source LLMs without any coding free locally and private

Requirements

Python knowledge for the low coding part is helpful but not necessaril required

To follow along with the openai ChatGPT part there is a sign up and a $5 credit payment required (credit card)

All other open source models and software is completely free

Description

"In today's digital age, you're likely familiar with ChatGPT - a name synonymous with powerful language models.Welcome to the captivating world of Large Language Models (LLMs)!This course takes you on an exploratory journey through the LLM landscape, no code as well as low code powered by Python. We delve into not only open-source models but also the official ChatGPT API.Utilizing free additional software, we enable the operation of these models locally without the need for an internet connection. This allows you to experiment with various models, both with and without coding (please note the hardware requirements).Discover how some open-source models, like Google’s Gemma:7b or Llama3, can deliver astonishing results. We also examine the industry leader, OpenAI, and its efficient GPT models (ChatGPT), which not only promise top-notch performance but are also cost-effective (see course prerequisites for a starting credit of $5).We'll familiarize you with fetching responses in both batch and streaming modes.As a grand finale, we'll jointly develop a small web frontend (using Streamlit) for our streaming LLM API.No prior experience is required, though basic Python knowledge is helpful. This course is tailored for beginners and includes both low-code (minimal Python coding) and no-code options.Are you ready to dive into the exciting world of Artificial Intelligence and explore the capabilities of LLMs? Join us on this exhilarating journey and gain valuable insights. More details are available in the course prerequisites."

Overview

Section 1: Introduction

Lecture 1 1 Download the required Software for the course

Lecture 2 Here are the course files to download for you

Lecture 3 2 No code chat with open source models locally for free

Lecture 4 3 Running open source models without code locally in the command line

Lecture 5 4 Openai API preparations

Lecture 6 5 Download python and set env variable in your code editor

Lecture 7 6 Exploring the local Server API endpoint of our open source model

Lecture 8 7 A different way to use local server api endpoint for open source llms with pyt

Lecture 9 8 Open Source LLM streaming responses locally with python api calls

Lecture 10 9 Exploring the official openai api endpoint using python

Lecture 11 10 Streaming openai chatgpt responses with python low code

Lecture 12 11 Introduction to function calling with ChatGPT models in python

Lecture 13 12 Open source llama3 model with web interface in python

Lecture 14 13 Running No code open source llms locally

Everyone interested in running open source llms locally,Everyone interested in running open source llms private,Everyone interested in running open source llms completly free,Everyone interested in getting started with low code (a little bit of python) API endpoints of LLMs,Everyone interested in running no code LLMs locally