AIs: LangGraph, LangChain, Ollama
AIs: LangGraph, LangChain, Ollama
LangGraph is the orchestration harness for LangChain agents.
Ollama is an open-source tool and framework designed to run, manage, and orchestrate various LLMs locally. Ollama allows you to download and run dozens of different open-weight LLMs, including Meta's Llama, Alibaba's Qwen, Google's Gemma, and Microsoft's Phi. Ollama requires LLMs to be quantized into the GGUF format (the format used by llama.cpp) and configured with a Modelfile. Ollama does not fine-tune LLMs.
LLMs - usually in safeTensor or .gguf file format. The .gguf file format is for local use.
Fine-Tuning => LLaMA-Factory is currently the most popular tool for local fine-tuning, because it provides a complete Web UI. You do not need to write any code to use it. It supports exporting trained models directly into the GGUF format needed for Ollama.
Comments
Post a Comment