Trelis Research Courses

Fine-tuning Multi-modal Video and Text Models

Explore fine-tuning techniques for multi-modal video and text models, covering dataset generation, clipping, querying, and evaluation using IDEFICS 2 and Jupyter Notebooks.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Transformers from Scratch - Part 2: Building and Training a Weather Prediction Model

Dive deep into advanced transformer concepts, exploring encoder-decoder architectures, GPT-4o, and positional embeddings. Apply knowledge to weather prediction and analyze model performance.

• YouTube
• 57 minutes
• On-Demand
• Free Video

Training and Serving Custom Multi-modal Models - IDEFICS 2 and LLaVA Llama 3

Explore advanced multi-modal model fine-tuning and deployment techniques, focusing on IDEFICS 2 and LLaVA Llama 3 for enhanced image-text processing capabilities.

• YouTube
• 38 minutes
• On-Demand
• Free Video

IDEFICS 2 API Endpoint, vLLM vs TGI, and General Fine-tuning Tips

Explore IDEFICS 2 API, vLLM vs TGI, and fine-tuning techniques. Gain insights on deploying multimodal models, transformer architectures, and advanced training methods for AI development.

• YouTube
• 1 hour
• On-Demand
• Free Video

Very Few Parameter Fine-Tuning with ReFT and LoRA

Explore advanced fine-tuning techniques ReFT and LoRA for efficient parameter optimization in transformer models. Learn implementation, comparison, and practical tips for improved model performance.

• YouTube
• 55 minutes
• On-Demand
• Free Video

Tiny Text and Vision Models - Fine-Tuning and API Setup

Explore fine-tuning and API setup for tiny text and vision models, covering multi-modal architectures, LoRA adapters, and deployment strategies for custom APIs.

• YouTube
• 44 minutes
• On-Demand
• Free Video

Full Fine-Tuning vs LoRA and QLoRA - Comparison and Best Practices

Explore full fine-tuning vs (Q)LoRA techniques, comparing VRAM usage, training time, and quality. Learn parameter selection, tips for QLoRA, and step-by-step guidance for TinyLlama and Mistral 7B fine-tuning.

• YouTube
• 53 minutes
• On-Demand
• Free Video

Multi-GPU Fine-tuning with DDP and FSDP

Master multi-GPU fine-tuning techniques using DDP and FSDP. Explore VRAM optimization, distributed training strategies, and practical implementation with code examples and demos.

• YouTube
• 1 hour 8 minutes
• On-Demand
• Free Video

Combined Preference and Supervised Fine-Tuning with ORPO

Explore combined preference and supervised fine-tuning with ORPO. Learn about fine-tuning methods, loss functions, and performance improvements. Includes practical demos and evaluations.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Deploying Serverless Inference Endpoints - Setup and Cost Comparison

Deploy serverless inference endpoints efficiently. Learn setup, use cases, and cost comparisons for API-based machine learning model deployment.

• YouTube
• 20 minutes
• On-Demand
• Free Video

Improved Retrieval Augmented Generation with ALL-SORT - Advanced Techniques

Explore advanced retrieval augmented generation techniques using ALL-SORT for improved LLM-assisted information retrieval, with practical demonstrations and performance evaluations.

• YouTube
• 57 minutes
• On-Demand
• Free Video

Fine-tuning LLMs - Every Step Explained for Memorization Tasks

Explore LLM fine-tuning techniques, from dataset generation to hyperparameter optimization. Learn to overcome challenges like the reversal curse and optimize model performance for specific tasks.

• YouTube
• 47 minutes
• On-Demand
• Free Video

Mistral Large vs GPT-4: Practical Benchmarking and LLM Evaluation

Explore practical benchmarking of Mistral Large vs GPT4. Compare performance, run custom evaluations, and gain insights into LLM capabilities for informed decision-making.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Fine-tuning Optimizations - DoRA, NEFT, LoRA+, and Unsloth

Explore advanced fine-tuning techniques like DoRA, NEFT, LoRA+, and Unsloth to optimize language models. Learn implementation, comparisons, and practical applications through code examples and demonstrations.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Fine-tuning Multi-modal LLaVA Vision and Language Models

Explore advanced techniques for fine-tuning multi-modal vision and language models like LLaVA and IDEFICS. Learn about architectures, data creation, training, and evaluation methods.

• YouTube
• 51 minutes
• On-Demand
• Free Video