Model Evaluation Courses and Certifications

Deep Dive into Regression and Classification Metrics

Master essential machine learning metrics for evaluating regression and classification models, from basic error measurements to advanced ROC curves and confusion matrices.

• CodeSignal
• On-Demand
• Free Certificate

Model Evaluation and Optimization

Master advanced techniques for evaluating and optimizing regression models, from cross-validation to hyperparameter tuning and regularization methods for enhanced predictive accuracy.

• CodeSignal
• On-Demand
• Free Certificate

Yannic Kilcher

BLEURT - Learning Robust Metrics for Text Generation

Explora BLEURT, una métrica de evaluación basada en BERT para generación de texto, su preentrenamiento con datos sintéticos y su capacidad de modelar juicios humanos con pocos ejemplos.

• YouTube
• 32 minutes
• On-Demand
• Free Video

DigitalSreeni

Understanding the Training and Validation Loss Curves

Interpret loss curves from neural network training using Wisconsin breast cancer dataset. Explore various scenarios including underfitting and good fit.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Institute for Advanced Study

What Do Our Models Learn? - Aleksander Mądry

Exploring machine learning model behavior, biases in datasets, and challenges in dataset creation and replication for more robust and reliable AI systems.

• YouTube
• 1 hour 28 minutes
• On-Demand
• Free Video

Data Science Dojo

Introduction to Text Analytics with R - Model Metrics

Explore advanced model evaluation techniques, including sensitivity and specificity, feature engineering, and improving model performance beyond accuracy in text analytics using R.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Krish Naik

Evidently AI Tutorial - Open Source ML Models Monitoring and Observability

Learn to monitor and evaluate ML models with Evidently AI, an open-source Python library for data scientists. Explore reports, test suites, and dashboards for continuous model quality assessment.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Yannic Kilcher

Evaluating NLP Models via Contrast Sets

Explore how contrast sets reveal NLP model limitations by exposing systematic gaps in test data, offering insights into true linguistic capabilities and decision boundaries.

• YouTube
• 19 minutes
• On-Demand
• Free Video

Reducing Hallucinations and Evaluating LLMs for Production

Explore techniques to reduce hallucinations and evaluate large language models for production use, covering traditional and modern evaluation methods, underlying causes, and best practices.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Model Building and Evaluation for Data Scientists

Building and evaluating machine learning (ML) models is daunting, but correctly engineered models can provide millions of dollars in value. In this course, you'll learn to build and evaluate these tools, leveraging existing data science knowledge.

• Pluralsight
• 28 minutes
• On-Demand
• Free Trial Available

DevConf

Understanding LLM Benchmark Quality - Who Watches the Watchmen?

Explore LLM benchmarks' effectiveness in measuring model performance. Gain insights into evaluating language models beyond leaderboards for informed decision-making in AI applications.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Discover AI

Performance Evaluation of Open-Source Instruction-Tuned Large Language Models

Explore the latest performance benchmarks and evaluation methodologies for open-source instruction-tuned Large Language Models through comprehensive leaderboard comparisons.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Toronto Machine Learning Series (TMLS)

Validate and Monitor Your AI and Machine Learning Models

Discover techniques for validating and monitoring advanced AI and ML models, ensuring long-term performance and business adoption in various industries.

• YouTube
• 48 minutes
• On-Demand
• Free Video

Unify

Hierarchical Prompting Taxonomy - A Universal Evaluation Framework for Large Language Models

Explore a universal evaluation framework for large language models using Hierarchical Prompting Taxonomy. Gain insights into assessing dataset complexity and model capabilities.

• YouTube
• 1 hour 1 minute
• On-Demand
• Free Video

Neuro Symbolic

Performance Measurement for Machine Learning

Master essential metrics and techniques for evaluating machine learning models, from accuracy assessment to advanced performance measurements in AI applications.

• YouTube
• 11 minutes
• On-Demand
• Free Video