Benchmarking Courses and Certifications

How to Design Effective Training Programs

3065 ratings at Udemy

Your practical A-Z guide based on best-practice standards, including downloadable, customisable templates!

• Udemy
• 1 hour 12 minutes
• On-Demand
• Paid Course

SQL Server: Benchmarking and Baselining

233 ratings at Pluralsight

Learn how to benchmark a SQL Server instance and create a performance baseline to compare against for simplified troubleshooting, applicable for developers, DBAs, and anyone who uses SQL Server from SQL Server 2005 onwards

• Pluralsight
• 3 hours 21 minutes
• On-Demand
• Free Trial Available

Cuentas nacionales trimestrales e Indicadores económicos de alta frecuencia

Aprenda a compilar cuentas nacionales trimestrales (CNT) de alta calidad y oportunas, así como indicadores de alta frecuencia de actividad económica (IAFAE).

• edX
• 6 weeks, 3-4 hours a week
• On-Demand
• Free Online Course (Audit)

Association for Computing Machinery (ACM)

Revisiting Knowledge Graph Completion From a Practical Perspective - Danai Koutra

Explore practical aspects of knowledge graph completion, covering construction, calibration, open-world assumptions, and human-AI collaboration for improved link prediction and triple classification.

• YouTube
• 43 minutes
• On-Demand
• Free Video

CNCF [Cloud Native Computing Foundation]

Maximizing M3 - Pushing Performance Boundaries in a Distributed Metrics Engine at Global Scale

Explore performance optimizations in M3, an open-source distributed metrics engine, to handle billions of data points per second. Learn about identifying bottlenecks and implementing solutions for improved efficiency.

• YouTube
• 56 minutes
• On-Demand
• Free Video

1littlecoder

Evaluating AI Agents - The Right Approach with TOOLSANDBOX

Explore TOOLSANDBOX: a comprehensive framework for evaluating AI agents with stateful tools, user simulation, and dynamic assessment strategies for enhanced performance analysis.

• YouTube
• 16 minutes
• On-Demand
• Free Video

UofU Data Science

Taskification and Valid Benchmarks in Data Science

Explore the concept of taskification and its role in creating valid benchmarks for data science applications, focusing on practical implementation and evaluation methods.

• YouTube
• 1 hour 13 minutes
• On-Demand
• Free Video

Trelis Research

Mistral Large vs GPT-4: Practical Benchmarking and LLM Evaluation

Explore practical benchmarking of Mistral Large vs GPT4. Compare performance, run custom evaluations, and gain insights into LLM capabilities for informed decision-making.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Data Centric

Comparing Open Source AI Agents to Perplexity AI - Testing Codestral, GPT4o, and Mixtral

Benchmark open-source AI models against Perplexity AI using a custom web search agent. Compare Codestral, Mixtral, and GPT4o performance in handling complex queries and multi-hop questions.

• YouTube
• 1 hour 37 minutes
• On-Demand
• Free Video

SNIAVideo

Benchmarking Storage with AI Workloads - Performance Analysis and Optimization

Explore how storage systems impact AI/ML workload performance through comprehensive benchmarking analysis, focusing on data ingestion, training patterns, and inference workload optimization.

• YouTube
• 46 minutes
• On-Demand
• Free Video

SNIAVideo

SPEC SFS2014 Within Emerald Power Efficiency Testing - Part 1

Discover the fundamentals of SPEC SFS2014 implementation within the SNIA Emerald framework, exploring key concepts and technical specifications for storage performance evaluation.

• YouTube
• 44 minutes
• On-Demand
• Free Video

ACM SIGPLAN

ValBench: Benchmarking Exact Value Analysis

Explore ValBench, a comprehensive benchmark suite for evaluating value analysis tools in Java and Android. Learn about its test cases, evaluation framework, and insights into current challenges in program analysis.

• YouTube
• 18 minutes
• On-Demand
• Free Video

Dave's Garage

Solving Primes to One Trillion - PDP-11 vs Threadripper Performance Comparison

Explore prime number computation up to one trillion and compare performance between PDP-11 and Threadripper processors using a custom prime sieve algorithm.

• YouTube
• 17 minutes
• On-Demand
• Free Video

Anyscale

Chatbot Arena: Evaluating AI Models Through Human Preferences

Explore UC Berkeley's Chatbot Arena platform and its innovative approach to evaluating AI models through human preferences, pairwise comparisons, and crowdsourced data from 1.7M+ user votes.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

AppWorld: Reliable Evaluation of Interactive Agents in a World of Apps and People

Explore AppWorld's innovative framework for evaluating AI agents' performance in everyday digital tasks across popular apps, highlighting challenges and future directions for reliable AI systems.

• YouTube
• 1 hour 9 minutes
• On-Demand
• Free Video