Test Time Compute: Verifiers and Parallel Sampling - Part 2

Test Time Compute: Verifiers and Parallel Sampling - Part 2

Trelis Research via YouTube Direct link

Resources

21 of 21

21 of 21

Resources

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Test Time Compute: Verifiers and Parallel Sampling - Part 2

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Sampling and Verification
  2. 2 Training Compute vs Test Time Compute
  3. 3 Part 1 Recap: Sampling and Chain of Thought
  4. 4 Video Overview: Parallel Sampling and Filtering with Verifiers
  5. 5 How to sample multiple answers in parallel
  6. 6 Verifier Methods
  7. 7 Improving verifiers with fine-tuning or prompt optimisation
  8. 8 Output verifiers versus process verifiers
  9. 9 Majority Voting and Monte Carlo MCTS
  10. 10 Notebook Setup - Trelis.com/advanced-inference
  11. 11 Installation of vLLM with guided decoding
  12. 12 Loading Llama 3.2 1B as opposed to 3B in Part 1
  13. 13 Baseline Single-shot approach
  14. 14 Parallel sampling approach Pass@n / perfect verifier
  15. 15 Parallel sampling with a voting verifier using vLLM guided decoding
  16. 16 Prompt optimisation for verifiers
  17. 17 Parallel sampling with a scoring verifier 1-10
  18. 18 Parallel sampling with a binary true/false scoring verifier
  19. 19 Llama 3.2 1B Results
  20. 20 Literature Review Let’s Verify Step by Step, Large Language Monkeys, Are more LLM calls all you need? Tree of Thought
  21. 21 Resources

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.