Reference Kernels

This repo holds reference kernels for the KernelBot which hosts regular competitions on discord.gg/gpumode.

You can see what's going on gpumode.com

Competitions

1. PMPP practice problems
2. AMD $100K kernel competition
3. BioML kernels
4. AMD $100K distributed kernel competition
5. NVIDIA Blackwell NVFP4 competition
6. AMD $1.1M competition
7. Helion IRL hackathon

We also work with universities on hosting the infrastructure for their classes:

• Stanford CS149 assignment 5 kernels
• Tri Dao's Princeton parallel programming class

Contributing New Problems

To add a new problem, create a new folder in the problems/glory directory where you need to add the following files:

• reference.py - This is the PyTorch reference implementation of the problem.
• task.yml - This is the problem specification that will be used to generate test cases for different shapes
• task.py - Specifies the schema of the inputs and outputs for the problem

You can evaluate problems with your own Modal account (they give you a free $30) by borrowing this neat script from @gau-nernst

License

This project is licensed under the June 9 Researcher Reciprocity License.

The license adapts the Open RAIL-S structure and adds one specific use restriction: training, fine-tuning, distillation, synthetic-data generation for training, embedding for training, or otherwise using this project to improve an AI model or AI service requires Researcher Reciprocity.

If you train on it, you let us generate.

Covered AI model and service providers may not use this project while imposing terms that prevent GPU Mode, project contributors, or authorized researchers from generating outputs, evaluating models, benchmarking, publishing research, or exploring their own research ideas on materially equal terms to ordinary users.