Show HN: A CUDA-Generating AI Agent
Hacker News - AI
Jul 9, 2025 23:02
atallahw
1 views
hackernewsaidiscussion
Summary
MakoGenerate is an AI agent that automatically converts PyTorch code into optimized CUDA kernels, iteratively improving performance and correcting errors based on feedback from compilation and validation. Users can customize the process with prompts, documentation, and specific optimization goals, making it a flexible tool for accelerating deep learning workflows. This approach has significant implications for automating and streamlining the development of high-performance AI models on GPU hardware.
MakoGenerate is an AI agent that takes any PyTorch code as input, and writes CUDA kernels for it. You can choose a sample problem or enter in your own PyTorch. It generates CUDA, compiles and validates the results, then uses all of this as feedback into the next generation attempt. If the generated kernel didn’t work, it tries to fix it. If it did work, it tries to make it faster. You can configure the agent with a model/hardware/compute budget. The optional custom prompt section gives you the opportunity to add more context to the agent. You can include specific documentation, tutorials, or examples. You can also identify specific optimization techniques that you would like to see applied. Prompts can be as short as one line, or even multiple pages long. Let me know what you think. Comments URL: https://news.ycombinator.com/item?id=44515598 Points: 2 # Comments: 0