I actually found a project which does almost exactly what you've described:

https://github.com/jdrbc/podly_pure_podcasts