> - fully containerized for both dev & ci, works the same locally as in ci
That's nice. I heard about Dagger a while ago. I think it would be a bit overkill for my use case, but I definitely need to check it since I didn't include it in my search phase / blog post draft.
I came across many scalable/production-ready tools, but I ended up deciding to go with this more fundamental approach since my projects aren't that complex/large. (And many of these tools prioritize reproducibility over isolation, which is fair, but not quite what I was looking for). That said, I still plan to try many of them anyway hehe
I really like Dagger, definitely recommend adding it to your evaluation candidates. It consolidates a lot of tools and processes into one. We started with replacing Dockerfiles, but now we are also replacing Make. Dagger has made it incredibly easy to iterate and expand. For example, it was a breeze to add in several security scanning tools as we evaluate what we want to purchase. I didn't have to change our CI at all, just write a function per tool. The reason is that I have an internal struct in our Go that holds onto the information during running. It includes the source pre/post build and various stages of containers (base, building, runtime). I can then pass this struct to a function and it can decide what it operates on. Best part is I don't have to tell it to build ahead of time. Dagger is lazy and will determine the dependencies (kind of like make, but better) and perform the required precursor steps when needed.
The Dagger team is also incredibly helpful and responsive
Sure, all it takes to add support for a new service is a small sample of the `.csv` or `.json` file provided by the service--as the ones in the /examples/silo directory. Anyone can submit a request for support with a sample.
I've been logging my listenings on last.fm since 2011 and the idea of adding support for it never crossed my mind lol
Unfortunately, as it seems, last.fm currently does not provide a way for users to download their data other than using the API. I found a website that seems like people use to achieve that, but for now I'd rather support only official files (I think).
I don't have a soundcloud account atm, but I added a TODO to check if they provide a data export option.
That's nice. I heard about Dagger a while ago. I think it would be a bit overkill for my use case, but I definitely need to check it since I didn't include it in my search phase / blog post draft.
I came across many scalable/production-ready tools, but I ended up deciding to go with this more fundamental approach since my projects aren't that complex/large. (And many of these tools prioritize reproducibility over isolation, which is fair, but not quite what I was looking for). That said, I still plan to try many of them anyway hehe