what I really want is the inverse of this: decorate functions in code and have a workflow/pipeline emerge from that.

apparently this actually exists:

https://www.prefect.io

interesting...

nostr:note1gumysnchn7hd35ltx29pvs2wej3xveetqjcgpkfl0ds2vc3txrksznc6ys

Reply to this note

Please Login to reply.

Discussion

I feel like this is pretty much what all code is doing, Prefect just has good marketing.

For defining a DAG type of workflow you may not actually want the full flexibility of a general purpose language. More constraints are better here in my view.

i just want observability and restartability and things like that

https://dagster.io/ is pretty interesting too

I'll try and compare