It's useful for search type problems where the result is relatively compact and verifiable in isolation. I haven't found a way to build production quality software that way in general but for certain kinds of reverse engineering or system optimization problems it's helpful.
Are you talking problems along the lines of Karpathy's autoresearch? Reverse engineering does seem pretty straightforward actually in that use case, but for practical business building work as opposed to hobby projects that's where I'm hitting the wall at the moment.
I haven't looked closely enough at his autoresearch stuff to know how similar it is. From what I have seen the quality of output is directly tied to the quality of the request, a human can only read and understand some finite amount of material in a day, so maintaining enough understanding to ask quality questions becomes the limiting factor. What are the priorities you want to move faster on?
It's useful for search type problems where the result is relatively compact and verifiable in isolation. I haven't found a way to build production quality software that way in general but for certain kinds of reverse engineering or system optimization problems it's helpful.
Are you talking problems along the lines of Karpathy's autoresearch? Reverse engineering does seem pretty straightforward actually in that use case, but for practical business building work as opposed to hobby projects that's where I'm hitting the wall at the moment.
I haven't looked closely enough at his autoresearch stuff to know how similar it is. From what I have seen the quality of output is directly tied to the quality of the request, a human can only read and understand some finite amount of material in a day, so maintaining enough understanding to ask quality questions becomes the limiting factor. What are the priorities you want to move faster on?
For 24/7 agent ops with review in the loop I recommend this: https://aicommander.dev
[flagged]
[flagged]
[flagged]