In the project I am working on I use 5 LLM models
- 3 evaluate a task
- 1 implements task
- 1 checks the work and send back to the implementer
What I have found is that anything done with a single family of models is going to be, in my opinion, far less quality than something done with at least a second family of models checking the work. In this particular case it also sounds like there was very little human oversight. Even it works, it likely will have lots of decisions which will come back to haunt the developer, or the users of the software.