My experience with AI agents, when left to design a system, produce systems that are either:
- very good and simple, because the ideal pattern is represented in training
- simple and not good, with many failure cases
- very complex
They seem bad at working hard to create something simple. They can do a lot of work to create a document 2000 words long, or they can dash out a document 200 words long, but they seem to categorically refuse to work hard to create a document 200 words long. As such, I'm forced to ask them to create long docs which I never read. I then ask them to boil it down. Even then, I'm dissatisfied with the result.