That's his thing. He gets angry and turns into Hulk, so he's still angry when he's Hulk. Sometimes they write him as not being Hulk anymore when he calms down. It's a metaphor.

Because if the problem needed brains to solve it, they wouldn't need Hulk. Just Banner.

Within reason.