That's his thing. He gets angry and turns into Hulk, so he's still angry when he's Hulk. Sometimes they write him as not being Hulk anymore when he calms down. It's a metaphor.