Notice he only says it in the diary room to try and make his fellow 'competitors' look like they're picking on poor little Ben and BB plays along by playing his fake shit all the time.
Yep! And I honestly think the other HMs are genuinely nice to Ben and wouldn't want to harm him...