"At times they were just too good for us and that's the first time we've been beaten convincingly. I thought the final scoreline was harsh."
Groves said Tony Gallimore's 60th minute red-card changed the game but said the way the side tackled was a sign of his players' commitment.
"The players never stopped running and worked hard but I think there was a little bit of frustration with some of the tackles. That's just the players showing their commitment.
"There were one or two challenges in the game that were close and the players have to channel their aggression in the right manner.
"But, without saying too much, some of the decisions were a little bit frustrating at times."
"The Gallimore incident changed the game. Once we had 10 men we had a little spell of pressure but it made us vulnerable to the counter attack. They are a decent side.
"I didn't see the sending off and I'll have to watch the video before I make my mind up about it."
Groves gave away a penalty for the second time in a week but felt again the decision was harsh: "I felt I was handed off first and the ref saw it differently. If I meant to bring him down, if it was cynical, then fair enough. I don't think that was the case."
The defeat against Forest leaves Town firmly rooted to the foot of the 1st Division table and Saturday's game away at fellow strugglers Brighton is now a real six-pointer even at this early stage of the season.