Why did Harry look upset when Sirius called him James?

In Order of the Phoenix, why did Harry look shock and upset when
Sirius called him James? Is it because it made him think he was a
bully? Sirius said "nice one James" when James disarmed Snape to bully
him in Hogwart years.