Both benches were warned after the fourth-inning stand-off