Economic Freedom Fighters leader Julius Malema on Thursday asked Speaker Baleka Mbete to show him which rule prevented him from asking questions during the president's state of the nation address.
"Point us the rule that gives you power to deny us this," he said.
"I'm not working for you, I'm not going to leave."
Mbete told Malema that she would not allow any other points of order to be raised.
Mbete then told EFF Floyd Shivambu to leave the chamber after he also tried to ask a question.
"I now have to ask that you leave the chamber, because it is clear that you are not prepared to cooperate with us," she said.
EFF national spokesman Mbuyiseni Ndlozi told Mbete she was not a bishop.
"I'm appealing to your conscience honourable speaker," he added.
Mbete then called on protection services to remove EFF MPs from the room.
EFF MPs were escorted from the House by security personnel. It's not clear if they were police members or parliamentary security personnel.
Just R20 for the first month. Support independent journalism by subscribing to our digital news package. 