Van der Westhuizen admits in his book Joost: The Man in the Mirror, that he had taken drugs and had "sexual relations" with a woman who was not his wife.
Earlier this year, he vehemently denied that it was him in a 29-minute sex-and-drugs video tape released by a celebrity magazine in February.
"My wife is taking it very tough. I could still lose her. I could still lose my family," said Joost this morning during an interview on Talk Radio 702.
"I'm going to fight for it (my family)," said Joost.
He said that he had "no excuses" for his behaviour but also took a swipe at those who had tried to blackmail him and "some media" that had "paid these people" for the story.
The former Springbok scrumhalf also told John Robbie of Talk Radio 702 that he had never had a drug problem and that he never took drugs when he was still playing rugby.
chris van der merwe