Prime Minister Anthony Albanese would be “comfortable” if embattled Senator David Van didn’t come back to parliament after allegations of misconduct were made against him.

Senator Van resigned from the Liberal Party following allegations made by independent senator Lidia Thorpe and former Liberal senator Amanda Stoker.

He has denied all the allegations raised against him.

Claims of inappropriate conduct have also been made by a third unnamed person.

Asked if he had heard of bad behaviour, Mr Albanese said “no”.

“I’d never heard of him really … and I’d be very comfortable if he never returned to the Senate,” he told KIIS FM Melbourne on Tuesday.

Mr Albanese said he was “very concerned” women wouldn’t want to come forward with their own experiences of sexual assault because of how allegations made by Brittany Higgins had been handled over the past week.

“Some of the commentary and leaking of personal text messages and other stuff that’s gone on has been really regrettable … as well as not being legal some of it as well,” he said.

“People need to be treated with respect, every woman should feel safe at work.It’s as simple as that, and our workplace hasn’t been good enough in the past.”

Opposition Leader Peter Dutton has called on Senator Van to resign from parliament, but the Victorian senator quit the party before a committee could meet to discuss the allegations against him.

Mr Dutton told colleagues the decision to expel the senator from the party room had been “difficult” but given the allegations his position was “untenable”.

He hoped it sent a “very clear message” about what was expected from Liberal members of federal parliament.

The opposition leader said MPs should maintain respect, treat one another equally and take care of each other. 

In a letter to Victorian Liberal Party president Greg Mirabella, Senator Van said he could not remain a member of a party that “tramples upon the very premise on which our justice system is predicated”.

By Tess Ikonomou in Canberra