The lack of female toilets is "a critical issue" that could affect the performance of duties, the MPs say.