Almost 40 send a letter to Sir Keir Starmer voicing concerns that the proposal will "limit a fundamental right".