Sir Ed Davey says Prince Andrew should be give evidence to a select committee inquiry about Crown finances.