The UK gained new power to take back control of borders but has 'wilfully failed to use it'