Can your broadband provider charge you for leaving?

I am thinking of changing broadband, from orange to BT. I had a letter through the post with the MAC code saying i may need to pay the rest of the contract length as a fee, and seeing as i have been with them for 5 years i would of thought that they cant charge for leaving?