How do people know that IP adress belongs to VPN?

It seems that many servers know that I use VPN. They either block me completly or make me answer CAPTHA etc.

I want to use VPN but seems that many host dont want their customers to use VPN. How do they know that I use VPN? And how could I use VPN without people knowing about it?