which service provider give cheap domain?



Almost all of them, if you're referring to hosting companies. You're better of having hosting and domain registrar separate, so your host doesn't have the ability to steal your domain name (this is a fishy area).

If you just want to buy a cheap domain, get a non-tld from Namecheap for $2.99. Depending on the name you're looking for you can sometimes get tlds for $2.99 for the first year.
 
Dyandot is the best, i am using their hosting for last 3 years. I am satisfied with their services