Closing Bank Account?

I dont want to maintain my Saving account at one bank. Can withdraw all balance money and then never transact with that bank? In the sense, I dont want to do the formalities of closing an account. Will that affect my credit ranking?