How do you change bank accounts?

I've had a child savings account all my life, but now I want to close that account and open a new savings account at a different bank. What do I literally have to do? Do I take the money out in cheque or cash and give it to the new bank when I open the new account? straightforward answers please. Thanks.