Just archive Files, and Export DB.
Extract those files, open configuration.php of Joomla and change tmp, log file path, and DB access details.
Create new DB on the new server and import the DB you have.
You are all set on the new server. it's quick and simple. No fuss.