Best practices for choosing the system hostname during setup

Thanks @shoulders

Should host.mydomain.com have an IP address pointing to the server? If so, should then rather login to the server via host.mydomain.com:10000 or should I use mydomain.com:10000?