So I noticed after installing that the original admin account I created during install was assigned to the Registered user group as the primary, and then the admin and moderating as a secondary user group. Why would it just not have me as an admin as the primary?
XenForo permissions are designed so that users are in multiple user groups. All members including admins and moderators should have the Registered group as their primary user group. See this resource for details.