Is the only way to add Contact to my gmail account is to send and invite? if so that sucks. Also how come there isn't a better contact address book that is simple to add new people

You can go to Contacts, and then there is an Add Contact link on the right. Also, when you send emails those people are automatically added as your contacts.