After having a day off work, I decided to play with the code while breaking many things in the process but after a while, I fixed it.
For anyone who is interested, place this code under the "IP Property" code.
<n.if.visitor.is_site_admin>
<then>
<div style="margin-top:.5em">
<img src="/images/user_group.png" class="image16" style="margin:0 1px"/>
<a href="[n.change_user_groups_path/]" target="_top"><t>Add / Remove Groups</t></a>
<img src="/images/user_group.png" class="image16" style="margin:0 1px"/>
<a href="[n.edit_profile_path/]" target="_top"><t>Edit Profille</t></a>
</div>
</then>
</n.if.visitor.is_site_admin>
If you install the Extra Fields and IP script, the Add/Remove Groups and other moderator options don't show. The code provided above fixes it.
Thanks for responding Franklin.