In PowerShell v.2, remote access is available only to users who hold local administrator privileges. So, even if you do have appropriate remote access to a machine, you cannot remotely access the system if you are not an Admin. This is not a technical limitation, though, just a safe default. You should use this line to change it:
Set-PSSessionConfiguration -Name Microsoft.PowerShell -showSecurityDescriptorUI