Easiest way is to not give them access to the user functions.
However, you should be able to add yourself back in from you partner portal. Where the users are listed, there is an 'Add Me to Site' link.
Brad has the best option though. Hide what the client does not need to see using the permisions in the roles.
It is way less hassle to do this rather then have to deal with when they do break something etc.