Well actually since you don't have a written contract and you were not legally allowed to rent out the basement. You would have to keep it a quiet affair as you can't afford to let the authorities know. The best thing would be to talk it over with the tenant and find a way through mutual discussion. You can throw out his stuff however that is not recommended keeping in view your legal situation.
