I was checking a TFS Team Project that I had created and found that the name of the project was misspelled. On checking the Net found that you cannot rename a Team project. This might be taken up in TFS 2010. No gaurantees though.
Only option, delete TFS Team Project and create a new one.