Street Twin Rattles

I have a rattle with my street twin that has occurred since I had it rebuilt. The rattle sounds like the car is going to fall apart, it is that loud. When I remove the tranny and just have the clutch bolted to the engine there is no rattle when I start the car. As soon as I install the tranny the rattle shows up, it happens at idle, in gear, out of gear, clutch pushed in, clutch out. I had my transmission freshly rebuild with new front bearings and seals so I don't believe it's a transmission problem, but am not totally sure.

I am kind of leaning toward the pilot bushing, throwout bearing or clutch fork.

If it was the throwout bearing would that make the same rattle without the transmission in place?

Just read somewhere that the pilot bearing is the cause for most M6 rattles...think it was a quote from SLP...But don't trust me I have an A4;)
--Alan