Obviously a shortened version of "you're crazy." Meaning: 1. Why that is just silly. 2. That's another stupid idea from you. 3. Hello, I'm with crazy over here. 4. You just plain crazy.
Lindsey insisted that Scott were the velvet jumper, to which he replied, "you crazy."