What is Got Your Number?
To have leverage, control, knowledge, or power over another individual.
You should be scared to death because he's got your number.
See power, knowledge, control, manipulation, leverage