What is Pounds From?
"Pounds from" is something like
when you have to do something and
you don't care much about the feelings of the other people.
"Pounds from my brothers, cause I need to leave." means "Sorry for my brothers, but I have to leave (now and I don't care of what you're saying!)."