My dad gave me $50K for the offer on my 1st home — now he wants it back. Do I say no or risk losing the house?

My dad gave me $50K for the offer on my 1st home — now he wants it back. Do I say no or risk losing the house?