Yes it is tough I know, I remember purchasing my home I had to get some help from family and had to sell some of my personal assets in order to come up with the down payment and closing costs, insurance, utillity deposits and other moving costs and they won't let you borrow any of those expenses and you have to prove to the bank where you came up with the funds.
One reason why I can't understand how they let the housing market crash, when I purchased they made me jump through hoops and I had excellent credit
Hope things work out for y'all