Washington (CNN) -- While acknowledging the hard-hit black community and budding criticisms in its ranks, President Barack Obama said in a speech Saturday night to the Congressional Black Caucus that he wouldn't give up -- and urged members of the black community to join him to jump-start the still-sluggish economy.

"I expect all of you to march with me, and press on," Obama said. "... Stop complaining, stop…