up or down?

"it's all uphill from here." or is it "it's all downhill from here."?

I never quite understood this comment. I know the person saying this to me is being kind. but if you really think about it, going uphill can be difficult and tiring. it makes me think of an uphill battle.

going downhill doesn't sound optimistic or encouraging either. "man, she is going downhill rapidly!"

I think I prefer things on an even keel.