The Port Authority Bus Terminal at 42nd St. and 8th Ave. has a luggage storage facility that you can rent storage from for several days, at least they offered such a service about ten years ago when I used it. Many hotels in the area offer the same service.

"Thou, O Lord, are the shield about me;
You're my helper,
You're the one who lifts up my head."
"Whom have I in heaven or earth but You?"