Once upon a time, they held many different jobs.
New York Magazine has perused the city's online photo archives and pulled together what must be an exhaustive account of all the roles horses used to play in the city. Among the more interestng roles was that of a subway digger (see below).
See the complete list (with pictures!) here.
All photos courtesy of New York City's online archives.