Skip Annapolis, or at least you only need like half a day there. Philly is really cool these days and has a great food scene. I also recommend stopping in Princeton, NJ on your way to NY since that’s a train stop and has great history too. In New Haven get pizza. There’s not much else there but you’ll be happy you did that.
This is what did it for me. Once you see that shit you stop seeing meat as food.