If memory serves me right there were exiled samurai in California and Mexico at the same time as the Mexican-American war so its entirely feasible to have them fighting during said war. Though as I understand they were pretty universally insular and mostly stuck to themselves.