Yes but only on clear road and highways, theoretically a horse can go anywhere, but by 1939 they were restricted to the roads.Horses may have been of little use in a cross country cavalry charge but EVERY European power except England relied on horses for the movement of goods on public roads and their armies relied on them for the movement of guns and supplies whenever and wherever the railroads could not be relied on or were overloaded.