081128-2033 EST
Jakewhis:
It is necessary to more clearly define what you are talking about.
First, some assumptions.
1. Assume the source is 3 phase Y and presumably with a neutral from the source to the load area (outbuilding). Also means there should be an EGC (Equipment Grounding Conductor) from the main panel to the destination. That line to line the voltage is 208 V and any line to neutral is 120 V at the source and should be at the destination.
2. The lights are 120 V and one side of the lamps is connected to neutral.
3. No idea where the dimmer is located or how it is wired.
4. No idea if the lamps are fed from a single pole breaker or one pole of a three pole breaker.
5. No idea what other loads are connected to the three phase system at the destination.
6. What does this statement mean? "I measured voltage on the hot and neutral in that area ----". Does this mean between hot and neutral or to some other reference like earth, or the EGC, or what?
You do not measure voltage on something without a reference. You measure voltage between points, and you measure current at a point.
We need to know what all the loads are that are connected to the four wires (A, B, C, and neutral) coming from the main panel? What kind of breaker or breakers are supplying the destination? How many wires to the destination? Is there an EGC?
Most likely from your description you were measuring the voltage across your destination lamps, and that there are other loads at the destination that connect to other legs of the three phase source, and that there is not one single three pole breaker at the main panel supplying the destination.
To troubleshoot this problem you need clarification of the actual circuit and loads.
.