Are there any other large loads that produce the same situation on the panel?
I had a call 30 years ago that I never forgot. A table saw in a garage caused the entire house to dip way beyond tolerable, to the point other items would shut down due to voltage drop. I went through every possible scenario in troubleshooting that I could do, with no reason for it other than the power company. I called for a trouble truck from the poco, guy shows up and without testing ANYTHING at the meter,, says its impossible for it to be their problem because he just finished checking the
XFMR and its fine.
I asked him to pull the meter ( in our area electricians aren't "supposed" to pull it). He does as I ask and to our surprise he finds a knockout slug from the original installation which had fallen between a lug and the meter can. The paint prevented a dead short. He pulled it out and presto problem is gone.
I'm not saying that is your problem, but it wouldn't surprise me if it is on the PoCo side.