@E16,
if I am following you correctly (and if I am not, my apologies) but it appears you are wanting to do an installation in accordance with 230.40 Ex. 3. Obviously if the building to which the temporary panel is located would have to meet 230.70(A)(1) and 230.71. Others may disagree but I see this as your only potential avenue.
if you happen to attempt to use 230.40 Ex. 3, then install two service conductors to the dwelling then it may bring up an issue with 230.2.
But hopefully others will chime in and assist more. The application (in fact a reverse application since you are wanting to go from a structure to the dwelling) is really irrelevant, the issue will be in compliance with 230.2 at this point. Now, if you can make the argument that they are "parallel" and electrically joined at both ends maybe...but the fact you are feeding two separate panels will create the problem.
When you see the use of two separate service entrance conductors from a meter enclosure back to back with two separate panel enclosures , it may look very similar to what you are trying to do...the only problem is in the back to back example only one set of was actually bought to the structure (in this example, not always) and so it is not a concern. In your example as drawn you will be brining two sets of underground service conductors to the dwelling which is against 230.2 (unless you can get permission from your AHJ for the application).
Just my thoughts on it....others will chime in.