I would not consider any system that has duct work. That's what opening the windows are for.
Ground source heat pump is an expensive install with some maintenance issues. The compressors are ~ 15 yr expected lifetime. People like them but it's not for me.
For similar money I would start with the foundation built similar to European Passivhaus standards. All the concrete, footings, slabs, walls are wrapped in 4" or more rigid foam board. This gets your heat loss down to a very small number and the thermal mass is a battery or flywheel for heat. Most of the year the foundation will heat and cool the house passively with house appliances and electronics supplying enough supplemental heat.
With the low heat loss and modern insulated coated windows, the A/C system could easily be one or two small window units or a small minisplit.
For heat, gas, methane, is the best fuel and a modern condensing boiler with indirect DHW is a no brainer. People like the newer heat pump DHW tanks also.
If methane gas is not available, I would be installing a modern high end European pellet boiler, Windhager / Froling. That system is made for radiant but conventional baseboard hydronic or European style low temp radiators, heat emitters, are also in view. An essential element imo is outside air temp hot water reset of the HW distribution temp.
The added foundation insulation has the fastest payback of any option with no maintenance issues. The heat penetrates the mass evenly, no drafts or temp differences anywhere in the house. I have 2" rigid foam board under my slab and exterior to the foundation walls. It works perfectly. If it's 40 deg out I really don't have to fire the boiler for several days once the slabs are up to temp. In this weather of 20 deg, if I don't fire the boiler for three days the house will drop to ~ 61 - 62 but it would take another three weeks of January weather for the house to drop below 55 without firing the boiler. The insulated foundation is an effortless heating and cooling system. Next time it will be 4" minimum rigid foam board.
Myself, I would never build a conventional uninsulated concrete foundation.