You remember correctly. The average human consumes 2,000 calories per day. Those are large calories; it is the same as 2,000,000 thermodynamic calories. That is the same as 2,326 watt-hours. For a 24-hour day, that would be a rate of 2,326/24 = 96.9 watts. Obviously you pump out more during the day when active so 100 watts is a reasonable ballpark. It's the easy way to estimate HVAC loads for a given space. How many people x 100 watts. This also means that 20 watts is not an outrageous estimate for what keeps the ole' noggin ticking away.