Rashi on Numbers 26:2/רש"י על במדבר כ״ו:ב׳

1לבית אבתם [TAKE THE SUM OF THE CONGREGATION] ACCORDING TO THEIR FATHERS’ HOUSE — after their fathers’ tribes shall they reckon their descent, and not after their mothers’ (Bava Batra 109b).