Rashi on Numbers 20:15/רש"י על במדבר כ׳:ט״ו

1וירעו לנו AND [THE EGYPTIANS] DID EVIL TO US — we have borne many adversities.

2ולאבתינו [THEY DID EVIL TO US] AND TO OUR FATHERS — From here we may learn that the patriarchs grieve in their graves when punishment comes upon Israel (cf. Midrash Tanchuma, Chukat 12).