Schmidtt's study(pdf) appears to display a comparatively continuous decline from time of European contact right until around the beginning with the 20th century (at which place their inhabitants started growing again). The only real bit in there that really sticks out like a sore thumb was in 1804, when it seems nearly half the remaining population