Discussions
Request to Adjust Daily Download Limit Based on Dataset Size
Hi!
I hope this message finds you well.
I understand that the 5% daily download limit is reasonable for very large datasets; however, it seems less applicable to smaller datasets. For example, in the ATTOM data, the Tax Assessor History spans over 20 years and contains 2,705,538,321 rows. In contrast, another similar data Tax Assessor dataset that only covers the recent two years with 158,460,166 rows, yet both are subject to the same 5% daily limit.
As a result, downloading just two years of Tax Assessor data takes significantly longer than downloading one year of Assessor History data, even though the latter is much larger.
Would it be possible to adjust the daily limit based on the dataset size, allowing a larger quota for smaller datasets? This would greatly improve efficiency without compromising the safeguards intended for large datasets.
Thank you very much for considering this request!