Discussions

Ask a Question
Back to all

deweypy filtering by date

Hi,

I'm trying to download with the Advan Foot Traffic/ Weekly Patterns data. I am mostly interested in 2023-present. When I use the command line interface it seems to ignore the "partition-key-after" argument.

python -m deweypy --api-key KEY_HERE --partition-key-after 2023-01-01 speedy-download FLDR_here

I also tried loading the python package directly:

from deweypy.downloads import DatasetDownloader, set_download_directory
downloader = DatasetDownloader(folder_id, partition_key_after='2023-01-01')

print(downloader.metadata)

{'total_files': 195357,
'total_size': 3095106030665,
'total_partitions': 391,
'partition_type': 'DATE',
'partition_column': 'DATE_RANGE_START',
'partition_aggregation': 'DAY',
'min_partition_key': '2018-01-01',
'max_partition_key': '2025-06-23'}

Anyway -- is there a way to download files only from select dates? It seems like a very long download and quite a bit of storage for files I probably won't need/use.

Thanks

-Chris