Discussions

Discussions

Ask a Question
Back to all

How to download large component tables (Job Descriptions) via Bulk API?

last month by Jun Fang

Hi Dewey team,

I'm a researcher using LinkUp data for an academic project. I've successfully downloaded Job Records and ONET Taxonomy via the Bulk API using deweypy speedy-download.

I'd like to also download the Job Descriptions component table from LinkUp. However, when I try to customize this dataset (e.g., filtering by date range), I'm
unable to generate a Bulk API download link — it seems the file size exceeds the available download options.

My questions:

  1. Is there a way to download the Job Descriptions table via the Bulk API, perhaps by splitting it into smaller time-range partitions?
  2. If not, is there an alternative access method (e.g., Snowflake, direct query) available through my institutional subscription?
  3. Are there any size limits on Bulk API downloads that I should be aware of for future requests?

I only need Job Descriptions for U.S. job postings from 2015–2025. Happy to split this into multiple requests if needed.

Thank you for your help!