Hello All, I am looking to pull the weekly_patterns data for a particular state, using the search function. I am aware that only the first 20 results will be returned when using such function. Besides passing in an arbitrary max-results number to overcome this limitation, are there other ways to just search for the entire dataset? The historical data starts in Jan. 01/18. Thank you for your help.
This topic was automatically generated from Slack. You can find the original thread here.
I’ve got a repo that programmatically syncs weekly patterns data via s3 and separately munges those files to grab data for a specific state (ultimately storing data in a db). Not sure what your use case is and if this would be helpful, but happy to share code if that would be interesting
the api has a max result of 500 per response, but has params to allow you to paginate through the set (after and last_seen_placekey)
Thats great thank you @vchen . I may need to create a loop that runs and uses the last_seen_placekey param until it gets no results back.
Thank you @Benjamin_White for your help. Unfortunately i do not have the ability to work in s3. Im trying to use just the api to access the data. and incorporate it into GCP.
yup, last_seen_placekey is usually best for pulling in larger dataset. let me know if you run into any issues
To prevent any further questions from being overlooked, I’ll go ahead and close this thread out. If you have any more questions or follow-up questions, we’re always here to help! Just be sure to make a new post to help, as we aren’t monitoring old threads at this time. Thanks!