I’m trying to sync monthly and weekly patterns backfill data through s3 (my team’s integration is built around s3, not the shop data), and the folder structure is confusing to say the least. For weekly patterns, I’m using
weekly-patterns-delivery-2020-12-backfill/patterns_backfill/2020/14/21/... and from there there are folders for 2018, 2019, and 2020, which seem to make sense.
For monthly places patterns, I can’t tell what I should use. My best guess is it should be
monthly-patterns-2020-12/patterns_backfill/... but from there I’m not sure since there seems to be a number of recursively nested folders. As best I can tell, something probably went wrong when Safegraph was syncing data to s3, and it ended up incorrectly syncing to subfolders numerous times (something I’ve managed to do in my own projects before).
Any help would be much appreciated.
This topic was automatically generated from Slack. You can find the original thread here.