Can I know how to get the weekly mobility data (or social distance) data by state level?

Questions & Help
41 
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\02',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\03',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\04',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\05',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\06',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\07',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\08',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\09',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\10',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\11',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\12',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\13',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\14',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\15',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\16',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\17',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\18',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\19',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\20',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\21',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\22',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\23',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\24',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\25',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\26',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\27',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\28',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\29',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\30',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/01\\31',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\01',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\02',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\03',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\04',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\05',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\06',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\07',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\08',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\09',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\10',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\11',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\12',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\13',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\14',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\15',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\16',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\17',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\18',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\19',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\20',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\21',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\22',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\23',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\24',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\25',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\26',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\27',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\28',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/02\\29',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\01',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\02',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\03',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\04',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\05',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\06',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\07',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\08',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\09',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\10',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\11',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\12',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\13',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\14',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\15',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\16',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\17',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\18',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\19',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\20',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\21',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\22',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\23',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\24',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\25',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\26',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\27',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\28',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\29',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\30',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/03\\31',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\01',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\02',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\03',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\04',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\05',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\06',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\07',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\08',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\09',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\10',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\11',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\12',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\13',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\14',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\15',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\16',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\17',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\18',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\19',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\20',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\21',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\22',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\23',
 'F:/Covid_19/SafeGraph/social-distancing/v1/2020/04\\24']```
43

includes all files

44

not quite, we need one more loop, like this:

45 
for month in os.listdir(dir_to_read):
  month_path = os.path.join(dir_to_read,month)
  for day in os.listdir(month_path):
    day_path = os.path.join(month_path,day)
    for file in os.listdir(day_path):
      all_files.append(os.path.join(day_path, file))```
46

then
df = pd.concat([pd.read_csv(f) for f in all_files])

47

df = pd.concat([pd.read_csv(f) for f in all_files]) is still runing.i Take a while

48

that’s a good sign.

49

you should probably do this:

50 
df = pd.concat([pd.read_csv(f, dtype=my_dtypes) for f in all_files])```
so that you don't drop the leading zeroes of CBGs
52

looks good, just be mindful of dropped leading zeroes for CBGs as I said above ^^

53

run the code"

df = pd.concat([pd.read_csv(f, dtype=my_dtypes) for f in all_files])```
even slower than before
55

seems prefect! thank you so much!

56

good luck!

57

Last questions, hwo can I create a column with partial code of “origin_census_block_group” to extact state information? since the first two code of origin_census_block_group is state?

58

yes the first 2 digits are the state FIPS
you can substring the CBG FIPS

59

fips codes are in Open Census Data

60

Thank you so much! You help me a lot! have a good evening!