Data Loading Special Cases

PTS

the PTS file is updated weekly and uploaded to the DOF SFTP server. We only pull it monthly when there's a update for PLUTO

pluto_pts

This is the main file for PTS, note that the original PTS file has 140 columns, and for the purpose of building pluto, we are only taking a selected 40 fields. for the complete column definition and the fields we are taking, please checkout the pluto_build/_load_pts.sql script.

pluto_input_geocodes

This is the main geocoding input for PLUTO. DOF usually has out of sync address information compared to DCP, so we geocode BBL from PTS instead of addresses. The workflow follows: pass PTS BBL through the BL function -> get Address from BL function, then pass it into 1A+1E/1B -> Get Lat Lon and other information. Please checkout pluto_build/python/geocode.py for more information.

CAMA

pluto_input_cama_dof

We receive the CAMA file from DOF via SFTP.

Number of Buildings

pluto_input_numbldgs

To enhance number of buildings on a lot, we are geocoding BIN information from building footprints and group by BBL to get a more up-to-date count of number of buildings pluto_build/python/numbldgs.py