aemp-seattle

Initial repository for building up Seattle database for anti-eviction mapping.

Modelled off the evictorbase pipeline code.

Relevant but not 1-1 walkthrough of how to programmatically find building owners: 350 Seattle BEPS Repo.

AEMP Seattle Community Agreements

Project Structure

• processors/: directory for Python scripts to extract, transform, and load the data
• postgis-data/: directory that will hold the PostgreSQL data
• data/: currently ignored by git, need to share manually
  • inputs/: directory with only files that come directly from APIs or public websites
  • intermediates/: directory for folders containing intermediate transformed versions of the inputs
  • to_load/: directory for files that can be loaded directly into the PostgreSQL database
• experiments/: directory for Jupyter notebooks for data exploration and script development

Data Inputs:

King County Assessor: Download records of all apartment complexes in King County. eRealProperty: King County assessor data for finding the owner of a given parcel. Washington State Corporations and Charities Filing Database (CCFS): For looking up a parcel owner name and finding the related business listing and related info.

TODO: Find a good source for eviction filing data. Those with access can refer to the potential data source list to find new data sources.

Object Storage

An S3 compatible storage is hosted on minio.radmin.live

SDK documentation: https://github.com/minio/minio-py/blob/master/docs/API.md

Use lib/minio_helper.py to extend the functionality

Run test_minio in lib/main.py to test out that it works (TODO: move this to own testing script, perhaps unit tests)

Note: You will need to have minio_access_key and minio_secret_key in your env before running for this to work, contact @linnealovespie or @ammaratef45 to obtain these keys)