Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DevDB - first automated push #31

Merged
merged 6 commits into from
Jan 15, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
54 changes: 0 additions & 54 deletions products/developments/housing/metadata.yml

This file was deleted.

112 changes: 112 additions & 0 deletions products/developments/housing_database/metadata.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,112 @@
id: housing_database

attributes:
description: >-
The NYC Department of City Planning's (DCP) <a href =
"https://www.nyc.gov/site/planning/data-maps/open-data/dwn-housing-database.page#housingdevelopmentproject">Housing
Database</a> contains all NYC Department of Buildings (DOB) approved housing construction and demolition jobs filed or
completed in NYC since January 1, 2010. It includes the three primary construction job types that add or remove residential
units: new buildings, major alterations, and demolitions, and can be used to determine the change in legal housing units
across time and space. Records in the Housing Database Project-Level Files are geocoded to the greatest level of precision
possible, subject to numerous quality assurance and control checks, recoded for usability, and joined to other housing data
sources relevant to city planners and analysts.

Data are updated semiannually, at the end of the second and fourth quarters of each year.

Please see DCP's annual Housing Production Snapshot summarizing findings from the 21Q4 data release <a
href="https://storymaps.arcgis.com/stories/1c9138dc24064b2e8142ff156345a719">here</a>. Additional Housing and Economic
analyses are also <a
href="https://www.nyc.gov/site/planning/planning-level/housing-economy/housing-economy.page">available</a>.

The NYC Department of City Planning's (DCP) <a
href="https://www.nyc.gov/site/planning/data-maps/open-data/dwn-housing-database.page#housingdevelopmentunit">Housing Database
Unit Change Summary Files</a> provide the net change in Class A housing units since 2010, and the count of units pending
completion for commonly used political and statistical boundaries (Census Block, Census Tract, City Council district,
Community District, Community District Tabulation Area (CDTA), Neighborhood Tabulation Area (NTA). These tables are aggregated
from the DCP Housing Database Project-Level Files, which is derived from Department of Buildings (DOB) approved housing
construction and demolition jobs filed or completed in NYC since January 1, 2010. Net housing unit change is calculated as the
sum of all three construction job types that add or remove residential units: new buildings, major alterations, and
demolitions. These files can be used to determine the change in legal housing units across time and space.
display_name: Housing Database
each_row_is_a: DOB-approved housing construction or demolition job
tags:
- housing
- house
- building
- development
- dwelling unit
- alteration
- demolition
- certificate of occupancy
- co
- permit
- job application
- filing
- net units
- unit change
- hotel
- class b
- class a
- pipeline
- existing units
- proposed units
- construction
date_made_public: "4/7/2021"

assembly: []

custom: {}

destinations:
- id: socrata
type: socrata
files:
- id: data_dictionary
custom:
destination_use: attachment
custom:
four_four: 6umk-irkx
- id: bytes
type: bytes
files:
- id: csv
custom:
url: https://s-media.nyc.gov/agencies/dcp/assets/files/zip/data-tools/bytes/nychousingdb_{{ version }}_csv.zip
- id: gdb
custom:
url: https://s-media.nyc.gov/agencies/dcp/assets/files/zip/data-tools/bytes/nychousingdb_{{ version }}_gdb.zip
- id: shapefile
custom:
url: https://s-media.nyc.gov/agencies/dcp/assets/files/zip/data-tools/bytes/nychousingdb_{{ version }}_shp.zip
- id: data_dictionary
custom:
url: https://s-media.nyc.gov/agencies/dcp/assets/files/excel/data-tools/bytes/Housing_Database_Data_Dictionary.xlsx
- id: data_dictionary_summary_files
custom:
url: https://s-media.nyc.gov/agencies/dcp/assets/files/excel/data-tools/bytes/Housing_Summary_Files_Data_Dictionary.xlsx

files:
- file:
id: csv
filename: nychousingdb_{{ version }}_csv.zip
type: csv
- file:
id: shapefile
filename: nychousingdb_{{ version }}_shp.zip
type: shapefile
- file:
id: gdb
filename: nychousingdb_{{ version }}_gdb.zip
type: fgdb
- file:
id: data_dictionary
filename: Housing_Database_Data_Dictionary.xlsx
is_metadata: true
type: None
- file:
id: data_dictionary_summary_files
filename: Housing_Summary_Files_Data_Dictionary.xlsx
is_metadata: true
type: None

columns: []
Original file line number Diff line number Diff line change
@@ -1,9 +1,17 @@
id: housing_database_by_2020_cdta

attributes:
description: |-
Net change in housing units arising from new buildings, demolitions, or alterations for NYC Community District Tabulation Areas (CDTAs) since 2010. The NYC Department of City Planning's (DCP) <a href="https://www1.nyc.gov/site/planning/data-maps/open-data/dwn-housing-database.page#housingdevelopmentproject">Housing Database</a> provide the 2010 census count of housing units, the net change in Class A housing units since the census, and the count of units pending completion for commonly used political and statistical boundaries. These tables are aggregated from the DCP Housing Database, which is derived from Department of Buildings (DOB)-approved housing construction and demolition jobs filed or completed in NYC since January 1, 2010. Net housing unit change is calculated as the sum of all three construction job types that add or remove residential units: new buildings, major alterations, and demolitions, and can be used to determine the change in legal housing units across time and space.

description: >-
Net change in housing units arising from new buildings, demolitions, or alterations for NYC Community District Tabulation
Areas (CDTAs) since 2010. The NYC Department of City Planning's (DCP) <a
href="https://www1.nyc.gov/site/planning/data-maps/open-data/dwn-housing-database.page#housingdevelopmentproject">Housing
Database</a> provide the 2010 census count of housing units, the net change in Class A housing units since the census, and the
count of units pending completion for commonly used political and statistical boundaries. These tables are aggregated from the
DCP Housing Database, which is derived from Department of Buildings (DOB)-approved housing construction and demolition jobs
filed or completed in NYC since January 1, 2010. Net housing unit change is calculated as the sum of all three construction
job types that add or remove residential units: new buildings, major alterations, and demolitions, and can be used to
determine the change in legal housing units across time and space.

{{ bytes_previous_versions_link }}
display_name: Housing Database by 2020 CDTA
each_row_is_a: community district tabulation area
Expand Down Expand Up @@ -37,16 +45,17 @@ attributes:
- cdta
- neighborhood tabulation area
- nta
date_made_public: "6/7/2023"

assembly: []

custom: {}

destinations:
- id: socrata_prod
- id: socrata
type: socrata
files:
- id: primary_shapefile
- id: shapefile
custom:
destination_use: dataset_file
- id: data_dictionary
Expand All @@ -57,18 +66,25 @@ destinations:
- id: bytes
type: bytes
files:
- id: primary_shapefile
- id: shapefile
custom:
url: https://s-media.nyc.gov/agencies/dcp/assets/files/zip/data-tools/bytes/nychdb_cdta_{{ version }}_shp.zip
- id: csv
custom:
url: https://s-media.nyc.gov/agencies/dcp/assets/files/zip/data-tools/bytes/nychdb_cdta_{{ version }}_csv.zip
- id: data_dictionary
custom:
url: https://s-media.nyc.gov/agencies/dcp/assets/files/excel/data-tools/bytes/Housing_Summary_Files_Data_Dictionary.xlsx

files:
- file:
id: primary_shapefile
filename: shapefile.zip
id: shapefile
filename: nychdb_cdta_{{ version }}_shp.zip
type: shapefile
- file:
id: csv
filename: nychdb_cbdta_{{ version }}_csv.zip
type: csv
- file:
id: data_dictionary
filename: Housing_Summary_Files_Data_Dictionary.xlsx
Expand Down Expand Up @@ -96,107 +112,83 @@ columns:
- id: comp2010ap
name: comp2010ap
data_type: integer
description: |
Net number of class A housing units completed between April 1, 2010
and December 31, 2010, accounting for new buildings, alterations, and demolitions
description: Net number of class A housing units completed between April 1, 2010 and December 31, 2010, accounting for new
buildings, alterations, and demolitions
example: '253.0'
- id: comp2010
name: comp2010
data_type: integer
description: |
Net number of class A housing units completed year in 2010, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2010, accounting for new buildings, alterations, and demolitions
example: '188.0'
- id: comp2011
name: comp2011
data_type: integer
description: |
Net number of class A housing units completed year in 2011, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2011, accounting for new buildings, alterations, and demolitions
example: '122.0'
- id: comp2012
name: comp2012
data_type: integer
description: |
Net number of class A housing units completed year in 2012, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2012, accounting for new buildings, alterations, and demolitions
example: '34.0'
- id: comp2013
name: comp2013
data_type: integer
description: |
Net number of class A housing units completed year in 2013, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2013, accounting for new buildings, alterations, and demolitions
example: '70.0'
- id: comp2014
name: comp2014
data_type: integer
description: |
Net number of class A housing units completed year in 2014, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2014, accounting for new buildings, alterations, and demolitions
example: '46.0'
- id: comp2015
name: comp2015
data_type: integer
description: |
Net number of class A housing units completed year in 2015, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2015, accounting for new buildings, alterations, and demolitions
example: '63.0'
- id: comp2016
name: comp2016
data_type: integer
description: |
Net number of class A housing units completed year in 2016, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2016, accounting for new buildings, alterations, and demolitions
example: '41.0'
- id: comp2017
name: comp2017
data_type: integer
description: |
Net number of class A housing units completed year in 2017, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2017, accounting for new buildings, alterations, and demolitions
example: '2011.0'
- id: comp2018
name: comp2018
data_type: integer
description: |
Net number of class A housing units completed year in 2018, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2018, accounting for new buildings, alterations, and demolitions
example: '119.0'
- id: comp2019
name: comp2019
data_type: integer
description: |
Net number of class A housing units completed year in 2019, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2019, accounting for new buildings, alterations, and demolitions
example: '352.0'
- id: comp2020
name: comp2020
data_type: integer
description: |
Net number of class A housing units completed year in 2020, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2020, accounting for new buildings, alterations, and demolitions
example: '792.0'
- id: comp2021
name: comp2021
data_type: integer
description: |
Net number of class A housing units completed year in 2021, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2021, accounting for new buildings, alterations, and demolitions
example: '658.0'
- id: comp2022
name: comp2022
data_type: integer
description: |
Net number of class A housing units completed year in 2022, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2022, accounting for new buildings, alterations, and demolitions
example: '93.0'
- id: comp2023
name: comp2023
data_type: integer
description: |
Net number of class A housing units completed year to date, accounting
for new buildings, alterations, and demolitions
description: Net number of class A housing units completed year in 2023, accounting for new buildings, alterations, and demolitions
example: '74.0'
- id: comp2024
name: comp2024
data_type: integer
description: Net number of class A housing units completed year to date, accounting for new buildings, alterations, and demolitions
example: '74.0'
- id: cenunits20
name: cenunits20
Expand Down
Loading