Merge data version update to staging (#287)

* point to archive digital ocean space

* Fix for AB#14700, invalid selection type will no
cause server api

* use node v18.17.1 for ci

* point to versioned digital ocean space

* only specify major version of database

* expose port 5433

* use 5432 within docker network

* point to archive digital ocean space

* update postgres to 15

* build from spaces version folders

* point to 2023-08-21 decennial data

* update table variables that changed

* Decennial data version with:
- No space at end of male var
- 2020 var metadata
- ccd prefix in geoid

* Updated geography version.

* populate support_geoids table with ccds
update selection table to support ccds

* Add CCDs to summary level

* update ci to postgres:15 and node 18

* update ci to run ubuntu 22

* add special variable configurations

* Revert "use 5432 within docker network" and
"expose port 5433"

This reverts commits b8a66f1 and
479fc95

* remove CCDs from support geoids table migration

* fix agdpdrt and popacre calculations

* support decennial variable names for mdage bins

* remove CCDs from support geoids table migration
(reapplication of change)

* use data version with two decimal landacre precision

* use regex match in median error calculation

* Add index on geoid column for ACS db tables (#261)

* Add index on geoid column for ACS db tables

* Add INDEX_NAME var to etl script and update acs.sql to use it to create geoid index

* Update decennial.sql to use INDEX_NAME variable to create geoid index

---------

Co-authored-by: Tyler Matteo <[email protected]>

* Issue/16067 PFF Updates (#272)

* Population FactFinder 2018-2022 ACS & 2020 DDHC-A Updates

* Issue 268 update constants

* Issue 256 Update top and bottom thresholds

* issue 274 update constants for data migration

* Update to working version folders for acs and decennial csvs

* Closes #1147
 - updated decennial metadata script to reflect domain change from decennial to census
 - added semicolons in constants js

* updated constants with new dates

---------

Co-authored-by: pratishta <[email protected]>

* 279 updated constants

* issue 284 updated constants to pull new data (#286)

---------

Co-authored-by: tangoyankee <[email protected]>
Co-authored-by: dhochbaum-dcp <[email protected]>
Co-authored-by: Bryan <[email protected]>
Co-authored-by: Horatio <[email protected]>
Co-authored-by: pratishta <[email protected]>
Co-authored-by: horatio <[email protected]>

app.js

@@ -19,10 +19,10 @@ app.db = pgp(process.env.DATABASE_URL);
 
 // allows CORS
 app.use(cors({
-  origin: ['https://staging--labs-factfinder.netlify.app','https://develop--labs-factfinder.netlify.app','https://popfactfinder.planning.nyc.gov', 'http://localhost:4200','https://factfinder-staging.planninglabs.nyc','https://factfinder-develop.planninglabs.nyc'],
-  methods: "GET,HEAD,PUT,PATCH,POST,DELETE",
+  origin: ['https://staging--labs-factfinder.netlify.app', 'https://develop--labs-factfinder.netlify.app', 'https://popfactfinder.planning.nyc.gov', 'http://localhost:4200', 'https://factfinder-staging.planninglabs.nyc', 'https://factfinder-develop.planninglabs.nyc'],
+  methods: 'GET,HEAD,PUT,PATCH,POST,DELETE',
   allowedHeaders: 'X-Requested-With,Content-Type,Authorization',
-}))
+}));
 
 // middleware
 app.use(logger('dev'));

special-calculations/data/constants.js

@@ -8,14 +8,14 @@ const PREV_YEAR = 'Y2006-2010'; // TODO: update with actual previous year
 const GEOGRAPHY_VERSION = '2023-08-29';
 const DECENNIAL_SCHEMA_NAME = 'decennial';
 const DECENNIAL_LATEST_TABLE_NAME = '2020';
-const DECENNIAL_LATEST_VERSION = '2024-03-15';
+const DECENNIAL_LATEST_VERSION = '2024-03-19';
 const DECENNIAL_EARLIEST_TABLE_NAME = '2010';
-const DECENNIAL_EARLIEST_VERSION = '2024-03-15';
+const DECENNIAL_EARLIEST_VERSION = '2024-03-19';
 const ACS_SCHEMA_NAME = 'acs';
 const ACS_LATEST_TABLE_NAME = '2022';
-const ACS_LATEST_VERSION = '2024-03-15';
+const ACS_LATEST_VERSION = '2024-03-19';
 const ACS_EARLIEST_TABLE_NAME = '2010';
-const ACS_EARLIEST_VERSION = '2024-03-15';
+const ACS_EARLIEST_VERSION = '2024-03-19';
 const ACS_METADATA_FULL_PATH = `"${ACS_SCHEMA_NAME}"."metadata"`;
 const ACS_LATEST_TABLE_FULL_PATH = `"${ACS_SCHEMA_NAME}"."${ACS_LATEST_TABLE_NAME}"`;
 const ACS_EARLIEST_TABLE_FULL_PATH = `"${ACS_SCHEMA_NAME}"."${ACS_EARLIEST_TABLE_NAME}"`;