Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BULK REMOVAL AND NEW UPLOAD: Pokhara (25 datasets) #203

Open
sophialinn opened this issue Aug 22, 2019 · 18 comments
Open

BULK REMOVAL AND NEW UPLOAD: Pokhara (25 datasets) #203

sophialinn opened this issue Aug 22, 2019 · 18 comments

Comments

@sophialinn
Copy link

We need to REMOVE 24 datasets currently on the 2C GeoNode and replace them with updated 25 datasets for Pokhara. This is NOT a clean 'replace' because the filenames are slightly different; the prefix of the 'old' data is "pokhara" and the prefix for the new data is "POK", even though the nature of the data is probably the same. For this reason, we need to REMOVE the old, and then upload the new.

Please REMOVE the datasets listed in this spreadsheet: https://docs.google.com/spreadsheets/d/1L-ddQbUL4c966kAa6RxO6mz1Yc4_HSvsyPcmtbsN3Ck/edit?usp=sharing

And then UPLOAD the new data and metadata found here: https://drive.google.com/drive/folders/0B2Oc3HZSI7QFUFQ2RWd4WmxYb0E?usp=sharing

@kalxas
Copy link
Collaborator

kalxas commented Sep 10, 2019

[SUCESS] Layer [pokhara_atm] deleted
[SUCESS] Layer [pokhara_banks] deleted
[SUCESS] Layer [pokhara_commercialbanks] deleted
[SUCESS] Layer [pokhara_developmentbanks] deleted
[SUCESS] Layer [pokhara_financecompanies] deleted
[ERROR] Layer [pokhara_financecompanies] couldn't be deleted
[SUCESS] Layer [pokhara_fuelstations] deleted
[SUCESS] Layer [pokhara_governmentoffices] deleted
[SUCESS] Layer [pokhara_ngo] deleted
[SUCESS] Layer [pokhara_hospitals] deleted
[SUCESS] Layer [pokhara_healthposts] deleted
[SUCESS] Layer [pokhara_pharmacies] deleted
[SUCESS] Layer [pokhara_clinics] deleted
[SUCESS] Layer [pokhara_dentist] deleted
[SUCESS] Layer [pokhara_schools] deleted
[SUCESS] Layer [pokhara_wardboundary] deleted
[SUCESS] Layer [pokhara_rivercanals] deleted
[SUCESS] Layer [pokhara_roadnetwork] deleted
[SUCESS] Layer [pokhara_trunkroad] deleted
[SUCESS] Layer [pokhara_primaryroad] deleted
[SUCESS] Layer [pokhara_secondaryroad] deleted
[SUCESS] Layer [pokhara_tertiaryroad] deleted
[SUCESS] Layer [pokhara_residentialroad] deleted
[SUCESS] Layer [pokhara_lakes] deleted

@sophialinn
Copy link
Author

@kalxas The number of Pokhara data layers and metadata should line up now. Here are the links:

Pokhara Data: https://drive.google.com/drive/folders/0B2Oc3HZSI7QFMUNJYkhKaURwTEE?usp=sharing

Pokhara Metadata: https://drive.google.com/drive/folders/0B2Oc3HZSI7QFMUNJYkhKaURwTEE?usp=sharing

@kalxas
Copy link
Collaborator

kalxas commented Sep 10, 2019

Finished processing 65 layers in 4107.0 seconds.

50 Created layers
0 Updated layers
1 Skipped layers
14 Failed layers
63.184615 seconds per layer

@kalxas
Copy link
Collaborator

kalxas commented Sep 10, 2019

Pokhara: Automated Teller Machines : Metadata updated!                                       
Pokhara: Banks : Metadata updated!                                                           
Pokhara: Co-operative Banks : Metadata updated!                                              
Pokhara: Commercial Banks (Class A) : Metadata updated!                                      
Pokhara: Development Banks (Class B) : Metadata updated!
Pokhara: Finance Companies (Class C) : Metadata updated!
Pokhara: Micro Finance Development Banks(Class D) : Metadata updated!
pokhara: drinking water pipeline network : Failed to update
Exception: Layer matching query does not exist.
Pokhara: Fuel Stations : Metadata updated!
Pokhara: Government Offices : Metadata updated!
pokhara: non-governmental organizations : Failed to update
Exception: Layer matching query does not exist.
Pokhara: Ward Offices : Metadata updated!
pokhara: security services : Failed to update
Exception: Layer matching query does not exist.
Pokhara: Hospitals : Metadata updated!
Pokhara: Helath Posts : Metadata updated!
Pokhara: Pharmacies : Metadata updated!
Pokhara: Clinics : Metadata updated!
Pokhara: Dentists : Metadata updated!
Pokhara: Veterinaries : Metadata updated!
Pokhara: Schools : Metadata updated!
Pokhara: Private Schools : Metadata updated!
Pokhara: Government Schools : Metadata updated!
Pokhara: Kindergartens : Metadata updated!
Pokhara: Wards : Metadata updated!
Pokhara: Media : Metadata updated!

@kalxas
Copy link
Collaborator

kalxas commented Sep 10, 2019

We completed a cleanup of the database, things should be fine now

@kalxas
Copy link
Collaborator

kalxas commented Sep 10, 2019

These are the layers that did not have metadata:

  • pok_placesofworship
  • pok_highways
  • pok_drinkingwater
  • pok_secondaryroads
  • pok_primaryroad
  • pok_hotels
  • pok_tertiaryroads
  • pok_touristattractions
  • pok_residentialroads
  • pok_security
  • pok_ngos

@sophialinn
Copy link
Author

Missing data and metadata for Pokhara can be found in this folder:

https://drive.google.com/open?id=1W-QLUR7D33wU7NUeeMwVih5EkY-ThN2p

@kalxas kalxas modified the milestones: Stage 1, maintenance Sep 13, 2019
@kalxas
Copy link
Collaborator

kalxas commented Sep 13, 2019

Metadata spreadsheet has a comment about pok_highways.shp. Should we ignore that line?

@sophialinn
Copy link
Author

Yes, ignore/delete the pok_highways.shp line in the metadata

@kalxas
Copy link
Collaborator

kalxas commented Sep 13, 2019

Finished processing 9 layers in 528.0 seconds.

9 Created layers
0 Updated layers
0 Skipped layers
0 Failed layers
58.666667 seconds per layer

@kalxas
Copy link
Collaborator

kalxas commented Sep 13, 2019

Pokhara: Hotels : Metadata updated!
Pokhara: Non-Governmental Organizations : Metadata updated!
Pokhara: Places of Worship : Metadata updated!
Pokhara: Primary Roads : Metadata updated!
Pokhara: Residential Roads : Metadata updated!
Pokhara: Secondary Roads : Metadata updated!
Pokhara: Tertiary Roads : Metadata updated!
Pokhara: Tourist Attractions : Metadata updated!

@kalxas
Copy link
Collaborator

kalxas commented Sep 13, 2019

ready for review

@sophialinn
Copy link
Author

waiting for geonode to be restored (certificate issue) and will then review

@kalxas
Copy link
Collaborator

kalxas commented Sep 13, 2019

GeoNode is up, you just need to add an exception and you can see it working

@kalxas
Copy link
Collaborator

kalxas commented Sep 13, 2019

Pokhara Highways metadata missing from both latest spreadsheets

https://secondarycities.geonode.state.gov/layers/geonode:pok_highways

@sophialinn
Copy link
Author

Message from Gaurav (Pokhara partner):

The pok_highways was renamed to pok_trunkroad. And this file is redundant.

@sophialinn
Copy link
Author

...but now I don't see pok_trunkroad anywhere. I'm going to follow up, but until then, go ahead and delete pok_highways

@kalxas
Copy link
Collaborator

kalxas commented Sep 13, 2019

ok thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants