-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
v0.9rc3 testing (v0.9rc3-0-g3a6bf5c on OSX/Chrome) #133
Comments
Results (see above for context)
PR for test plan improvements: #134 Key
|
Where did you see this? It's .edu not .org That's why it's not there. |
I thought this went in for v0.9rc3, but it has not. Sorry! |
Ah, that makes sense 👍 I probably should've noticed that hehe It was when connecting an external account via API key.. I was using the link in the modal to set link me off to each server and set up API keys, but the last Dataverse one didn't work. |
Test Plan
https://github.com/whole-tale/wt-design-docs/issues/new?template=test_plan.md
Note: For all tests, repeat for supported browser/OS combinations.
Preconditions:
Authentication
Navigation
Browse
Preconditions:
Assumes production Tales present (e.g., LIGO, materials, etc).
No running instances
General
STAGE: LIGO Tale missing from dashboard.stage.wholetale.org - could it be marked as private by mistake?
TEST: Filter is no longer reset
STAGE: LIGO Tale missing from dashboard.stage.wholetale.org - could it be marked as private by mistake?
STAGE: LIGO Tale missing from dashboard.stage.wholetale.org - could it be marked as private by mistake?
Manage
Preconditions
Empty home directory
No registered data
Register General
10.5065/D6862DM8
BUG: Needed refresh after deleting datasets to see newly registered ones
BUG: Searching for this DOI/URL only returned
No matching results found.
Run
Preconditions:
No running Tale instances
General
Environment
dropdown menuLicense
dropdownCreated by <your_name>
underAuthors
Published Location
readsThis Tale has not been published
BUG: Adding too many datasets pushes select-data-modal's Submit button of the screen
BUG: Deleting a single file from a folder cleared multiple files from view - this has already been fixed in master
doi:10.18739/A29G5GD0V
) on Manage > Data (see Manage > Register test cases above)BUG: Rename allows duplicates, but a refresh reveals that saving has failed
BUG: "Copy to Workspace" threw a stack trace when attempting to move/copy a specific instance of a file - unclear what caused the error:
Failed
{"message": "OSError: OSError('Specified file does not exist: /collection/WholeTale Workspaces/WholeTale Workspaces/5e39bf2c8bec16c2663dd8d5/1m.dat',)", "trace": ["<FrameSummary file /girder/girder/api/rest.py, line 630 in endpointDecorator>", "<FrameSummary file /girder/girder/api/rest.py, line 1224 in POST>", "<FrameSummary file /girder/girder/api/rest.py, line 967 in handleRoute>", "<FrameSummary file /girder/girder/api/access.py, line 63 in wrapped>", "<FrameSummary file /girder/girder/api/describe.py, line 709 in wrapped>", "<FrameSummary file /girder/girder/api/v1/resource.py, line 374 in copyResources>", "<FrameSummary file /girder/girder/models/item.py, line 445 in copyItem>", "<FrameSummary file /girder/girder/events.py, line 314 in trigger>", "<FrameSummary file /girder/plugins/wt_home_dir/server/init.py, line 80 in handler>", "<FrameSummary file /girder/plugins/wt_home_dir/server/lib/EventHandlers.py, line 214 in run>", "<FrameSummary file /girder/plugins/wt_home_dir/server/lib/EventHandlers.py, line 199 in assertIsValidFile>"], "type": "internal"}
run-local.sh
tagmanifest-sha256.txt
tagmanifest-md5.txt
manifest-sha256.txt
manifest-md5.txt
bag-info.txt
README.md
bagit.txt
fetch.txt
data/
metadata/
metadata
foldermanifest.json
andenvironment.json
fileLICENSE
fileSettings
BUG: http://dataverse.harvard.org/ is down - cannot generate or add API keys. Validation error message is blank in this case
#370
/user/me
endpoint to confirm tokens are still presentTale Creation
BUG: Invalid metadata prevents deleting Tale
{
"field": "id",
"message": "No such item: 59aeb3f246a83d0001ab6771",
"type": "validation"
}
Compose Jupyter Tale
Compose OpenRefine Tale
Too many instances
STAGE: Clearing out old datasets from staging may break some existing Tales - need to manually remove datasets before Girder allows you to delete
Analyze in Whole Tale
Task 1: Importing a Dataset from Dataverse
These test cases cover potential situations that can occur when importing datasets from Dataverse.
Testing Steps:
Replication Data for: "Agricultural Fires and Health at Birth"
Input data
section matches the uri withData Source
appendedCreate New Tale and Launch
button is disabledCreate New Tale and Launch
science
Task 2: Importing a Dataset from DataONE
These test cases cover different scenarios that may happen when importing datasets from DataONE.
This test covers the ideal case where dataset importing has all of the needed information
to properly run. This includes the dataset location, title, and selected environment.
Testing Steps:
Fire influences on forest recovery and associated climate feedbacks in Siberian Larch Forests, Russia
Selected data
section matches the uri withData Source
appendedRstudio
is selected in the Environments widgetCreate New Tale and Launch
button is enabledCreate New Tale and Launch
science
The
Analyze in Whole Tale
feature is deployed across a few DataONE test sites. This test ensures Whole Tale has the ability to importdata from each of them.
Links:
Testing Steps:
Create New Tale and Launch
TEST: Space(s) in test URL(s) should be replaced with %20
Task 3: Shared Behavior
These cases show errors that are common between Dataverse and DataONE. Although they are tested using DataONE URIs, the errors should be the same when replacing it with a Dataverse URI.
This test covers the case where the name query parameter is missing. The expected behavior is
that the uri query parameter is used instead.
Testing Steps:
https://dataverse.harvard.edu/api/access/datafile/3323458
Selected data
section matches the uri withData Source
appendedCreate New Tale and Launch
button is disabledCreate New Tale and Launch
This test covers the case where a user imports data from an external source and selects READ/WRITE in the Create Tale Modal.
Testing Steps (Variant 1):
Selected data
section matches the uri withData Source
appendedCreate New Tale and Launch
button is disabledREAD/WRITE
Create New Tale and Launch
Testing Steps (Variant 2):
Selected data
section matches the uri withData Source
appendedCreate New Tale and Launch
button is disabledREAD/WRITE
Create New Tale and Launch
Tale metadata tests
The purpose of these tests are to confirm that the metadata files (manifest.json, environment.json, LICENSE) we generate are correct.
manifest.json
file undermetadata/
schema:author
createdBy
aggregates
aggregates
Datasets
metadata/environment.json
config
section from girder matches theconfig
section inenvironment.json
LICENSE
fileLICENSE
file matches the selected license on the metadata pageLICENSE
changed appropriatelyPublishing tests
Case 1: No Accounts Configured
Publish tale...
Go to Settings
Case 2: Publishing to a Third Party
Connect to a third party provider (make sure it's a dev server)
Launch a Tale that you own
Add some data to it
Click
Publish tale...
Confirm that the publishing modal opens
Confirm that the third party that you are connected to appears in the dropdown
Select the third party
Click
Publish
Once complete, navigate to the metadata page
Confirm that the published location is present
Visit the published location
Confirm that you see the following files plus yours
metadata.xml
LICENSE
README.md
manifest.json
environment.json
Repeat for each third party provider
a. After publishing to DataONE, use girder to query the Tale
b. Ensure that the 'pid' field in the 'publishInfo' object has an identifier in a doi format
Case 3: Re-published Tale
Published Location
in Run > metadataPublished Location
has changed to the correct package landing pageZenodo integration tests
doi:10.5281/zenodo.16384
ver_1
https://zenodo.org/record/1172960#.XidIvlNKh24
ver_2
doi:10.5281/zenodo.1172960
ver_2
doi:10.5281/zenodo.608984
ver_2
The register tests the following cases.
Datasets with multiple files
Datasets with multiple versions
Concept DOI
Zenodo dataset via AiWT
The register tests the following cases.
Dataset with single file (zipfile)
Zenodo Binder via AiWT
publishInfo
field on the tale object contains pid, repository, repository_id, uriBUG: Notebook cell throws an error - No Texas :(
AttributeError Traceback (most recent call last)
in
12
13 output_notebook()
---> 14 palette.reverse()
15
16 # Choose a state to plot
AttributeError: 'tuple' object has no attribute 'reverse'
run-local.sh
command to run the Tale locallyRegression tests
/manage
viewtest123
) and click down into it/manage
viewtest123
folder and close the incognito tab/manage
view of your Home folder/run/ThisIsObviouslyNotARealID
/browse
page insteadThe text was updated successfully, but these errors were encountered: