Skip to content

Commit

Permalink
Updated reference to include large dataset method
Browse files Browse the repository at this point in the history
  • Loading branch information
maggieklope committed Oct 11, 2024
1 parent 4f03d75 commit a4f29a8
Showing 1 changed file with 14 additions and 0 deletions.
14 changes: 14 additions & 0 deletions reference/reference.Rmd
Original file line number Diff line number Diff line change
Expand Up @@ -145,3 +145,17 @@ children <- paste0(chapter, sections)

```{r, child = children}
```

# Large Dataset Method

The large dataset method is currently used when processing dataset that have a large number of files or contain very large files, both of which are not well-supported on the current ADC site. Our development team is currently working on addressing this, but in the meantime we are having PIs upload their data files to our servers directly through SFTP (secure file transfer protocol), where we will host them until these changes take place. The current method we use will allow the data files to automatically be uploaded once the updates to the ADC site take place.

```{r, echo = FALSE}
chapter <- "../workflows/large_dataset_method/"
sections <- dir(path = chapter, pattern = ".Rmd$")
children <- paste0(chapter, sections)
```

```{r, child = children}
```

0 comments on commit a4f29a8

Please sign in to comment.