Dataset/dataloader API #174
Labels
Type: Improvement 📈
Performance improvement not introducing a new feature or requiring a major refactor
Type: New Feature ➕
Introduction of a completely new addition to the codebase
Milestone
Feature Description
Add helper class that to make easier data loading, batching, shuffling, etc.
I.e. dataset and/or dataloader class API that would help user to prepare data for training.
Use cases:
Job.train(..., {data: dataset, ...})
and update Job.train to work with the dataset API.Design: TBD
Is your feature request related to a problem?
Standardize the way data is loaded into training loop across workers.
What alternatives have you considered?
Discussed with FL team.
Additional Context
See also #172
The text was updated successfully, but these errors were encountered: