Home

1. What is Nightfall?
2. What is Nightfall for?
3. What problem does Nightfall solve?
4. Supported versions?

DEPRECATED

Nightfall was replaced by other tools that improve the usage in development environments, like jupyter with Apache Toree.

What is Nightfall?

Welcome to the Nightfall documentation, this project aims to help the development of applications for Spark facilitating the creation of Streams and Batches jobs, also providing simple configuration for them.

What is Nightfall for?

Nightfall is for:

• Dependency injection on Spark jobs;
• Streamming Listeners;
• StatsD Reporter;
• Kafka Offset Persistency;
• Riposte;

What problem does Nightfall solve?

Nightfall has to leave less verbose and laborious development of Java applications for Spark. With the use of dependency injection its easy to create multiples tasks for a job. Note that dependency injection only occurs on the driver side. Using DI on the worker is not easy due to serialization of code when executing tasks.

Learn more about How It Works and How To Use.

Supported versions

Nightfall supports Spark 2.0 or higher.

Nightfall	Spark	Scala
1.x	1.6.x	2.11
2.0.0	2.0	2.11
2.1.0	2.2	2.11
2.1.1	2.3.1	2.11
2.1.2	2.4.0	2.11
2.1.3	2.4.3	2.11