Skip to content

Kinesis event stream mapper for humilis deployment framework

License

Notifications You must be signed in to change notification settings

humilis/humilis-kinesis-processor

Folders and files

NameName
Last commit message
Last commit date

Latest commit

author
German Gomez-Herrero
Nov 30, 2017
36787d1 · Nov 30, 2017
Nov 29, 2017
Oct 2, 2016
Jul 11, 2017
Oct 26, 2016
Jul 30, 2017
Nov 30, 2017
Oct 26, 2016
Nov 30, 2017
Oct 30, 2016
Nov 19, 2016
Mar 24, 2016
Jul 2, 2016
Nov 30, 2017
Oct 27, 2016
Nov 1, 2016
Aug 11, 2017
Oct 26, 2016
Oct 2, 2016
Nov 30, 2017

Repository files navigation

Kinesis event stream processor

Build Status PyPI

A humilis plugin to deploy a Lambda function that maps events in a Kinesis event stream using a list of Python callables.

Installation

pip install humilis-kinesis-processor

Development

Assuming you have virtualenv installed:

make develop

Configure humilis:

.env/bin/humilis configure --local

Testing

Unit tests

To run the local test suite:

make test

Integration tests

Before running the integration test suite you need to set a few deployment secrets using the command:

s3keyring set [group]/[STAGE] [key] [secret]

In group humilis-kinesis-processor the following secrets need to be set:

By the default, the integration tests will deploy on a stage called DEV so the command to set the Sentry DSN is:

s3keyring set humilis-kinesis-processor:DEV sentry.dsn [SENTRYDSN]

To run the integration test suite:

make testi

The command above will deploy a Kinesis processor to your AWS account, and will also create additional resources (such as several Kinesis streams) needed to test that the deployment was successful. Once deployed, the integration tests will run, and once they have completed the test environment will be destroyed.

If you do not want the test environment to be destroyed after tests have completed you should run instead:

make testi DESTROY=no

You can also modify the name of the deployment stage by setting the STAGE environment variable. For instance, to deploy to a TEST stage:

make testi STAGE=TEST

More information

See humilis documentation.

Contact

If you have questions, bug reports, suggestions, etc. please create an issue on the GitHub project page.

License

This software is licensed under the MIT license

See License file

© 2016 Anatoly Bubenkov, German Gomez-Herrero, FindHotel and others.