Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

limit workers to 1 when autodetect_column_names is enabled #72

Open
robin13 opened this issue Mar 13, 2019 · 1 comment
Open

limit workers to 1 when autodetect_column_names is enabled #72

robin13 opened this issue Mar 13, 2019 · 1 comment
Assignees
@colinsurprenant
Labels
enhancement

Comments

@robin13
Copy link

robin13 commented Mar 13, 2019

As fixing #65 is a big issue requiring fundamental work on logstash to synchronize between threads, would it be possible for the interim to

  1. Document that when autodetect_column_names is true pipeline.workers must be set to 1
  2. Have a startup check such that if autodetect_column_names is true and pipeline.workers is >1 then startup will fail (similar to the way the aggregate filter does).
@colinsurprenant
Copy link
Contributor

the new csv codec should be more appropriate for this, when paired with the file input a new codec instance will be used per file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@colinsurprenant colinsurprenant

Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@colinsurprenant @robin13 @robbavey