-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathNEWS
3153 lines (2070 loc) · 112 KB
/
NEWS
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
20160622
* $PATH can now be exported using --env PATH. Useful if GNU Parallel
is not in your path on remote machines.
* If --block is left out, --pipepart will use a block size that will
result in 10 jobs per jobslot.
* The cookie from 2016-01-04 was won by Morgan Rodgers on the
2016-06-06 after 5 months.
* Vote for GNU Parallel's community ad on
https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
* GNU Parallel was cited in: Genotypic Resistance Tests Sequences
Reveal the Role of Marginalized Populations in HIV-1 Transmission in
Switzerland http://www.nature.com/articles/srep27580
* GNU Parallel was cited in: A Deep-Learning Approach for Operation of
an Automated Realtime Flare Forecast
https://arxiv.org/pdf/1606.01587.pdf
* Unix parallel: Populating all the USB sticks
http://www.markhneedham.com/blog/2016/06/01/unix-parallel-populating-all-the-usb-sticks/
* GNU Parallel is a fantastic utility https://www.dray.be/parallel/
* Combining a large number of VCF files
https://gtamazian.com/2016/06/16/combining-a-large-number-of-vcf-files/
* Useful Scraping Techniques
http://blog.apps.npr.org/2016/06/17/scraping-tips.html
* Tools of the trade
http://onox.com.br/2015/05/tools-of-the-trade/#more-198
* Armslist scraper https://github.com/nprapps/armslist-scraper/
* Bug fixes and man page updates.
20160522
* niceload --net pauses the program if the internet connection is
overloaded.
* Vote for GNU Parallel's community ad on
https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
* Updated speed comparison between versions
https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
* GNU Parallel was cited in: Improving computation efficiency by
parallel programming
http://www.irbis-nbuv.gov.ua/cgi-bin/irbis_nbuv/cgiirbis_64.exe?C21COM=2&I21DBN=UJRN&P21DBN=UJRN&IMAGE_FILE_DOWNLOAD=1&Image_file_name=PDF/ape_2013_3_44.pdf
* GNU Parallel was cited in: A supernova feedback implementation for
the astrophysical simulation software Arepo
https://arxiv.org/abs/1604.06071
* GNU Parallel was cited in: Lorenz-Mie theory for 2D scattering and
resonance calculations https://arxiv.org/pdf/1505.07691v2.pdf
* GNU Parallel was cited in: Host-pathogen co-evolution and the
emergence of broadly neutralizing antibodies in chronic infections
https://arxiv.org/abs/1512.06296
* GNU Parallel was cited in: Pacific People, Metabolic Disease and
Evolutionary Processes: a mitochondrial DNA study
https://otago.ourarchive.ac.nz/handle/10523/6340
* GNU Parallel was cited in: The effect of domain modeling on
efficiency of planning: Lessons from the Nomystery domain
http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7407131
* GNU Parallel was cited in: Oops, my tests broke the build: An
analysis of Travis CI buildswith GitHub
https://peerj.com/preprints/1984/
* GNU Parallel was cited in: Drosophila Muller F Elements Maintain a
Distinct Set of Genomic Properties Over 40 Million Years of
Evolution http://www.g3journal.org/content/5/5/719.full.pdf+html
* GNU Parallel was cited in: An Empirical Comparison of Neural
Architectures for Reinforcement Learning in Partially Observable
Environments
http://biorxiv.org/content/biorxiv/early/2016/03/24/022707.full.pdf
* GNU Parallel was cited in: Functional enrichments of disease
variants across thousands of independent loci in eight diseases
http://biorxiv.org/content/early/2016/04/11/048066.abstract
* GNU Parallel was cited in: PleaseTM: Enabling Transaction Conflict
Management in Requester-wins Hardware Transactional Memory
http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7446072
* GNU Parallel was cited in: EASE-MM: Sequence-Based Prediction of
Mutation-Induced Stability Changes with Feature-Based Multiple
Models
http://www.sciencedirect.com/science/article/pii/S0022283616000310
* GNU Parallel was cited in: A new orthology assessment method for
phylogenomic data: Unrooted Phylogenetic Orthology
http://mbe.oxfordjournals.org/content/early/2016/04/06/molbev.msw069.short
https://github.com/ballesterus/UPhO
* GNU Parallel was cited in: Distinctive Interest Point Selection for
Efficient Near-duplicate Image Retrieval
http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7459172
* GNU Parallel was cited in: The Evolution of C Programming Practices:
A Study of the Unix Operating System 1973–2015
https://dl.acm.org/citation.cfm?id=2884799 (It has the cutest
thumbnail graphs I have ever seen scattered all over the text)
* GNU Parallel was cited in: StrAuto: Automation and Parallelization
of STRUCTURE Analysis
http://vchhatre.w3.uvm.edu/download/strauto/strauto_doc.pdf
* GNU Parallel was cited in: Data processing pipeline for serial
femtosecond crystallography at SACLA
http://journals.iucr.org/j/issues/2016/03/00/zw5001/index.html
* GNU Parallel was cited in: Reconstruction of Fine-Scale Auroral
Dynamics http://arxiv.org/pdf/1512.01460.pdf
* GNU Parallel was cited in: The Outer Solar System Origins Survey:
I. Design and First-Quarter Discoveries
http://arxiv.org/pdf/1511.02895.pdf
* GNU Parallel was cited in: Multiscale Estimation of Binding Kinetics
Using Brownian Dynamics, Molecular Dynamics and Milestoning
http://journals.plos.org/ploscompbiol/article/asset?id=10.1371%2Fjournal.pcbi.1004381.PDF
* GNU Parallel was cited in: Genomic legacy of the African cheetah,
Acinonyx jubatus
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4676127/pdf/13059_2015_Article_837.pdf
* GNU Parallel was cited in: Don’t Forget to Lock the Back Door! A
Characterization of IPv6 Network Security Policy
http://benign-research-probe2.eecs.umich.edu/ndss16_ipv6_final.pdf
* GNU Parallel was cited in: Comprehensive Annotation of the
Parastagonospora nodorum Reference Genome Using Next-Generation
Genomics, Transcriptomics and Proteogenomics
http://journals.plos.org/plosone/article/asset?id=10.1371%2Fjournal.pone.0147221.PDF
* GNU Parallel was cited in: Stride Search: a general algorithm for
storm detection in high-resolution climate data
http://www.geosci-model-dev-discuss.net/8/7727/2015/gmdd-8-7727-2015.pdf
* GNU Parallel was cited in: How attention influences perceptual
decision making: Single-trial EEG correlates of drift-diffusion
model parameters http://www.cidlab.com/prints/nunez2016attention.pdf
* GNU Parallel was cited in: Telomere And Proximal Sequence Analysis
Using High-Throughput Sequencing Reads
http://repository.upenn.edu/edissertations/1460/
* GNU Parallel was cited in: AT-GIS: Highly Parallel Spatial Query
Processing with Associative Transducers
http://lsds.doc.ic.ac.uk/sites/default/files/ATGIS-SIGMOD16.pdf
* GNU Parallel was cited in: PVAIR: Partial Variable Assignment
InterpolatoR http://verify.inf.usi.ch/sites/default/files/main-2.pdf
* GNU Parallel was cited in: Comparative Cladistics: Fossils,
Morphological Data Partitions and Lost Branches in the Fossil Tree
of Life http://opus.bath.ac.uk/43955/
* GNU Parallel was cited in: Shannon: An Information-Optimal de
NovoRNA-Seq Assembler
http://biorxiv.org/content/biorxiv/early/2016/02/09/039230.full.pdf
* GNU Parallel was cited in: Adaptive Measure-Theoretic Parameter
Estimation for Coastal Ocean Modeling
https://repositories.lib.utexas.edu/handle/2152/32435
* GNU Parallel was cited in: Computational Design of DNA-Binding
Proteins
http://link.springer.com/protocol/10.1007/978-1-4939-3569-7_16
* GNU Parallel was cited in: Reference genotype and exome data from an
Australian Aboriginal population for health-based research
http://www.nature.com/articles/sdata201623
* GNU Parallel was cited in: Computational Design of DNA-Binding
Proteins
http://link.springer.com/protocol/10.1007/978-1-4939-3569-7_16
* GNU Parallel was cited in: Do aye-ayes echolocate?
http://biorxiv.org/content/biorxiv/early/2016/04/11/048165.full.pdf
* GNU Parallel was cited in: Functional enrichments of disease
variants across thousands of independent loci in eight diseases
http://biorxiv.org/content/biorxiv/early/2016/04/11/048066.full.pdf
* GNU Parallel was cited in: From genomes to phenotypes: Traitar, the
microbial trait analyzer
http://biorxiv.org/content/biorxiv/early/2016/03/12/043315.full.pdf
* GNU Parallel was mentioned in: Fast Playback Framework for Analysis
of Ground-Based Doppler Radar Observations Using MapReduce
Technology
http://journals.ametsoc.org/doi/pdf/10.1175/JTECH-D-15-0118.1
* NCBI blast tutorial
https://github.com/enormandeau/ncbi_blast_tutorial
* Distributed Preservation Made Simple
https://blog.archive.org/2016/02/26/distributed-preservation-made-simple/
* Parallel Jobs in Luigi http://rjbaxley.com/posts/2016/03/13/parallel_jobs_in_luigi.html
* Bug fixes and man page updates.
20160422
* :::+ and ::::+ work like ::: and :::: but links this input source to
the previous input source in a --xapply fashion. Contrary to
--xapply values do not wrap: The shortest input source determines
the length.
* --line-buffer --keep-order now outputs continously from the oldest
job still running. This is more what you would expect than the
earlier behaviour where --keep-order had no effect with
--line-buffer.
* env_parallel supports tcsh, csh, pdksh. In fish it now supports
arrays. In csh/tcsh it now supports variables, aliases, and arrays
with no special chars. In pdksh it supports aliases, functions,
variables, and arrays.
* Function exporting on Mac OS X works around old Bash version.
* Better CPU detection on OpenIndiana.
* GNU Parallel was cited in: How Can We Measure the Similarity Between
Resumes of Selected Candidates for a Job?
https://www.researchgate.net/publication/275954089_How_can_we_measure_the_similarity_between_resumes_of_selected_candidates_for_a_job
* GNU Parallel was cited in: Automatic Methods for Assisted
Recruitment
https://www.researchgate.net/publication/297738658_Automatic_Methods_for_Assisted_Recruitment
* GNU Parallel was cited in: Tools and techniques for computational
reproducibility
http://biorxiv.org/content/biorxiv/early/2016/03/17/022707.full.pdf
* GNU Parallel was cited in: Reinterpretation of ATLAS 8 TeV searches
for Natural SUSY with a R-Sneutrino LSP
http://arxiv.org/pdf/1603.06130.pdf
* GNU Parallel was cited in: An Operational Radiometric Landsat
Preprocessing Framework for Large-Area Time Series Applications
https://www.uni-trier.de/fileadmin/fb6/prof/FER/Publikationen/frantz_et_al_ieee-tgrs-2016-post-print.pdf
* A basic demo of how GNU Parallel can speed up execution of commands
https://www.youtube.com/watch?v=kl8LO2jcvMc
* Downloading a list of URLs
http://blog.gypsydave5.com/2016/02/04/xargs-and-curl/
* qbatch uses GNU Parallel: https://pypi.python.org/pypi/qbatch/1.0rc2
* FaceCrop uses GNU Parallel: https://github.com/EderSantana/FaceCrop
* Parallel Processing with Catmandu
https://librecatproject.wordpress.com/2016/04/20/parallel-processing-with-catmandu/
* GNU parallel 應用範例
http://staypython.blogspot.dk/2016/04/gnu-parallel.html
* Bug fixes and man page updates.
20160322
* env_parallel is a function that exports the environment (functions,
aliases, variables, and arrays) to GNU Parallel. Run 'man
env_parallel' for details.
* niceload --prg now searches for substrings if no process with the
name is found.
* GNU Parallel was cited in: Random Forest DBSCAN for USPTO Inventor
Name Disambiguation http://arxiv.org/pdf/1602.01792.pdf
* GNU Parallel was mentioned (with wrong citation) in: Dual Level
Parallel Computations for LargeScale High-Fidelity Database to
Design Aerospace Vehicles
http://www.nas.nasa.gov/assets/pdf/papers/Guruswamy_2013_DualLevelParallelComputations.pdf
* Using ‘Parallel’ in Unix
https://shearnrylan.wordpress.com/2016/02/22/using-parallel-in-unix/
* JPEG Squish uses (and co-distributes) GNU Parallel:
http://dantidswell.co.uk/jpeg-squish/
* Bug fixes and man page updates.
20160222
* Vote for new community on Superuser, Ask Ubuntu, Unix&Linux
http://meta.superuser.com/questions/11127/community-promotion-ads-2016/11225#11225
http://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
http://meta.unix.stackexchange.com/questions/3854/community-promotion-ads-2016/3893#3893
* Daily Quick Tip: parallel
https://medium.com/@jacaetevha/daily-quick-tip-parallel-8772435f6582
* Downloading a list of URLs
http://blog.gypsydave5.com/2016/02/04/xargs-and-curl/
* Using GNU Parallel and ImageMagick for Conversions
http://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/
* Running bash commands in parallel
http://linuxcommando.blogspot.dk/2016/01/running-bash-commands-in-parallel.html
* parallel processing in PDAL
https://smathermather.wordpress.com/2016/01/28/parallel-processing-in-pdal/
* A Million Text Files And A Single Laptop
http://randyzwitch.com/gnu-parallel-medium-data/
* 「今日から使い切る」ための GNU Parallelによる並列処理入門
http://www.slideshare.net/koji_matsuda/gnu-parallel
* Bug fixes and man page updates.
20160122
* --sql DBURL uses DBURL as storage for jobs and output. It does not
run any jobs so it requires at least one --sqlworker. DBURL must
point to a table.
* --sqlworker DBURL gets jobs from DBURL and stores the result back to
DBURL.
* --sqlandworker is a shorthand for --sql and --sqlworker.
* --sqlworker requires the output of a single job to fit in memory.
* --results now also saves a file called 'seq' containing the sequence
number.
* If $PARALLEL_ENV is a file, then that file will be read into
$PARALLEL_ENV.
* man parallel_tutorial has been given an overhaul.
* --workdir now accepts replacementstrings.
* GNU Parallel was cited in: Possum - A Framework for
Three-Dimensional Reconstruction of Brain Images from Serial
Sections http://link.springer.com/article/10.1007/s12021-015-9286-1
* GNU Parallel was cited in: A Genetic Algorithm for the selection of
structural MRI features for classification of Mild Cognitive
Impairment and Alzheimer's Disease
http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=7359909&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7359909
* GNU Parallel was cited in: The Effect of Domain Modeling on
Performance of Planning Algorithms
http://isaim2016.cs.virginia.edu/papers/ISAIM2016_Bartak_Vodrazka.pdf
* Plotting time tables for jobs run by GNU Parallel
https://github.com/ziotom78/plot_joblog
* GNU Parallel was used in: Mission Impossible: you have 1 minute to
analyze the Ebola Genome https://www.biostars.org/p/119397
* GNU Parallel is used in LAST: http://last.cbrc.jp/
* Distributed Log Search Using GNU Parallel
http://codehate.com/blog/2015/12/01/distributed-log-search-using-gnu-parallel/
* Bug fixes and man page updates.
20151222
* --transfer is now an alias for --transferfile {}.
* --transferfile works like --transfer, but takes an argument like
--return. This makes it possible to combine transferring files
with multiple input sources: parallel -S server --tf {1} wc {2}
{1} ::: * ::: -l -w -c
* total_jobs() can now be used in {= =}: parallel echo job {#} of '{=
$_=total_jobs() =}' ::: {1..50}
* GNU Parallel was cited in: Evolution and Learning in Heterogeneous
Environments
http://research.gold.ac.uk/15078/1/COM_thesis_JonesD_2015.pdf
* GNU Parallel was cited in: Contrasting genetic architectures of
schizophrenia and other complex diseases using fast
variance-components analysis
http://www.nature.com/ng/journal/v47/n12/full/ng.3431.html
* GNU Parallel was cited in: Efficient Retrieval of Key Material for
Inspecting Potentially Malicious Traffic in the Cloud
http://www.cs.bham.ac.uk/~bxb/Papres/2015.1.pdf
* GNU Parallel was cited in: Achieving Consistent Doppler Measurements
from SDO/HMI Vector Field Inversions
http://arxiv.org/pdf/1511.06500.pdf
* Flo uses GNU Parallel: https://github.com/wurmlab/flo
* 使用 GNU parallel 來平行運算
http://mutolisp.logdown.com/posts/316959-using-gnu-parallel-to-parallel-computing
* Bug fixes and man page updates.
20151122
* GNU Parallel packaged for CERN CentOS:
http://linuxsoft.cern.ch/cern/centos/7/cern/x86_64/repoview/parallel.html
* GNU Parallel was cited in: The Outer Solar System Origins Survey:
I. Design and First-Quarter Discoveries
http://arxiv.org/pdf/1511.02895.pdf
* GNU Parallel was cited in: Contrasting genetic architectures of
schizophrenia and other complex diseases using fast
variance-components analysis
http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3431.html
* GNU Parallel was cited in: Named-Entity Chunking for Norwegian Text
using Support Vector Machines
http://ojs.bibsys.no/index.php/NIK/article/viewFile/248/211
* GNU Parallel was cited in: Multiscale Estimation of Binding Kinetics
Using Brownian Dynamics, Molecular Dynamics and Milestoning
http://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004381#pcbi.1004381.ref072
* GNU Parallel was cited in: A Detailed Characterization of Errors in
Logic Circuits due to Single-Event Transients
http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=7302348&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7302348
* GNU Parallel was cited in: Arabic Speaker Emotion Classification
Using Rhythm Metrics and Neural Networks
http://www.eurasip.org/Proceedings/Eusipco/Eusipco2015/papers/1570104855.pdf
* GNU Parallel was cited in: Stride Search: a general algorithm for
storm detection in high resolution climate data
http://www.geosci-model-dev-discuss.net/8/7727/2015/gmdd-8-7727-2015.pdf
* GNU Parallel was cited in: Decomposing Digital Paintings into Layers
via RGB-space Geometry http://arxiv.org/pdf/1509.03335.pdf
* GNU Parallel was cited in: Structure and evolutionary history of a
large family of NLR proteins in the zebrafish
http://www.biorxiv.org/content/biorxiv/early/2015/09/18/027151.full.pdf
* GNU Parallel was cited in: Evolution of movement strategies under
competitive interactions
http://digital.csic.es/bitstream/10261/115973/1/evolution_movement_strategies_Kiziridis.pdf
* Automating large numbers of tasks
https://rcc.uchicago.edu/docs/tutorials/kicp-tutorials/running-jobs.html
* Max out your IOPs with GNU Parallel
http://blog.bitratchet.com/2015/11/11/max-out-your-iops-with-gnu-parallel/
* Bug fixes and man page updates.
20151022
* --plus makes it possible to use {##} as a shorthand for
{= $_=$Global::JobQueue->total_jobs() =} which gives the the number
of jobs to run in total.
* {= $_=$Global::JobQueue->total_jobs() =} is incompatible with -X,
-m, and --xargs.
* GNU Parallel is now mostly compatible with lsh
(http://www.lysator.liu.se/~nisse/lsh/) and somewhat compatible with
autossh (http://www.harding.motd.ca/autossh/).
* --workdir ... now also works when run locally.
* GNU Parallel was cited in: There is no (75, 32, 10, 16) strongly
regular graph http://arxiv.org/pdf/1509.05933.pdf
* GNU Parallel was cited in: Roary: rapid large-scale prokaryote pan
genome analysis
http://bioinformatics.oxfordjournals.org/content/early/2015/08/05/bioinformatics.btv421.full.pdf+html
* GNU Parallel is used in TraitAR:
https://testpypi.python.org/pypi/traitar/0.1.4
* GNU Parallel is used in youtube-dl-parallel:
https://github.com/dlh/youtube-dl-parallel
* A parallel and fast way to download multiple files
http://onetipperday.blogspot.com/2015/10/a-parallel-and-fast-way-to-download.html
* Usar GNU Parallel para aumentar el rendimiento de tus scripts
http://adrianarroyocalle.github.io/blog/2015/10/20/usar-gnu-parallel/
* Bug fixes and man page updates.
20150922
* GNU Parallel was cited in: Flexible Modeling of Epidemics with an
Empirical Bayes Framework
http://journals.plos.org/ploscompbiol/article?id=10.1371%2Fjournal.pcbi.1004382
* GNU Parallel was cited in: BL1: 2D Potts Model with a Twist
https://sucs.swan.ac.uk/~rjames93/Dissertation.pdf
* GNU Parallel was cited in: DockBench: An Integrated Informatic
Platform Bridging the Gap between the Robust Validation of Docking
Protocols and Virtual Screening Simulations
http://www.mdpi.com/1420-3049/20/6/9977/pdf
* GNU Parallel was cited in: A Scalable Parallel Implementation of
Evolutionary Algorithms for Multi-Objective Optimization on GPUs
http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7257074
* GNU Parallel was cited in: Tools and techniques for computational
reproducibility
http://biorxiv.org/content/biorxiv/early/2015/07/17/022707.full.pdf
* GNU Parallel was cited in: How Can We Measure the Similarity Between
Résumés of Selected Candidates for a Job?
http://www.researchgate.net/publication/275954089_How_can_we_measure_the_similarity_between_rsums_of_selected_candidates_for_a_job
* GNU Parallel was cited in: Interplay of cell dynamics and epithelial
tension during morphogenesis of the Drosophila pupal wing
http://www.researchgate.net/profile/Raphael_Etournay/publication/279061859_Interplay_of_cell_dynamics_and_epithelial_tension_during_morphogenesis_of_the_Drosophila_pupal_wing/links/558a95ad08aeae8413bcceea.pdf
* Third-party selling GNU Parallel T-shirts
http://www.aliexpress.com/item/2015F-BSO-GNU-LOGO-GNU-PARALLEL-men-s-shirt-sleeve-visual-illusion-error/32464827966.html
* Joys of gnu parallel
http://scottolesen.com/index.php/2015/08/26/joys-of-gnu-parallel/
* Crop and resize images with bash and ImageMagick
https://www.simonholywell.com/post/2015/08/image-resize-crop-bash-imagemagick/
* Three Ways to Script Processes in Parallel
http://www.codeword.xyz/2015/09/02/three-ways-to-script-processes-in-parallel/
* What It Looks Like to Process 3.5 Million Books
http://blog.gdeltproject.org/what-it-looks-like-to-process-3-5-million-books/
* Bug fixes and man page updates.
20150822
* If $job->skip() is called in {= =} the job will not be run.
* @arg can now be used in {= =}: parallel echo '{= $arg[2] < 5 and
$_="j" =}' ::: 1 2 3 ::: 4 5 6
* Version of GNU Parallel that uses PostgreSQL as backend
https://github.com/stephen-fralich/parallel-sql/
* A composite genome approach to identify phylogenetically informative
data from next-generation sequencing
http://www.biomedcentral.com/content/pdf/s12859-015-0632-y.pdf
* SpeedSeq: ultra-fast personal genome analysis and interpretation
http://www.nature.com/nmeth/journal/vaop/ncurrent/full/nmeth.3505.html
* GNU Parallel is used in elPrep: https://github.com/ExaScience/elprep
* Who actually reads the code?
http://www.fsf.org/blogs/community/who-actually-reads-the-code
* Introduction to GNU Parallel
http://erictleung.com/2015/08/06/intro-to-gnu-parallel/
* ¿Alguien se lee el código?
http://www.taringa.net/post/linux/18854759/Alguien-se-lee-el-codigo.html
* ¿Quién se lee el código fuente?
https://victorhckinthefreeworld.wordpress.com/2015/08/12/quien-se-lee-el-codigo-fuente/
* Distribution des traitements avec GNU Parallel
http://blog.inovia-conseil.fr/?p=226#4
* Эксперимент по проверке, читают ли код открытых проектов
http://www.opennet.ru/opennews/art.shtml?num=42718
* 多核心主機搭配 GNU parallel
http://blog.zeroplex.tw/2015/08/gnu-parallel.html
* Bug fixes and man page updates.
20150722
* If a record fits in a block, --block only reads upto the size of
--block. If not: --block reads a full --block more.
* Due to widely spread distributions still using --tollef even after a
year of being retired following a year of being obsolete, --tollef
now gives an error unless used with --gnu.
* --nice now uses a perl wrapper instead of the nice command.
* Cookie 2013-08-18 was won by Mark Maimone, 1 year and 11 months
after release.
* A parser for GNU Parallel --joblog files:
https://github.com/harryjubb/joblog
* GNU Parallel was cited in: Dynamical formation & scattering of
hierarchical triples: Cross sections, Kozai-Lidov oscillations, and
collisions http://arxiv.org/pdf/1507.03593.pdf
* GNU Parallel was cited in: A Fast Compiler for NetKAT
http://arxiv.org/pdf/1506.06378.pdf
* GNU Parallel was cited in: Flexible Modeling of Epidemics with an
Empirical Bayes Framework
http://www.stat.cmu.edu/~ryantibs/papers/empbayes.pdf
* GNU Parallel was cited in: Decomposing Time-Lapse Paintings into
Layers
http://cs.gmu.edu/~ygingold/timemap/Decomposing%20Time-Lapse%20Paintings%20into%20Layers%20(Tan%20et%20al%202015%20SIGGRAPH)%20600dpi.pdf
* GNU Parallel was used in: Somatic mutation calling from the matched
tumor-normal exome-sequencing
http://fafner.meb.ki.se/biostatwiki/somac/
* Parallel Processing from the Command Line
https://www.perpetual-beta.org/weblog/parallel-processing-from-the-command-line.html
* Using GNU Parallel to speed up network operations
http://vielmetti.typepad.com/vacuum/2015/06/using-gnu-parallel-to-speed-up-network-operations.html
* Crawl faster with "parallel" - but how fast?
http://andreas-wpv.blogspot.com/2015/07/crawl-faster-with-parallel-but-how-fast.html
* Simultaneously benchmark many URLs with ApacheBench and GNU parallel
https://www.simonholywell.com/post/2015/06/parallel-benchmark-many-urls-with-apachebench/
* Bug fixes and man page updates.
20150622
* --halt has been rewritten completely. You can now combine
percentages with success or fail. See the man page.
* Exit values 102..254 have been removed. 101 means more than 100 jobs
failed.
* Killing through --timeout, --memfree, or --halt is now done as a
process group.
* --termseq determines which signals are sent when a job is killed.
* An empty argument would previously cause no string to be
inserted. This is now changed to '' being inserted, thus prepending
a space to the output of: parallel echo {} b ::: ''
* $PARALLEL_ENV can now be set to an environment prepending the
command. Used in env_parallel as mentioned in the manpage.
* --retry-failed will retry all failed jobs in a joblog. It will
ignore any command given.
* --ssh and $PARALLEL_SSH can be used to set the command used for
ssh. The command is assumed to behave the same way as ssh.
* --fifo now works in csh, too.
* Q(...) can be used in {= =} to shell quote a string.
* GNU Parallel was cited in: Contrasting regional architectures of
schizophrenia and other complex diseases using fast variance
components analysis
http://biorxiv.org/content/biorxiv/early/2015/06/05/016527.full.pdf
* GNU Parallel was cited in: DockBench: An Integrated Informatic
Platform Bridging the Gap between the Robust Validation of Docking
Protocols and Virtual Screening Simulations
http://www.mdpi.com/1420-3049/20/6/9977
* GNU Parallel was cited in: Swedes Online: You Are More Tracked Than
You Think
http://www.diva-portal.org/smash/get/diva2:807623/FULLTEXT01.pdf
* GNU Parallel was cited in: Tutorial: Lorenz-Mie theory for 2D
scattering and resonance calculations
http://arxiv.org/pdf/1505.07691.pdf
* GNU Parallel was cited in: A quantitative assessment of the Hadoop
framework for analyzing massively parallel DNA sequencing data
http://link.springer.com/article/10.1186/s13742-015-0058-5
* GNU Parallel was cited in: A composite genome approach to identify
phylogenetically informative data from next-generation sequencing
http://www.biomedcentral.com/content/pdf/s12859-015-0632-y.pdf
* GNU Parallel was cited in: Tutorial: Lorenz-Mie theory for 2D
scattering and resonance calculations
http://arxiv.org/pdf/1505.07691.pdf
* GNU Parallel is used in: taxator-tk
http://algbio.cs.uni-duesseldorf.de/webapps/wa-download/
* GNU Parallel is used in: https://github.com/d2207197/local-mapreduce
* GNU Parallel is used in: wiki-edit-news https://github.com/albert-decatur/wiki-edit-news
* GNU Parallel is used in: A Fingerprint Identification System
https://curve.carleton.ca/system/files/theses/28733.pdf
* Job ad asking for GNU Parallel experience:
http://searchjobs.intel.com/gdansk-pol/software-validation-engineer/63A06826DAF24797AB414DC146201C2E/job/
* Using BLAT http://wangzhengyuan.blogspot.dk/2015/06/using-blat.html
* Bug fixes and man page updates.
20150522
* Security: The security issue for --sshlogin + --fifo/--cat has been
fixed. Thereby all issues with
http://lists.gnu.org/archive/html/parallel/2015-04/msg00045.html
have been fixed.
* Security: After further security analysis the issue fixed in
20150422 also fixed the problem for --tmux.
* GNU Parallel was cited in: CIDER: a pipeline for detecting waves of
coordinated transcriptional regulation in gene expression
time-course data
http://biorxiv.org/content/biorxiv/early/2015/03/17/012518.full.pdf
* GNU Parallel was cited in: Building Genomic Analysis Pipelines in a
Hackathon Setting with Bioinformatician Teams: DNA-seq, Epigenomics,
Metagenomics and RNA-seq
http://biorxiv.org/content/biorxiv/early/2015/05/05/018085.full.pdf
* GNU Parallel was cited in: Toward Enhanced Metadata Quality of
Large-Scale Digital Libraries: Estimating Volume Time Range
https://www.ideals.illinois.edu/bitstream/handle/2142/73656/186_ready.pdf
* GNU Parallel was cited in: Sequencing the cap-snatching repertoire
of H1N1 influenza provides insight into the mechanism of viral
transcription initiation
http://nar.oxfordjournals.org/content/early/2015/04/20/nar.gkv333.full.pdf
* GNU Parallel was cited in: Genome assembly using Nanopore-guided
long and error-free DNA reads
http://www.biomedcentral.com/content/pdf/s12864-015-1519-z.pdf
* GNU Parallel was cited in: Contrasting regional architectures of
schizophrenia and other complex diseases using fast variance
components analysis
http://biorxiv.org/content/biorxiv/early/2015/03/13/016527.full.pdf
* GNU Parallel was used (unfortunately with wrong citation) in:
Comparing the CarbonTracker and TM5-4DVar data assimilation systems
for CO2 surface flux inversions
http://www.atmos-chem-phys-discuss.net/15/8883/2015/acpd-15-8883-2015-discussion.html
* GNU Parallel was used in: Gene Set Omic Analysis (GSOA) method
https://bitbucket.org/srp33/gsoa
* A Quick and Neat :) Orchestrator using GNU Parallel
http://www.elsotanillo.net/2015/05/a-quick-and-neat-orchestrator-using-gnu-parallel/
* Execute commands on multiple computers using GNU Parallel (setting
up a cluster on the cheap)
https://spectraldifferences.wordpress.com/2015/04/26/execute-commands-on-multiple-computers-using-gnu-parallel-setting-up-a-cluster-on-the-cheap/
* Functions and GNU parallel for effective cluster load management
http://genomespot.blogspot.dk/2015/04/functions-and-gnu-parallel-for.html
* Use parallel processing to save time importing databases
http://drupalsun.com/node/41854
* Run multiple ssh commands in parallel with GNU Parallel
http://www.ameir.net/blog/archives/380-run-multiple-ssh-commands-in-parallel-with-gnu-parallel.html
* Importing huge databases faster
https://www.lullabot.com/blog/article/importing-huge-databases-faster
* Run multiple ssh commands in parallel with GNU Parallel
https://www.ameir.net/blog/archives/380-run-multiple-ssh-commands-in-parallel-with-gnu-parallel.html/comment-page-1
* Parallel? Gnu parallel! https://debian.pro/1834
* Bug fixes and man page updates.
20150422
New in this release:
* Security fix. An attacker on the local system could make you
overwrite one of your own files with a single byte. The problem
exist when you use --compress or --tmux or --pipe or --cat or
--fifo. The attacker must figure out the randomly chosen file name
and create a symlink within a time window of 15 ms.
* --shuf will generate all jobs, and shuffle them before running
them. This is useful to get a quick preview of the results before
running the full batch.
* GNU Parallel now has a DOI: https://dx.doi.org/10.5281/zenodo.16303
* GNU Parallel was cited in: Scaling Machine Learning for Target
Prediction in Drug Discovery using Apache Spark
https://cris.cumulus.vub.ac.be/portal/files/5147244/spark.pdf
* GNU Parallel was cited in: Bayesian inference of protein structure
from chemical shift data https://peerj.com/articles/861/
* GNU Parallel was cited in: Toward Enhanced Metadata Quality of
Large-Scale Digital Libraries: Estimating Volume Time Range
https://www.ideals.illinois.edu/bitstream/handle/2142/73656/186_ready.pdf
* GNU Parallel was cited in: Contrasting regional architectures of
schizophrenia and other complex diseases using fast variance
components analysis
http://biorxiv.org/content/biorxiv/early/2015/03/13/016527.full.pdf
* GNU Parallel was cited in: Experimental study on the Wind Farm
Substation Cable Installation Problem
http://i11www.iti.uni-karlsruhe.de/_media/teaching/theses/ma-schmitz-14.pdf
* GNU Parallel was used in: landsat-gifworks
https://github.com/KAPPS-/landsat-gifworks
* GNU Parallel was used in: https://github.com/exascience/elprep
* GNU Parallel was used in:
http://search.cpan.org/~jillrowe/HPC-Runner-GnuParallel-0.01/
* GNU Parallel was used in:
http://search.cpan.org/~ajpage/Bio-Roary-2.0.7/lib/Bio/Roary/JobRunner/Parallel.pm
* GNU Parallel was used in: Rapid haploid SNP calling
https://github.com/tseemann/snippy
* Pictures and Metadata
http://www.ozzy.no/2015/02/05/pictures-and-metadata/
* Task automation with bash and parallel
https://biowize.wordpress.com/2015/03/23/task-automation-with-bash-and-parallel/
* How To: Speed Up File Transfers in Linux using RSync with GNU
Parallel
http://www.yourownlinux.com/2015/04/speed-up-file-transfers-using-rsync-with-gnu-parallel.html
* Mirroring a Git Repository
https://avacariu.me/articles/mirroring-a-git-repository.html
* Add an ENVI header to JAXA Global Mangrove Watch PALSAR tiles
https://spectraldifferences.wordpress.com/2015/03/24/add-an-envi-header-to-jaxa-global-mangrove-watch-palsar-tiles/
* GNU Parallel (Sebuah Uji Coba)
http://kaka.prakasa.my.id/2014/09/04/gnu-parallel-sebuah-uji-coba/
* 你见过的最牛逼的命令行程序是什么？
http://www.zhihu.com/question/29257300
* Bug fixes and man page updates.
20150322
New in this release:
* --number-of-cores respects 'taskset' on GNU/Linux.
* --joblog --pipe gives the data send and received in the log.
* GNU Parallel was tested to support 100 GB sized records in --pipe. A
few bugs was fixed to support >2 GB records. It works, but is rather
slow.
* GNU Parallel was cited in: RIG: Recalibration and Interrelation of
genomic sequence data with the GATK
http://www.g3journal.org/content/early/2015/02/13/g3.115.017012.full.pdf+html
* GNU Parallel was cited in: MPI-blastn and NCBI-TaxCollector:
Improving metagenomic analysis with high performance classification
and wide taxonomic attachment
http://www.worldscientific.com/doi/abs/10.1142/S0219720014500139?af=R&
* GNU Parallel was cited in: Recent evolution in Rattus norvegicus is
shaped by declining effective population size
http://biorxiv.org/content/biorxiv/early/2015/03/01/015818.full.pdf
* GNU Parallel was cited in: Evidence for DCO+ as a probe of
ionization in the warm disk surface
http://arxiv.org/pdf/1503.02659.pdf
* GNU Parallel was cited in: De novo assembly and annotation of the
Asian tiger mosquito (Aedes albopictus) repeatome with dnaPipeTE
from raw genomic reads and comparative analysis with the yellow
fever mosquito (Aedes aegypti)
http://gbe.oxfordjournals.org/content/early/2015/03/11/gbe.evv050.full.pdf
* GNU Parallel was cited in: A General Approach to Network
Configuration Analysis
http://research.microsoft.com/en-us/um/people/ratul/papers/nsdi2015-batfish.pdf
* GNU Parallel was cited in: Scrimer: designing primers from
transcriptome data
http://onlinelibrary.wiley.com/doi/10.1111/1755-0998.12403/pdf
* GNU Parallel was cited in: Efficient Retrieval of Key Material for
Inspecting Potentially Malicious Traffic in the Cloud
http://sacko.uk/pdf/2015.1.pdf
* GNU Parallel will be presented at Strataconf: Poor Man's Parallel
Pipelines
http://strataconf.com/big-data-conference-uk-2015/public/schedule/detail/40031
* GNU Parallel was used in:
https://github.com/alexbyrnes/FCC-Political-Ads_The-Code
* GNU Parallel was used in: https://github.com/martymac/fpart
* GNU Parallel was used in:
https://github.com/hoytak/diabetic-retinopathy-code
* GNU Parallel was used in:
https://github.com/mehmattski/HybSeqPipeline
* GNU Parallel was used in:
http://search.cpan.org/~ajpage/Bio-Roary-2.0.0/lib/Bio/Roary/JobRunner/Parallel.pm
* Using GNU Parallel on a Raspberry Pi cluster:
http://www.dcglug.org.uk/cluster-progress/
* An introduction to vector tiling and map reduce in postgis:
http://dimensionaledge.com/intro-vector-tiling-map-reduce-postgis/
* Running scripts in parallel with GNU Parallel:
http://code.jasonbhill.com/2015/03/
* Mahout: Parallelising the creation of DecisionTrees:
http://www.markhneedham.com/blog/2012/12/27/mahout-parallelising-the-creation-of-decisiontrees/
* High-Performance Scientific Computing: Running serial jobs in
parallel
https://support.scinet.utoronto.ca/education/staticpublic/course178/serial.pdf
* Parallel cardinality on your laptop
https://highonscience.wordpress.com/2015/03/15/parallel-cardinality-on-your-laptop/
* Experiments about a better locate using grep
http://a3nm.net/blog/better_locate.html
* Homework with GNU Parallel:
https://support.scinet.utoronto.ca/education/staticpublic/course178content349.html
* Parallel - Jobs in Skripten parallelisieren:
https://slzm.de/blog/linux-tool-des-tages-parallel-jobs-in-skripten-parallelisieren/#more-612
* GNU Parallel, czyli 100% użycia procesora
http://matmatyk.blogspot.dk/2015/03/gnu-parallel-czyli-100-uzycia-procesora.html
* Bug fixes and man page updates.
20150222
* --tmux has gotten a major overhaul.
* GNU Parallel was cited in: RaftLib: A C++ Template Library for High
Performance Stream Parallel Processing
http://www.cs.wustl.edu/~lip/pubs/pmam15_jbeard.pdf
* GNU Parallel was cited in: Quantifying properties of hot and dense
QCD matter through systematic model-to-data comparison
http://arxiv.org/pdf/1502.00339.pdf
* GNU Parallel was cited in: Towards Collaborative Exploration and
Analysis of Big Data from Mars: A Noachis Terra Case Study
http://link.springer.com/chapter/10.1007/978-3-319-13865-7_25
* GNU Parallel was cited in: Towards Recommender Engineering Tools and
Experiments for Identifying Recommender Differences
http://elehack.net/research/thesis/mde-thesis.pdf
* GNU Parallel was used (unfortunately with wrong citation) in: