Skip to content
Jianhai SU edited this page Jun 17, 2020 · 103 revisions

Welcome to our reading group!

This reading group was inspired by the SE reading group at CMU led by Christian Kaestner and Gabriel Ferreira and ML reading group at Imperial, and we just want to replicate a similar experience at USC.

The paper reading group meets weekly during the semester to discuss papers in the areas of artificial intelligence, machine learning, systems, and software engineering. Participation is open to all, guests are always welcome; if you are interested in receiving invitations contact the organizer.

Each week we will discuss a different paper. The paper to discuss is announced about one week in advance by the organizer. All participants are expected to read the paper before the meeting. It is recommended to take notes about insights, questions, and other points potentially worth discussing.

The goals of the reading group are:

  • Critical reflection on scientific work
  • Practice of reading and argumentation strategies
  • Exposure to a broad range of research topics
  • Practice of leading group discussions

We follow these simple rules:

  • Please read the paper before the meeting
  • Engage in the discussions (ask questions, answer questions, discuss insights, discuss writing style)

The discussion is limited to one hour. The discussion is lead by a moderator, who may also set a focus for the discussion. The moderator will kick off the meeting by giving a short summary of the paper and raising a few points for discussion. The moderator should try to incorporate all participants into the discussion. The moderator role rotates through all participants. The moderator is encouraged to help with the selection of a paper that week.

Time and location: Friday 11:00 am in CSE Department, RM 2265. (We are now e-meeting via Zoom)

Subscribe for announcements:

Agenda

June 26 2020

"Scalable Neural Bootstrapper". Minsuk Shin, Hyungjoo Cho, Sungbin Lim.

Moderator: Minsuk

June 19 2020

"Concept Learning in Deep Reinforcement Learning." Diego Gomez, Nicanor Quijano, Luis Felipe Giraldo.

Moderator: Nawras

June 12 2020

"Shortcut Learning in Deep Neural Networks." Robert Geirhos, Jörn-Henrik Jacobsen, Claudio Michaelis, Richard Zemel, Wieland Brendel, Matthias Bethge, Felix A. Wichmann.

Moderator: Ying

June 5 2020

"Domain Adaptation by Using Causal Inference to Predict Invariant Conditional Distributions." Sara Magliacane, Thijs van Ommen, Tom Claassen, Stephan Bongers, Philip Versteeg, Joris M. Mooij. Moderator: Mohammad

May 29 2020

"Transfer in Deep Reinforcement Learning Using Successor Features and Generalized Policy Improvement." Andre Barreto, Diana Borsa, John Quan, Tom Schaul, David Silver, Matteo Hessel, Daniel Mankowitz, Augustin Zidek, Remi Munos. Moderator: Jianhai

May 22 2020

“Sympson’s Paradox in Covid-19 Case Fatality Rates: A Mediation Analysis of Age-Related Causal Effects.” Julius von Kügelgen, Luigi Gresele, Bernhard Schölkopf. Moderator: Marco

May 15 2020

"Counterfactuals and Their Applications" - the chapter 4 of the book, “Causal Inference in Statistics: A Primer” (Judea Pearl, Madelyn Glymour and Nicholas Jewel). Moderator: Mohammad

May 8 2020

“Successor Features for Transfer in Reinforcement Learning” André Barreto, Will Dabney, Rémi Munos, Jonathan J. Hunt, Tom Schaul, Hado van Hasselt, David Silver. Moderator: Pooyan

May 1 2020

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 16.3 onwards" MIT press, 2016. Moderator: Mohammad

April 24 2020

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 16.1 onwards" MIT press, 2016. Moderator: Mohammad

April 17 2020

[Continual] “On Learning Invariant Representations for Domain Adaptation”. Han Zhao, Remi Tachet des Combes, Kun Zhang, Geoffrey J. Gordon. Moderator: Jianhai

April 10 2020

“On Learning Invariant Representations for Domain Adaptation”. Han Zhao, Remi Tachet des Combes, Kun Zhang, Geoffrey J. Gordon. Moderator: Jianhai

April 3 2020

“Fundamental Tradeoffs between Invariance and Sensitivity to Adversarial Perturbations”. Florian Tramèr, Jens Behrmann, Nicholas Carlini, Nicolas Papernot, Jörn-Henrik Jacobsen. Moderator: Ying

March 27 2020

“Invariant Risk Minimization”. Martin Arjovsky, L´eon Bottou, Ishaan Gulrajani, David Lopez-Paz. (Continue) Moderator: Mohammad

March 20 2020

"The Three Pillars of Machine Programming". Justin Gottschlich, Armando Solar-Lezama, Nesime Tatbul, et al. Moderator: Pooyan

March 13 2020

“Invariant Risk Minimization”. Martin Arjovsky, L´eon Bottou, Ishaan Gulrajani, David Lopez-Paz. Moderator: Mohammad

March 6 2020

“A Programmable Approach to Model Compression”. Vinu Joseph, Saurav Muralidharan, Animesh Garg, Michael Garland, Ganesh Gopalakrishnan. Moderator: Shahriar

February 14 2020

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 12, section 1.4 to section 1.6" MIT press, 2016. Moderator: Jianhai

February 7 2020

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 12, section 1.1 to section 1.3" MIT press, 2016. Moderator: Bharat

January 31 2020

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 11.5 onwards" MIT press, 2016. Moderator: Bharat

January 24 2020

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 11 onwards" MIT press, 2016. Moderator: Shahriar

January 17 2020

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 9.10 onwards" MIT press, 2016. Moderator: Ying

January 10 2020

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 9.6 onwards" MIT press, 2016. Moderator: Jianhai

November 22 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 9.4 onwards" MIT press, 2016. Moderator: Shahriar

November 22 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Chapter 9 onwards" MIT press, 2016. Moderator: Bharat

November 8 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Section 8.7 onwards" MIT press, 2016. Moderator: Shahriar

November 1 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Section 8.6 onwards" MIT press, 2016. Moderator: Jianhai

Oct 11 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Section 8.4 onwards" MIT press, 2016. Moderator: Shahriar

Oct 4 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Section 8.3 onwards" MIT press, 2016. Moderator: Ahmed

Aug 19 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Section 7.9 onwards" MIT press, 2016. Moderator: Chris

Aug 12 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: Section 7.6 onwards (Semi-supervised, multi-task learning, early stopping)" MIT press, 2016. Moderator: Dr. Jamshidi

Aug 5 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 7.2 - 7.5" MIT press, 2016. Moderator: Shahriar

Jul 29 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 7" MIT press, 2016. Moderator: Ahmed

Jul 22 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 6" MIT press, 2016. Moderator: Ying

Jul 15 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 6" MIT press, 2016. Moderator: Ying

Jul 08 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 6" MIT press, 2016. Moderator: Ying

Jul 01 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 5 (ML basics)" MIT press, 2016. Moderator: Joshua

Jun 24 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 5 (ML basics)" MIT press, 2016. Moderator: Nawras

Jun 17 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 5 (ML basics)" MIT press, 2016. Moderator: Chrisogonas

Jun 10 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 5 (ML basics)" MIT press, 2016. Moderator: Chrisogonas

Jun 3 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 3 (Probability and Information Theory)" MIT press, 2016. Moderator: Shahriar

May 27 2019

Goodfellow, Ian, Yoshua Bengio, and Aaron Courville. "Deep Learning: chapter 2 (Linear Algebra)" MIT press, 2016. Moderator: Jianhai

May 20 2019

Neapolitan, Richard E. ["Learning bayesian networks: chapter 8 (Sections 8.1-8.2)"] Moderator: Marco

May 13 2019

Borchani, Hanen, Ana M. Martínez, Andrés R. Masegosa, Helge Langseth, Thomas D. Nielsen, Antonio Salmerón, Antonio Fernández, Anders L. Madsen, and Ramón Sáez. "Modeling concept drift: A probabilistic graphical model based approach." In International Symposium on Intelligent Data Analysis, pp. 72-83. Springer, Cham, 2015. Moderator: Emad

May 06 2019

Sen, Rajat, Kirthevasan Kandasamy, and Sanjay Shakkottai. "Noisy Blackbox Optimization using Multi-fidelity Queries: A Tree Search Approach." In The 22nd International Conference on Artificial Intelligence and Statistics (AIStats), pp. 2096-2105. 2019. Moderator: Jianhai

Apr 15 2019

Van Seijen, Harm, Mehdi Fatemi, Joshua Romoff, Romain Laroche, Tavian Barnes, and Jeffrey Tsang. "Hybrid reward architecture for reinforcement learning." In Advances in Neural Information Processing Systems, pp. 5392-5402. 2017. Moderator: Yuxiang

Mar 25 2019

Sciuto, Christian, Kaicheng Yu, Martin Jaggi, Claudiu Musat, and Mathieu Salzmann. "Evaluating the Search Phase of Neural Architecture Search." arXiv preprint arXiv:1902.08142 (2019). Moderator: Rui

Mar 18 2019

Kim, Jinhan, Robert Feldt, and Shin Yoo. "Guiding deep learning system testing using surprise adequacy." Proceedings of the 41th International Conference on Software Engineering (ICSE), 2019. Moderator: Ying

Mar 11 2019

Pearl, Judea. "The seven tools of causal inference, with reflections on machine learning." Communications of the ACM 62, no. 3 (2019): 54-60. Moderator: Marco Valtorta

Mar 4 2019

Baker, Bowen, Otkrist Gupta, Nikhil Naik, and Ramesh Raskar. "Designing neural network architectures using reinforcement learning." International Conference on Learning Representations (ICLR), 2017. Moderator: Jianhai Su

Feb 25 2019

Majumdar, Abhinandan, Leonardo Piga, Indrani Paul, Joseph L. Greathouse, Wei Huang, and David H. Albonesi. "Dynamic gpgpu power management using adaptive model predictive control." In 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA), pp. 613-624. IEEE, 2017. Moderator: Shahriar

Feb 11 2019

Mammadli, Rahim, Felix Wolf, and Ali Jannesari. "The Art of Getting Deep Neural Networks in Shape." ACM Transactions on Architecture and Code Optimization (TACO) 15, no. 4 (2019): 62. Moderator: RUI XIN

Feb 4 2019

Han, Xue, Tingting Yu, and David Lo. "PerfLearner: learning from bug reports to understand and generate performance test frames" In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering, pp. 17-28. ACM, 2018. Moderator: Yang Ren

Jan 27 2019

Machalica, Mateusz, Alex Samylkin, Meredith Porth, and Satish Chandra. "Predictive Test Selection" In ICSE 2019. Moderator: Alireza

Jan 21 2019

Zhao, Yanpeng, Yetian Chen, Kewei Tu, and Jin Tian. "Curriculum learning of Bayesian network structures" In Asian Conference on Machine Learning, pp. 269-284. 2016. Moderator: Mohammad Ali Javidian

Jan 14 2019

Ardelean, Dan, Amer Diwan, and Chandra Erdman. "Performance Analysis of Cloud Applications" In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18). USENIX Association, 2018. Moderator: Jianhai Su

Jan 7 2019

Machado, Marlos C., Marc G. Bellemare, Erik Talvitie, Joel Veness, Matthew Hausknecht, and Michael Bowling. "Revisiting the arcade learning environment: Evaluation protocols and open problems for general agents" Journal of Artificial Intelligence Research 61 (2018): 523-562. Moderator: Yuxiang Sun

Dec 17 2018

Liam Li, Kevin Jamieson, Afshin Rostamizadeh, Ekaterina Gonina, Moritz Hardt, Benjamin Recht, and Ameet Talwalkar. "Massively Parallel Hyperparameter Tuning" Moderator: Shahriar

Dec 3 2018

Pearl, Judea, and Elias Bareinboim. "Transportability of causal and statistical relations: A formal approach." In Proceedings of the 25th AAAI Conference on Artificial Intelligence, 2011. Moderator: Mohammad Ali Javidian

Nov 26 2018

Adnan Darwiche. 2018. Human-level intelligence or animal-like abilities?. Commun. ACM 61, 10 (September 2018), 56-67. Moderator: Marco Valtorta

Nov 19 2018

Shu Wang, Chi Li, Henry Hoffmann, Shan Lu, William Sentosa, Achmad Imam Kistijantoro. "Understanding and Auto-Adjusting Performance-Sensitive Configurations." Moderator: YANG REN

Nov 12 2018

Venkataraman, Shivaram, Zongheng Yang, Michael J. Franklin, Benjamin Recht, and Ion Stoica. "Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics." In NSDI, pp. 363-378. 2016. Moderator: Edward Tsien

Nov 5 2018

Negrinho, Renato, and Geoff Gordon. "Deeparchitect: Automatically designing and training deep architectures." arXiv preprint arXiv:1704.08792, 2017. Moderator: Rui Xin

October 29 2018

Pei, Kexin, Yinzhi Cao, Junfeng Yang, and Suman Jana. "Deepxplore: Automated whitebox testing of deep learning systems." In Proceedings of the 26th Symposium on Operating Systems Principles (SOSP), pp. 1-18. ACM, 2017. Moderator: Hussein Almulla

October 22 2018

Hangl, Simon, Sebastian Stabinger, and Justus Piater. "Autonomous skill-centric testing using deep learning." In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 95-102. IEEE, 2017. Moderator: Jason O'Kane

October 15 2018

Mnih, Volodymyr, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves et al. "Human-level control through deep reinforcement learning." Nature 518, no. 7540 (2015): 529. Moderator: Yuxiang Sun

October 8 2018

Blasi, Arianna, Alberto Goffi, Konstantin Kuznetsov, Alessandra Gorla, Michael D. Ernst, Mauro Pezzè, and Sergio Delgado Castellanos. "Translating code comments to procedure specifications" In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis, pp. 242-253. ACM, 2018. Moderator: Gregory Gay

October 1 2018

Brown, David Bingham, Michael Vaughn, Ben Liblit, and Thomas Reps. "The care and feeding of wild-caught mutants." In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, pp. 511-522. ACM, 2017. Moderator: Alireza Salahirad

September 24 2018

Mishra, Nikita, Connor Imes, John D. Lafferty, and Henry Hoffmann. "CALOREE: learning control for predictable latency and low energy." In Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 184-198. ACM, 2018. Moderator: Shahriar

September 10 2018

Gunawi, Haryadi S., Mingzhe Hao, Tanakorn Leesatapornwongsa, Tiratat Patana-anake, Thanh Do, Jeffry Adityatama, Kurnia J. Eliazar et al. "What bugs live in the cloud? a study of 3000+ issues in cloud systems." In Proceedings of the ACM Symposium on Cloud Computing, pp. 1-14. ACM, 2014. Moderator: Yang

Clone this wiki locally