Skip to content

How to review CFPs

Phil Dibowitz edited this page Oct 13, 2024 · 12 revisions

Logging in / Creating an Account

Head to https://www.socallinuxexpo.org/user/

Create an account if you don't already have one and log in.

If you are logged in, there should be a Reviewer section on the left. If not, you don't have reviewer access yet, let KC know to fix your account.

Getting to the proposals

Once you have the Reviewer section, you want Presentations Filtered because in this view you can sort by Topic (track).

Be sure to change the SCALE event to be the current year (22x as of writing) and click Apply! You must do this each time. It will likely default you to an older conference which is over and so voting on those isn’t useful.

Getting started:

  • You're likely to start with the Topic(s) you know best but plan to review most/all Topics if you can. More votes yield better opinions and better results. Also, people mis-categorize a lot so you can help catch talks that should be moved to a different Topic.
  • Sort the talk list by Topic and try to review one Topic at a time as the talks will be similar.
  • Before digging into individual talks, look over the Topic to see if anything sticks out as in the wrong place.

On each talk:

  • Choose a number of stars. Remember that 3 stars is the least-valuable vote since it’s neither a vote for nor a vote against. Use it sparingly.
  • Try to add a comment - just something on why you voted that many stars, to help add context for talks that may, for example, have 2 5-stars and 2 1-stars.
  • Add a comment if you know someone is a great speaker, if a talk seems like it should be moved to a different Topic.
  • Pay close attention if there are notes in the Message to Reviewers section as the speaker specifically added that note for your benefit.

Making the schedule

  • After everyone on the Program Committee has had time to vote for individual talks, the chairs will start to solidify the schedule which determines how many slots are available for each track.
  • The track leads will fill in those slots to create a proposed schedule for the track (typically 5-7 talks + 2 reserve depending on the days).
  • The Program Committee will meet to review the proposed schedules and finalize selection before notifications to speakers.