CS91.3 Lab 7: Review Five Posters

Due Tuesday, March 15, by midnight (23:59, EST)

Goals

The goals for this lab assignment are:

  • Get comfortable with using Reviewer Guide from CS conferences

  • Get comfortable with the Double-blind Peer Review Process

  • Provide helpful suggestions to your peers to improve the posters

  • Think about your poster, how can you improve

  • Prepare to write your Author Response

1. Reviewer Guide

For this week, please read the Entire Page of the Reviewer Guide. Pay special attention to the sections of:

  • Reviewer best practices

  • Reviewer Instructions

2. Review Examples

Please review the three examples below:

8-8-10, Best paper award Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Research By Bernard Koch, Emily Denton, Alex Hanna, and Jacob Gates Foster.

8-9-9, Best paper award ATOM3D: Tasks on Molecules in Three Dimensions By Raphael John Lamarre Townshend, Martin Vögele, Patricia Adriana Suriana, Alexander Derry, Alexander Powers, Yianni Laloudakis, Sidhika Balachandar, Bowen Jing, Brandon M. Anderson, Stephan Eismann, Risi Kondor, Russ Altman, and Ron O. Dror.

7-7-10, ML and BCI EEGEyeNet: a Simultaneous Electroencephalography and Eye-tracking Dataset and Benchmark for Eye Movement Prediction By Ard Kastrati and Martyna Beata Plomecka and Damian Pascual and Lukas Wolf and Victor Gillioz and Roger Wattenhofer and Nicolas Langer.

3. Write Your Own Review

  • Review the FIVE posters you are assigned in Course folder

  • You will get a reply email to your midterm submission about which five posters you are required to review.

  • Follow the instructions about Double-blind reviewing on the Reviewer Guidelines page.

  • Write your review based on the Reviewer Guide and Review Examples above. You should include:

    1. Summary and contributions: # At least five sentences, including its innovation, connection, and impact.

    2. Strengths: # At least five sentences, with details from the poster to support your opinion.

    3. Weaknesses: # At least eight sentences, with details from the poster to support your opinion. 'Your comments should be detailed, specific, and polite. Please avoid vague, subjective complaints. ' 'Always be constructive and help the authors understand your viewpoint, without being dismissive or using inappropriate language. '

    4. Correctness: # At least one sentence.

    5. Clarity: # At least three sentences, examples are required 'Give examples of what parts of the paper need revision to improve clarity.'

    6. Relation to prior work: # At least three sentences, 'The related work section should not just list prior work, but explain how the proposed work differs from prior work appeared in the literature.'

    7. Reproducibility: # At least five sentences, example required 'Mark whether the work is reasonably reproducible.'

    8. Additional feedback: # Optional.

    9. Overall score: # At least one sentence, I expect 6 out of 10 or lower, compared to the EEGEyeNet (7-7-10). '6: Marginally above the acceptance threshold.' The rubric focuses on how you support your peers to improve their papers. This overall score is purely for improving your peers' posters, NOT for the midterm scores.

    10. Confidence score: # At least one sentence.

    11. Broader impact: # At least two sentences.

    12. Ethical concerns: # At least one sentence.

  • The '#' parts above are the comments for each section, similar to comments in Python.

4. Submission Guide

4.1. Team Submission

  • Each team only submits one file, lab_7_lastname1_lastname2.zip, including

    1. FIVE PDF files for each of the five posters you reviewed, in the Double-Blind way, for example, Submission_3rd_Reviewer_yF7c.PDF

  • Email 'xqu1@swarthmore.edu' your Lab 7 files as lab_7_lastname1_lastname2.zip.

  • The team members from the same team may get the same score.

4.2. Individual Submission

  • This part is Confidential.

  • Please do NOT cc your co-author.

  • Please do NOT upload it to the shared Google Drive Folder.

  • Each student only submits one file, lab_7_lastname_evaluation.pdf, including

    1. Midterm Evaluation Answer the questions in midterm evaluation form. At least five sentences for each question.

  • Email 'xqu1@swarthmore.edu' your evaluation file as lab_7_lastname_evaluation.pdf.

  • This lab_7_lastname_evaluation.pdf is Due Tuesday, March 08, by midnight (23:59, EST)

5. Notes

  • Lab assignments will typically be released on Wednesday and will be due by midnight on the following Tuesday. This lab was released on 03/02 and will be due by midnight on 03/15, after the spring break.