Homework - 4

Due: September 21, 2015

Metrics and Experiments in CS papers

1. Make a list of metrics used in measurements in the ten resesarch papers you selected in the area related to your research. Categorize your list into a few groups. You may come up with your own criteria to group the metrics.

2. Define each metric in a few sentences. The definition needs to be accessible to someone not in your area of resesarch.

3. What is the most common and uncommon metric used in these papers? Why are those metrics most common and uncommon?

4. What is the most common and uncommon experiment used in these papers? Why are those experiments most common and uncommon?

5. Select five papers from your list of ten you want to explore in detail. For each of these five papers, please suggest at least one additional experiment the authors could have done to strengthen their work OR one experiment that does not add significantly to the paper. Please provide a rationale.

Please also submit the list of research papers you surveyed in this assignment. You can obtain this from your hw3. This section should be titled References and formatted similarly to how the references are listed at the end of research papers.

Submission

Please submit your homework on Moodle. Your submission should be in a pdf named hw4.pdf.