Author: Stan Eisenstat
Subject: Comments on the grading of mcBash
Date: Wednesday, 04 Nov 2020, 15:29:16
Statistics for Homework #3 mcBash ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ #Tests Passed ~~~~~~~~~~~~~ min = 18.00, max = 40.00, median = 37.00, avg = 35.52 39 < X <= 40: (12) X X X X X X X X X X X X 38 < X <= 39: (10) X X X X X X X X X X 37 < X <= 38: ( 7) X X X X X X X 36 < X <= 37: ( 5) X X X X X 35 < X <= 36: (11) X X X X X X X X X X X 34 < X <= 35: ( 3) X X X 33 < X <= 34: ( 2) X X 32 < X <= 33: ( 1) X 31 < X <= 32: ( 3) X X X 30 < X <= 31: ( 3) X X X 29 < X <= 30: ( 2) X X 28 < X <= 29: ( 3) X X X 27 < X <= 28: ( 0) 26 < X <= 27: ( 0) 25 < X <= 26: ( 0) X <= 25: ( 4) X X X X Estimated Time ~~~~~~~~~~~~~~ 07.00 07.00 08.00 10.00 10.00 10.00 10.50 11.00 12.00 12.00 12.00 12.00 12.00 12.00 13.00 14.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 15.00 18.00 18.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 20.00 21.00 25.00 25.00 30.00 30.00 30.00 30.00 36.00 40.00 Median = 15.00 Total Time ~~~~~~~~~~ 05.00 05.00 07.00 07.00 07.25 07.25 08.00 08.00 08.33 08.50 08.75 08.75 09.00 09.42 09.75 10.00 10.50 10.50 11.00 11.00 11.00 11.00 11.50 11.50 11.67 11.83 12.00 12.00 12.00 12.50 12.75 12.75 13.00 13.00 13.00 13.50 14.33 14.50 15.00 15.00 16.00 16.00 16.00 16.00 16.50 17.00 17.00 17.25 17.50 18.00 18.00 18.00 18.00 18.50 19.00 20.17 21.00 21.00 22.00 22.00 22.00 23.00 23.50 25.00 25.00 26.50 29.50 Median = 13.00 Cumulative Time Spent On All Assignments ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 29.75 34.33 36.00 37.25 38.00 38.25 39.00 40.83 43.16 43.17 45.58 45.75 46.00 47.00 47.50 50.17 52.00 52.50 53.50 54.09 54.50 55.41 55.50 55.67 56.75 57.00 59.50 59.58 59.75 60.00 60.17 60.25 60.75 62.50 64.00 67.00 67.00 67.50 68.00 68.00 69.50 70.00 70.00 71.00 71.50 72.17 73.00 74.25 74.75 77.75 79.33 80.00 80.00 85.58 85.92 88.83 89.92 91.00 92.50 95.25 100.00 101.58 103.00 109.00 109.00 114.25 121.50 Median = 62.50 Note: These numbers omit students who * did not report the data for all of the assignments, e.g., because they did not submit one of them AND * whose reported total for the assignments they did submit was less than 60.50 hours. Comments on mcBash ~~~~~~~~~~~~~~~~~ 1. See below for a complete description of how the grading script works. You can retrieve your grade sheet using the command % /c/cs323/bin/retrieve 3 GradeSheet All deductions from the number of tests passed are noted at the end of that file. Lateness penalties are assessed separately. 2. If your source file(s) did not contain your name and netID, I deducted 0 points if both were missing and 0 points if only the name or netID was missing, when I entered the score in the grade file. 3. If your log file did not contain a statement of major difficulties, I deducted up to 1 point (depending on the extent to which your session log contained such information) when I entered the score in the grade file. 4. Your statement of major difficulties should have been 100 words or longer (i.e., at least eight 80-character lines, excluding the listing of those with whom you discussed the solution) and should include assignment-specific details. I deducted up to 1 point for statements that were significantly shorter or non-specific when I entered the score in the grade file. 5. You can save time by stopping and seeking help when you run into problems that you cannot resolve in 30 minutes or so. Starting early (hint!) means that you are less likely to be near the due date when this happens. If you spent 25 hours or more on the assignment (the median was 13 hours), you may want to make an appointment to see me for ways to reduce the time. 6. If any part of a specification is unclear or confusing, please let me know so that I can correct it. 7. When debugging, it helps to have small examples where code fails, since it is easier to trace the flow of execution using a debugger, print statements, or with a listing. 8. Please use the unsubmit command to remove any files that are not part of your ultimate solution. 9. As noted in the specification: Hwk3/mcBash runs a Perl solution that contains 39 lines of code (ignoring comments and blank/brace-only lines). A Python solution contains 56 lines (ignoring comments and blank/brace-only/continue-only lines). A C version would be _much_ longer. If your solution was more than 100 lines (ignoring comments and blank or brace-only lines), you may want to meet with me or one of the staff to discuss why you solution was so long and what you could have done to produce a shorter one. How the Grading Script Works ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 1. After running the tests, the grading script checked for files submitted after the due date, printing the number of late days and a listing of all files and their submission dates if any file was late. If you submitted a LATENESS file, it adjusted the number of late days accordingly. The lateness penalty (5% per day or part thereof, excluding the week when the clock was stopped) was applied when I entered the score in the grade file. 2. Next the grading script printed the submission logs for your file(s) (excluding the log file and the makefile), showing the revision numbers, the times of submission, and how many lines were added and deleted. If the ratio of the number of hours reported to the number of submissions was sufficiently large, or if the number of lines in an initial submission or a lower bound on the number of new (not just changed) lines in some update was sufficiently large, it printed a warning message: checkrcs: too few submissions: NN in HH.HH hours or checkrcs: too few resubmissions: large submission(s) under the header ***** Checking RCS files ***** near the end of its output. In extreme cases I deducted up to 1 point from the score that appears on the grade sheet when entering that score in the grade file. In the future I will both raise the 1-point cap and deduct points in less extreme cases. 3. Next the grading script searched your log file for the one line that contains the string "ESTIMATE" and your estimate of the time required made prior to writing any code. If it did not find such a line, it printed a warning message: checklog: no line with ESTIMATE under the header ***** Checking log file ***** near the end of its output, and I deducted 0.5 point from the score that appears on the grade sheet when I entered that score in the grade file. If it did not find such a line even when case was ignored, it printed a warning message checklog: no estimate of time spent and I deducted 0.5 point from the score. If it found more than one line containing the string "ESTIMATE", it printed a warning message: checklog: multiple estimates of time spent and I deducted 0.5 point from the score. 4. Next the grading script searched your log file for the one line that contains the string "TOTAL" and the total time that you actually spent prior to writing any code. If it did not find such a line, it printed a warning message: checklog: no line with TOTAL under the header ***** Checking log file ***** near the end of its output, and I deducted 0.5 point from the score that appears on the grade sheet when I entered that score in the grade file. If it did not find such a line even when case was ignored, it printed a warning message checklog: no total of time spent and I deducted 0.5 point from the score. If it found more than one line containing the string "TOTAL", it printed a warning message: checklog: multiple estimates of time spent and I deducted 0.5 point from the score. 5. Finally the grading script may have printed a list of certain files, including: * A file named LOG.CORRECTED, which means that your log file did not have an estimate and/or a total in the proper format. The deduction(s) were taken as above, and where possible these values were taken from the corrected log so that they could be reported. * A directory named Overwritten, which means that you overwrote some of the files you submitted with those from a later assignment and I had to restore them. --Stan-PREV INDEX NEXT