doc/homework/lonchart.test_procedure - view

File: [LON-CAPA] / doc / homework / lonchart.test_procedure
Revision 1.2: download - view: text, annotated - select for diffs
Fri Jun 28 17:35:00 2002 UTC (22 years, 5 months ago) by stredwic
Branches: MAIN
CVS tags: version_2_9_X, version_2_9_99_0, version_2_9_1, version_2_9_0, version_2_8_X, version_2_8_99_1, version_2_8_99_0, version_2_8_2, version_2_8_1, version_2_8_0, version_2_7_X, version_2_7_99_1, version_2_7_99_0, version_2_7_1, version_2_7_0, version_2_6_X, version_2_6_99_1, version_2_6_99_0, version_2_6_3, version_2_6_2, version_2_6_1, version_2_6_0, version_2_5_X, version_2_5_99_1, version_2_5_99_0, version_2_5_2, version_2_5_1, version_2_5_0, version_2_4_X, version_2_4_99_0, version_2_4_2, version_2_4_1, version_2_4_0, version_2_3_X, version_2_3_99_0, version_2_3_2, version_2_3_1, version_2_3_0, version_2_2_X, version_2_2_99_1, version_2_2_99_0, version_2_2_2, version_2_2_1, version_2_2_0, version_2_1_X, version_2_1_99_3, version_2_1_99_2, version_2_1_99_1, version_2_1_99_0, version_2_1_3, version_2_1_2, version_2_1_1, version_2_1_0, version_2_12_X, version_2_11_X, version_2_11_5_msu, version_2_11_5, version_2_11_4_uiuc, version_2_11_4_msu, version_2_11_4, version_2_11_3_uiuc, version_2_11_3_msu, version_2_11_3, version_2_11_2_uiuc, version_2_11_2_msu, version_2_11_2_educog, version_2_11_2, version_2_11_1, version_2_11_0_RC3, version_2_11_0_RC2, version_2_11_0_RC1, version_2_11_0, version_2_10_X, version_2_10_1, version_2_10_0_RC2, version_2_10_0_RC1, version_2_10_0, version_2_0_X, version_2_0_99_1, version_2_0_2, version_2_0_1, version_2_0_0, version_1_99_3, version_1_99_2, version_1_99_1_tmcc, version_1_99_1, version_1_99_0_tmcc, version_1_99_0, version_1_3_X, version_1_3_3, version_1_3_2, version_1_3_1, version_1_3_0, version_1_2_X, version_1_2_99_1, version_1_2_99_0, version_1_2_1, version_1_2_0, version_1_1_X, version_1_1_99_5, version_1_1_99_4, version_1_1_99_3, version_1_1_99_2, version_1_1_99_1, version_1_1_99_0, version_1_1_3, version_1_1_2, version_1_1_1, version_1_1_0, version_1_0_99_3, version_1_0_99_2, version_1_0_99_1, version_1_0_99, version_1_0_3, version_1_0_2, version_1_0_1, version_1_0_0, version_0_99_5, version_0_99_4, version_0_99_3, version_0_99_2, version_0_99_1, version_0_99_0, version_0_6_2, version_0_6, version_0_5_1, version_0_5, version_0_4, stable_2002_july, loncapaMITrelate_1, language_hyphenation_merge, language_hyphenation, conference_2003, bz6209-base, bz6209, STABLE, HEAD, GCI_3, GCI_2, GCI_1, BZ4492-merge, BZ4492-feature_horizontal_radioresponse, BZ4492-feature_Support_horizontal_radioresponse, BZ4492-Support_horizontal_radioresponse

Updated this document to include testing of pages, reuse of the same
.problem, sorting, and the student active status.  Also to fix a couple
of typos in the last submission.  This document corresponds to the class
created by Jason Stredwick called Chart Test on the 103 domain on machine
103l5.

lonchart Test Procedure The procedure will show the validity of the lonchart code. A course called Chart Test was created to test the possible scenarios due to course creation. Next a series of false students will take the course. Each student will perform differently. The number of students will be relate directly to the number of grade related tests required. The combination of these two sets of tests will ensure the proper output of lonchart. The course was designed to test the following: problems in the top level sequence, problems in a sequece separated by a subsequence, problems with parts, reuse of the same problem, using a page, and the correctness of a single problem resource in general. The course is laid out beginning with a top sequence containing in order, start, problem, sequence, problem, page, problem, and finish resources. The subsequence contains two problems. The first problem is a general problem containing a simple numeric response. The second problem contains two parts. The page contains three problems with two parts, but all three problems are the same. The chart output should contain three columns. The first should have three problems in it, the second should have three, and the third should have six problems. The headings for these columns should be the title of the sequences in which they lie. The following table outlines a series of students and their performance on the homework sets. Each row in the table represents a student in the course. The combinations of results will test the possible outcomes lonchart will handle. When the table specifies just correct, it means on the first try. Homework 2 student responses: username problem 1 problem 2 part1 part2 armadilla correct correct correct Bean skip skip skip cat correct(12 tries) correct skip dog correct(2 tries) skip correct elephant correct by override correct after correct first time skip first flamingo incorrect by override correct first correct after skip time first time gnat incorrect incorrect correct hippo excused correct incorrect iguana correct second try incorrect incorrect after correct by override on first try For the problems in the top sequence, they will all be correct on first try, except for bean, who didn't log in. Also, cat will get problem two and three correct on the second try and iguana will be incorrect for problem one. All the problems will be correct on the first try for Homework 3, except for the dog which will be correct with the following tries: 121131, and cat which will be incorrect on problem one part two, incorrect on problem two part two, and correct with two tries on problem one part one. Expected output: User Name Homework 1 Homework 2 Homework 3 Total Solved/ Total Problems armadillo 111 3 111 3 111111 6 12 / 12 Bean cat 122 3 *1 2 2.1.11 6 9 / 12 dog 111 3 2 1 2 121131 4 11 / 12 elephant 111 3 +11 2 111111 6 11 / 12 flamingo 111 3 -11 2 111111 6 11 / 12 gnat 111 3 ..1 1 111111 6 10 / 12 hippo 111 3 x1. 1 111111 6 10 / 11 iguana .11 3 +.. 1 111111 6 10 / 12 Expect output for student information: User Name Domain Section PID Full Name armadillo 103 1 armadillo, a a bean 103 1 Bean, b b cat 103 1 cat, c c dog 103 1 dog, d d elephant 103 1 elephant, e e flamingo 103 1 flamingo, f f gnat 103 1 gnat, g g hippo 103 1 a123332 Hippopatumous II, h h iguana 103 1 144 iguana, i i jason 103 a33377721 Stredwick fourth, Jason Michael One function of lonchart is to sort students by either username, section, or last name. Once you have downloaded the students for this class, either when no cache exists or recalculate button has been pressed, sort can occur. Begin by selecting sort by section followed by last name then username. The results for each will be listed below. For the sake of space, the grade all the information will be left off except for the username. The data below will show the correct username order for each of the sortings. If you want to check for the whole line to be correct, use the above to tables by matching them to the appropriate username. Sort by section: Sort by last name: Sort by username: armadillo bean armadillo bean hippo bean cat jason cat dog armadillo dog elephant cat elephant flamingo dog flamingo gnat elephant gnat hippo flamingo hippo iguana gnat iguana jason iguana jason The last piece of functionality is the student status. It allows the list of students to include/exclude based on the selection of Active, Expired, or Any type of student. The list of students so far have been active only. To see who is expired, select expired followed by one of the sorting buttons or the recalculate button. There will only be one user, dunk. Select the Any option, and redisplay the list of students again. This time all the students including dunk are displayed. This concludes the test of lonchart. Deviations from the expected output show incorrectness in the code. Please change the expected output for new formats, conceptual changes, or feature additions.