File:  [LON-CAPA] / doc / help / build_exam_guide.tex
Revision 1.16: download - view: text, annotated - select for diffs
Thu Apr 1 16:08:09 2010 UTC (14 years, 7 months ago) by raeburn
Branches: MAIN
CVS tags: version_2_12_X, version_2_11_X, version_2_11_5_msu, version_2_11_5, version_2_11_4_uiuc, version_2_11_4_msu, version_2_11_4, version_2_11_3_uiuc, version_2_11_3_msu, version_2_11_3, version_2_11_2_uiuc, version_2_11_2_msu, version_2_11_2_educog, version_2_11_2, version_2_11_1, version_2_11_0_RC3, version_2_11_0_RC2, version_2_11_0_RC1, version_2_11_0, version_2_10_X, version_2_10_1, version_2_10_0_RC2, version_2_10_0_RC1, version_2_10_0, loncapaMITrelate_1, language_hyphenation_merge, language_hyphenation, HEAD, BZ4492-merge, BZ4492-feature_horizontal_radioresponse, BZ4492-feature_Support_horizontal_radioresponse, BZ4492-Support_horizontal_radioresponse
- Bug 5853.
  scantron -> bubblesheet.

\documentclass[twocolumn,english]{article}
%\usepackage[T1]{fontenc}
\usepackage[latin1]{inputenc}
\usepackage{epsf}
\usepackage{ulem}
\usepackage[verbose,letterpaper,tmargin=1.0in,bmargin=-0.125in,lmargin=.25in,rmargin=.25in]{geometry}
\usepackage[tiny]{titlesec}
\makeatletter
\usepackage{babel}
\makeatother
 
\begin{document}
\pagestyle{empty}
 
\begin{flushleft}
\textbf{\LARGE{A Guide to Building Your Exam}}
%\vspace{-.125in}
\textbf{http://www.lon-capa.org}
\end{flushleft}
\vspace{.05in} \hrule height0.6pt \hfill \vspace{ .02in} \\
\vspace{-.25in}
                                                                                


\part*{Bubblesheet Exams}

\section*{Creating a Folder}

\begin{itemize}
\item Select {[}DOCS{]} from the Remote Control or Main Menu. This will
take you to the Course Documents screen, where you can import or upload
new documents to use in your course.
\item Click the {[}New Folder{]} button and name accordingly. Ex: Exam 1 
\end{itemize}
NOTE: You may wish to hide the folder so that students do not have
access. Check the Hidden option next to your folder on the {[}DOCS{]}
screen. Click the {[}Store Parameters{]} button to save.


\section*{Choosing Exam Questions}

\begin{itemize}
\item Add questions to your folder with {[}Import{]}, {[}Search{]}, {[}Load
Map{]}, or {[}Simple Problem{]}. At this point, your exam will look like homework. 
\end{itemize}

\section*{How Questions will be Scored}

\begin{itemize}
\item For all response types except for option and match response, each part in
a multi-part question is graded as if it were a separate problem. In other words
, a problem with weight of three and two parts will be printed as two separate 
problems each with a weight of three.  Multi-response questions require the 
student to get all numbered responses correct to get the problem correct. You 
can tell the difference between a multi-part and multi-response question online.
For multi-part questions, each part will have its own submit answer button. 
\item Option response and match response submissions are scored leniently.  This means if an option response question gives four foil statements to the student and is worth a weight of 4, each foil will be scored for one point. If there are multiple option or match responses in one part, then the entire problem is scored leniently regardless if each response is in its own part.  This is different behavior from all other response types.
\item Essay, formula, and string response questions must be hand-graded.  The instructor can hand-grade online or indicate the grade on the bubblesheet.  If the hand-graded question should receive 5 points then the letter E is bubbled in. If the hand-graded question should receive 15 points then J is bubbled in on the first line (10 points) and E is bubbled in on the second line (5 points) for a total of 15 points.  If the question should receive no credit, then nothing is bubbled in.
\end{itemize}
 
\section*{Setting the Question Type }

\begin{itemize}
\item Select {[}PARM{]} on the Remote Control or Main Menu. This will take
you to the Set/Modify Course Parameters screen.
\item Scroll down to the \textsf{Course Assessment Parameter - Table Mode}
section.
\item Choose your exam folder from the drop-down menu under {[}Select Enclosing
Map or Folder{]}.
\item Click the {[}Set/Modify Course Parameters{]} button. This will load
a new page with your Parameter Table at the bottom.
\item Click the {[}--{]} in the {[}Default Value{]} column next to {[}Question
Type (type){]}. This will give you a pop-up menu of question type
options.
\item Select the {[}Exam{]} option and then click \uline{Store} to save
your choice.
\item Your Parameter Table will now show 'exam' in both the {[}Default Value{]}
column and the {[}Parameter in Effect{]} column. 
\item You also need to set the number of bubbles for numerical questions.
Click the {[}---{]} in the {[}Default Value{]} column next to {[}Number
of bubbles in exam mode (numbubbles){]}. This will give you a pop-up
menu of bubble number options. After specifying a number, click the
Store link to save your choice. 
\end{itemize}
NOTE: The default number of bubbles is 8. LON-CAPA will generate random
wrong answers if wrong answers are not coded in the problem. Ex: If
you specify 5 bubbles in exam mode and 4 bubbles for your exam folder,
5 bubbles will still appear. 

\section*{Printing Your Exam}

\begin{itemize}
\item Use the {[}NAV{]} button to return to your exam folder.
\item Select one problem from the exam folder you created.
\item Select {[}PRT{]} from the Remote Control or Main Menu. This will take
you to the Printing Helper screen.
\item Choose the {[}Problems from (name of folder) for anonymous students{]}
printing option if you are using coded exams (exams without student
names printed on them). Choose the {[}Problems from (name of folder)
for selected students{]} printing option if you are using named exams
(exams with student names printed on them). Click the {[}Next{]} button
to continue.
\item At the Select Students and Resources screen, you can choose the number
of exams you want to print. 
\end{itemize}
NOTE: It is recommended that you store (save) the CODEs to a file
for later, though it is not necessary.

\begin{itemize}
\item Click the {[}Next{]} button to continue.
\item You will be directed to the Creating PDF screen. Click \uline{Click here
to download pdf}
\item After the PDFs are downloaded, you can print your exams. 
\end{itemize}
NOTE: You will need to do some testing to add blank pages/columns
to make sure the different student exams don't run together. 


\section*{Scoring Your Exam}

\begin{itemize}
\item Select {[}NAV{]} on the Remote Control or Main Menu. This will take
you to the Navigate Course Contents page.
\item Select the first problem in your exam set.
\item Select {[}PGRD{]} from the Remote Control or Main Menu. This will
take you to the Manual Grading/View Submission screen.
\item Click the {}``Grade/Manage/Review Bubblesheets'' link. This will take you to
the next Grading screen, where you will fill out the top section depending
on if you use coded or named exams.
\item In the \textsf{Sequence to grade} section, the system will automatically
select the sequence you are in. If you should be in another sequence,
you can choose this sequence from the drop down menu.
\item In the \textsf{Filename of scoring office file} section, the scoring
office generally uploads the filename. You also have the option to
specify a bubblesheet data file to upload by browsing for the data file
and clicking the {[}Upload Bubblesheet Data{]} button.
\item In the \textsf{Format of data file} section, use MSU with CODE in separate
location for coded exams and MSU without any CODE for named exams.
\item In the \textsf{Saved CODES to validate against} section: leave blank
unless you saved the CODEs file earlier.
\item In the \textsf{Each CODE is only to be used once} section, choose No
if you don't use separately coded exams for each student. Ex: You
use 10 variations for a class of 200. If you do use separately coded
exams, leave the default Yes.
\item In the \textsf{Options} section, check the Do only previously skipped
records option only if you wish to go through skipped records. If
you select this option, you have to complete all of the skipped records.
The file will erase if you exit without completing.
\item Click the {[}Validate Bubblesheet Records{]} button. This will take you
to the next grading page where you need to double-check your information.
\item If the information is incorrect, click the {[}Grading Menu{]} button.
This will take you back to the Manual Grading/View Submission screen.
\item If the information is correct, click the {[}Validate Records{]} button.
This will process the information and let you know about any errors.
\item You will then be shown errors that need to be compared to the bubblesheets. 
\end{itemize}
NOTE: The errors are (double bubble), (missing bubble), (incorrect
id), (incorrect name), or (incorrect code). You will need the
bubblesheets for (double bubble) or (missing bubble) errors.

\begin{itemize}
\item You have the option to skip an error or continue. If you choose to
fix the error, click continue. If you choose to skip the error, the
information about your student will save to a skipped records file
for later grading. If you continue, you will have several options. 
\item LON-CAPA will help you fix the error by providing the bubblesheet paper
sequence number of the student so you can compare it to the physical
bubblesheet. Many students who forget to bubble in their name or
ID usually write this information on the bubblesheet 
\item In the cases of incorrect student ID, misspelled name, and incorrect
code with specified code file, LON-CAPA will provide you with the
closest matches to choose from. In the case of a missing code or incorrect
code with no code file, you will need to track down which code the
student used. 
\item After you correct the errors, click the {[}Start Grading{]} button.
This will take you to the next screen where you will see how much
time remains in the Bubblesheet grading process.
\item Once this process is completed, select {[}CHRT{]} from the Remote Control or Main Menu. This will take you to the Course Statistics
and Charts screen.
\item Select your exam name, HTML with links, and Score summary to view
the exam results. 
\end{itemize}

\section*{Providing Answers}

\begin{itemize}
\item After scoring the exam, unhide the folder if it is hidden. However,
make sure your students can't access and retake the exam. 
\item If coded exams were given, students will be able to view the randomized
version of the paper exam they took, after scoring is completed.

\item You can make the answers visible to your students by setting the answer
date parameter.  The answer date parameter will not work unless an open date and due date have been set.
\item Select {[}PARM{]} on the Remote Control or Main Menu. This will take
you to the Set/Modify Course Parameters screen.
\item Scroll down to the \textsf{Course Assessment Parameter - Table Mode}
section.
\item Choose your exam folder from the drop-down menu under {[}Select Enclosing
Map or Folder{]}.
\item Click the {[}Set/Modify Course Parameters{]} button. This will load
a new page, with your Parameter Table at the bottom.
\item Click the {[}--{]} in the {[}Default Value{]} column next to {[}Problem
Answer Date (answerdate){]}. This will give you a pop-up menu of open
answer date options.
\item Set the open answer date and then click \uline{Store} to save your
choice.
\item Your Parameter Table will now show the open answer date in the {[}Default
Value{]} column. 
\item Set the due date parameter next.  Make sure that the due date is dated before the answer date.  The due date should be set to some date that has passed. This way, it will be impossible for students to submit answers online.
\item Set the open date for a date before the due date.
\end{itemize}

\part*{Online Exams}

\section*{Creating a Folder}

\begin{itemize}
\item Select {[}DOCS{]} from the Remote Control or Main Menu. This will
take you to the Course Documents screen, where you can import or upload
new documents to use in your course.
\item Click the {[}New Folder{]} button and name accordingly. Ex: Exam 1 
\end{itemize}
NOTE: You may wish to hide the folder so that students do not have
access while you are building your exam. Check the Hidden option next to your 
folder on the {[}DOCS{]} screen. Click the {[}Store Parameters{]} button to save.

\section*{Choosing Exam Questions}
                                                                                
\begin{itemize}
\item Add questions to your folder with {[}Import{]}, {[}Search{]}, or {[}Load
Map{]}. At this point, your exam will look like homework.
\end{itemize}

\section*{Setting Online Exam Parameters}
\begin{itemize}
\item Select {[}PARM{]} from the Remote Control or Main Menu. This will
take you to the Course Parameters screen, where you can set the open date, due
date, and answer open date just like you do for homework.  
\item You may wish to give your students a time-limit to complete their exam. Use the table mode and click the {[}--{]} in the {[}Default Value{]} column next to {[}Time-Limit (interval){]}. This will give you a pop-up window where you can set how long a student has to complete the exam once it is accessed between the open date and due date.
\item To inhibit students from seeing if they got a problem correct, click the {[}--{]} in the {[}Default Value{]} column next to {[}Show Problem Status (problemstatus){]} and choose No.  Multiple tries behave like a virtual eraser and the last submission recorded by the student is the one that is graded.
\item To only allow students to access the exam from specific comptuters, click the {[}--{]} in the {[}Default Value{]} column next to {[}Client IP/Name Access Control (acc){]}. In the window that pops up, you can type in the specific IP address or hostname, ex. \texttt{s1.lite.msu.edu} or \texttt{35.9.119.101}.  You can also specify a range such as \texttt{35.8.*}, \texttt{*.msu.edu}, \texttt{35.8.[35-49]}.  You can enter a comma-separated list of multiple values as well.
\end{itemize}



\section*{Disabling Communication During Exams}

\begin{itemize}
\item There are three kinds of communication functions available in LON-CAPA:
chat room, discussion board, and internal e-mail. Students also can store information in their portfolio.

\end{itemize}

\subsection*{Chat Room}

\begin{itemize}
\item To set the chat room, select {[}PARM{]} on the Remote Control
or Main Menu. This will take you to the Set/Modify Course Parameters
screen.
\item Click the {[}Set Course Environment Parameters{]} button. This will
take you to a new page. 
\item Scroll down to {[}Disallow chat room use for Roles{]} or {[}Disallow
chat room use for User{]}.
\item To deactivate chat for specific roles, enter a comma-separated list
of roles. Ex: {}``st'' for student. To deactivate the chat room for a specific
user, enter username:domain.
\item Check the {[}Set{]} option if it isn't checked by default already.
\item Scroll down and click the {[}Set Course Environment{]} button. Changes
will take effect the next time the user(s) enter the course.
\end{itemize}

\subsection*{Discussion}

\begin{itemize}
\item To set the discussion function, select {[}PARM{]} on the Remote Control
or Main Menu. This will take you to the Set/Modify Course Parameters
screen.
\item Scroll down to the \textsf{Course Assessment Parameter - Table Mode}
section.
\item Choose your exam folder from the drop-down menu under {[}Select Enclosing
Map or Folder{]}.
\item Click the {[}Set/Modify Course Parameters{]} button. This will load
a new page with your Parameter Table at the bottom.
\item Click the {[}---{]} in the {[}Default Value{]} column next to {[}Discussion
End Time{]}. This will give you a pop-up menu of date and time options.
The drop-down menu will automatically direct you to specify the ending
date. You can also specify the starting date or the time interval.
After setting the date and time, click \uline{Store} to save your
choice. 
\end{itemize}

\subsection*{Internal Email}

\begin{itemize}
\item Select {[}COM{]} from the Remote Control or Main Menu. This will take
you to the Communication and Messages screen.
\item Click \uline{Configure blocking of student communication during exams} 
\end{itemize}
NOTE: Students will still be able to access previous emails. They
will be able to send emails, but cannot receive emails during the
set time.

\begin{itemize}
\item Select the start and end dates and times for the exam and click the
{[}Save Changes{]} button.
\end{itemize}
NOTE: You MUST set an end date or communication will be blocked for
all of the student's LON-CAPA courses.


\subsection*{Portfolio}

\begin{itemize}
\item The portfolio function is available and viewable by students only.
You will not be able to deactivate the portfolio during exams. 
\end{itemize}


\end{document}

FreeBSD-CVSweb <freebsd-cvsweb@FreeBSD.org>