Navigation Menu

Click the "+" to see inside a chapter or use the search to the right.

.

Skip to end of metadata
Go to start of metadata

Upload Analysis Set / Statistics using Excel file

You can add new analysis sets, delete or replace previous ones, or rename them. You can also download an analysis set as an Excel sheet or CSV template.

Manage Analysis Sets

  1. Select the  Manage → ImportStatistics menu.


  2. Download sample Analysis Set in Excel or CSV format, by clicking the appropriate link and save the template to your hard drive.

The Excel workbook contains the following:

  1. Worksheet labeled Analysis Set contains the following column:

    ParameterExplanation
    ValueThis column can be populated with as much data as desired on the analysis set including the name of the analysis set, an existing analysis group, and the dates that the set is valid for. If an analysis set name is not specified, the user is prompted for one before the import is accepted. If an analysis group name is not specified, then the analysis set is assigned to the "Ungrouped" analysis group. This also happens when the analysis group name is explicitly specified as "Ungrouped".
  2. Worksheet labeled Exam containing the following columns:

    ParameterExplanation
    Cut ScoreThis is the set Cut Score for the exam form.
    KR20This is a measure of the exam form's reliability.
    % PassingThe percent of the candidates that took the exam and passed.
    # CandidatesNumber of candidates that took the exam (this may be different than the N on the items if candidates did not complete or answer the items).

    There is also space to enter the date, time, and location of the exam name, although it is not mandatory.

     

  3. Worksheet labeled Questions containing the following columns:

    ParameterExplanation
    Revision CodeThe version of the item that was given to the candidate on the exam form.
    Question NumberThis is usually the system-generated Question ID but could also refer to an External ID given to an item.
    Question Difficulty (p)Typically the percent of candidates that answered the item correctly.
    Question Discrimination (rpb)A measure of the relationship between answering an item correctly and achieving a higher score on the exam form.
    Question IRTaDiscrimination parameter.
    Question IRTbDifficulty parameter.
    Question IRTcGuessing parameter.
    Question Candidates (N)The number of candidates who attempted the item.
    Custom ColumnsYou may add as many columns as you like, with additional statistics for the item. Only decimal values are allowed for all additional columns. You may name the columns as required.



  4. Worksheets labeled Option A through Option #, as many as required by the items, and containing the following columns:

    ParameterExplanation
    Candidates (N)The number of candidates who chose the option.
    ScoreThe average exam score of candidates who chose the option.
    RpbIs a measure of the relationship between choosing a response and achieving a higher score on the exam.
    Custom ColumnsYou may add as many columns as you like, with additional statistics for the question. Only decimal values are allowed for all additional columns. You may name the columns as required.



Icon

An analysis set can be associated with an exam form by entering the exam form name in the AnalysisSetTemplate.xls Excel sheet and checking the Bound to an exam check box in Upload Statistics page.

If Bound to an exam check box is selected and an exam form is selected from the list, then the revision code entered into the Excel sheet must match with the revision code of the item in that exam form.

If the exam form contains multiple items, you can also enter the revision codes against the corresponding Question IDs of each of the items required to have the updated statistics, one below the other, in the respective columns.

If an incorrect revision code is entered, an error message appears and the import fails.

If revision code is not specified (left blank), then the analysis set is attached to the version of the item in the exam form at the time it was published.


Upload a new Analysis Set

  1. Select an exam form from your project from the drop-down list of the Select Exam field.
  2. Choose the Question ID radio button if you want to upload statistics either bound to a Published exam form or not bound to any. This option also allows you to specify a specific revision code of the item to which the statistics are to be attached.
  3. Select  Bound to an Exam check box if you wish to upload an analysis set to an item in a Published exam form and wish to bind it to that exam form. Select  Show Retired check box to also display the published exam forms that have been Retired, in the drop-down list along with the published exam forms that have not been retired.
  4. Enter the Exam Code if the items are from an exam on ExamDeveloper. This is optional.
  5. If you choose to upload via External ID, then choose the External ID radio button. This option does not allow you to upload statistics bound to a published exam form or specify a revision code (as it always attaches to the latest version of the item).

To select a file from your system (for Chrome browser):

  1. Click Choose File button.
  2. The Open box is displayed.
  3. Select the file to be uploaded.
  4. Click Open.
  5. The path of the file is displayed in front of the Choose File button.

    Why is the selected template not showing as selected after selecting in Microsoft Edge web browser?

    Icon

    If you are using Microsoft Edge web browser, you might encounter the following behavior.

    When a template is opened, but not closed in the associated application, the template selection is not visible on the import page page even if the template is selected via the Browse button, and it is not possible to import it. To import the template successfully, it must be closed in the application where it is open.

    The issue has been observed up to Edge version 25.10586.0.0 as of the time of writing this.



  6. Click Upload.
  7. The file is uploaded to the server and be available for use.

 

Icon

An error message is displayed in red text when a user tries to upload an analysis set specifying the name of an existing analysis set in the system. An error message is also displayed if the user specifies an analysis group name that does not exist in the application. In either of the above two cases, the import fails.

 

Append an Analysis Set (to an existing Analysis Set)

Icon

Appending an analysis set means that it adds statistical values that were not originally included in the analysis set for the item(s). This feature only updates the analysis set for statistical values that do not already exist on it. If a statistical value already exists, then a warning message is displayed to the user to remove the concerned statistical value.

Selecting the Append radio button allows you to append a set of statistical values to an item other than the item(s) to which the existing set of statistical values in an existing analysis set are already applied. Upon clicking this radio button, two drop-downs appears to choose Analysis Group and Analysis Set (belonging to the analysis group selected in the previous drop-down) that are present in the project.

Here are the steps for this functionality:

  1. In this example, there is already an analysis set AS1AG1 with one question in the analysis group AG1. Create an Excel template with analysis set AS1AG1 for Question Q2, while Question Q1 with analysis set AS1AG1 already exists in the project. This analysis set belongs to the analysis group AG1.
  2. Select the Append radio button.

  3. Two drop-downs appears next to Append. Select the Analysis Group AG1 from the Analysis Group drop-down. This populates the Analysis Set drop-down with Analysis Sets belonging to AG1.

  4. Select the analysis set AS1AG1 from the Analysis Set drop-down.

  5. Click Choose File to browse and select the file from step 1 and click the Upload button.


     

    Why is the selected template not showing as selected after selecting in Microsoft Edge web browser?

    Icon

    If you are using Microsoft Edge web browser, you might encounter the following behavior.

    When a template is opened, but not closed in the associated application, the template selection is not visible on the import page page even if the template is selected via the Browse button, and it is not possible to import it. To import the template successfully, it must be closed in the application where it is open.

    The issue has been observed up to Edge version 25.10586.0.0 as of the time of writing this.



  6. A pop-up window prompts you to confirm the action:
    • OK button: Confirm that you wish to append the uploading analysis set with the existing analysis set and return to the previous screen.
    • Cancel button: Cancel and return to the previous screen.



  7. The analysis set AS1AG1 is applied to items Q1 and Q2.

    Icon

    In order to use Append with Bound to an Exam, it is necessary the analysis set being appended to an item in a published exam form must be already applied to another item from the same exam form. If this condition is not met, then an error message is displayed and the import fails.

If the Question ID is not bound to an Exam:

  1. Select the Manage → Reports → Statistics tab.
  2. The Analysis Sets with respect only to items not bound to an exam form will only have the Problematic Questions button enabled. The Statistics Summary and Candidate Scores buttons are disabled.
  3. The analysis set retrieves problematic items including items not belonging to the current project.

If the Question ID is bound to an Exam:

  1. Select the Manage → Reports → Statistics tab.
  2. The analysis sets with respect to the Question ID bound to an exam form have all the Statistics Summary, Problematic Questions, and Candidate Scores buttons enabled.
  3. The analysis set retrieves the problematic items including items not belonging to the current project.

Import Analysis Set by External ID:

To import items by External ID, you must select the External ID radio button under This analysis set uses. The Bound to an exam check box becomes disabled.

When a user imports an analysis set by External ID, and multiple items have the same External ID, then a confirmation message pop-up asks the user if he/she wants to upload this statistics data to all items having the same External ID.

  • Yes: the statistics are attached to all items having the same External ID.
  • No: the statistics are not imported.

Icon
In the above case of multiple items with same External ID, modifying the analysis set of one item does not affect the analysis set of other items with the same External ID.


When analysis set is uploaded by External ID to attach to item(s) and a new item is written later with the same External ID, the aforementioned analysis set is not attached to the new item even though it has the same External ID as the previously mentioned item(s) with the analysis set attached.

The Revision Code column of the analysis set must be left blank and the External ID must be entered in place of the Question ID.

 

Icon

If you enter a Revision Code, an error is shown as seen in the red text below and the import fails. You must remove the Revision Code and upload the file again.

Icon
Analysis Set uploaded by External ID binds to only the latest version of the item(s) as it is not possible to bind it for a specific version of the concerned item(s).
Icon

If you try to import Statistics/Analysis Sets for an item for an R-Type main item, the import fails and an error message in red text is displayed as below.


Specify Default Statistics while uploading:

A specific analysis set can be designated as the Default for an item when it is uploaded.

The Mark as Default check box has to be selected (which it is by default), to set the statistics contained in the analysis set file being uploaded, to Default. The new Default Statistics overwrite any previous Default Statistics for the item.

It is also possible to set Default Statistics for items with External ID as well.

 

Icon
There can be a maximum of one Default Statistics for an item and a minimum of zero.

Upload Analysis Set / Statistics using CSV format file:

You can also upload Analysis Set / Statistics via a Comma Delimited (CSV) format file.

Click the CSV template hyperlink on the Analysis Sets page to download a template in the CSV file format. This template contains the data structure with dummy data, which you must replace with the data for the Analysis Set that must be uploaded.

 
 

You can refer to the instructions that can be downloaded by clicking the CSV Instructions hyperlink or read on for the explanation in this help document.

As seen earlier, the CSV template is a rather simple way of entering data with column headers clearly mentioning what data is required to be entered under them. Here is what should be completed. The first row is not to be overwritten as it contains the column headers. The second row is to enter information about the Analysis Set and Exam Form.

Data

Explanation / Value type and format

Analysis Set Name

A text value to specify the name of the analysis set.

Analysis Group NameA text value to specify the name of the analysis group.

Date From

The date from which the analysis set is valid. The valid format is MM-DD-YYYY or MM/DD/YYYY.

Date To

The date to which the analysis set is valid. The valid format is MM-DD-YYYY or MM/DD/YYYY.

Exam Name

Name of the exam. This is a text value.

Date

Date of the exam, specified as MM-DD-YYYY or MM/DD/YYYY.

Time

Time of the exam, specified as HH:MM:SS or HH:MM AM/PM.

Location

Exam venue. This is a text value.

City

Name of the city in which the exam will be held. This is a text value.

State

Name of the state in which the exam will be held. This is a text value.

Cut Score

Cut score. This is a decimal number.

KR20

Kuder–Richardson Formula 20. This is a decimal value.

% Passing

Minimum score in % to pass the exam. This is a decimal number.

# Candidates

Number of candidates appearing for the exam. This is an integer greater than 0.

Custom1-e, 2-e, ...

You may add as many columns as you like, with additional statistics for the exam. Only decimal values are allowed for all additional columns. You may name the columns as required.

 

The third row contains header information about the data related to the items in the exam and should not be overwritten. This information must be entered starting from the fourth row down.

 

Data

Explanation / Value type and format

Question Number

Question ID of the item. This is an integer.

Revision Code

Revision ID of the item version. This is an integer.

Question Difficulty (p)

The item's difficulty value, between 0 and 1.

Question Discrimination (rpb)

The item's discrimination value, between -1 and 1.

Question IRTa, b, c

The item's IRT values, between -5 and 5.

Question Candidates (N)

The number of candidates who attempted the item.

Custom columns1-i, 2-i, ...

You may add as many columns as you like, with additional statistics for the item. Only decimal values are allowed for all additional columns. You may name the columns as required.

Candidates (N)-oa, -ob, ...

The number of candidates who selected this option. This is an integer.

Score-oa, -ob, ...

The score value for the option. This is a decimal value.

Rpb-oa, -ob, ...

The option's discrimination value, between -1 and 1.

Custom1-oa, -ob, ...Custom2-oa, -ob,...

You may add as many columns as you like, with additional statistics for the item. Only decimal values are allowed for all additional columns. You may name the columns as required.

Icon

The user is prompted to enter appropriate names for the custom columns if the same is not entered in the template before uploading, and the import is halted.

  • Save button: Save the custom labels and import the statistics.
  • Cancel button: Cancel the statistics uploading process.

Icon
You must be logged in as the Project Manager in order to upload analysis sets.
Icon

The link Click Here to edit statistical flags is displayed on the page. For details on editing statistical flags, refer to Statistical Flags.

 

 

  • No labels