The Custom Report tab on the Generate Reports page allows you to retrieve items, select them, and generate reports displaying information related to the current version of items such as state, text, usage, metadata, validation data, statistics, and enemies, in the HTML, Excel, and JSON file formats. This is the Custom Report. The report includes Question ID, Question Type, Written By, Name of the Case on which the item exists, Stem and Options text and images, Option labels and shape labels, references, metadata, blueprint, comments, enemies, parent Question ID (in case of R-Type Question Stems), latest Revision ID, External ID, question state, and exhibits.
The Custom Report tab includes following features:
There are four formatting options available for this report and the resulting reports with any selection have all the above-mentioned information columns with some differences.
Excel plain text: Text where Rich Text Editor has been used is presented in the rendered form (plain text). This report is generated in the Excel format on the Queue page.
Excel with HTML markup: Text where Rich Text Editor has been used is presented in the form of HTML code. This report is generated in the Excel format on the Queue page.
HTML formatted for the web browser: Text where Rich Text Editor has been used is presented in the rendered form (plain text). This report is generated in the HTML format on the Queue page.
JSON: Text that identifies information about the question. This report is generated in the JSON format on the Queue page. See JSON Report Format topic for details on the JSON formatting option.
The user can also select the type of data from the following:
Default: This is preselected and cannot be deselected. Data included: Question ID, Blueprint ID, Blueprint name, External ID, Language, Latest revision, Other blueprints, State, Translation group, Type, Written by, Written on.
Key: Select the Key option to include the 'correct options' in the custom report.
Metadata: Comments, Metadata, References.
Associations: Case ID, Case name, Cloned from, Cloned to, Collections, Enemies, Exam forms, Exhibit reference, Parent question ID, Sections.
For Associations, you can choose to Only include enemy relationships for the questions in the report. When this option is not selected, all enemies for each question are listed in the report. When this option is selected, enemy relationships with items that are not in the group are excluded from the report.
Statistics: Analysis set name, Candidates, Custom statistics, Difficulty, Discrimination, IRT, Option candidates, Option custom statistics, Option discrimination, Option score. This also requires selection of Analysis Group and type of Analysis Set (Default, Most Candidates, or Latest).
Validation: Average angoff, Average criticality, Average frequency, Average importance, Number of raters, Has one correct answer?, Has one verifiable reference?, Has one correct exam blueprint, Raters.
Include items referenced as exhibits: include contents of all the items referenced in the exhibits.
Select All fields to select all the available data grouping details.
Retrieve and select items from the current project according to the specified search criteria for which the Custom Report is to be generated.
Generate the Custom Report
Select the required Formatting option.
Select the Data option(s) according to the requirements of the Custom Report to be generated.
You are taken to the Reports page under Queue where the report is processed and generated. Once generated, you can click the Custom Report link under the Report Name column of the table to download the report in the format that was selected.
As of the 1810 version, the Custom Report now includes Enhanced Matching information on a new Enhanced Matching tab if you choose to include Content for those questions in the report.
The Enhanced Matching tab includes the following content:
The ID of the item that is also listed on the Questions tab of the Custom Report.
Any of the following items may be listed in the Component column.
Text from the Properties for all Tokens, Targets, and Labels.
The full ident from the Properties for all Tokens, Targets, and Labels.
The name of the Enhanced Matching template that was used.
The file name of the image used on the canvas background, or the background image from the Properties for all Tokens, Targets, and Labels.
The Tokens that may be matched with the Targets.
Correct Token(s) (Key)
The correct Token for the Target. The correct answer for the Target.
The scoring rule applied to the Target.
Basic scoring has one rule containing a Combination of ALL possible Targets, where the Item Score = 1. Combination lists all the Target tokens as comma separated in the field.
For Advanced scoring, each rule that is applied is listed in a separate row
The score value applied to the Target if the correct Token is selected.
As of the 1811 release, full scoring rules have been added for the Custom report whenEnhanced Matching questions are exported. When you choose to include the Content and the Key for Enhanced Matching Questions in the custom report, the Enhanced Matching tab includes the Compatible Token(s), Correct Token(s) (Key), Rule #, Combination, and Item Score.