Learn how to use the Item Bank Health Check (IBHC) tool through the Learnosity Console to analyze and improve the quality of your Item bank content.

Accessing the Item Bank Health Check

1. Log on to console.learnosity.com.
2. If your product license includes IBHC access and your role is configured for it, you will see a new AI section containing a link to Item Bank Health Check.
   
   Console page with IBHC option visible
3. Click the Item Bank Health Check option in the left navigation panel.

Creating a new Collection

To perform various checks on your Items, you must first create a Collection. A Collection is a group of Items you want to run analysis on.

1. After navigating to the Item Bank Health Check page, you will be directed to the Collections list page, which displays all previously created Collections.
2. To create a new Collection, click the + Create Collection button in the top-right corner of the Collections page.

3. On the Create new Collection page, enter a name for your Collection in the Collection Name field.

   
   Create new Collection page

4. From the Item bank dropdown, select the Item bank you want to use for your Collection.

5. Items can be imported in a Collection in two ways:

   1. Select the option Search Item Bank by Item Tags and Click SELECT TAGS to search for and choose relevant tags. Based on the selected tags, a list of Items will be displayed. These Items will form part of your Collection. You can click an Item to preview it. Click Create Collection at the top of the page to complete the process.
   2. Select the option Upload CSV of Item references and click Upload CSV to add your file. A green checkmark is displayed once your file is uploaded. Click Create Collection at the top of the page to complete the process.

   Note: A Collection can contain a maximum of 15,000 Items.
   
   Items list displayed based on selected tags

6. You will be redirected to the Collections list page, where your newly created Collection will appear at the top. Once the Collection has finished importing and the status is set to Ready, you can create and run jobs on it.

Creating a new job

A job is a task performed on all Items in a Collection to update them based on selected Guidelines.

Available job types:

• Alt text generation: Generates alt text for images that are missing descriptions.
• Audio and video transcription: Generates transcripts for missing audio and video elements.
• Bias check: Checks Items for biased language, provides suggested fixes, and supports custom guidelines.
• Correct answer validation: Checks whether the correct answer is accurate and suggests a replacement if needed.
• Custom Item report: Generates a report based on a custom query.
• Distractor rationale generation: Generates response-level distractor rationales for supported Question types.
• Language translation: Translates Items into a target language.
• Math hints generation: Generates hints for math-related Question types.
• Multiple choice to Essay with Feedback Aide rubric conversion: Converts multiple choice Questions into short-response format.
• Representation report: Generates a report on how representative the Collection is against selected categories. Unlike other jobs, no suggested actions are applied to individual Items. Instead, the report provides a summary of representation levels.
• Standards coverage report: Generates a report showing Item alignment with US school standards.
• Synchronize Items with source material: Checks Items against a selected source document stored in your Knowledge Bank to identify content that may be out of sync.

Steps to create and run a job:

1. Go to the Collections list.
2. Select the Collection by clicking on it.
3. On the Collection page, click Create in the Active job section. 
   
   Create a new job

4. On the Create new job page, select a job type from the dropdown menu.
    

   

   Create and run a job

5. Then enter a name for the job.
6. Uncheck the Audit Sign-off box or leave it checked; if checked, you must review and sign off on the audit results, which display the Items that passed the job criteria. This option is available for jobs that are not reports.
7. In the Guidelines dropdown, select Guidelines to follow when running the job. (Available for Bias check and Representation report types only.)
8. If the job type is Language translation, select a target language from the Target language dropdown.
9. If the job type is Math hints generation, select an option from the Hints style dropdown.
10. If the job type is Distractor rationale generation, select a Question type from the Question type dropdown.
11. If the job type is Custom Item report, enter a query description in the Query field.
12. If the job type is Standards coverage reports, select a jurisdiction, subject and grade from the different dropdowns.
13. If the job is Synchronize Items with source material, select a source document among files uploaded to the Knowledge Bank from the Resource search field.
14. Once all required fields are populated, click Run job.
15. Depending on the number of Items and complexity, the job may take several seconds or minutes to complete. When ready, the job status will change to Ready for review.
    Note: Only one job can be active at a time per Collection. You must either delete or complete the current job before starting a new one.
    
    Job status set to ready for review

Completing a job

Once a job’s status changes to Ready for review, you must complete the audit review (if applicable) and review suggested updates to the Items.

When all the AI-generated suggestions have been reviewed and accepted or rejected/ignored, you can Mark Completed to finalize the job. Alternatively, you can click Delete job at any point if you are not satisfied with the results.

Steps to complete a job:

1. Go to the Active job list for the Collection.
2. Click the Check details icon for the job.
   
   Click the check details button
3. On the Job details page, complete the following actions as needed.

Review Audit

Review Audit allows you to confirm that the AI’s suggestions comply with the selected guidelines.

• If satisfied, click Sign off and confirm in the pop-up dialog.

Review Actions

• Review flagged Items such as those with biased language or missing alt text.
• Use the Show original Item toggle to preview the unaltered version.
• If needed, you can edit the Suggested Item.
• Accept or reject the suggested changes.
• Any skipped actions must be resolved before completing the job.

Note: Changes are not applied to the original Items in the Item bank until the entire Collection is exported. Accepted changes will, however, be considered in future jobs run on the same Collection.

Review Guided Fixes

This review screen is only available for the correct answer validation job and the synchronize Items with source material job.

• Review AI guidance and manually update the Items if needed
• Accept your modifications or ignore the suggestions
• For the synchronize Items job, you can remove Items that have been flagged as irrelevant from your Collection
• Any skipped Guided Fixes must have receive a verdict before completing the job.

Note: Changes are not applied to the original Items in the Item bank until the entire Collection is exported. Accepted changes will, however, be considered in future jobs run on the same Collection.

Review Failed Items

Items that could not be analyzed due to errors or unsupported content are listed here. These must be manually reviewed outside of IBHC.

Mark Complete

Once all actions have been reviewed and approved, click Mark complete to finalize the job.

Completed jobs will be listed under the Completed jobs section for the Collection.

Delete Job

If you decide not to proceed, click Delete job to remove the active job.

Completed jobs will be listed under the Completed jobs section for the Collection.

Closing a Collection

Once all desired jobs are completed, you can push updates back to the Item bank by closing the Collection.

1. Go to the Collections list page.
2. Open the desired Collection by clicking on it.
3. Choose one of three options: Export and close, Export only, or Close only.
   
   Closing a Collection

Export and close

By default, the Export and close option is selected. This exports updated content to the original Item bank and closes the Collection.

On the Export and close Collection page, first select the export behavior. There are three options:

1. Create new Items - Add suffix to existing Item reference: In this case a new Item will be created in the Item bank for each modified Item from this Collection. The new Item reference combines the existing Item reference with a custom suffix.
2. Create new Items - Generate random Item reference: In this case a new Item will be added to the Item bank for each Item modified in this Collection. The new Item reference will be a UUID.
3. Overwrite original Items: Modified Items from this Collection will replace original Items in the Item bank. Unmodified Items will not be overwritten. The existing Item reference will not be changed. Note that any original Items which have had their Item reference altered since this Collection was created will not be overwritten. Instead a new Item will be added to the Item bank.

Next, you can choose to add Tags, with options to tag all Items in the Collection or just the Items that have been modified.

Export and close Collection

After performing an export, you can view the details from the Completed jobs table as well as download a CSV of the modified Items. This is especially helpful when you have chosen to generate new Item references.

Export only

Exports content to the selected Item bank but keeps the Collection open for further jobs. The same options are available as in the Export and close flow.

Close only

Closes the Collection without exporting changes. Confirm the action in the pop-up dialog to close it permanently.