Learn how to use the Item Bank Health Check (IBHC) tool through the Learnosity Console to analyze and improve the quality of your Item Bank content.
This is a premium feature and may not be included in your product license. For more information, reach out to your Learnosity Customer Success Manager.
Accessing the Item Bank Health Check
- Log on to console.learnosity.com.
- If your product license includes IBHC access and your role is configured for it, you will see a new AI section containing a link to Item Bank Health Check.
Console page with IBHC option visible - Click the Item Bank Health Check option in the left navigation panel.
Creating a new collection
To perform various checks on your Items, you must first create a collection. A collection is a group of Items you want to run analysis on.
- After navigating to the Item Bank Health Check page, you will be directed to the Collections list page, which displays all previously created collections.
- To create a new collection, click the + Create new collection button in the top-right corner of the Collections page.
- On the Create new collection page, enter a name for your collection in the Collection name field.
Create new collection page - From the Import source dropdown, select the source where your Item Bank is located.
- From the Item Bank dropdown, select the Item Bank you want to use for your collection.
- Collections are defined by tags. Click SELECT TAGS to search for and choose relevant tags. Based on the selected tags, a list of Items will be displayed. These Items will form part of your collection. You can click an Item to preview it.
Items list displayed based on selected tags - Click Create collection at the top of the page to complete the process.
Note: A collection can contain a maximum of 15,000 Items. - You will be redirected to the Collections list page, where your newly created collection will appear at the top. Once the collection has finished importing and the status is set to Ready, you can create and run jobs on it.
Creating a new job
A job is a task performed on all Items in a collection to update them based on selected guidelines.
Available job types
- Bias check: Checks Items for biased language, provides suggested fixes, and supports custom guidelines.
- Alt text generation: Generates alt text for images that are missing descriptions.
- Representation report: Generates a report on how representative the collection is against selected categories. Unlike other jobs, no suggested actions are applied to individual Items. Instead, the report provides a summary of representation levels.
- Audio and video transcription: Generates transcripts for missing audio and video elements.
- Language translation: Translates Items into a target language.
- Math hints generation: Generates hints for math-related Question types.
- Correct answer validation: Checks whether the correct answer is accurate and suggests a replacement if needed.
- Distractor rationale generation: Generates response-level distractor rationales for supported Question types.
- Custom Item report: Generates a report based on a custom query.
Steps to create and run a job:
- Go to the collections list.
- Select the collection by clicking on the it.
- On the collection page, click Create in the Active job section.
Create a new job -
On the Create new job page, enter a name for the job.
Create and run a job
- From Job Type dropdown menu, select a job type.
- From the Audit sign off required checkbox, select Yes or No; if Yes is selected, you must review and sign off on the audit results, which display the Items that passed the job criteria. This option is available for jobs that are not reports.
- In the Guidelines dropdown, select a guideline to follow when running the job. (Available for Bias check and Representation report types only.)
- If the job type is Language translation, select a target language from the Target language dropdown.
- If the job type is Math hints generation, select an option from the Hints style dropdown.
- If the job type is Distractor rationale generation, select a Question type from the Question type dropdown.
- If the job type is Custom Item report, enter a query description in the Query field.
- Once all required fields are populated, click Run job.
- Depending on the number of Items and complexity, the job may take several seconds or minutes to complete. When ready, the job status will change to Ready for review.
Note: Only one job can be active at a time per collection. You must either delete or complete the current job before starting a new one.
Job status set to ready for review
Completing a job
Once a job’s status changes to Ready for review, you must complete the audit review (if applicable) and review suggested updates to the Items.
If you are satisfied with the AI-generated suggestions, you can Mark complete to finalize the job. Alternatively, you can Delete job if you are not satisfied.
Steps to complete a job:
- Go to the Active job list for the collection.
- Click the Check details icon for the job.
Click the check details button - On the Job details page, complete the following actions as needed.
Audit Review
Audit review allows you to confirm that the AI’s suggestions comply with the selected guidelines.
- If satisfied, click Sign off and confirm in the pop-up dialog.
Review Actions
- Review flagged Items such as those with biased language or missing alt text.
- Use the Show original Item toggle to preview the unaltered version.
- If needed, you can edit the Suggested Item.
- Accept or reject the suggested changes.
- Any skipped actions must be resolved before completing the job.
Note: Changes are not applied to the original Items in the Item Bank until the entire collection is closed. Accepted changes will, however, be considered in future jobs run on the same collection.
Review Failed Items
Items that could not be analyzed due to errors or unsupported content are listed here. These must be manually reviewed outside of IBHC.
Mark Complete
Once all actions have been reviewed and approved, click Mark complete to finalize the job.
Delete Job
If you decide not to proceed, click Delete job to remove the active job.
Completed jobs will be listed under the Completed jobs section for the collection.
Closing a collection
Once all desired jobs are completed, you can push updates back to the Item Bank by closing the collection.
- Go to the Collections list page.
- Open the desired collection by clicking on it.
- Choose one of three options: Export and close, Export only, or Close only.
Closing a collection
Export and close
By default, the Export and close option is selected. This exports updated content to the original Item Bank and closes the Collection.
On the Export and close Collection page, first select the export behavior. There are three options:
- Create new Items - Add suffix to existing Item reference: In this case a new Item will be created in the Item Bank for each modified Item from this Collection. The new Item reference combines the existing Item reference with a custom suffix.
- Create new Items - Generate random Item reference: In this case a new Item will be added to the Item Bank for each Item modified in this Collection. The new Item reference will be a UUID.
- Overwrite original Items: Modified Items from this Collection will replace original Items in the Item Bank. Unmodified Items will not be overwritten. The existing Item reference will not be changed. Note that any original Items which have had their Item reference altered since this Collection was created will not be overwritten. Instead a new Item will be added to the Item Bank.
Next, you can choose to add Tags, with options to tag all Items in the Collection or just the Items that have been modified.
Export and close collection
After performing an export, you can view the details from the Completed jobs table as well as download a CSV of the modified Items. This is especially helpful when you have chosen to generate new Item references.
Export only
Exports content to the selected Item Bank but keeps the Collection open for further jobs. The same options are available as in the Export and close flow.
Close only
Closes the collection without exporting changes. Confirm the action in the pop-up dialog to close it permanently.