Optimizing Variable Instructions

When defining a variable, the instructions are the primary communication mechanism between you, Brim, the Large Language Models that draft labels, and the humans that review labels. Better instructions will help you get better draft labels and allow your human reviewers to spend less time editing results.


Brim provides a Variable Instruction Optimizer to help you create the best variable instructions. We recommend running the Optimizer after you import or create your variables initially, and also after you've generated and reviewed some patient labels - the Optimizer can learn from your edits.



To optimize your variable instructions:

  1. Go to "Project Setup", scroll down to the Variables section, and click on "Optimize" for the variable you want to optimize.
  2. Review the current instructions in the modal, and click "Generate Optimized Instructions". It may take a moment to refine the variable instructions.
  3. Once it's complete, you'll see the current instructions and aggregation instructions above the optimized instructions and aggregation instructions. This allows you to review each and understand the differences. You can edit the optimized instructions if you wish.
  4. Once you are satisfied with the Optimized instructions, click "Use Optimized Instructions". This will copy the new instructions and aggregation instructions into your variable.
  5. Scroll down and click "Save" for your variable to save it with the new instructions.
Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.