Evaluation
What is active learning?
Active learning chooses which unlabeled examples a person should label next, so the model improves faster than if you labeled at random.
Updated
How it works
- Score unlabeled rows by uncertainty or disagreement.
- Send the top of that list to a person.
- Write the new labels back onto the rows and repeat.
What it is not
It is not labeling every row, and it is not a random sample.
active learning: this, and the thing it is confused with
| This | Not this | |
|---|---|---|
| Selects | Informative rows | All rows, or a random draw |
| Labels go | Back on the row | Into a file nobody joins |
| Loop | Model, rank, label | A single export |
Where Pixeltable fits
Pixeltable can rank rows with a computed score and store the human label on the same row, which is the loop.
Questions
How does active learning work?
Score unlabeled rows by uncertainty or disagreement. Send the top of that list to a person. Write the new labels back onto the rows and repeat.
What is active learning often confused with?
It is not labeling every row, and it is not a random sample.
Next step
Install the Pixeltable skill, or sign up for Cloud and run the same file on a hosted database.