An optimal Snorkel model is made up of an ensemble of labeling functions, since each individual labeling function encodes a different heuristic. In addition, most labeling functions abstain on sentences that their heuristic does not cover. Therefore, analysis of an individual labeling function using typical classification metrics does not always tell us how useful the labeling function would be in practice.
