Don't trust the model card: three decision models on real data
After this episode the viewer can measure any classification model on their own labelled data in twenty lines, and use the probability to decide what runs without a human.
Prerequisites: Ruby, Python, an AI Gateway key for the hosted models, decision-models-demo on episode-005-before
Not covered: fine-tuning, embeddings, agent frameworks
Source: https://github.com/webmatze/decision-models-demo (branches: episode-005-before / episode-005-after)