{"docs":[{"id":195,"title":"Building a Training Dataset: Collection, Labelling and Bias","heading":"Building a Training Dataset: Collection, Labelling and Bias","subheading":null,"category":"AI & Machine Learning","body":{"root":{"type":"root","children":[{"type":"heading","tag":"h3","version":1,"children":[{"type":"text","text":"Where bias comes from","version":1}]},{"type":"paragraph","version":1,"children":[{"type":"text","text":"Sampling bias arises when the collected data does not reflect the conditions of use. Class imbalance means rare but important cases have too few examples to learn from. Labelling bias appears when annotators interpret ambiguous cases differently or follow their own assumptions.","version":1}]},{"type":"paragraph","version":1,"children":[{"type":"text","text":"Counter each one deliberately: plan collection as a matrix of conditions, record metadata for every sample, label a shared subset twice to measure agreement, and review the disagreements to tighten the guidelines.","version":1}]}],"direction":"ltr","format":"","indent":0,"version":1}},"tags":"AI & Machine Learning, Datasets, Labelling","cardCta":{"label":null,"link":null},"pageCta":{"label":"Talk to AAVICO engineering","link":"/contact"},"excerpt":"A model learns whatever its data teaches, including the shortcuts and gaps. Planning collection and labelling carefully is the most reliable way to improve results.","featuredImage":null,"type":"Blog","readTime":"3 min read","publishedAt":"2026-11-15T14:22:00.000Z","heroImage":null,"introText":"For most applied machine learning projects the dataset matters more than the choice of network. A model learns the patterns present in its examples, so missing conditions, inconsistent labels or accidental correlations all end up in its behaviour. Building a good dataset is a planned engineering activity with its own specification and quality checks. This article covers how to collect data, how to label it consistently and where bias comes from.","metrics":[{"id":"building-a-training-dataset-collection-labelling-metric-1","value":"Coverage","label":"Examples of every class and condition the product will meet in use.","icon":null},{"id":"building-a-training-dataset-collection-labelling-metric-2","value":"Guidelines","label":"Written labelling rules that make two annotators draw the same box.","icon":null},{"id":"building-a-training-dataset-collection-labelling-metric-3","value":"Agreement","label":"Measured consistency between annotators, which tests the rules themselves.","icon":null},{"id":"building-a-training-dataset-collection-labelling-metric-4","value":"Held out","label":"A test set collected and frozen before any tuning begins.","icon":null}],"gallery":[],"challenge":{"root":{"type":"root","children":[{"type":"paragraph","version":1,"children":[{"type":"text","text":"Data is usually collected wherever it is easiest: one site, one camera, daytime, a few operators. A model trained on it can latch onto the background, the camera or the lighting instead of the object, and fail as soon as any of those change.","version":1}]},{"type":"paragraph","version":1,"children":[{"type":"text","text":"Labels carry errors too. Without clear rules, annotators disagree on where a box ends, whether a partly hidden object counts, or which class an unusual item belongs to, and the model learns that inconsistency.","version":1}]}],"direction":"ltr","format":"","indent":0,"version":1}},"blockquote":{"quote":"Write the labelling guidelines before the first label, and expect to revise them after the first hundred.","author":"","role":"AAVICO Engineering"},"supportImage1":null,"deliverables":{"root":{"type":"root","children":[{"type":"paragraph","version":1,"children":[{"type":"text","text":"List the classes, conditions and edge cases the product must handle, and turn them into a collection plan with target counts.","version":1}]},{"type":"paragraph","version":1,"children":[{"type":"text","text":"Write labelling guidelines with examples of difficult cases, run a pilot batch and measure agreement between annotators.","version":1}]},{"type":"paragraph","version":1,"children":[{"type":"text","text":"Freeze a test set from separate sessions or sites, then label the remaining data with regular quality review.","version":1}]}],"direction":"ltr","format":"","indent":0,"version":1}},"results":[{"id":"building-a-training-dataset-collection-labelling-result-1","title":"Better Models","description":"Consistent, representative data improves results more reliably than tuning."},{"id":"building-a-training-dataset-collection-labelling-result-2","title":"Known Gaps","description":"Metadata shows exactly which conditions are under-represented."},{"id":"building-a-training-dataset-collection-labelling-result-3","title":"Fairer Behaviour","description":"Performance is checked across groups and conditions, not just on average."},{"id":"building-a-training-dataset-collection-labelling-result-4","title":"Reusable Asset","description":"A documented dataset supports every later model version."}],"lookingAhead":{"root":{"type":"root","children":[{"type":"paragraph","version":1,"children":[{"type":"text","text":"Where images or recordings include people, check consent and data protection requirements for each jurisdiction before collection starts.","version":1}]},{"type":"paragraph","version":1,"children":[{"type":"text","text":"Consider synthetic or augmented data to fill specific gaps, but always test on real data. A model can learn the artefacts of a simulator as easily as the objects in it.","version":1}]}],"direction":"ltr","format":"","indent":0,"version":1}},"supportImage2":null,"testimonial":{"quote":null,"author":null,"role":null,"photo":null},"challengesSolved":[{"id":"building-a-training-dataset-collection-labelling-challenge-1","title":"A model that learned the background","description":null,"icon":null},{"id":"building-a-training-dataset-collection-labelling-challenge-2","title":"Annotators following different rules","description":null,"icon":null},{"id":"building-a-training-dataset-collection-labelling-challenge-3","title":"Rare cases with too few examples","description":null,"icon":null},{"id":"building-a-training-dataset-collection-labelling-challenge-4","title":"Test data drawn from the training sessions","description":null,"icon":null}],"relatedPosts":[],"contactUs":{"show":true},"updatedAt":"2026-11-15T17:32:32.682Z","createdAt":"2026-11-15T17:32:32.682Z"}],"hasNextPage":false,"hasPrevPage":false,"limit":10,"nextPage":null,"page":1,"pagingCounter":1,"prevPage":null,"totalDocs":1,"totalPages":1}