MLSD-009 · DESIGN PRACTICE
Practice: Content moderation
Draft the complete decision system before revealing the guidance. Use a 45-minute rehearsal budget and adapt it to the interviewer’s direction.
Preserve eligibility, available-at-decision inputs, mature labels, bounded work and compatible releases. Explain alternatives and test a normal, boundary and failure case.
Your practice draft
Design editable text/image moderation with versioned policy, 300-ms synthetic initial action budget, finite human review and appeals. Explain baseline, labels/splits, score/calibration/action policy, full schema/lineage, capacity, stale-result rejection, rollback and observable recovery. Change the input to unsupported modality and cut review staffing.
Saved locally on this device. The worked answer does not score your draft. Existing lesson notes and completion are separate.
Progressive hints
Hint 1
Define the content revision, policy target and reversible action before selecting a model.
Hint 2
Account for every proposal and keep pending/unknown separate from allowed/negative; compute per-hour load.
Hint 3
Require current revision/policy/action/case versions for reviewer/appeal effects, and validate the whole release rather than weights alone.
Self-review evidence
For each criterion, record Missing, Prompted, Independent or Adaptive reasoning. No automated scoring or offer prediction is provided.
- Clear decision, reversible actions, six answered clarifications and changed-assumption branches.
- Label/policy/availability, annotation disagreement, sampling, splits and appeal selection are explicit.
- Complete baseline, modeling alternatives, calibration diagnostics and capacity-feasible action policy.
- Concrete PK/FK/cardinality, feature/label/run/action lineage and cross-record state invariants.
- Normal, boundary, overflow, stale-review and appeal-correction traces preserve state and identity.
- Gated current-policy release/recovery, owner-action signals, cost units and human/technical review limits.
Reveal worked design guidance
A coherent answer starts with rules and bounded review, defines adjudicated policy-versioned labels with availability and selected-population limits, and separates raw scores, calibration and action thresholds. The six-item fixture restricts A/B, admits C/D, retains E as pending-overflow and allows F. It computes threshold/confusion and calibration diagnostics without claiming safety. It pins content/feature/label/run lineage, bounds preprocessing/inference/claims, rejects stale edits/policy/versions, and appends compatible corrections. It estimates human arrivals/backlog separately from machine capacity, stages current-policy bundles with rollback or approved fallback, and assigns audit/slice/privacy/review ownership.
Open the complete worked design in a new tab →The new tab keeps this draft visible. Save it on this device before closing the page.