Model evaluation sampling planner

What does the model evaluation sampling planner produce?

Plan reproducible evaluation sample sizes from approved precision and population assumptions.

Use the exact local files and task-specific inputs listed below. Preparation and review stay in this browser. Inspect all findings before preparing the finalized pack.

What do you need before you start?

• Define the authorized source population and your review rules.
• Keep the unchanged original files and record the snapshot and exclusions.
• Review missing and invalid inputs before preparing the finalized pack.

What information do you enter?

Select the actual local sources and freeze the task-specific inputs below. Keep source files and complete findings private.

• Observed source records. Exact headings stratum_id, population_size, expected_proportion_percent, source_ref.
• Approved method rules. Exact headings stratum_id, margin_percent, z_score, minimum_sample, model_version, approval_ref.
• Analysis reference. Customer-controlled review reference.
• Analysis owner. Responsible reviewer of method and evidence.
• Observation date. Real YYYY-MM-DD date. Future source observations are unresolved.
• Population and method scope. Name source population, selected period, approved model and known omissions.
• Population declaration. Select the explicit approved working method.

What you can download

Every result must identify its supplied facts, assumptions and unresolved items.

Fictional review report (PDF). Editable review (DOCX). Complete fictional pack (ZIP). Requires tailoring and responsible review. Samples use the finalized renderer.

How does the model evaluation sampling planner work?

1. 1
   Select the actual sources

   Observed source records. Exact headings stratum_id, population_size, expected_proportion_percent, source_ref.

2. 2
   Freeze the review rules

   For each stratum calculate ceil(N z^2 p(1-p) divided by (e^2(N-1) plus z^2 p(1-p))), then apply the approved minimum without exceeding N. p and e are supplied percentages. Preserve each assumption and separate stratum. Flag planned expected positive or negative counts below 5. This normal-approximation planning calculation does not guarantee achieved coverage or model validity.

3. 3
   Inspect complete findings

   Review all source-linked results and unresolved items. Free JSON and CSV preserve complete results.

4. 4
   Keep recoverable work

   Exact source files and input strings save in this browser. Backups verify tool identity, input schema, hashes and parsed bytes before replacing current work. Prior checkpoints and historical purchases stay separate.

5. 5
   Prepare the finalized pack

   Prepare nine complete files, including both exact originals, then download them free. Review the fictional sample below.

Method and sources

Apply the steps above to the supported inputs. Use the listed source sections to review the rule basis, assumptions and limits.

• Common Format and MIME Type for Comma-Separated Values FilesSupports source CSV mechanics only. Your factors, formulas, units, quotas, population and decision thresholds are not specified by this source. Section 2 describes records, exact field counts, quoted fields and escaped double quotes.RFC Editor. Reviewed 2026-10-09.
• Confidence Intervals and Sample SizeSupports the stated normal-approximation finite-population formula only. Precision depends on a suitable complete sampling frame and assumptions. It does not validate an evaluation, customer quotas, actual coverage or a legal sample requirement. Population proportion section gives n = N p(1-p) / ((N-1)d^2/z^2 + p(1-p)) for finite-population proportion planning.Penn State Department of Statistics. Reviewed 2026-10-09.

Common questions

What still needs review?

Calculations use supplied observations and explicitly approved methods. Original files and prior work remain in this browser. Results do not establish source authenticity, population completeness, causation, regulatory compliance or approval to make a customer, supplier, lending or model decision.

Sampling without replacement from a complete frame. z_score is 1.645, 1.96 or 2.576 for approximate 90%, 95% or 99% two-sided planning. Expected proportion must be strictly between 0 and 100. No power calculation, pooled stratified precision or evaluation result.

Source limits are 10 MB, 5000 rows, 50 fields, 100000 cells and 5000000 parsed characters per file. Plain decimal inputs support 12 whole digits and 6 fractional digits.

Calculations use exact rational arithmetic and round displayed values half away from zero to six fractional places unless an explicit payment rounding rule applies. Decisions compare unrounded values.

Complete results support at most 20000 findings and 15000000 characters. Formal reports show the first 25 rows per calculation output, 1000 characters per calculation preview, and the first 100 named checks with 400 characters per check field. Excel and JSON retain all values.

Related working records

The related workspace contains working administrative records. Open it for the related administrative task.

Related tools

Browse all ai governance tools.

• Ground-truth answer-key managerVersion answers, rubrics and exceptions. Try the free example, then enter your own inputs and review the result before exporting.
• Evaluation run comparatorCompare results across models, prompts and versions. Try a free example, then review your inputs and the result. No account or payment required.
• Fairness metrics calculatorCalculate selected measures from datasets. Try a free example, then review your inputs and the result. No account or payment required.
• Fairness assessment workpaperInterpret metrics, context, limitations and mitigation choices. Try a free example. Review your inputs and result. No account or payment required.
• Regression acceptance checkerApply release thresholds and flag failures. Try a free example, then review your inputs and the result. No account or payment required.