Calibration and confidence bar
How Stage 2 training progress works before per-intent auto-send unlocks on Handlet Pro.
Calibration and confidence bar
Handlet Pro uses a two-stage auto-send model:
- Stage 1 — Opt-in: auto-send is off by default. You turn on the master switch when you are ready.
- Stage 2 — Training unlock: for each intent, Handlet Pro shows validated training evidence by default. The per-intent auto-send toggle unlocks only after that intent reaches its minimum.
Stage 2 does not replace Stage 1. Even after training is complete, your master switch, per-intent toggles, confidence threshold (minimum 85%), and platform guardrails still apply.
Where you see training progress
Open Settings → Channels & Tone. Each configurable intent on the Conditional auto-send card shows:
- A validated count (for example
12 / 30 validated) - A progress bar toward the platform minimum
- A badge such as Training in progress or Ready for auto-send
- An optional correctness rate when you have answered "Was this correct?"
The calibration progress flag remains available for emergency rollback, but the Pro default is to show training progress before an intent can be enabled.
What increases the validated count
Each of the following operator actions counts as one validated message for the draft’s detected intent:
| Action | Counts? |
|---|---|
| Approve & send — send the draft as-is | Yes |
| Edit — change the draft, then send | Yes |
| Was this correct? — Yes, looked correct | Yes |
| Was this correct? — No (optional reason) | Yes |
| Was this correct? — Not now | No |
Dismissals do not count. Sending is never undone when you skip correctness feedback.
See Reviewing AI drafts for the full operator workflow.
Platform minimums (v1)
| Intent scope | Minimum validated messages |
|---|---|
| All configurable intents (default) | 30 |
| Complaints | 50 |
Minimums are platform constants — you cannot lower them in settings. Only events on or after 2026-06-23 count; earlier sends do not receive retroactive credit.
What "Ready for auto-send" means
Ready for auto-send (or calibration unlocked) means the validated count meets the minimum for that intent. It is necessary but not sufficient for auto-send:
- Master switch must be on
- Per-intent toggle must be unlocked and on
- Confidence must meet your threshold (≥ 85%)
- Intent-specific guardrails must pass (pricing, booking fields, complaint severity, and so on)
The Automate ready replies preset does not bypass training — intents still training stay off.
When auto-send stays blocked after training
Even when an intent is Ready for auto-send, Handlet may still block auto-send when:
- Confidence is below your threshold
- Pricing, booking, or complaint guardrails fail
- The intent is platform-vetoed (risk, noise, unknown, unsupported)
- Credentials are degraded or mandatory disclosures fail
Blocked sends appear in the Action Queue with a reason code (for example CALIBRATION_INSUFFICIENT_VALIDATED_MESSAGES while training is incomplete).
Rollback note
Calibration progress bars and send-time enforcement are on by default for Pro workspaces. If the emergency rollback flags are disabled, Stage 1 opt-in and guardrails still apply.