Understanding Confidence Scores

What is a Confidence Score?

When SkinVault scans a photo, the AI outputs a confidence score between 0% and 100%. This represents how certain the model is that the photo contains sensitive content.

Think of it this way: if we ran 100 slightly different versions of our AI model on the same photo, 87 of them would flag it as sensitive. The higher the number, the more certain the detection.

The False Positive / False Negative Tradeoff

No AI is perfect. There are two types of mistakes:

There's always a tradeoff between these two. You can't minimize both at the same time:

• Lower threshold (catch more): Fewer false negatives, but more false positives
• Higher threshold (be strict): Fewer false positives, but more false negatives

Why We Err Toward False Positives

SkinVault is designed to err on the side of caution. Here's why:

Consider the consequences:

• False positive: You spend 2 seconds looking at a flagged photo and thinking "nope, that's fine" ← Minor inconvenience
• False negative: A sensitive photo stays visible when you thought your library was clean ← Actual problem

This is why our default threshold is relatively sensitive. We'd rather flag a few extra beach photos than miss something actually sensitive.

Play With the Threshold

You can adjust how sensitive the detection is. Lower thresholds catch more (including more false positives). Higher thresholds are stricter (but might miss borderline cases).

In the app, you can review flagged photos and mark safe ones. The more you review, the better you'll understand where your personal comfort level is.

Confidence Score Ranges

🔴 80-100%: High Confidence

The AI is very sure this photo contains sensitive content. These are rarely false positives.

🟠 50-80%: Medium Confidence

Likely sensitive, but could be ambiguous cases like swimwear, artistic shots, or partial views. Worth reviewing.

🟡 30-50%: Low Confidence

Borderline cases. The AI isn't sure. These have higher false positive rates but are flagged to be safe.

🟢 0-30%: Likely Safe

The AI doesn't think this is sensitive. Not flagged by default, but you can lower your threshold to include these.

The Bottom Line

Confidence scores give you transparency into the AI's thinking. Instead of a mysterious black box that just says "yes" or "no," you see exactly how certain the model is.

We default to catching more rather than missing things, because:

• Reviewing a false positive takes 2 seconds
• Missing a sensitive photo defeats the whole purpose
• You can always adjust the threshold to your preference

The robots are here to help - and they'd rather be a little overcautious than miss something important.