Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: emcd/python-detextive
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: master
Choose a base ref
...
head repository: emcd/python-detextive
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: decode-refactor
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 3 commits
  • 9 files changed
  • 2 contributors

Commits on Dec 14, 2025

  1. [WIP] Refactor 'decode' logic to improve accuracy of character set se… 

    …lection.
    @emcd
    emcd committed Dec 14, 2025
    Configuration menu
    Copy the full SHA
    24adf4f View commit details
    Browse the repository at this point in the history

  2. Update notes. (Coauthor: Anthropic Claude Sonnet 4.5)

    @emcd
    emcd committed Dec 14, 2025
    Configuration menu
    Copy the full SHA
    78f373a View commit details
    Browse the repository at this point in the history

  3. Document confidence scoring and text validation strategies. 

    Add comprehensive documentation for confidence scoring approach:
- Size-based scaling rationale and formula
- Detector-specific strategies (intrinsic vs constant confidence)
- Base confidence values for magic (0.95/0.75) and charset-normalizer (0.85)
- Examples and interaction with behavior thresholds

Add analysis of text validation and confidence threshold:
- text_validate_confidence is effectively unused (always 0.0 in main path)
- Validation checks textuality, not detection confidence (orthogonal concerns)
- Recommend removing confidence threshold, keeping tristate control

Fix docstring in is_permissive_charset() to correctly reflect that CP1252
is not permissive (has 5 undefined bytes).

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
    @emcd @claude
    emcd and claude committed Dec 14, 2025
    Configuration menu
    Copy the full SHA
    f76b0a0 View commit details
    Browse the repository at this point in the history
Loading