The problem
Manual categorisation was slow and inconsistent, and the data required strict access control.
The system
A classification service hosted on AWS. Before a model was chosen, OpenAI, Anthropic and self-hosted open-weight models were benchmarked on accuracy against real categories and on cost per classification.
- model selected on measured accuracy and cost
- multi-factor authentication and full audit logging
- a purpose-designed results database
- integration with existing ticketing and reporting tools
- continuous accuracy monitoring
Benchmark on real categories
Bars show accuracy. Selection weighs accuracy against cost per item, so the most accurate model is not automatically chosen.
Live classification
The result
A manual workflow replaced by a secure service with measured accuracy and a known cost per item, integrated with existing tools.
- AWS
- Python
- SQL
- LLM APIs
- REST APIs
- Dashboards
Designed and delivered by our founder while employed at a global digital-commerce analytics business. Not client work for Clarke Systems Group. Clarke Systems Group is independent and not affiliated with, or endorsed by, any current or former employer.