Our methodology
How we rate AI operating systems
Our own assessment, scored on published criteria. Separate from buyer reviews.
AIOS Market editorial rating
This is our editorial assessment. No payment changes a score. Makers cannot buy or edit a rating, but they can ask for a re-check.
Class
Class tells you what a product is. Scores and “best in class” are compared within a class.
| Class | Description |
|---|---|
| Prompt and template pack | Prompts and templates you copy and run yourself. |
| Skill pack | Skills or commands you add to an AI assistant and trigger one at a time. |
| Agent pack | A set of agents that each do multi-step work in your assistant. |
| Full operating system (installed) | An installed system that runs many agents together on your own machine or server. |
| Hosted AI team (SaaS) | A web app run by the maker where AI helpers work in their cloud. |
| Done-for-you install service | A person or team sets an AI system up for you. |
| Open-source framework | Open-source runtimes and orchestration layers that builders run agents on. |
Usefulness levels
One scale for all classes, describing how much a product does on its own.
Level 1: Basic
Templates and prompts you copy and run yourself.
Level 2: Helpful
Skills you trigger one at a time.
Level 3: Capable
Agents that do multi-step work when asked.
Level 4: Autonomous
Runs on its own schedule, acts proactively and remembers context.
Level 5: Runs the business
Handles whole business functions end to end, with monitoring, memory and self-checks.
Criteria
Weights are normalised over active criteria. Inactive criteria do not affect the score.
| Criterion | Weight | Description |
|---|---|---|
| Autonomy | 15% | Does work without being prompted: schedules, background runs, proactive actions. |
| Depth | 15% | How much it covers: agents, skills and the business areas they handle. |
| Ease of setup | 15% | How quickly a non-technical small business owner can get it running. |
| Ownership and privacy | 10% | Runs on your own machine or account, and you keep your data and files. |
| Value for money | 15% | What you get for the price, compared with similar products in its class. |
| Updates and support | 10% | How often it improves and how you get help. |
| Security | 10% | Installable: our scanner result on the public code where the licence allows. Hosted: HTTPS, privacy policy, terms and data handling statements. |
| Maturity and traction | 10% | How established it is: age, users, stars, funding and track record. |
How the score is worked out
We take a weighted average of the available active criterion scores, each from 1 to 10, and show it to one decimal place. Missing scores are not counted as zero. Stars are the score divided by 2, rounded to the nearest half star.
Security checks
For installable open-source code, we run our scanner pipeline on the public repository where the licence allows. It checks malware signatures, YARA rules, exposed secrets and dependency advisories. We show the result.
For hosted products, we check HTTPS, privacy policy, terms and data handling statements. Automated checks are not a guarantee of safety.
Editorial listings
“Listed by AIOS Market” means the maker has not joined. Facts are re-checked from the maker’s own site or repository on the date shown. “Not stated” means we could not verify it. We use referral links only where the maker runs a public programme, and say so.
Our own products
All Sorted and PeptAIOS are made by the team behind AIOS Market. They carry a disclosure and are scored by the same rules.
Buyer ratings
Buyer ratings come only from verified purchasers. They are never seeded and remain separate from our editorial rating.
Corrections and claims
Makers can claim a listing from its page and request a re-check. For corrections, contact joe@aiosmarket.ai.