Curation Criteria: Quality, Novelty and Usefulness

A curator who is asked "why that one?" ought to have an answer. Not a vague one, such as "it felt right", but a reasoned statement that another thoughtful person could understand, test and perhaps disagree with. Having criteria does not remove judgement. It makes judgement visible.

For product launches, three criteria carry a great deal of the weight: quality, novelty and usefulness. This guide sets out what each means, how to look for it and how the three interact. It is written for people choosing, for founders preparing to be considered and for readers who want to understand why a pick was made.

Why criteria at all

Criteria are the standards by which something is judged. Without them, a selection is a set of preferences. With them, it becomes an argument that can be examined.

Three benefits follow. Choices become more consistent from week to week. Founders can see what is valued and decide whether to take part. And readers can judge the curator, not only the products, which keeps the curator honest.

Criteria should be few, because a long list invites box-ticking. Three is enough to be thorough and few enough to remember.

Criterion one: quality

Quality, in a business sense, concerns how well a product meets requirements and performs its function. For a launch, ask whether it is well made.

Things an editor can observe:

• It works. The main function does what it claims, without errors, on first use.
• It is stable. It does not collapse when used in an ordinary way.
• It is coherent. The parts fit together, and the experience feels designed rather than assembled.
• It is cared for. Details such as wording, spacing, speed and error messages show attention.
• It is honest. The page describes what the product does without inflation.
• It is accessible. People with different abilities and devices can use it.

Quality is not polish for its own sake, and an early product is not expected to be flawless. The question is whether the maker has taken care with what they have chosen to show.

Criterion two: novelty

Innovation is often defined as the introduction of something new, whether an idea, method or device. For a curator, novelty asks what the product adds.

Novelty comes in several forms.

• A new approach to an old problem.
• A new audience, meaning a group that had been poorly served.
• A new combination of existing ideas that works better than either alone.
• A new level of clarity or care in a crowded field.
• A new constraint deliberately chosen, such as doing less, or working offline.

Novelty is not the same as being first. Few products are. What matters is whether, after seeing it, the reader's picture of what is available has changed. A curator who has seen twenty note-taking tools can still be surprised by a twenty-first that works on a different principle.

Be wary of novelty for its own sake. A strange product that solves no problem is a curiosity. That brings us to the third criterion.

Criterion three: usefulness

Usability concerns how effectively and satisfactorily people can use something to achieve their goals. Usefulness goes a step beyond it: is the goal worth achieving, and is the product the right way?

Questions an editor asks:

• Who is this for? A clear group, described concretely.
• What is their problem? Stated in their own terms.
• Does the product solve it? Visibly, in a way a person could confirm by trying.
• Is it easy to begin? Few steps from arrival to first value.
• Would someone come back? A hint of lasting value rather than a one-off thrill.

A narrow product with a clear group and a real problem often scores better on usefulness than a broad product with a vague promise.

How the three interact

The criteria are not equal in every case, and they sometimes pull apart.

• High quality, low novelty: a very well-made version of something familiar. Often useful, rarely surprising. Worth including when the execution is exceptional.
• High novelty, low quality: an exciting idea that does not yet work. Interesting, but a curator who cannot confirm it works must hesitate.
• High usefulness, modest on both: a plain, serviceable tool that solves a real problem. Frequently underrated.
• Strong on all three: rare, and the easiest choice.

An editor may consider a product strongest on two criteria and note a plan for the third. A selection that is balanced across a week, with one remarkable idea, one beautifully made familiar tool and one humble helper, is often better than a list of near-duplicates that all score the same.

Writing down the reasons

A pick is more useful with a short statement of why. A simple three-line note will do.

• Quality: what was observed, such as "checked the main function; worked first time; clear error messages."
• Novelty: what is added, such as "differs from similar tools in sorting by deadline rather than by name."
• Usefulness: who it helps, such as "freelancers invoicing in more than one currency."

The caption that readers see can be a distillation of these notes. Writing them also exposes weak reasoning: if you cannot fill in a line, perhaps the pick is not as strong as it seemed.

Using the framework as a founder

Before you submit, run the check on your own product. It takes ten minutes.

1. Quality. Use your product as a stranger on a phone. List three things that feel rough. Fix what you can, and be honest on the page about the rest.
2. Novelty. Complete this sentence: "Unlike other tools, ours ___." If the answer is vague, find the real difference or say plainly that your strength is execution.
3. Usefulness. Name one specific person and the problem they have. If you cannot, your audience is too wide.

Then ask: where is my product strongest, and does my page make that obvious in the first screen? The framework is not a way to dress up a weak product. It is a way to make sure a good one is seen for what it is.

Limits of the framework

No set of criteria captures everything.

• Taste remains. Two careful editors may weigh the criteria differently.
• Context matters. What is novel in one community is common in another.
• Some value is slow. A product's usefulness may only show with time.
• Criteria can be gamed. A page can be dressed to look novel and useful without being so. Checking claims and trying the product are essential.
• Fairness requires reflection. Editors should ask whether their criteria favour the familiar, and whether they overlook products from outside their own circle.

For these reasons, the criteria are a framework for thinking, not a formula for scoring.

A worked example

An editor examines three candidates in a week.

The first is a budgeting tool for students, with a clean, well-tested interface that does what it says. It resembles several others. Quality is high, novelty low, usefulness good. The editor notes its exceptional clarity.

The second is a tool that turns lecture recordings into short, searchable summaries. It is quite new in approach and very useful to a defined group, but it fails on two of five test files. Novelty and usefulness are high, quality is uneven. The editor sends a note to the maker and holds the product for a later week.

The third is a plain page-layout tool for community newsletters. It is neither flashy nor unprecedented, but it is carefully made and solves the specific problem of a group of volunteers who have never had one. Quality good, novelty modest, usefulness high.

She chooses the first and third, writes a three-line reason for each and tells the second maker what would change her mind. The selection is not the three most exciting products. It is the two she can best defend.

Questions people ask

Should the weights be published? Publishing the criteria is enough. Exact weights suggest a precision judgement does not have.

Can a product succeed with only usefulness? Often yes. Plain, useful products are much loved.

How should I treat early products? Look for care and honest scope, rather than completeness.

Does a high score mean it is the best? It means it met the criteria well this week, in the editor's view.

Applying the criteria to your own shortlist

The framework is not only for editors. Anyone who chooses tools, whether for a team, a classroom or a household, can use it. Write the three words on a page and give each candidate a line under each. Under quality, note what you saw when you tried it. Under novelty, note what it does that your current tool does not. Under usefulness, note who in your group would use it weekly. Candidates that leave a line empty are usually the ones to set aside. The exercise takes minutes, and it turns a vague preference into reasons you can share with colleagues, which is exactly what a good curator does with a public pick.

Summary

Three criteria carry much of curation: quality, how well a product is made; novelty, what it adds; and usefulness, who it clearly helps. They interact, and a good selection balances them rather than rewarding one. Write short reasons for each pick, use the framework as a self-check before submitting and remember its limits: taste remains, context matters and claims must be tested. Criteria do not remove judgement, but they make it visible, which is what allows trust.