Editor's Picks Versus Community Ranking
Curation · 9 min read ·
Curated choice and crowd ranking measure different things. How each works, where each misleads and how to read them together without confusion.
Ask a hundred people which film is the best of the year and you will get one kind of answer. Ask one respected critic and you will get another. Both are useful, and they are not the same. A crowd tells you what moved many people. A critic tells you what a trained, accountable eye found remarkable. Treating them as interchangeable is the mistake.
The same is true when products are launched. Some places show an editor's selection, others show a ranking by community response, and many show both. Knowing what each measures lets a reader use them wisely and lets a founder understand what a place in either one does, and does not, mean.
Novara Launch shows one of the two. Every listed launch is hung on the wall, and community votes set the order; nobody here picks. Editor's picks are something you will meet on other lists and in newsletters, so this guide explains both, and how to read our ranking beside a pick made elsewhere.
Two different questions
An editor's pick asks: what is worth looking at, and why? A person or a small panel examines the candidates, applies criteria they have stated and chooses a few, with reasons.
A community ranking asks: what did many people respond to? Votes, saves or other signals from users are counted, and the items are ordered by the result.
The questions differ, so the answers differ. A product can be excellent and little known, which an editor may spot and a crowd may miss. A product can be hugely popular and merely adequate, which a crowd will reward and an editor may pass over. Neither is wrong. They are measuring different things.
What the crowd does well
The idea that groups can judge well has a long history, and under the right conditions it holds. The wisdom of the crowd describes the observation that the combined estimate of many independent people can be more accurate than most individual estimates. It works best when people judge independently, when they have varied information and when there is a way to combine what they say.
Community ranking benefits from that. It can:
- surface products that many ordinary users find useful, including some that no editor had heard of
- scale to a large number of submissions without bottlenecks
- reflect real appetite, since people vote on what they would use
- update quickly as opinion changes
- resist the quirks of any single person's taste
Where products are for broad audiences, a community signal is a fair measure of fit.
Where the crowd misleads
The same conditions that make crowds wise can fail.
- Herding. If people see the current ranking before voting, early leaders attract more votes, and the result reflects timing as much as quality.
- Reach, not merit. A team with a large existing audience can bring many voters, which says something about their audience and not necessarily about the product.
- Novelty and noise. A striking idea may draw votes for being surprising rather than being good.
- Small groups. In a niche, a handful of votes can swing an order.
- Gaming. Wherever ranking confers advantage, someone will try to manipulate it. Defences exist, but they are never perfect.
None of this makes community ranking worthless. It means a ranking is a measure of response, and reading it as a measure of quality overstates what it says. On this site, votes can never be bought, and the community ranking is a separate system from paid placements such as the labelled Featured wall, so that neither contaminates the other.
What an editor does well
A curator brings qualities a count cannot.
- Context. They know what already exists and can tell what is new.
- Depth. They can use a product for ten minutes and notice what a thousand glances would miss.
- Explanation. They give reasons, which readers can weigh.
- Attention to the overlooked. A small, careful product with no audience can be found.
- Coherence. A selection can be arranged so that it tells a story.
Where a reader wants guidance rather than a popularity contest, an editor's selection is often more useful.
Where an editor misleads
Editors are fallible in ways that differ from crowds.
- Taste. Every selector has preferences, and a narrow taste narrows the selection.
- Limited reach. An editor can see only what is submitted or noticed.
- Selection bias. When the way items are chosen makes the chosen set unrepresentative, conclusions drawn from it can be wrong. An editor who only reads products from one circle will draw their picks from that circle.
- Capacity. A person can examine only so many items, so some good ones go unseen.
- Error. Judgements can simply be wrong.
The remedy is not to distrust editors but to read their stated criteria and treat each choice as a view, not a verdict.
What each tells a buyer
For someone choosing a product, the two signals combine well.
An editor's pick suggests that a careful person found the product notable against stated criteria. It does not tell you whether it fits your needs. A high community rank suggests that many people responded. It does not tell you whether they used it for long or whether people like you were among them. Where both agree, confidence rises. Where they disagree, ask why: the editor may have found a hidden gem, or the crowd may know something about daily use that a quick examination missed.
The best use of either is as a place to start a short investigation, which should end in your own testing.
What each tells a founder
For a team, the two signals call for different responses.
- A pick is recognition that your product stood out on stated qualities: clarity, care, usefulness. It is worth noting which. It does not guarantee traffic or sales, and it describes one week.
- A community rank is a sign that your message reached people and resonated. It is influenced by your own outreach, so it measures your ability to reach as well as your product.
- Not appearing in either tells you less than you fear. The first question is whether the right people saw you.
Try not to chase one at the expense of the other. A product that is good and clearly explained tends to do reasonably in both over time.
Keeping the two honest
Trust in both depends on keeping them separate and clean.
- Label them clearly, so a reader knows whether they are looking at a judgement or a count.
- Do not let money cross over. Paid placement, where it exists, is its own labelled thing. It must not alter either the editor's choice or the community's votes.
- State criteria. For editorial choice, say what is judged. For community ranking, say what is counted and how manipulation is handled.
- Show uncertainty. Where numbers are small, say so rather than implying precision.
- Allow disagreement. A reader should be able to see both views and make up their own mind.
A worked example
In one week, a small tool for converting handwritten notes into tidy text is chosen by an editor, with the caption: "A careful, plain tool that does one thing well for people who still take notes by hand." It sits twelfth in the community ranking, behind several better-known products.
A reader weighs both. The pick tells her that a person judged it carefully made and clearly explained. The rank tells her that it has not yet reached a wide audience. She tries it, finds that it handles her handwriting well and decides it fits.
A week later, the community ranking moves it to fourth as users share it. The editor's pick has not changed, because the pick described that week. The product's maker notes in her log that the pick brought a trickle of curious readers and the rank brought a larger group, but that the people who stayed came through both. She treats each as one input and keeps improving the product, which was always the thing under her control.
Questions people ask
Should I prefer a place that shows only one? Prefer one that is clear about what it shows. Either can be useful if honest.
Is a ranking more objective? It is more mechanical, which is not the same as objective. It encodes choices about what to count.
Do editors read the community ranking? They may notice it, and they should say how, if at all, it affects their choice.
What if the two disagree sharply? That is interesting, not alarming. Try the product yourself.
A simple habit for readers
When you meet a list, ask two questions before you trust it. First, who or what chose these items: a person, a count or a mixture? Second, what would it take to change the order: a better product, a bigger audience or a bigger budget? The answers tell you what the list is really measuring. Over a few weeks, notice which kind of list has served you best for which kind of decision. Many people find that a curated pick is better for discovering something unfamiliar, while a community ranking is better for confirming that a familiar kind of tool is widely used. Keeping that distinction in mind makes both kinds of list more useful and less likely to mislead.
Summary
An editor's pick and a community ranking answer different questions: what is worth looking at, and what did many people respond to. Crowds are good at scale, breadth and real appetite, but can herd, follow reach and be gamed. Editors bring context, depth and reasons, but have taste, limited reach and bias. Read them together, keep them separate and unbought, and let your own testing decide. Founders should treat each as one signal and keep improving the product.
Questions and answers
- What is the difference between an editor's pick and a community ranking?
- An editor's pick is a judgement made by a person against stated criteria. A community ranking orders items by the responses of many users.
- Which is more reliable?
- Neither in general. They answer different questions, and each has characteristic weaknesses.
- Can a product appear in both?
- Yes, on places that run both, and agreement between the two is a useful signal. This site runs only the community ranking: every launch is shown and votes set the order.
- Can either be bought?
- Votes can never be bought, and editorial choice must not be for sale. Paid placement, where it exists, is separate and labelled.
- How should I use both when choosing a product?
- Treat the editorial pick as a starting point, the community ranking as a sign of popularity and your own testing as the deciding factor.