Frequently Asked Questions
What is Paperstars?
Paperstars is a platform where researchers can rate and review published scientific papers. Think Goodreads, but for science — with a focus on quality, transparency, and open dialogue.
Why do we need Paperstars?
Because current academic metrics — like citation counts, H-index, and journal impact factor — don't reflect the actual quality of research.
They measure visibility, not rigour.
Paperstars offers an alternative: structured, thoughtful reviews from verified researchers and qualitative metrics through 5-star ratings.
Who can leave a rating and review?
Anyone can rate and review, but reviewers who are academically verified (via academic email) have a "verified academic" badge.
This ensures credibility while keeping reviews anonymous, so everyone can speak freely.
How are reviews moderated?
It's important that we keep this platform safe, constructive, and respectful.
- All reviews will initially be moderated by us before publication to ensure they meet our standards and code of conduct.
- Users can mark reviews as helpful or flag them if they feel something should be reconsidered.
- Over time, we plan to introduce community moderation, where trusted users can help maintain the quality and tone of the platform.
This is about protecting open, honest critique — without opening the door to harassment or abuse.
Is Paperstars anonymous?
Yes — all reviews are anonymous by default, but your academic status is verified.
This lets researchers give honest, critical feedback without fear of professional repercussions.
Why is my username "PurpleMicroscope"?
For every paper that you interact with you will be assigned a random pseudonym, which is yours only for that paper. When you rate and review a different paper, a new pseudonym will be assigned to you.
How does the anonymous rating work?
When you interact with a paper, you will be randomly assigned a pseudonym, e.g. "PurpleMicroscope". This is your anonymous name for this paper only, meaning if you interact through the comments you will always show up with the name user name for this paper, but other papers may also have comments or reviews by "PurpleMicroscope" that aren't you. Your personal profile is available to view, however the papers you have rated are not visible on it.
I can't find Paper X?
This may be because it hasn't been indexed on CrossRef yet - if you encounter this problem, drop us on an email at info@paperstars.org.
What makes the rating system different?
Paperstars uses a weighted rating system.
You rate specific aspects of a paper — like clarity, methodology, transparency, etc. — and those inputs generate a final star rating (1–5).
You can also manually adjust the score to reflect your overall impression.
You can check out the details of the rating system here.
What if someone abuses the platform?
We have safeguards in place:
- Reviews are community-moderated with flags and upvotes
- Users who leave repeated negative reviews for a single author are automatically flagged for review
- Personal attacks, hate speech, and low-effort reviews are not tolerated
Do authors get notified when their paper is reviewed?
Not yet, but this feature is planned. Currently, authors can "claim" their publications and respond constructively to reviews.
Does Paperstars replace peer review?
No. Paperstars is not a replacement — it's an additional layer of feedback that happens after publication.
This is called post-publication peer review and it's already becoming a core part of open science.
Is it free to use?
Yes. Paperstars is free to use and always will be for researchers and reviewers.
When can I start using it?
Now! This is the MVP so if there are any issues or questions, please feel free to let us know. You can email us at info@paperstars.org.
Where is feature X?
Have an idea for a feature? We'd love to hear it. Drop us an email at info@paperstars.org!