Frequently Asked Questions

What is Paperstars?

Paperstars is a platform where researchers can quickly and anonymously rate and review published scientific papers. Think Goodreads, but for science. The ultimate aim is to help uncouple science from publication metrics

Why do we need Paperstars?

Because current academic metrics don't reflect the actual quality of research.

They measure visibility, not rigour.

Paperstars offers an alternative: structured, thoughtful reviews from verified researchers and qualitative metrics through 5-star ratings.

Who can leave a rating and review?

Anyone can rate and review, but reviewers who are academically verified (via academic email or ORCID linking) have a "verified academic" badge.

This ensures credibility while keeping reviews anonymous, so everyone can speak freely.

How are reviews moderated?

It's important that we keep this platform safe, constructive, and respectful.

• All reviews will initially be moderated by us before publication to ensure they meet our standards and code of conduct.
• We don't moderate based your opinions, but do make sure it stays professional and fair
• Users can mark reviews as helpful or flag them if they feel something should be reconsidered.
• Over time, we plan to introduce community moderation, where trusted users can help maintain the quality and tone of the platform.

This is about protecting open and honest critique, without opening the door to harassment or abuse.

Is Paperstars anonymous?

Yes. All reviews are anonymous by default, but your academic status can be verified.

This lets researchers give honest, critical feedback without fear of professional repercussions.

Why is my username "PurpleMicroscope"?

For every paper that you interact with you will be assigned a random pseudonym, which is yours only for that paper. When you rate and review a different paper, a new pseudonym will be assigned to you.

How does the anonymous rating work?

When you interact with a paper, you will be randomly assigned a pseudonym, e.g. "PurpleMicroscope". This is your anonymous name for this paper only, meaning if you interact through the comments you will always show up with the name user name for this paper, but other papers may also have comments or reviews by "PurpleMicroscope" that aren't you. Your personal profile is available to view, however the papers you have rated are not visible on it. Your reviews are also anonymised for the admins, meaning we can only see the pseudonym.

I can't find Paper X?

This may be because it hasn't been indexed on CrossRef yet. If you encounter this problem, drop us on an email at info@paperstars.org.

What makes the rating system different?

Paperstars uses a weighted rating system.

You rate specific aspects of a paper, like clarity, methodology, transparency, etc. Those inputs generate a final star rating (1–5).

You can also manually adjust the score to reflect your overall impression.

You can check out the details of the rating system here.

What if someone abuses the platform?

We have safeguards in place:

• Reviews are community-moderated with flags and upvotes
• Users who leave repeated negative reviews for a single author are automatically flagged for review
• Users who leave 3 consecutive negative reviews are automatically flagged for review
• Personal attacks, hate speech, and low-effort reviews are not tolerated

Can I delete my account?

We'll be sad to see you go, but yes, absolutely. Just navigate to your profile settings and find the "cancel account" button

What happens to my ratings and reviews after I delete my account?

They will stay part of the record, but will no longer be linked to your account

Can I delete a rating & review?

Yes. Unforunately, we don't have a easy button for this, So right now, the best thing to do is to edit your review with "TO DELETE" and then email us with the pseudonym used and the paper details and we can delete it for you.

Do authors get notified when their paper is reviewed?

Not yet, but this feature is planned. Currently, authors can "claim" their publications and respond constructively to reviews.

Does Paperstars replace peer review?

No. Paperstars is not a replacement, it's an additional layer of feedback that happens after publication.

This is called post-publication peer review and it's already becoming a core part of open science.

Is it free to use?

Yes. Paperstars is free to use and the core feature of rating and reviewing always will be for researchers and reviewers.

When can I start using it?

Now! This is the MVP so if there are any issues or questions, please feel free to let us know. You can email us at info@paperstars.org.

Where is feature X?

Have an idea for a feature? We'd love to hear it. Drop us an email at info@paperstars.org!