Peer Review: SensorOverlord Paper
For years on Twitter, I’ve seen scientists in different degrees of celebration or dismay that correspond to different stages of the peer review process.
It’s interesREADMEting being a student in this environment. I’m probably part of the first generation of students to see some of the inner-workings of the scientific community before really being a part of it. If I was a student in the 80s, I might’ve been well into my PhD before being privy to professorly complaints about the peer review process.
So, when I finally finished the year-long process of writing my first primary-author paper (after hundreds of drafts, slowly improved by edits from anyone who was willing to give them), I had some vague sense of what lie ahead.
About seven months later–a year and a half or so after my first draft–I finally have my first publication. I often have to qualify that it’s just in Scientific Reports, just barely a “ real” journal, but I’m still proud that it’s out.
Below is the timeline for my peer review process. I don’t know why exactly I’m documenting it. To remind myself? To help others that come after me better prepare for the process? I’m not sure, but here it is.
Step 1: The preprint
My advisor, Javier, put the paper on biorxiv, here. That was a very easy process. We celebrated.
Step 2: Desk-rejections
We submitted to Nature Methods on 10 February, 2020. It was rejected on 12 February. That was a bummer, we thought it was a good fit. But fast rejections are good.
Then we submitted to PLOS Biology later that day–12 February, 2020. Desk rejection five days later, 17 February.
Step 3: Major Revisions :/
I suggested BMC Biology next. We submitted on 18 February, 2020.
We passed the editor’s desk (woo!!)
Then, three long months later (19 May, 2020), an email:
Please accept my apologies for this prolonged review process.
Oh, was it prolonged? I definitely wasn’t refreshing my email every five minutes. (But actually no worries–finding reviewers seems like a damn hard job).
You will see that while the reviewers comment on the interest of the study, they have raised significant issues, […] It might be more productive to submit the manuscript to another journal, however, if you can address the criticisms, which as we see it will require further experiments, we should be happy to see a resubmission.
Ahh, bummer. Here are some snippets from those reviews:
Reviewer #1 was the big bummer. They said:
I personally enjoyed to read the manuscript. However, overall, it is too immature to publish in BMC biology.
And they wanted more experiments:
The authors should pick up two or three probes, and investigate the same correlations to ones shown in Fig 1, with adding the various artificial error.
This would be a decent undertaking, maybe a few months of work. Combined with the other suggestions, Javier thought it would be about a year of work. And we didn’t think it was necessary: I presented a mathematically-rigorous model that was guaranteed to work under my assumptions.
Ultimately, I interpreted this reviewer’s reaction as a failure on my part to properly communicate the significance of my findings. Javier didn’t think so, though–he just thought it was a luck of the draw..
And Reviewer #2 was very positive:
Overall I think the experiments are well executed and controlled, and the manuscript is well written. I am therefore in favor of the publication of the manuscript on BMC Biology, provided that following minor questions can be addressed satisfactorily.
And what followed were reasonable, but definitely seemed like that reviewer didn’t fully understand some of our figures.
Step 4: Out-of-scope desk rejection.
On May 20, Javier suggested submitting to Genetics. They quickly came back on May 22nd and told us that they couldn’t find a suitable editor to review our paper.
Step 5: Minor revisions!!
Finally, we decided to submit to the mega-est of megajournals: Scientific Reports. That was on May 22nd.
On June 6th, we got a confirmation that it was out for review.
Two months later–August 5th, 2020, we received a set of reviewer comments. And they were pretty positive! Just two reviews.
The first review said:
This manuscript is quite suitable for publication in this journal. Some minor questions might be addressed in the revision:
Their questions were
(1) about microscopes that set their own algorithms for output ratios. We turn off any microscope processing. We like to record raw intensities and do any processing afterwards–so we recommended that people do the same. We also explained some about our post-processing, and why it doesn’t affect the model.
(2) About how fluorophores work differently in different environments. This was a really good point, which we addressed some in the paper. In some cases, we can address that. In other cases, we can’t.
The second review said:
I would suggest a major revision by considering the following points:
But the actual points were super minor. Things like asking us to make more simplifications to our formulas and talking about how background reduction affects our results.
After getting these reviews, I worked 8+ hours on revisions each day, while doing other work. It was exhausting. Javier submitted the response to reviewers on August 11th.
Then we got the acceptance on September 24th, and proofs near-after (September 28th). And that was that!
On October 13th, Javier received an email from a PI in France who said:
[…] we chatted a bit some days ago on your brand new paper concerning SensorOverlord. I read it yesterday, and it is brilliant!
That made me really happy. I need to remember to email authors when I like their papers.