That BICEP Rumour…

So there’s been another twist in the story of BICEP2 and whether or not it has actually detected primordial gravitational waves.

This time it is a blog post on a site called Résonaances by Adam Falkowski who alleges that the BICEP2 team has made a pretty astounding error in their analysis of the data. This suggestion has been picked up by a couple of fairly influential science news sites (here and here). The BICEP2 team deny having made any such error and are quoted in the news stories defending their results in robust terms.

Before I continue let me make it clear that I stand by the scepticism I have expressed on this blog about this result (which, in fact, is shared by many of my colleagues in the cosmology fraternity1). The problem is that the measurement is made at a single frequency (150 GHz) and it is by no means clear on that basis whether it has the black-body spectrum that would characterize it as being associated with the cosmic microwave background rather than some sort of foreground emission. At 150 GHz the major worry is that polarized emission from galactic dust might contribute significantly to the signal, and might even swamp any primordial contribution.

Anyway, the blog post states that:

To estimate polarized emission from the galactic dust, BICEP digitized an unpublished 353 GHz map shown by the Planck collaboration at a conference.  However, it seems they misinterpreted the Planck results: that map shows the polarization fraction for all foregrounds, not for the galactic dust only (see the “not CIB subtracted” caveat in the slide). Once you correct for that and rescale the Planck results appropriately, some experts claim that the polarized galactic dust emission can account for most of the BICEP signal.

Here’s the map concerned as it appeared in the conference talk as presented on the blog post:

culprit

The point about this is that dust emission increases with frequency, so that at 353 GHz it would be expected to dominate the primordial cosmic microwave component. However, if one can measure the polarized component of this emission at high frequency (where it is larger and consequently easier to measure) then one could try to estimate the polarized contribution at the lower frequency measured at 150 GHz by BICEP2 by assuming it has a similar polarized fraction. This is actually just about the only way to estimate the foreground contribution.

Unfortunately in this map there is an additional unpolarized foreground arising from the Cosmic Infrared Background (CIB) which comprised integration dust emission from extragalactic sources. Including this component makes the polarized fraction look lower than it would if it were separated out and only the more highly polarized Galactic contribution considered. In other words including the CIB leads to an underestimate of the polarized fraction and consequently an underestimate of the foreground contamination at 150 GHz.

So now there are three issues:

  1. Did BICEP2 actually use this digitized image to estimate the polarized foreground for their experiment?
  2. Did they make the error of which they have been accused?
  3. Does this invalidate the BICEP2 announcement?

The answer to (1) is that I don’t know for sure but it’s certainly possible that they did. It sounds a pretty ropey approach, but the Planck data are not publicly available so they had to improvise. Even if (1) is the case, I am not at all sure that (2) is true. They may have, but in their responses to the suggestion they have denied it. It seems such a silly error that I’d be surprised, but that doesn’t in itself make it untrue.

However, even if (1) and (2) are the case that doesn’t mean that (3) is true, i.e. it does not imply that the entire analysis presented by BICEP2 is wrong. They have several different estimates of the foreground contribution using other methods so the entire result clearly does not stand or fall on the basis of the use of this particular map in a particular way.

I repeat what I’ve said before in response to the BICEP2 analysis, namely that the discussion of foregrounds in their paper is disappointing. I’d also say that I think the foreground emission at these frequencies is so complicated that none of the simple approaches that were available to the BICEP2 team are reliable enough to be convincing. My opinion on the analysis hasn’t therefore changed at all as a result of this rumour. I think BICEP2 has definitely detected something at 150 GHz but we simply have no firm evidence at the moment that it is primordial. That will change shortly, with the possibility of other experiments (specifically Planck, but also possibly SPTPol) supplying the missing evidence.

I’m not particularly keen on the rumour-mongering that has gone on, but then I’m not very keen either on the way the BICEP2 result has been presented in some quarters as being beyond reasonable doubt when it clearly doesn’t have that status. Yet.

Rational scepticism is a very good thing. It’s one of the things that makes science what it is. But it all too easily turns into mudslinging.

Note: 1 I use the word “fraternity” in the sense given in the Chambers Dictionary as “any set of people with something in common” rather than as “an all-male N American college association”. Cosmology is neither “all-male” nor exclusively American and I did not mean to imply either by my use of English.

 

27 Responses to “That BICEP Rumour…”

  1. […] Peter Coles has a blog post about this here, with bottom […]

  2. stringph Says:

    Indeed. Of course this is (at least) the second BICEP rumour – the first one being that they *had* detected primordial GW.

  3. […] team itself). But an unsourced rumor on a blog isn’t news (not even from this blog!). As Peter Coles says, “Rational scepticism is a very good thing. It’s one of the things that makes science […]

  4. Thanks for the good post. What’s interesting is that the latest Planck version of the map you show is like that map, except that lots of the yellow regions are much redder, indicating a lot higher dust polarization fraction. For details, see my blog post “Why a New Planck Paper Casts Grave Doubts on the ‘Epic’ BICEP2 Study”
    http://futureandcosmos.blogspot.com/2014/05/why-new-planck-paper-casts-grave-doubts.html

  5. Good stuff Peter. Thanks for all this. It’s good to know that cosmology has not descended into straight-to-press hype and multiverses after all. My attitude towards BICEP2 hardened when I started reading about “proof of the multiverse”. Now I think back to Steve Eales’ Origins where he was somewhat critical of “high powered theoretical physics”, and my attitude towards inflation has hardened too.

  6. John Peacock Says:

    Peter: this is all fascinatingly poised. I think the rumours trace to a virtuoso piece of analysis by Raphael Flauger. You can find his slides at
    http://www.pctp.princeton.edu/pcts/SpecialEventSimplicity2014/Simplicity.pdf, and the talk itself at http://www.pctp.princeton.edu/pctp/SpecialEventSimplicity2014/SpecialEventSimplicity2014.html

    Amazingly, what this comes down to is taking various Planck conference talks, digitizing the data on some images, guessing a few details of how the images were made, and recovering an estimate of the unpublished Planck data in the BICEP region. Even more amazingly, it seems that this is what the BICEP people did. But they made different assumptions in their reverse engineering and got a lower answer. All the time, Planck knows the truth, but they’re saying nothing – what a state of affairs.

    Still, for now, and given the level of detail in what Flauger has done, I guess we have to put the BICEP result into limbo until we hear from Planck. I hope they move fast: the present situation is intolerable.

    • telescoper Says:

      I agree that it’s intolerable, but it makes for fascinating television. er…

    • Anton Garrett Says:

      Did BICEP ask Planck for that data? If not, why not; if so, what happened next?

    • Mark McCaughrean Says:

      At the risk of stating the obvious, John, I’d say that the present situation in the Ukraine is something that would count as “intolerable”.

      On the other hand, the tension between the BICEP2 result and what-the-Planck-team-may-or-may-not-yet know-based-on-their-ongoing-detailed-processing-and-careful-analysis-of-their-full-dataset-ahead-of-the-scheduled-October-release is something that I suspect The Real World(TM) can live with for a tad longer.

      And surely even within the world of cosmology, it would be for the best if the Planck team make sure that when they do put out something on this, it’s as rock solid as possible.

      (Naturally, I don’t know what the Planck team may or may not know, but hopefully the point stands.)

  7. John Peacock Says:

    Hello Mark,

    Well of course you’re right: a great many people in the world live pretty horrible lives, and spending Planck-style quantities of money sorting out abstract issues about the origin of the universe would hardly be at the top of their priorities. We should never forget how privileged we are to lead nice lives with the luxury to be concerned with such matters. And I hope mostly I do manage to be appropriately grateful.

    But interest in the universe is a great human universal: everyone has stood at night, looked at the stars and wondered. So it’s not just for an elite that sorting out BICEP matters.

    Agreed, Planck had long-term plans, and it must be annoying to have to deal with BICEP as a distraction from these. But we’re talking about a once-in-a-century discovery here (or not). What seems to be at issue is a factor 3 in the level of background at 150 GHz, and you’d think Planck data should be good enough to decide on that quite rapidly, even if it takes longer to reach the ultimate accuracy. Or even issue a short note saying “we can’t yet give a verdict, for the following reasons”. Otherwise, we’ll just see months more of this technically impressive but ultimately amateurish digging around in whatever PDFs can be found on the web. It’s not going to make the subject look good.

    • D R Lunsford Says:

      What a pile of hot air. It’s just embarrassing how seriously you people take yourselves. I find not a little guilt because most of you are so deluded and credulous.

      -drl

      • telescoper Says:

        Your comments have degenerated into crude and ill-informed abuse. Kindly desist or I shall be forced to ban you.

  8. Per B. Lilje Says:

    Somewhere in the multiverse, right now, in one bubble universe, there is a discussion about scientists who have used an instrument called BICEP2 who claim to have discovered primordial B polarisation. However, there is doubt about the amount of polarised dust they have deduced from a slide showed in a conference. In that bubble universe data from a satellite called Planck will later show that the measured polarisation all came from dust and that r is much less than 0.1.

    Somewhere else in the multiverse, right now, in another bubble universe, there is also a discussion about scientists who have used an instrument called BICEP2 who claim to have discovered primordial B polarisation in their universe. Also for them, there is doubt about the amount of polarised dust, which they also have deduced from a slide showed at a conference. In that bubble universe data from a satellite called Planck will later show that the measured polarisation really was primordial, that the contribution from polarised dust was subdominant and that r is 0.1.

    I wonder wether any of these bubble universes have any similarity with our place in the multiverse…

    • D R Lunsford Says:

      Do you actually think such adolescent speculations make you appear profoundly thoughtful? I do not know which is more execrable, that professionals are themselves utterly deluded, or that they suffer amateur commentary such as this in the name of fairness.

      -drl

  9. drewancameron Says:

    I don’t understand how there remains any question of whether they (BICEP2) did or did not hitch their wagon to this data from the Planck slide … I thought we were taught in first-year science how to write a complete methodology section, or is this optional in cosmology papers?

    • telescoper Says:

      To my knowledge no BICEP2 papers have yet been accepted for publication; I hope whoever the referee is, that person will demand a proper description of the foreground analysis.

  10. D R Lunsford Says:

    This is a scandalous situation that calls into question (as if that were needed) the entire subject of cosmology as actual science. I refer you to your nemesis, Mike Disney, a man of mental means who can call a spade a spade.

    When you have digested Disney, then meet Cooperstock.

    -drl

  11. Steven Meyerson Says:

    Notify me of new posts via email.

  12. […] (Un-)Wissensstandes von gestern (mehr, mehr und mehr), dem 16. Mai (mehr und mehr) und dem 14. Mai (mehr) sowie des Status der Inflation und der Erforschung der Hintergrundstrahlung>7a> und ihrer […]

  13. Reblogged this on thecuriousastronomer and commented:
    More on BICEP2 and whether its results are correct or not.

  14. Great post Peter. It does not surprise me that Planck are keeping quiet, the detection (or not) of this B-mode polarisation is such an important result that it is understandable that the Planck consortium want to analyse their own results as carefully as possible before saying anything. They of course have the huge advantage of all sky coverage *and* 7 frequencies, so one would assume they can do a much better job of foreground subtraction than BICEP2 were able to do.

    I am a little surprised that BICEP2 used a “guesstimate” based on a Planck map presented at a conference to get a (better?) handle on the foreground emission at their single frequency of 150 GHz, and even more surprised that this is not thoroughly discussed in their paper. As you say Peter, any referee worth his salt will require a very thorough discussion of their foreground analysis methodology to be presented in any published paper.

    Even if it takes another 4-6 months for Planck’s analysis to come out, that is not *that* long in the grand scheme of things. Geez, I still have unpublished papers from observing runs in the 1990s sitting somewhere in my office!

  15. […] Coles, “That BICEP Rumour…“, In The Dark, May 14, […]

Leave a reply to BICEP2 News | Not Even Wrong Cancel reply