In my quest for understanding I keep coming back to some fundamental questions relating to evidence synthesis and I’m often left wondering about the evidence underpinning what appears to be assumptions. So, the first question I’m requesting evidence for is: What is the evidence that systematic reviews give an accurate assessment of the effectiveness of an intervention? There, simple. We’re always extolling people … Continue reading Where’s the evidence?
I asked the following question to the EBHC mail-list: “I’m wondering how one could test the following so would welcome advice. Question: Assuming we have a finite resource for evidence synthesis which is better 1 systematic review or, say, 5-10 rapid reviews? Context: There is an opportunity cost associated with doing the labour intensive systematic reviews how do we know we are using this … Continue reading Methods Q: Rapid versus systematic reviews – assessing which generates most benefit/least harm
SelecTing Approaches for Rapid Reviews (STARR) Decision Tool project Authors: Eva Kaltenthaler, Katy Cooper, Marrissa Martyn St James, Abdullah Pandor, Ruth Wong ScHARR, University of Sheffield This is a project outline with the following aims: The aim of the proposed study is to validate the decision tool by achieving consensus using the Delphi method among those involved in rapid reviewing. This will ensure that the most important … Continue reading SelecTing Approaches for Rapid Reviews (STARR) Decision Tool project
In my recent post I expressed frustration with the direction of travel of rapid reviews and one thing I highlighted was the lack of work on using regulatory data. This prompted two responses highlighting two separate papers: How to use FDA drug approval documents for evidence syntheses, BMJ 2018 Practical guidance for using multiple data sources in systematic reviews and meta‐analyses (with examples from the … Continue reading Using regulatory data
A while back I wrote a piece Different approaches to rapidity which suggested there are two ways of doing a rapid review: Process – take the systematic review and take short cuts Outcome – what’s the optimal way of getting to the desired outcome I’m increasingly concerned that all the focus is on the former and not the latter. My concern is based on a variety … Continue reading Where are we going with rapid reviews? #frustrating
The Cochrane HPV vaccine review was incomplete and ignored important evidence of bias by Lars Jørgensen, Peter C Gøtzsche, Tom Jefferson (BMJ Evidence-Based Medicine 2018) This is a highly critical article pointing out that the review missed nearly half of eligible trials. They also land some heavy punches with comments such as: “Cochrane’s public relations of the review were uncritical“ “In our view, this is not … Continue reading The Cochrane HPV vaccine review was incomplete and ignored important evidence of bias
I posted a post-Evidence Live blog last week which explored the notion of harms associated with doing rapid reviews (RRs). There is overlap from that post but I’ve had time to reflect and hopefully this will be better written. I’ve also added a vote!! It may need re-writing again, if you think it needs clarification then please let me know! The question I was asked … Continue reading Value of Information to help with the SR v RR debate?
I was at the wonderful Evidence Live and presented on rapid reviews. One question came from the wonderful Iain Chalmers who asked about the potential for harm if health professionals followed the advice of a RR that was subsequently shown to be wrong. Later, in conversation, it became clear that ‘wrong’ meant a reversal of conclusion – so the SR might say the intervention is … Continue reading Systematic versus rapid reviews – what about harms?
Abbreviated literature searches were viable alternatives to comprehensive searches: a meta-epidemiological study. Nussbaumer-Streit B. et al. J Clin Epidemiol. 2018 Jun 1 A paper highlighting that abbreviated searches typically produce very similar results. The authors conclude: “If decision makers are willing to accept less certainty and a small risk for opposite conclusions, some abbreviated searches are viable options for rapid evidence syntheses. Decisions demanding high … Continue reading Two new posts (well, new to the site)
I had the pleasure of presenting at the HTAi 2018 conference in Vancouver which ended yesterday. Here is a picture from the event, shared as (a) the unplanned colour co-ordination is impeccable and (b) people have commented I look like a game show host. I talked about, you guessed it, rapid reviews. My emphasis was on the fact that, whatever the review type, you never … Continue reading HTAi 2018