COCHRANE ROB 2 · 偏誤風險評讀
明顯改善率與總改善率(12週)
← 回到「注意力不足過動症」的圖表
總體判斷 OVERALL-High(高風險)
Domain 與 overall 判斷由程式依 Cochrane RoB 2 官方演算法計算;AI 只負責回答下方各訊號問題。符號:+ 低風險、? 有些疑慮、- 高風險(不只靠顏色)。
風險偏誤紅綠燈
- ?Domain 1 隨機化過程:Some concerns(有些疑慮)
- -Domain 2 偏離預定介入:High(高風險)
- -Domain 3 缺失結局資料:High(高風險)
- +Domain 4 結局測量:Low(低風險)
- ?Domain 5 選擇性報告:Some concerns(有些疑慮)
- -總體(Overall):High(高風險)
中文摘要(給一般讀者)
這篇論文的偏誤風險與 limitation
本試驗為兩中心、依 ADHD 亞型分層的平行組隨機試驗,比較電針灸+行為治療與假電針灸(0 mA、不行針)+行為治療,對象為 4 到 6 歲學齡前兒童。隨機序列以電腦產生,但未說明分配隱匿方式,基線大致均衡。假電針設計使幼兒不易分辨組別,施針者則必然知情。最主要的問題在分析族群:未完成 12 療程者(至少 24 人,排除原因包括無法耐受針刺、依從性差、改接受其他治療)被排除,且只取每個亞型「最先 60 名合格者」分析,屬完成者分析而非 ITT,排除原因與組別及預後相關,流程圖也把排除畫在隨機之前,人數前後不一(表 1 為 92 對 88,安全性表為 90 對 90)。結局由盲性兒童心理師以症狀消失數目分級判定,測量面偏誤風險較低。無註冊或事前分析計畫可比對。整體而言,本結局最主要的偏誤來自偏離介入的分析方式與缺失資料,療效估計可能被高估。
詳細評讀(給專業讀者)
Domain 1:隨機化過程 — 判斷:Some concerns
偏誤來源:隨機分組的過程——分配序列是否隨機產生、是否隱蔽到分組為止、基線(第一期開始時)是否平衡。
1.1 Was the allocation sequence random?
分配序列是否隨機產生?
- 回答:是(Yes — 有明確證據支持)
- 原文引述:In each subtype, patents were divided randomly (by using the computerized random code generating software) into experimental group在每個亞型中,病人以電腦隨機碼產生軟體隨機分入實驗組。
- 理由:以電腦軟體產生隨機碼,且依亞型分層,屬含隨機成分的序列產生方法,判為是。
1.2 Was the allocation sequence concealed until participants were enrolled and assigned to interventions?
分配是否隱蔽到分組為止?
- 回答:資訊不足(No information — 原文未提供足以判斷的資訊)
- 原文引述:A computer algorithm generated randomization numbers to blindly assign patients to the two groups in a 1:1 fashion at the site level.以電腦演算法產生隨機號碼,在各試驗中心以 1:1 方式「盲性地」將病人分派至兩組。
- 理由:文中只說以電腦演算法「盲性分派」,未說明由誰保管序列、是否由獨立單位或中央系統分派、是否使用密封信封等隱匿機制,無法判斷收案者在納入前是否可能得知下一個分配,判為資訊不足。
1.3 Did baseline differences between intervention groups suggest a problem with the randomization process?
(第一期開始時)基線差異是否暗示隨機化有問題?
- 回答:可能否(Probably no — 綜合判斷後傾向「否」)
- 原文引述:The ratio of gender, average age, the number of cases of three subtypes, average course of disease and average IQ between two groups had no statistical differences兩組的性別比、平均年齡、三種亞型人數、平均病程與平均智商均無統計差異。
- 理由:基線表各項(性別、年齡、亞型、病程、IQ)均無顯著差異,看不出隨機化出問題的跡象。各亞型組別人數(28/32、33/27、31/29)與宣稱的 1:1 略有出入,但在每層 60 人的簡單隨機下仍屬機率可解釋範圍。需注意此基線表只涵蓋完成療程的 180 人,並非全部隨機分派者,故判可能否而非否。
Domain 2:偏離預定介入 — 判斷:High
偏誤來源:實際執行時偏離預定的介入——盲性如何、是否依「隨機分到的組別」分析(ITT)。
2.1 Were participants aware of their assigned intervention during the trial?
參與者是否(在每一期)知道自己的分組?
- 回答:可能否(Probably no — 綜合判斷後傾向「否」)
- 原文引述:after the insertion the needle tube was pulled out but the operator did not manipulate the needle, and the patients had no de qi sensation ... voltage was 2—4 V, but current intensity was 0 mA進針後拔出針管,但施術者不行針,病人無得氣感……電壓 2–4 V,但電流強度為 0 mA。
- 理由:對照組為假電針(同穴位進針、不行針、接電針儀但電流 0 mA),結論自稱雙盲,受試者為 4 到 6 歲幼兒,理論上不易分辨組別,故判可能否。但真電針 3 到 5 mA 會產生明顯麻刺與肌肉跳動,陪同家長可能看得出差異,且文中未做盲性成功度評估,此判斷有不確定性。
2.2 Were carers and people delivering the interventions aware of participants' assigned intervention during the trial?
照護/執行者是否(在每一期)知道分組?
- 回答:是(Yes — 有明確證據支持)
- 原文引述:the operator manipulated the needle (include lifting, thrusting, or rotating the needle) until the patient had the senses of aching, numbness or distention (de qi sensation)施術者行針(提插或捻轉)直到病人出現痠、麻、脹的得氣感。
- 理由:真針組需行針至得氣並設定電流,假針組不行針且電流為 0 mA,施針者必然知道所施予的是哪一組。
2.3 Were there deviations from the intended intervention that arose because of the trial context?
是否因試驗情境造成偏離?
- 回答:資訊不足(No information — 原文未提供足以判斷的資訊)
- 原文引述:Therefore the behavioral therapies might not be the same among the patients in a same subtype or between the experimental and control groups.因此,同一亞型內的病人之間,或實驗組與對照組之間,行為治療可能並不相同。
- 理由:文中未報告是否有因試驗情境而產生的介入偏離(例如施針者或行為治療師對兩組處置不同)。作者自承個別化行為治療在兩組間可能不同,另有部分病人「試驗期間接受其他治療」而被排除,但未說明組別與原因是否與試驗情境有關,資訊不足。
2.4 Were these deviations likely to have affected the outcome?
這些偏離是否可能影響結局?
- 回答:不需評估(NA)
- 原因:條件題:依 2.3 的答案,本題依 RoB 2 官方路由不需評估(NA)。
2.5 Were these deviations from intended intervention balanced between groups?
這些偏離在兩組間是否平衡?
- 回答:不需評估(NA)
- 原因:條件題:依 2.4 的答案,本題依 RoB 2 官方路由不需評估(NA)。
2.6 Was an appropriate analysis used to estimate the effect of assignment to intervention?
是否用了適當分析(ITT)?
- 回答:否(No — 有明確證據支持)
- 原文引述:other 24 patients were also excluded because did not finish the 12 courses of treatment for the reasons such as poor compliance, or received other treatment during the trial. We finally put the first 60 qualified children of each diagnostic subtype in the cohort另有 24 名病人因依從性差或試驗期間接受其他治療等原因未完成 12 療程而被排除。我們最後將每個診斷亞型最先符合資格的 60 名兒童納入研究。
- 理由:未完成全部療程者(24 人)與試驗期間接受其他治療者被排除於分析之外,納入條件也明寫未完成療程者排除,最後只取每亞型「最先 60 名合格者」分析,屬排除隨機後合格受試者的完成者(per-protocol)分析,並非 ITT 或 mITT,判為否。
2.7 Was there potential for a substantial impact (on the result) of the failure to analyse participants in the group to which they were randomized?
未依隨機分組分析,是否可能對結果造成重大影響?
- 回答:可能是(Probably yes — 綜合判斷後傾向「是」)
- 原文引述:Those who did not finish the whole courses of treatment caused by the reasons such as intolerance to acupuncture, poor compliance, or received other treatment during the study, or written consent not obtained, were excluded from the cohort.因無法耐受針刺、依從性差、研究期間接受其他治療或未取得書面同意等原因而未完成全部療程者,均被排除於研究之外。
- 理由:被排除者至少 24 人(約佔隨機後人數的一成以上),各組人數未報告;排除原因包括無法耐受針刺(真針組較可能發生)與接受其他治療(療效不佳者較可能發生),都與組別或預後相關。結局為三級療效分類,組間差距中等,這個規模且與預後相關的排除足以大幅改變結果,判可能是。
Domain 3:缺失結局資料 — 判斷:High
偏誤來源:結局資料缺失——是否幾乎所有人都有資料、缺失是否可能與病情(結局真實值)相關。
3.1 Were data for this outcome available for all, or nearly all, participants randomized?
是否幾乎所有受試者都有此結局的資料?
- 回答:可能否(Probably no — 綜合判斷後傾向「否」)
- 原文引述:213 patients were enrolled according to the including criteria, among which 9 patients were excluded because written consent forms not obtained, other 24 patients were also excluded because did not finish the 12 courses of treatment依納入標準收案 213 人,其中 9 人因未取得書面同意書被排除,另有 24 人因未完成 12 療程被排除。
- 理由:扣除未簽同意書者後約 204 人,最終分析 180 人,至少 24 人(約 12%)因未完成療程而無結局資料,且「每亞型取最先 60 名合格者」意味實際隨機人數與排除人數可能更多;流程圖把排除畫在隨機之前,與「未完成療程」必然發生在隨機後的事實矛盾。缺失比例相對於組間事件差距不算小,判可能否。
3.2 Is there evidence that the result was not biased by missing outcome data?
是否有證據顯示結果未受缺失資料偏誤?
- 回答:否(No — 有明確證據支持)
- 原文引述:2 -test was used to exam the difference between two groups.以卡方檢定比較兩組差異。
- 理由:統計方法只有卡方檢定,未做任何校正缺失資料偏誤的分析或敏感度分析,沒有證據顯示結果未受缺失資料影響。
3.3 Could missingness in the outcome depend on its true value?
缺失是否可能取決於結局真實值?
- 回答:可能是(Probably yes — 綜合判斷後傾向「是」)
- 原文引述:did not finish the 12 courses of treatment for the reasons such as poor compliance, or received other treatment during the trial因依從性差或試驗期間接受其他治療等原因未完成 12 療程。
- 理由:缺失原因為依從性差與改接受其他治療,這兩者都可能與症狀改善程度有關(症狀未改善者較可能中斷或另尋治療),缺失可能取決於結局真值。
3.4 Is it likely that missingness in the outcome depended on its true value?
缺失是否很可能取決於結局真實值?
- 回答:可能是(Probably yes — 綜合判斷後傾向「是」)
- 原文引述:Those who did not finish the whole courses of treatment caused by the reasons such as intolerance to acupuncture, poor compliance, or received other treatment during the study因無法耐受針刺、依從性差或研究期間接受其他治療等原因而未完成全部療程者。
- 理由:未報告各組缺失人數,但缺失原因中的「改接受其他治療」通常反映療效不佳,「無法耐受針刺」則偏向真電針組,缺失很可能與結局真值及組別相關;加上只挑「最先 60 名合格者」的選取方式,判可能是。
Domain 4:結局測量 — 判斷:Low
偏誤來源:結局的測量——測量工具是否恰當、評估者是否盲化、評估是否可能受分組知情影響。
4.1 Was the method of measuring the outcome inappropriate?
結局測量方法是否不適當?
- 回答:可能否(Probably no — 綜合判斷後傾向「否」)
- 原文引述:Showing effectiveness: in PI subgroup or HI subgroup, at least five symptoms were disappeared after treatment; in CT subgroup, at least 10 symptoms were disappeared after treatment.顯效:PI 或 HI 亞型治療後至少五項症狀消失;CT 亞型治療後至少十項症狀消失。
- 理由:結局以 DSM-IV 核心症狀消失數目分級,依國家中醫藥標準判定。此分級未經效度驗證、較粗糙(作者自承西方讀者不熟悉),但以症狀條目計數評估 ADHD 核心症狀,尚不至於不適當,判可能否。
4.2 Could measurement or ascertainment of the outcome have differed between intervention groups?
(每一序列內)結局測量是否可能因介入而異?
- 回答:否(No — 有明確證據支持)
- 原文引述:The symptom changes before/after the treatment was evaluated by two independent pediatric psychologists who were blind to the study after 12 courses of treatment治療前後的症狀變化於 12 療程後由兩位不知分組的獨立兒童心理師評估。
- 理由:兩組由同樣的評估者、同樣的標準、同一時間點(12 療程後)評估,測量方法沒有組間差異。
4.3 Were outcome assessors aware of the intervention received by study participants?
結局評估者是否知道受試者接受的介入?
- 回答:可能否(Probably no — 綜合判斷後傾向「否」)
- 原文引述:The symptom changes before/after the treatment was evaluated by two independent pediatric psychologists who were blind to the study治療前後的症狀變化由兩位不知分組的獨立兒童心理師評估。
- 理由:明言由兩位盲性獨立兒童心理師評估療效。但學齡前 ADHD 症狀是否消失通常需參考家長的觀察陳述,而家長盲性未說明且可能看得出真假電針差異,故判可能否而非否。
4.4 Could assessment of the outcome have been influenced by knowledge of intervention received?
結局評估是否可能受介入知情影響?
- 回答:不需評估(NA)
- 原因:條件題:依 4.3 的答案,本題依 RoB 2 官方路由不需評估(NA)。
4.5 Is it likely that assessment of the outcome was influenced by knowledge of intervention received?
結局評估是否很可能受介入知情影響?
- 回答:不需評估(NA)
- 原因:條件題:依 4.4 的答案,本題依 RoB 2 官方路由不需評估(NA)。
Domain 5:選擇性報告 — 判斷:Some concerns
偏誤來源:選擇性報告結果——是否依事前訂定的分析計畫分析、有無從多個結果中挑選有利者報告(交叉另含:是否因偵測到殘留而只報第一期)。
5.1 Were the data that produced this result analysed in accordance with a pre-specified analysis plan that was finalized before unblinded outcome data were available for analysis?
是否依事前訂定(取得未盲化資料前定版)的分析計畫分析?
- 回答:資訊不足(No information — 原文未提供足以判斷的資訊)
- 原文引述:Sample size was estimated as Faul et al., 24 which indicated 57 cases in each subtype at minimum.樣本數依 Faul 等人方法估算,每個亞型至少需 57 例。
- 理由:文中未提及試驗註冊、公開計畫書或解盲前定案的統計分析計畫,僅有樣本數估算,無法確認分析是否依事前計畫進行。
5.2 Is the numerical result being assessed likely to have been selected, on the basis of the results, from multiple eligible outcome measurements (e.g. scales, definitions, time points) within the outcome domain?
此數值結果是否可能依結果,從多個量表/定義/時間點中選出?
- 回答:可能否(Probably no — 綜合判斷後傾向「否」)
- 原文引述:The treatment efficacy was evaluated by measuring the change in core symptoms of ADHD according to the standard enacted by the national traditional Chinese medicine committee after 12 courses of treatment (lasted 12 weeks)療效以 12 療程(歷時 12 週)後,依國家中醫藥委員會標準測量的 ADHD 核心症狀變化評估。
- 理由:療效只用單一分級標準、單一時間點(12 療程後)評估,未見其他量表或時間點被測量而未報告,較不像從多個測量中挑選。
5.3 Is the numerical result being assessed likely to have been selected, on the basis of the results, from multiple eligible analyses of the data?
此數值結果是否可能依結果,從多種分析中選出?
- 回答:可能否(Probably no — 綜合判斷後傾向「否」)
- 原文引述:In HI and CT subtypes, Though the effectiveness rate and total improvement rate in experimental group were both higher than those of control group, 2 -test indicated no statistical differences between the two groups在 HI 與 CT 亞型中,雖然實驗組的顯效率與總改善率都高於對照組,但卡方檢定顯示兩組無統計差異。
- 理由:作者同時報告了各亞型(含不顯著的 HI、CT)與三亞型合併的結果,未見只挑有利分析報告的跡象;但合併分析是否事先規劃無法確認,判可能否。