See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/281622744 Using Total Error to Qualify Reagents and Calibrators 1992 AACC Poster Research · September 2015 DOI: 10.13140/RG.2.1.4952.8801 CITATIONS 0 READS 59 1 author: Some of the authors of this publication are also working on these related projects: LinkedIn Group: Quality of Covid19 Laboratory Testing View project Acceptability of current risk. View project Zoe Christine Brooks AWEsome Numbers Inc. 29 PUBLICATIONS   51 CITATIONS    SEE PROFILE All content following this page was uploaded by Zoe Christine Brooks on 09 September 2015. The user has requested enhancement of the downloaded file.


USING

TO QUALIFY REAGENTS AND CALIBRATORS

Zoe Brooks David Plaut2. G.R. Massarella

1

i. Cochranc Region Laboratory Program 700 Paris Street, Sudbury, Ont. P3E 3B5

  1. Baxter Diagnostics, Miami, Florida

American Association for Clinical Chemistry

44th National Meeting July 19-23, 1992 Chicago


METHODS

1m LABORATORY STUDIES

• TOTAL ALLOWABLE ERROR LIMITS WERE BASED ON CLINICAL REQUIREMENTS

RETROSPECTIVELY

• TOTAL ERROR FROM HOSPITALS’ MONTHLY DATA WAS COMPARED TO TOTAL ALLOWABLE ERROR

• WHEN TE > TEO THE RESULTS WERE INVESTIGATED USING ‘PSF’

PROSPECTIVELY

• PRIOR TO IMPLEMENTING THE use OF A NEW LOT OF REAGENT(S), LABORATORY TESTED PATIENT SAMPLES AND ac MATERIALS USING SOTH CURRENT AND TRIAL LOTS ON 3S RUNS.

THE PROJECTED TE OF THE NEW LOT WAS COMPARED TO THE

WHEN TE > TEe THE NEW LOT WAS REJECTED

  1. COMPUTER SIMULATIONS

SIMULATIONS WERE USED TO ANALYZE THE EFFICACY THE TE CRITERIA AND TO COMPARE TE AsSESSMENT TO THE CHANGES IN REC AND SHIFTS IN THE MEAN GREATER THAN 1 sm


TOTAL

LARGE

ERROR WITH

BIAS, SMALL

SD

TRUE 200

UJAS SD

10 —

TOTAL

ERROR

= 16

TEa 218

SMALL

ERROR WITH

BIAS, LARGE

SD

TRUE 200

$ so

TOTAL

ERROR

16

7/ 17/92

CHEM

c,

SLY-MARY OF

ALL ‘TESTS >TEa

113-52 g ,

XPS-629

Fage

CONTROL

CODE:

303

27.60

1-20

CONTROL

coop, MEAN

CH2

SD

503

35

30.30

i .20

-TEO

5.35 3.07

1,07 1.02

TEa

3.00

SO

4.05

1-45

. 33

SYSTEY:ATYC

(SGPi1’J

CONTROL LAB N

CODE:

Ctn

BIAS

505 304

31

20

27 .50 18.51 29.20

2.70 1.25 2.20

-1.69

S. 42

RATIO cO

1.18

-31 .34

Eaaca

Attty lase

LAB

cone:

504

20

54.50

ans

TEa

3.20 5.20 5.00

, 70 6. 10

5.62 24.50 46

26.29 12 . 60

vo TEa so

.35

-24

COtE’R0T,

COBE:

50’ 26

Bins

Cholesterol

CONTROL cooe::: MEAN

so

.20

Rh’rrc TO so

.21

1, 06


ASSESSMENT CRITERIA: The following values were calculated for each time period (month) of Q.C. data changes: and for prospective lot

INDICATOR

LSE

ARE

FORMULA

IBCI+ (sOc*1.96)

(Xc-Xi)/SDc

SDc/SDi

PASS CRITERIA

TE < TEa

LSE < ASEc

L RE < LREc

LR < 1.0

STATISTICAL_DATAz Quality Control Analysis: — value set during first Initial Mean (Xi) period of use with current control lot. = bias established by Initial Bias (Di) comparison of patient data to a reference laboratory over a 3-day study. Current Mean ( mean from routine daily QC data. = standard deviation Current SD csDc) from routine daily QC data- — Current Bias (Bc) *i + Bi ) T Ea = Total Error Allowable TE = IBcl+ (1.96 x SDc) ASEc REC TEa/(SDix1.96)


NAME: EXAMPLE 1 srs EMAV»C

ASSESSMENT CRITERIA FOR CONTROL; TEA woasuremeot Units 2.9 2.9 SD (Current Standard Doviations) SO (Current $.laocfard Ooviations) 1.0SD (Shit in mean from previous month)

O.C, DATA: MEAN

ums

UNITS Ur.ik:s units. I-inns

4 o

TIME 1 TIME? TIME 3 204 4 20B 4 212

TIME

196

INO*CATORS;

so SO $13

11.8

1.0 1.0

19.8

5.0

1.0

1.0

192 4 -8

TIME

-‘2

15.0

-1.0

19.8 0.0 1.0 0.0

ASSESSMENT

€. 1.0

1’A5S

PASS PASS

PASS PASS PASS

PASS PASS

PASS

PASS FAIL

PASS PASS PASS PASS

PASS PASS

NAME. EXAM/” E 2 •

ASSESSMENT CRITERIA THIS CONTflOt: tea IB.O Measurernent LINE SEc 2-9 2.3 SD {Cl.ment Stnndard Dovii’bons} SO (Current Standard $0 (Shitr in mean from provic»s month)

a.c,2 (DATA: MEAN SO

0

JEME-a

iNOlCATOHS:

50 31) $0

0.0

0.0

IS,J 0.0 20 0.0

19.6 0.0

200 12

23.5 0.0

Ifi 0

0.0

31.4 0.0 4.0

ASSESSMENT; TE

“SEC

PASS PASS PASS

PASS PASS PASS PASS

FAIL PASS

PASS

PASS FAIL

FAI.

e.vss

PASS rAlL PASS

TEST

ASSESSMENT CRITE’” ta.0 SO

SO Sta..‘ida;d

3.0

SO rahitt munlhj Ut”tts

ac. OATA:

so BIAS

aj4

4

4

4

so

so

ASSESSMENT:

lt.a 1.0

1.0

0.0

PAG.s

1.0

FWS

0.0

ASS&S$MENT

Urt•s

GO

MEAN so

UNITS

.4

6

*SEG

1.0

1.3

2.0 0.0

1.0 1.0

Pass

FAIL PASS FASS


TOTAL ERROR QC REPORT [LAB El [CHEMISTRY] (JUNE 19921

2

1.5

1

0.5

a

-0.5

.5

.2

ALB AL p

ALT AML

AST CA

CHOL

SD HIGH

‘3/17/92

MONTIlL’t’ Q, c,

UEPCRT

Page

CONTROL LOT No’ s: xtiS-529,

LKITTAL USE: DATE;

FREViOLiS Yih&’

creatinine

CONTROL

Ct.’?REtC1’ PREVIOUS

LOT-TO-DATE

cotcrnc;l, coo?.:.

CURRENT pazvzoos

LOT -TO-OAT a

659

CODE;

TOTAL YEAN SO

cv

BINS

99.90

3.30

-a. 00 a .00

cv

6 €70

ERROR:

92 J,

•re,/ffEa

F tÄ.c

50

17 . 73

g 3, 23

Ganma-GT

ccwraoL COZIE;

CODE:

1.40

LOT-TO-OATS:

coter•fioL coaE:

CURRENT PREVIOUS

LOT-TO-OATE

SD

cv

11 z .90 , .10

2 .10

2.4 t

-1.70

G lucose

Fast Inq

CONTROL CODE:

PREVIOUS

63b

cv

.06

.06

-.10

.26 .31 .25 , 30

, 23

-.76


TOTAL ERROR REPORT BY LAB CHOLESTEROL MAY 1992

1.5

0.5

LAB a LABC LABD LABE

CAB F

BIAS 0K

HIGH SO 0K

SD HIGH

Cholesterol CONTROL :

25

CONTROL ;

3 .65

505

.11

Creo t. n -ne CONTROL. :

CHI.

53

cowrr«za LAB

503

100 . oa

  1. go

t l, 66 23

Bilirubir. CONTROL; CHI.

. 03

.26

E 10

BIAS

-1 . 20

11.6*

-7.2 z

err: >

F t.AG


AMYLASE REAGENT LOT CHANGE A,G.H. APRIL 1992

soo

250

2ac

150

50

50

100

150 CURRENT LOT H-6255 200

CONTROLS

PATIENTS

250

goo

TESt IN

C.CVPAA’SON OF REAGENT OR I-OTS

LCVS • S

SOUÄCE; I-CT EXP DATE

OA7E• ctV*L 1

CTRL

CTRL 1 CtRL

CTal.

CTaL I CTRL

27

69 2EO

2SE 27

32 73

266

33

516

2b

fib

29

73 za

215

aes

3.7


ERROR PROBLEM-SOLVING FLOW CHAPP

n 10 f?)

TEST FLAGGED 1OF PREVIOUS 2 REPORTS

YES

SO/TEa 0.33 {7)

NO

BIAS/TEa)0.20(7)

NO

NO

YES

YES

TE/TEa 1.25

(7)

ENVESTIG.ATE ANOOM ERRO

INVESTIGATE SYSTEMATIC

TAKE CORRECTIVE ACTION

TAKE CORRECTIVE ACTION

CURRENT PERFORMANCE ACCEPTABLE (7)

YES

RECORO COMMENTS IN a.c. ACTION LOG

NO

MONITOR PERFORMANCE CLOSE-Y

ONGOING PEFOP,MANCE ACCEPTABLE

NO

RECORO IN a.c. ACTION LOG

RE-EXAMINE FACTS

TAKE ALTERNATIVE CORRECTIVE ACTION

IMPROVED (7)

HO

ARRANGE TECHNICAL ASSISTANCE

REFER OUT UNTu- SAT1SFACTORY PERFORMANCE IS RE- ESTABUSHED



CONCLUSIONS

TE CRITERIA IS AS EFFECTIVE AS SEC AND REC WHEN INDEPENDENT CHANGES OCCUR IN SYSTEMATIC AND RANDOM ERROR

• TEIS MORE SENSITIVE THAN SEG AND REc TO SIMULTANEOUS CHANGES IN SYSTEMATIC AND RANDOM ERROR

• ACCEPTING SHIFTS IN MEAN VALUES WHEN THEY ARE LESS THAN 1 SO IS NOT A VALID PRACTICE

COMPARISON OF TE TO TEa IS A SIMPLE AND EFFECTIVE WAY TO MONITOR CHANGES IN ac PERFORMANCE AND TO PREDICT ACCEPTABILITY OF NEW LOTS OF REAGENTS OR CALIBRATORS