Skip to main content
Skip to content
Case File
efta-efta01072417DOJ Data Set 9Other

RI strategic initiative

Date
Unknown
Source
DOJ Data Set 9
Reference
efta-efta01072417
Pages
94
Persons
0
Integrity
No Hash Available

Summary

Ask AI About This Document

0Share
PostReddit

Extracted Text (OCR)

EFTA Disclosure
Text extracted via OCR from the original document. May contain errors from the scanning process.
RI strategic initiative orking Retreat Pre-reads/handouts I BILLetMELINDA GATESfradad- 1 EFTA01072417 RI Retreat agenda CI= 11154:45 a amain( evattabIo 540630 fro 41304, 10 an, 4146-104) am Welcome. overview or the day and contend Introchralon to 'WON a' strategy refresh process How RI lean gallon the soon of thalr program • One ortvotnol deInnon moo (Mate non may cosh** Mallon of RI • Dissamiga.MIOch toads me mai catIcal la tons/di Fstaloj7 VIO Mitchell John *IWO MItchMI and Malt Manton 10:30410)am Brag 11.00.120)pm How RI Ste Into founctabon's Melon for WHAM • Moore ttol Ponoon tootkm and obi natuuom Maw Ctrs RI anatla prograMgOals of (1004010 IMml enhIVCOTVOS to RI ca/0 twee a trzroknmMw moor, Matt Hansen and Molly AbblULZOI4 12:0012:4S pm Mach 12:45.2:30pen RI currant and future pnoblVr. klenlincation • Manley MOW gaps that Oolong* louniatIon ablIM 10 reel gods • °mow= hch Spa sooti4 be 10P pn00y IV he glotol comely-0y 10 oddrem, Thy Core team My I00 0)" Strategy 23043/0 an Ore* 100430 ph 416620 ph WIMAII tlW leunceselon could and should engage Whallit team NS rowdfrom fr-may • woo am C moose.] Rots tor to 5.10. 25 'MU Talk • QYuMpr Mimeo IVCci0 fink tho kordotoo Provo/ engem. • RrM'Olo•m GeMaW b-ndalloo ammo:mom VloMllonMi and Skye Gilbert VI* Mitchel Recap al the day and not slope 2 2 EFTA01072418 RI team charter EFTA01072419 Project Charter (I) Routine Immunization Steering Group: Global Development Program Team Name Work Group Goal The goals of the RI Steering Group are as follows: - Develop routine immunization strategy; - Identify resources that can be employed toward RI goals (potential partners, catalytic funding, voice); — Identify strategic opportunities for future RI Investments; — Monitor initial implementation of RI strategic initiatives. GD Goal this effort relates to Strong routine immunization systems are the core of our Vaccine Delivery goals (as listed on the Scorecard I: — Eradicate Polio — Prevent re-emergence of polio from either wild or vaccine-derived viruses — Reduce measles morbidity and mortality (from 2000-2008, 2/3 of reduction in measles mortality due to RI' — Save 6.0M lives in 69 high burden countries over 2010-2019 with currently available (DTP Measles, Nib, pneumo, rota) and new vaccines (malaria) — Reach 90% of the children n the poorest countries with sustained coverage of vaccines nationally and no district <80%. — Achieve the DoV effort. Work Group Executive Sponsor Steve Landry Work Group Lead: Acting DD, RI Violaine Mitchell Time Frame Eleven Months: February 1, 2012 — December 31, 2012 Updated on April 30, 2012; and August 31, 2012 4 EFTA01072420 Project Charter (II) Opportunity Ratemen& Justification Summary Assumptions and Risks • Wattehraa twine an . pa, .1 ratan.. rerbdtv reciartvebtad wt., w fre,entall, 015215r. • WmManRrwnru,rn-unuuo+evRrlbwlxnnLaMGaWrUl4lryvrytlnmuyanohteunnnavllorlof role 414.1401, rif e 'ha to0r an vier. end Ilan pixy ity ljart.K.Jalve w1o+r0✓nc 02..ntrat end thaw within kn[atashed traliMs9.0,2 • yrient routine Demtnitabe WAtera.122 46O A. Attest!, e1,2.222. e)she.lit ma. Mum wat th•cath new nbeduchen • $0.011.:1utite ~ere Pelovn.zwe apinst Mute measse, oabreaa. sudi 'WOW t•PtAeKed a 2010.2011. 4,2 vMl rare the way lor <imago. 11 e ...pt., that e• .42Fontly sgintsunt Inancul ennerliferfeumlawne natµ taxad pole on.ohcalsen rif ranvottthelrtr0'Ja11M.Mh101 .2011101~ NittConite45)341., Pea> «20<et JCIMOty On, WX2et $.2521.1 Ito GAV1 • len,ntaben alw•Oalorrn up.n whaho11,e manna and c2d11 Hath trUnantnnt may tárd.rband.11,ts cen1212utárs cut halal gash • 1N>er>HOhaWnNMl5ppM11tsirorOtO,tlrSW?em>6trORa,ImlmintOmOMhatemynteUMxatxelnr nun,/ cc...num.:tom loch A, Ip.ct. to With 20111 • lbw le,datsen Nearer, ettantrehonath bur pc teen mi. as lahlrary 4 4444444 Ette.nt the *fiat GAM Scud-nil V20«, ,N220 2.11.11«.212.2»tr, .1.201htfe..22.141b2C.mentrt• As áent(Ore. A anlega.cocedruhnl•pwait..to wan,' snmankra un bet (*Wan nr-enuagra our 'ninon • 02 4,21,^1.2. COmbratee efnar.akt.t1/Ount~ 6.CorteenIlan ah..2, my, Ito the nave« cyt aO.Te4 A atnic.cocedrubid *pp oétl. to wan,' mmankra en mil!~ Le go1.01».1 telh ard 2112cduction • C~ 2.ogral0222.« , {Clat.t.b.1/ t 201.! CZOVJOijel'oll be aletesedie .12)4hg, Se the tr.,. uraan R1 Intern 10.12, • As we e^Pite•ath1212(.21,- toth al the 2120/I ountrr lest.; - eni." tatfátte•Ce212(Ore ihndegt Put I.,. wtal hr. le Whir nt20 Abp.. • ARIoughltrurory gaintiarfferb e rot cambia to Le sanAunt at oawited (*GPO. a GAY, (want liza.abnIGAV, taTto:NRI4hOm1.112nInvicedunnbt *re COntifillos2h 'tine rob/fear* • 02n, 20e 0112A/1 eme 2.1102µ trees toy/literate.- rotob0,6evi • Wendy brgrielir. Aud/renoath.onubgentulke.o.chau,drg. peogirammaxdbl to mac an ánmeat • ...tented 10 bal.«. the 2,0R.It., teen II wort with 22e .“~ ten, . StItage.0.2.a.41ereili te intustallafte EFTA01072421 Project Charter (III) >fcctesta Objectives Success Measures • Articulate RI goals — Within global context — Specific to the foundation — Specific to key geographies • Mmdmize RI resources — Identify key partner strengths — SUategiae as to potential external partnerships — Coordinate with other Internal efforts • Outline Strategic Initiative In RI — Identi Investments • Ultimately, to achieve the new DoV goals • Shorter-term Increase in RI coverage in key geographies fic success measures 7B13 on a initiative basis 6 EFTA01072422 Project Charter (IV) a nt.,,,, s .. Core Steering Group members and their s Pr/ Division • RI leans Voters* Mitchell Man Hanson Rap Rao Molly Abbrunese • INDIA TEAM Devendra Mandan • ()then IN) in-country prese • None Codaboration with other foundation terns (CD &FM Steering Group Memberare expected to coordinate across the foundation Gobal Health teams, and vitth the Gbbal Development ou t as appropriate. Partite • F MOH In key countries • Bilateral Donors, such as: USAID. UK/DrID. and Norway • Other Partners: GAVI Secretariat, UNICEF, WHO. World Bank Role of team members / staff mann ing sPecifIc activities with MOH • Violaine Mitchell, Acting DD for RI, will serve as the key contact person for FMOMs in key geographies • Steering Group Members will advise the Acting DD of new opportunities and topics under discussion with partners • Acting DD and RI Program Officer(s) will be available to pm/support these discussions with internal staff and external partners, as requested or appropriate 7 EFTA01072423 Project Charter (V) Proposed Timeline and Deliverables: 1 year High-level Milestones for Year One of Routine Immunization Steering Group Date Complete Review and adoption of RI Steering Group Charter 2/01/2012 Development of Year One Work Plan 2/01/2012 Meetings with External Advisors 06/2012, 09/2012 Development of Metrics for Project See Scorecard Initiation of 3 RI Emblematic Grants Ql, Q2 2012 8 EFTA01072424 Project Charter (VI) IVOPOINIA010tilt0 R0k$10414$0300001Ple Cieung 6,04 StEns-te - Chris Oa% Presibtm.Glabal DeallOPmait Po Steed,. Group - YbOlailt MOIChtll Ilan( INA IlVataltilMatinbielSen C4ocinate..1•44tiltez rant Gcts..aht T.dr.crtnpv.ans.nomtwanne.ntKeeColiltillnin..nra, bArylarrm emanil ,Cetro.ctrim Mx",,,—. :••••• whi est ro iron 11.1, 'dont law datnn:%•11•St-tarca,rm, Ludzan.in COw ns/I 'Am •cepae tneart ,,,,, • (WC., C'PAI Maio:am vs. ' ow C.Idil 4020 , B1 ton, in, trolAid, Ins Slitnig Cron, (44rdelatet.. pmt D.....itneie 4-oittipOlect :may. Ott, .11.1 igatAlta• IA:Mtn cliabn't.........ve.. rd'S•11:1¢1.•InSevain ra •ntry *eau Imorvne .C.ron.t..,. mkt,. wt. entathid %Firm{ &imp age.an. Omen. slew lit. et It•I•gir If noun rent as to' inurscnoldianiannyen0 ram' •.C.-.) oxID•unto.r. atop,.. rig ntrek rent Iran Stli Gnu: .p.4:nutz cline:we:n:4. a$ Kay.. ICIN:01P140 Ca ha.. a; rt ans eh gr man ProgramOf/kir nosiorling bSt.11,10.u. p ird plain On.n,..* oC, OfCalntugc pWel (WINN/ 'not-% ityors .. ,r., navy ups( et • tgot af.lyits 'Moto Presort/ St narn(uvelo.p,00. plse cats itowasitts B4000 wn. .ten. rde.artt4n9.t• (0.01.”,514W00/(01. 45,41.0 9 EFTA01072425 10 EFTA01072426 Global Immunization 1980-2009 - DTP3 coverage 100 80 E cn 60 4.) 40 20 feeigg slgiwggeleigg ggiegg Global Eastern Mediterranean —European Western Padfle —American —South East Asian SwevYMOVNCEFixwiseatliVeon0,209.4.0y2M 11 EFTA01072427 DPT3 coverage levels in key geographies OTP3 covetage (a) 12 EFTA01072428 Trends in DTP3 Coverage in Nigeria, 1980 - 2010 EPI re-launched. UCI implemented EPI initiated 07 70 CO 50 140 20 10 a 1970 1975 UCI 5$ end 1990 1995 ton 2000 1980 1985 EPI renamed NPI. made a paraslatal Sone' 1 WHON/1020:40mol 0a 10/01/2010 ha. tmLappautigunanmni.”1.:tnoltocres.012221/enn- 2.N800.1111 Immuntalen paler Survey MUGS). 2010. MOH and teHODA NPI 4NPHCDA Key Afti, Nig I. WHO/ UNICEF 2. NICS 2010 2005 2010 2015 EFTA01072429 Coverage and risk comparison of DTP3 shows that hardest to reach are those most in need of intervention Compared coverage rates and risk by wealth quintile • Using child mortality rates (1- 59 months) as a proxy for risk of vaccine preventable disease • Each line represents a single country. with individual points for each wealth quintile For most vaccines and most countries, lower wealth quintiles have higher mortality risks and lower coverage rates — however the pattern differs between countries • Assuming infections targeted by new vaccines are distributed similarly to child mortality. existing programs may miss substantial fraction of high risk children a 100% icrft 10% o a 100 I50 20) Vida 50V) irCenno Each Nom represents one county. ladWdual point, miasma each wealth quintile =IIIMMEMe tad Four graphs of coverage by quintile for all countries, recent year. BCG, DPT2, Polio 2, Measles. Like tableau lower left, but only most recent year 14 EFTA01072430 Case-study of impact of equitable distribution with Rotavirus Estimated distributional effects of totavirus vx Rotavirus mortality and coverage curves mortality reduction and cost effectiveness et [repeated 3 times] 1 It i• an.. man. Each lino represents a county: Individual points represent each wealth quintile Coverage decreases and deaths from rotavirus ; x.c ny atilt lower wealth NM. mi.*. caul Mown. I.......1. anew. tawdry linos nes Nan PpLinna SS *NOS as wand ~nal non,. Mame .P.A4 MIMS VO3 la INS WM 4...~ M Car WI lille an 44.1 >754 Rent MO) IN • a in as 21•1 • 5. MS IIan OS Mn 544 4/0 :MI PM )110 04 4.14 110m1 1e11. .01.11 In 2n ran.. Itei PM 147 249 MT TI 1414 pp 2M 251 PI MIS 14 00 I•15 2/1 )70 M IMO 00 10 Ill I Oa 121 Plemi PM Mn 10 10 aa is tie MOM ten I M ill 5740 Ma I SY i PO >at) ini I M I le I re, Well I N I 11 N4 MO 0 le Me Me as MP UM no 1M sie IMO KM 215 SW ON MY 2L •44 2n Pal. NM co ova Innen miennlina coal 4•0 • a+.. tim.4.7.40 newly ...no, Wen tmeni• 444.4.644 Nan &NA retell Fa • IMNIMOMMSYMMISMOT ant ---D=wir /MSC 15 EFTA01072431 Countries with DTP3 coverage below 70% 40 countries in 1990 37 countries in 2000 20 countries in 2009 © 2010 Bill & Melinda Gates Foundation 16 EFTA01072432 Demands on vaccine delivery systems are rising dramatically Demands on delivery systems are vowing dramatically Cumulus-4w nulae and volume q vorrines used An imam.- childhood Amenummlion [Myopia lalanket Rib 10000/0.11 OR KO 101,00.X.1 Total Valw, OW USD) I1 1012 1954 1986 191% 1990 19W II% In 19% 200) 1001 133. 1006 MOS 1010 IOW 20% Mintz %MSS. Caw Onl Swim Welds,/ lelfsels Odom?: el ant aloleesimmallaw. 17 EFTA01072433 Health worker shortfall is affecting immunization coverage Immunization coverage improves with increased density of vaccinators 90 - 80 - O-4 70 a) 60 - - O 0 30 - 20 - 10 - 0 ••• Ilurrenmearc:e3 to -• Doclorg NJIOS 10 Density (per 100 000) 100 WHO esthrolas Vat Inns then z . MISICOrOpOleeekeelli:traic,-,rases. end RiclatgOOPer100,cr,. 0:0111400 a dal tiberlaCt, 18 EFTA01072434 57 countries are facing a critical shortage of health workers ft 4 iri 1 c eh val l 1 - Abt ti r alli y Canines tort Crital 'Notate of health torten Countries...ghoul cnbcal shortage <IMAM wodtn Reaching target levels of health worker availability would roquir 2.4 million additional health workers in critical countries 19 EFTA01072435 Tech wrovelc, Many technological innovations could improve RI supply-chain, but need to be effectively implemented/deployed Temperature monitoring innovations: e.g. VVIA. freeze-tags. 30-day temperature recorders IT systems innovations lutuwa diva..• az i s 42)::"Zilleth IR,' re:. et...44es S HERMES: supply-chain modeling tool EVM+: next generation EVM toc RFID tags: inventory monitoring too' Others... 20 EFTA01072436 New touchpoints for vaccination (e.g. schools) have been deployed effectively in developed world Comparison of school-based versus healthfacility touchpoints in developed world Coverage raon fat 3 deo:G.11)V ICO 40 UK swan relied as Nghatorellmata h '<boob s -7---- AV* UK anal USA eau Mawr corforteowato noes UK 213 Fe UK 4-18 Feteeth.° 0:1,70 CI US 3.1irti 32 In developing world. greater proportion of out-of-school children can be a barrier to school-based immunizations of school alien:lance I UK 3 Ocoee USA 3 eases Pray Low .00:01INAIMIO Pray Law iffiX•040,116. Panty Isar 14.444.0W9Ity UK:HA/vaccine LISA:WV...wane dawn:demo", school' Sherpa Mrouell regutor hoavn North Amence Women EU SubStoran Meta SouthandYAW Asia Chennets, 21 EFTA01072437 Other services often integrated with routine immunization Health Facilities Integrating Services with Routine Immunization In 2007 RED evaluated countries) 0 OR POW) •CcadtN-133I Wiftn-fl I h i€ -1 Integrated service • The RI infrastructure provides a platform for the delivery of additional services during fixed and outreach vaccination sessions • In both fixed and outreach sessions. the services combined with immunization varied, even within the same country (see figure above) • Health facilities report that services are more frequently combined at fixed sites than during outreach sessions In addition to straining delivery system with new vaccines. health workers are also providing multitude of additional services with each interaction I 22 EFTA01072438 Our initial thinking on barriers to successful immunization 23 EFTA01072439 State of routine immunization today We have achieved significant Impact • In 2010. 109 million infants worldwide receive DTP3 vaccinations each year • 130 countries met the 2010 target of z90% national coverage of DTP3 • More than 2.5 million deaths are averted per year of children <5 years of age However, an unfinished agenda remains • In 2010. 19.3 million (-20%) children did not receive some or all of the routinely recommended childhood vaccines • DTP3 coverage was below 70% in 18 countries in 2010. only 59 countries (31%) achieved ≥80% coverage of DTP3 in every district • --2 million additional child deaths could be avoided if we can reach GIVS target of immunizing 90% of children < 5 years of age We cannot afford to be complacent in addressing these key gaps • RI coverage fell. or remained stagnant in 22 low-income countries between 2005 and 2009 • Hardest to reach children are those most in need of intervention and represent the most potential lives saved 24 EFTA01072440 Initial framework for thinking about components of routine immunization Data for decision•making For routine immunization to occur. three processes must be successful: • Demand: Individual must be present at the point of interaction where they can receive a vaccination • Snonly: The vaccine needs to anive at a designated point of i-iteraction where it can be administered to an individual • At the point of vaccination a health worker must actively identify an individual's vaccination needs and follow the right steps to administer and record the vaccination In addition, one enabler of routine immunization must be in place: • Data for decision-making must be collected, analyzed, and used. The data includes disease surveillance, coverage rates, and other metrics around the RI process 23 EFTA01072441 Demand barriers (I) Demand Barrier Rationale, evidence, assumptions il l p EdUall1011y 111 orwooen Slalus. • Niemen with low educational ilaltr3 may have less aCals 10 eseciad information. as well as lesser degree of socio-economic (mothers. caregivers) independence. Nils nate,' relates to decisimmialting power) • Evidence: Often correlated with chid health indicators. cited as risk factor for lack of vaconation Political banters • Chicken who he in conflict-affected areas. or who have recently migrated from those areas are less 'hely to be vaccinated. Reasons may range from lack of personal financial lemmas. lack a service delivery systems. and lack of trust in 'authority.' • Evidence: TBD Technology Operations Lack of caregiver education • Rationale: Some caregivers may not realize (or may not have been about vaccination told) linen to come back for subsequent doses. and villy* is important to do so • Evidence: Cutts S Eliellik (e.g. t0SURS of PaleiMan studyusing home' based education: study usng redesign c4 ot card to hilllight return dates and education on importance of full series) Lack of inkrmatico /Anti- • Rationale. May stem from misenformation: or from a lack of vaccine movements int:malice) regarding AtiFts • Caregivers may • Some indications that anti-vaccinahon movements are growing with choose not to have coverage rates increase as people see less evidence of trzEii. child vaccinated • Evidence: TBD Cultural / religious beliefs • Cultural or religious resistance to receiving vaccination, • Evidence: TBD 26 EFTA01072442 Demand barriers (II) IM= Opera tionS Cont.) Demand Barrier Rationale, evidence, assumptions Geography • Distance to point of vaoariation is a border (often related to line and finance, but also in its own righl) • Some geographic areas. we 'off the grid' (e.g. urban slums). and not accounted for n a designated service delivery area • Evidence: Cuttstieild pacer; Walt Orensteinn and Stanley Flotiliin Lack of financial resources • Delivery system does not account fee the cost and opponunily cost of binreang to a vaccination of waiting, and of any 'Unofficial' charges • Evidence: TED Lack of rpm/van:on • If no other services are offered at the same silelsame lime. it not be perceived as weer the cost & time • Evidence:TED Lack of btasernaliChld • Chidren been at home I without a skated birth attendant are les: lleallh Service UUizalion likely to be vaccinated • This priori lack of service uttizadon. presumably for similar operational reasons. spits over into lack of senuse utlizaticei for imrnortirdtion • Evidence: TBD Poo service deivery • Missed opporkwities. whereby 'lockouts. concerns of wastage rhos no opening of a new multi-dose vial). or other cancellation of vaccination discourage completion of a series • Evidence: TBD • Drepouts can also be caused by someone having a bad priori experience at a health censer - ride trealment by a healthcare worker. unexpected Sees. local vaccine ranchero, ex. • Evidence: TBD Bad experience 27 EFTA01072443 Surveys in Nigeria and Ethiopia shows that majority of unvaccination driven by lack of awareness or willingness Total patient pool IIIIWN gram 1111/11 Main reasons C44•0 BY ratter for chid n04 recemnp vaccine' : Nigeria size of unAinder vaotinaied (All vaccines? 100% Ohio& size ohm. vactinslims (Measles vaccines) Demand Compliance Total untunder vaccinated' • La:444i* • fee, ado .6140 • Post too fa. • blew.. mc • Foordikluagte Clik wasobsent Own wok Seam • UnelatabAlvel • RAMS note • Lac* mamma e3.4 04% et BO% 4, Lifer nearn A nib 69% e =1 31% 306 18% 12% WA ”- 02%rt i. 88% 47•-• 04% 41Th. St% II Su, 41% 23% 18% 18% WA 1.4ajOnty of unrunder• Smni8cani source of VaCCII130011 unAmder vaccination 28 EFTA01072444 correlated to mothers education schooV9 Primer/ Inforceoalalo Sezenenr Unwise,• 40 60 BO ICO % Coverage Mothers education appears to be a positive factor for immunization Coverage in Khartoum, Sudan Key findings on education from other studies • Generally. the studies reviewed suppore“ the conventional wisdom that education. particularly mothers education, is a positive factor for immunization • However, the relationship is not always dean and consistent • e.g. in one Kenya study fathers education correlated well with vaccination in urban areas and mothers education in rural areas • In Nigeria. educated people were less likely to immunize their children than illiterates 29 EFTA01072445 Lack of information on vaccination presents a barrier Country examples • Liberia: Over 1/3 of mothers said they were not informed about the return date • 2008 EPI review in Benin found that one d the pincipal reasons for non-vaccination was mothers being unaware of the need to return or when or where to return • In Mozambique. 3/4 of health workers said they always write the return dates on the child's card, but only 1/4 of the cards actually had the return date written • However..-i Uganda. 80% of parents claimed that health staff advised them to retsn for more vaccinations • In one area of Bangladesh. with a 30% dropout rate. 63% of mothers claimed they were not informed about the time and place of EPI sessions 30 EFTA01072446 Case study: addressing demand in rural India has more impact than addressing supply-issues only Note: This is a controversial issue( Immunization rates by type of immunization camp in rural India Fuly immunized 1%) so 30 20 0 %coverage 6% Avg cost! child Note. CCTs • ;34 novas temente/ me mee room •el+ dewed meoleaten nem epos 6.5x Control Reliable Incentives' + camps only reliable camps 18% 39% 555.83 527.94 V TOD Key findings Demand Improving reliability of services improves immunization rates by -3x. but adding small incentives improves uptake of by -6.5x • Primary impact of incentive is to increase full compliance Offering incentives proves to be more cost effective than purely improving supply • Average cost 1 child is actually lower when offering incentives - since daily fixed cost (mainly health worker salary) is spread over more children Study indicates that size of incentive does not matter beyond the fact that a positive incentive is offered However. coverage still remains very low despite interventions 31 EFTA01072447 Epidemiology of unimmunized child — access Impact of distance in Khartoum State. Sudan Impact of distance in Senegal lip Ici-clale irmnunizabon (%) 40 78 60 20 o ..— WO ire 4 GO inns Atilt hire a GO mns 40 Full imrriunizalica (%) so ro 60 40 93 0 10 Um wain i0 ims Welk awe a 30 32 EFTA01072448 Nigeria: Closer look at disparities by wealth quintile Methods • 2003 and 2008 data • Analyzed by region. wealth, vulnerability (nutritional status) and time • BCG. DPT1. DPT2. DPT3. Polio 0. Polio 1. Polio 2. Polio 3. Measles Table show coverage rates of different vaccines by wealth Quintile Key findings • Children in poorer households are less likely to be vaccinated • Disparities in coverage for all vaccines 100% 90% 80% >0% 00% 40% 30% 20% 10% 0% Penegi Pvcrtc ‘1019 fbc/Ro linen< Vaccination coverage rates by wealth quintile: Nigeria DHS 2008, children 12-23 months BOG OPTI 0012 - OPT, Polo 0 Polo, Polo 2 Polo Mooth•• 1 figure (most recent year) with multiple vaccines coverage rates by quintile (national) 33 EFTA01072449 Epidemiology of unimmunized child Demand Barriers Utilization difficulties: country examples Lack of motivation • In Dhaka. 21% of mothers in one study stated that immunizations were not necessary for thee children Previous use of health • Studies in West Africa. India. and Ecuador found that services families with a history of using health services for other reasons had a much higher chance of having their ch Jr vaccinated Poor service delivery • In Liberia. 30% of mothers commented on the inconvenience of long waiting times Bad experience • In Uganda. only a minority (13%) complained about being treated rudely or badly • After some mothers lose their immunizationThealth cards. they are scared to go back to the health centers for fear of being yelled at by the health staff. made to pay for a new card. and/or asked to return home for the forgotten card I saINIMMI 34 EFTA01072450 Epidemiology determinants of unimmunized child: summary of major Demand Major RIM Factors (secondary factors) ConespendingfrolnforcIng - Place of residence (rucal cistant front a health faddy) (family factor) Insufficient facift es. truela:se selvicer..routreach. restncledincorivenew servire hours (sernce factorS1 Poverty gamily Ham) Health marker attitudes and behavior. charges (official tad unaided (service factors) Mothers' education (family factor) (Although mothers' education was commonly associated viith ithiHren's immurization status. some studies found little or even a reverse correlation) Inthdficienthneffective IEC. engagement with commtably leaders and groups (service factors) Majer Causal Faders (primary factors) Cenuperbelna RaInferekia faders Bad experiences at health facittWoutreach. leadng to fears. negative expectations. and lack of bust ((amity fader) Health uerker &dudes and behavior. aide effects. stock Calls (service factors) Competing priorities (too busy) gamily Wei) Restridedfmconvenient hours. difficult access. unreliable serene, (service factors) Missed opportunities to immunize (sentry factor) Parents' altitudes and fears (e.g. to have sick chid immunized). although in most cases parents accept heath staffs recommendation Feardrumors (Ian* factor) Insufficienthnertedive IEC. engagement milk community leaders and groups (service factors) Lack of appreciation of ba.Oc benefit of vaccination ((amity factor) InthdficienVnertedive IEC. engagement milk community leaders and groups (service factors) Lack of understanding of need for multiple doses. when and where to return. That immunization protects against certain specific diseases (family factor) Poor health worker communication; insufficient/ ineffective IEC. engagement with community leaders and grows (service factors) 4>Nute• s volt!. 0tlel f won, I 35 EFTA01072451 Summary of papers reviewed shows a significant impact can be achieved by addressing demand generation barriers COUrIlly (Reg Veile) brarohn 19911191 8de< deStriptiOn OutcomeS Demand Moss .90:nation compagro: stainnary anke ara niobto ~ca Wite or eritioul bW sakmonialon as an ereceelbe 1201 Zlekla 19911161 En ya 1998 122) Mån 1997 Ota~ kame. ~rem:Ses (Frør b Semi elias ~ul anta)) 'noble kre 'henne« reernateltros 9wri grem atemprtsans.anotersnt ol~n~pbetial vahnloors !rc« grass »is 0(2.1~1kX4 IDOCt»400t <anwasirs Trea ~44n.le (Ara ot p» campaien was Mord,- Segl 1990 kcesed on kor N. fam ~e. and pfinfed ode wl rendnders el nar~ øy end *nem *meina Propan ol bre veds ()urne~ proerot sen Mad to 11"0 be oblaten lone eat Scinic ot tolt obo«, and wfl e roten* ~e ror the okt 1400 pmuoø ol smal colaVatoo mol tøsod CM!. 0111630101110id kir Ia -born va/x*1~ data. elabfreon 2006[171 2009 LSI 'Smie' Su« corroncelon togrem Modedm men/ ot Vanen) boalinn›LHaimossages (09. MCH.FP. vaconation) Tre ~au. «odla includod eapboards, enensian døme sen* telciame abedisemenee ~e spa. pre* a& in naseapen and local Trne elrechfied Statene binonen mb, kn thourand roande«. 1) CleCUPStn indros +avl ~nov**. bom ommuenney 2) Focusod on ad als anda sn s ol acnatIon 3) FOCUS00 on hal aztr‘ plan :Muting Øens tor eir, ~la and chtehoad °oste Ftogu1atmoela.63.3% 1~ raca," carrpapla: 77.1% Solony vatm ta rnerow.94.1% ',lobb vatn bod inconat 99.3% Men*, v.:floa 935-19 Bota (I% ~oase) enroene 11" nole~ Tete 122% ~ess) ~nano131K napm) Notes Ditto.« lo tak study n ~Ila 2000 53.9% Meie)» 64.5% 11993) Inler~~ ~se 59ntol93% [onkel grip: excoaso 1~ 60.7%lo 93" Total aro.112A Ond! poren 67.6% noteromber 68 e% ~tatten anaa 494% Monen wlio asen" meny Smeng Sen prabancel «anal bon) moro lloly tron noe bro db nol lo ~pleie OPT ~net» , (90Ins499.1 Note:~ pilstat roro b:61.1kcitio •111.1991.11 ~ia nimm: 20%.~..e efter knoin~-trensfer OPT: 28.5%inercazo stor knoncer3aoSanster 61~re COVIMILI 811/10.., 36 EFTA01072452 Point of Vaccination barriers (I) Polic Tech nology Barrier Health worker shortage Geer/seeing health worker ptiodliss Policies can result in missed oppccturiliss to vaccinate (e.g. wastage. oren-vial) Recordng name-based data on •vaccina:ions is lime consuming. prone to ems. and often nsukident to allure backing of chicken in the community Rationale, evidence, assumptions • Critical shortages and a high turnover of service delivery and supply Chain health workers in the poorest counties: ccenpouncrir by poor motivation and undemerfcemanse—leave poorest areas most underserved • Evidence: Stale of wono's niceness • Opportunity cost associated with screening la immirrization. administering a vaccination. and recording the information con 1 outweighed by need for another competing health service • Evidence:Stu:0hs showing decrease or vaccinationsduring curahve care Mils Include poides against wastage. lack of Wits. facilitating open.v policies. and lackof clarity at cortdintications Evidence: Observation and status of VVMs on new vaccines Difficult to ID patient quickly al health facility if home-based vaccinatcm card is unavailable Evidence: DOA and DOS assessments. RED ovals EFTA01072453 Point of Vaccination barriers (II) Barrier Missed opporltnities due lo stock•outs cc nadequale tinning leading to concerns about wastage or lane contraindications Civic operations discourage parents ken attending Rationale, evidence, assumptions • Evidence: RED evais: presentations by WHO iesnonsi EPI advisors to SAGE sneering,: Re:Mum on mined opportentes • Inadequate explanation to parents of hie need to return or when to MUT • Negative family experience al a previous health center or outreach alteManoe • Evidence: same as above 3 EFTA01072454 57 countries are facing a critical shortage of health workers 4Ia - Canines with cella shortage of health Wattn - Countries settent touch shortage of heath *odes Reaching target levels of health worker availability would roquir 2.4 million additional health workers in critical countries 39 EFTA01072455 Health worker shortfall is affecting immunization coverage Immunization coverage improves with increased density of vaccinators 100 90 80 - 70 - ) 60 50_ 40 - 30 _ 20 - 10 - 0 10 lc° -0- Maas -~ ',Asses Density (per 100 000) 40 EFTA01072456 a, ,-.3 i: , • 'afar-. ., 4,770, C". =4'7 re, "1"Niv . vl *n. IIII31,1,r , 1-"loill i , p 1 1 Data accuracy is difficult to achieve on health facility-based primary records Records include registers, tally sheets^ clinic copy of health card or family record etc Barriers to data accuracy include: • Poor form design (e.g. lack of space: outdated records meaning improvisation is needed for new vaccines) • Lack of writing tools (e.g. pencil blunt: biro runs out of ink) • Mistakes in recording data (e.g. wrong vaccine dose. wrong date. inclusion of children outside — the target age group etc) • Deliberate falsification of records. e.g. due to real or perceived pressure to meet targets • Poor storage leading to lost or damaged (e.g. by rain, rats. etc) records and egisters Oa MEMO 1 7 5 .4 r. I 41 EFTA01072457 -60-70% of all opportunities for valid vaccination were missed in CAR study Frequency of missed opportunities for vaccination, by antigen, among the study sample of 12-23-month-olds. Central African Republic. 1990 % of visits 100 80 40 0 Con DIM 70 1~ is.,COrtgi VISis aero vs OCe.“, elgen • A missed opportonRy for yearn/ben was defined as a VateirtaliOn visit or other health mite visit by a child wnr, ud not receive arraccinatian for which he or she was eligbie • Immunization policy in the CentralAfrican Republic encourages the immunizattn of all age-eligible ehildten. unless they are sick enough to wattanl hosutalitalion (study assumes no hospdatirarpms) I 42 EFTA01072458 Study suggests that by using all opportunities to vaccinate, full coverage rates could be raised to 65% Some opportunities were missed even when another vaccine was given 54o missed oppaturolies OPT' OPTS Limas Antigen MI % (NSW *two no atiar vocal. was ahem %ffisr.o3 nennl motor vocal. an' flan Potential increase in coverage by avoiding missed opportunities during other vaccination-visits or all visit % emiage 03 80 0 OPTS Menke Al .,.J:rc4 Sesalne noted onyx w0 PCONtlal vrafated dins .003 und PCONtlal vias wan wad 43 EFTA01072459 Other studies showed % of missed opportunities varied widely 4 by country but generally higher in curative than preventive visits Prevalence of missed opportunities in Key findings from missed opportunity preventive and curative visits in ten countries studies Cameroon (2.35 nos) CM (12-23 meal ..nores 023 noel 06464410.23, 4461 2466640-23n-4cl r —t . ..ea (12.23 f.>41 y44460494'441 PA4zarn0oue (12-23 fru) ID Pualo Ro2(2.6006441 Vs6-64.4016 (023 two AO courdrw• (01 O 20 40 60 SO 100 % missed oppedtmilies Screening for immunizations at curative visits important • Studies showed that 'Never immunizec' children were identified at curative services but were less likely to be seen at preventive services Alternatively, health facilities should increase the number of days that immunizations are offered • Studies in Gabon showed a 2- to 3-fold increase in missed opportunities on days when immunizations were not scheduled • In Burundi. missed opportunities were lowest in facilities that immunized at every health contact (15%), compared with facilities that immunized every day but not at every contact (21%), or facilities that immunized fewer than 4 days/ wk (30%) EFTA01072460 Five major reasons for missed opportunities highlighted by studies Major reasons for missed opportunities Conclusions Medan % acrass dudes analyzed (ranee in patendeses) Failure to administer immunizations simultaneously False contraindications Negative health•worker attitude eg Ani, e.,reie are n:o ant.% atul <v wewomo ftv vt Logistics problems aP vv MOIWO. poor COW orpmeanan oathaentorternang parental refusal 3 11%1 22 t7-35% 19(648%) 16(146%) 10(481%1 O 5 la IS 20 25 Medan %el missed opportunities Initiatives to eliminate missed opportunities can have significant impact: • Missed opportunities were reduced by 8-69% • Immunization coverage was increased by 10-145% Recommendations include: • Use missed opportunities survey: routinely • Screen and immunize at every contact • Administer vaccines simultaneously • Emphasize true contraindications • Provide continuing education on immunization • Reduce fear of vaccine wastage 45 EFTA01072461 Supply barriers (I) Policy Barrier Rationale, evidence, assumptions Health worker shortage Inadequate training Poo- demand forecasting at al levels Strateges not context spectec • Critical shortages and a high ttrnover of service delivery and supply chain health workers in the proofed Quintiles; compounded by poor supervision and support often resultng in absenteeism and underperformance —leaves poorest Weft most underserved • Evidence: State of worlds mothers • Little upitoidate pre-service training for immunization services. in- senice training is lime-consuming to devebp. thus is ftecroieney out- of-date. Few a-Learning or text messaging systems avedatle • CPI managers' meetings are useful for exchanging ink:motion at the policy level but rarefy provide updates to stall al the lower levels • Unclear protocols and inadequate training of staff for appropriate data collection and utilization • Evidence: TOD • Vaccine demand brocading is often based on old census data an last years procurement • It is rarely matched to end-user consumption • Eindenca TBD • Countries and districts face challenges in adapting program strategies to specific contextdroeds • Evidence: TBD 46 EFTA01072462 Supply barriers (II) Barrier Rationale, evidence, assumptions Policy (cost.) S Built in buffer stocks are if* large Parallel systems Lack o( optimally designed systems liatenal and nternabonal relicts are being very slow to adapt to the heal-stabrIty of new vaccines • Current irefficiericies are overcome by maintaining high stock levels and tolerating high wastage rates • andence: TBD • Many vertical meditine supply Chains (vx cold chains). ART. RH. operating in parallel • There are also significant management deincentives to init.-gin', • Evidence:TOD • There are onty rare projects 01 aitntry policies to demonstrate efficient and effective vaccine supply chains optrnized for high performance and low cost rather. current systems follow administratrae sructures • E odenct• TOO • HBV. TT. conjugate bacterial, and pentavalent vaccines (minus pedussis) can be heabslable . but polities constiain vaccination to sites with functionng cold chain . increasing costs of cold-chain • Assumption. Abifty to distribute. store and deliver vaccines under mere flexible singe condticns • Eodence: Multiple references on heal-stability and heeze-sensitrahe Project OM:nixie work? 47 EFTA01072463 Supply barriers (Ill) Barrier Lack of reliable funding Donor dependency Pore financial management. parlicubdy at lower levels Lack of discretionary funds at operational boos to solve ombems locally Routine nvounbarion lacks priority al global level Rationale, evidence, assumptions • Inadequate. unpredictable. and delayed release of designated funds from governments and damn to central and district levels affects abiley of program lo an and implement RI services • Evidence Nigeria national stock oul of pad vx in 2011 due lo late disbursement of funds. Lydon - report on Laos financial suslainablity pan • Many countries depend opal outside donors bond the goo's share of NIP • Evidence: country share of Funding • With lore or no budget oversight and accOuntatilly thee, is hale understandng of the cost drivers of the program and potential efficiencies • Evidence: TBD • E.g. Lady authority or petty cash to subcontract to a local sourt, of transport • Evidence: RED teals. personal experience • Evidence No RI position funded at UNICEF HO through regular resources. <2% of AFRO's immunization budget goes to RI. much or WHO's immunization program funded through GAtil Rusin< tt PLUM 48 EFTA01072464 Supply barriers (IV) Polley (cont.) Barrier Lack of information used to guide country dedsion making e around new product introductions) Inadequate guidance provided for some new votaries Inadequate vaccine safety guidelines Inadequate waste deposes guidance SE= Rationale, evidence, assumptions • Ladled country access to up-to-date information on product presentation and future pricing trajectories • GAVI-elgible countries have Mlle choice over vaccine peesertat- • No detailed mapping of is available of areas with tow coverage with high drop-oul rates. Opguide and diced irdensifed activities • Evidence TBD • Many national immunizalko programs lack policies. guidance strategies lo deliver vaccines that do not readily lit into arrant Muth! EPI schedule or louchpoints • Evidence: Hec,B brth dose should be given within 24 hours of birth. Men A is largeled to 1.29 year olds n campaign settings. HPV is targeted to school age population • Guidance on AEFI training and capaccy needs in countries is weak and yet wen the advent of newer vaccines (some introduced for the first lime ei develop-fly countries. given at different age groups. and through Sins.) AEFI stereillance and response is critical - esoecially with increasing pressure from anli-vaocire movement • Evidence: TBD • No dear policy recommendations on njedicei material waste disposal • Evidence: TBD 49 EFTA01072465 Supply barriers (V) Technology Opera lions Barrier Convicting and inadequate information systems Lack of reliable ccovnuncation between layers of health system Lack of information systems Suboptimal product profile Infrastructure in place does not match current need Outreach sessions frequently cancelled or delayed Supply Rationale, evidence, assumptions • Different systems for lopstics and supply chain. stock management. immunization records. performance monitoring and surveillance • Lack of birth registry to track unvaccinated children • Evidence: RED swats; SAGE reports ARISE. Cuttsainth report • Fixed posts were built decades earlier and population has mount: subsequently or posts were organized for pontosl reasons rather than need • Evidence: personal experience. • Current information systems to monitor and trap*. vaccine and irtecton supply stocks from arrival to point of use or disposal are not being ate not pale or are not being used lo back and mentor vaccine supplies and utilization from national to peripheral levels • Evidence: Optimize • packaging. presentaticn. thermostablity. and dosage regimen could be inproved for the developing world supply chain • Evidence: Project Optimize • Mismatch between ih the ntrnber of vaccination points anditor they are distributed in a manner oral does riot match up with popidation needs and the requiernents of the heath service • Evidence: personal experience. data on WHO heath systems site • Owing to a lack of funzing or procedures in place to refund out-of- pocket expenses of health staff iwnunization entrench is often delayed or Cancelled • Evidence: TBD 50 EFTA01072466 Supply barriers (VI) Opera tions (cent.) Barrier Rationale, evidence, assumptions Inadequate cold-chain • Al ✓ub national levels in Wieder capacity • Evidence: WHOWNICEF data; Project Optimize Inadequate temperature monitoring and reporting Inadequate maintenance Suboptimal power supply Serious transportation issues at peripheral points Supply Chao evaluation • Significant variability et the use of supply chain and cold chain variability assessment tools leading to vanable measured costs across countries and data gaps • Endence TOO • There is an absence of data compled centrally on V3CCitte heat exposure and no routine data is available at al on freeze exec:sena al any level of the system Mils indicate heat exposure localy • Evidence: Optimize • Cold Ch9in ethipment maintenance lends to be poor feeerythitie from not wiping down solar panels to hang an effective maintenance organization with skiled staff. transport and spare parts • Evidence: TBD • Poor and inxosistenl power supply at planet:anal levels • Evidence: LARI 2011 • The last 10K are the most dello-ill • Evidence: TBD 51 EFTA01072467 WHO Immunization schedule al friiiri• -i r-ez.. , ...wean Lea ,. 1....7. ”ft... isimidooen anan• KO 4.,...to• ay an, 4...0 vft. ' ., ... , ..saira nion, .,....ftioftebanoft I I ...room Ms .. ...cm; 'WWI ......i....fri.. annowom noein,.. , one 0 hN MP. On.afte 1..• ..4".”1"ftlf ihnftss ...V..) p..... f%, IN ...so. oen •4e,....i, a ....n.. nre •4 4 4 a.m. I 4 en•nr.f...•.• 4o. Oft•O on ..v.. cc, -••• •••••Th, ... ft...., ...oft. I teitroliortnri 4.10,ffeby OM •.,..it”nesii n"" I ter.......01.1 .0,40 &rat On.; ,,..... ft Ha I. a,. raY... 10. ....p.m. on OM. I ......roi.. OM re ......e. 0774 ...ft,..,. , Pt," curb. II.. non "gat ' o non ne a ...win, caw 0. 0...* ......, te, I anus.. 2..... F.., tool.. it 0,.....el• • .... ft... in. l nern ne polo'*. — non. .,.... in, en nor won, • one.. Fr no . en ---,on t en..., nonnt= none.. , to.,....nen— ,, I.. •ore •.I•• ,in•enn ee rDo e . i eine on mein 2t...1 e en en •o Fel ',soon.. nen, 1..1 ens eltaftr— fa ft n aftw..0.....ionrom wt. Owes ft.% z" " iv,. t011nwliolle•Sallulall 52 EFTA01072468 Country schedules AnOfien not (countries with vaccine Introduced I (of 1931010 slaps' .cciarnenclagons Medi &AIWA.. WA 177 102%1 00130%Y WA 173 M0%) 88 (45%10 39 120%) 139122Y% 45(23%) acocoel(COniugele v. PIN Reeernmendeffern kir caddren residing M cedOn miens Japanese Encephalon. Yellow rove, lecar mrntla tux., /0, chsidten ewne1001-n*acP0P0460^5 Typhoid Chokra 012%) 33O2%) WA WA 0,000014 32 (17%) 125%) t A WA .,,nendallons for chill, n receiving vs from ,,zatton ptogtom wish WIJ/di CILitaCICYJOICS Wattreasell 120162%) 131165% 106166%) 1510%) 0 of country vaccine introductions (for WHO tracked vaccines') e counties per vaccine a •.iC •MCV2 K Piwro ps III IF Maras cos !Slane HepA L. Pans vans nere E HPV -11 lance M Retahln, dd. (Wef 0 WmV raw 0 rent.** I W Iv wane ,.. won. atelt.OJelisealia aryl,* ifrvaXcps I•I••tIlI••tO20,t•- .r.s pro won sea peva amuses.. cfranrittx it Seta two ow Di EFTA01072469 Average Annual Immunization Program Cost per Year (2009 $USD) $100.000.000 $90.000,000 $80.000,000 $70.000.000 $60.000.000 $50.000.000 $40.000.000 $30.000.000 $20.000.000 $10.000.000 $0 2004 2005 2006 2007 2008 20092010 2011 201220132014 2015 —Routine —Campaign Shared —Imm Specific Total 34 EFTA01072470 Human resources costs a large part of non-vaccine costs Source: Lydon P, et al. 2009 r 1 Human Resources MCold Chain Transport (Surveillance Training Social Mobilization Other SOttON UOM BMW POION016.041.2011 55 EFTA01072471 Proportion of government funding increasing slowly Deno 1,1 governmen; tund.ng for •,‘accines and To o!ine Immunization in 185 WHO Member States-2610-2005 %Vaccinc cvcodehect teamed *.Roumw imenuninton cp;mblain I)) th 'ben crtuncom 0mm[d In thc mcntmcni I00% 90% 60% fe% g 1 I 0—Sanplc A‘Cl2gC Popu wash:.: Maa r'. I 56 EFTA01072472 Half of countries financing less than 50% of total needs Government financing is 42% of total financing 100". 57 EFTA01072473 Today's vaccine supply chain A network of people and equipment and well established procedures stivo(t vesc" PAIL,* RECORD ANNUAL STATISTICS ItStouiryS ANALYSIS RIONTIII.T REPORT C loZ il KIIIOUNIS A te 7:2* .0 411 VACCINATOR/ NOON. MOORED KOREN CENTRE MANUFACTURER REQUEST FORSUPPLY f a te, mi l - AIRPORT Fri % 1;1M wawa STORE DOTRICT/ REGIONAL STORE Simple, precise & standardized 58 EFTA01072474 Supply system architecture follows administrative/ political structure fr Al pots Pier.ify SIure —. National $ 0-natio al I - S I 3 4 .7 late Sub-national 2 "K - to- C. 4. II•ofth Centel NoahCaren C SONCO Calvary 5— Oalhory I - 111=1:isi EFTA01072475 Vaccine storage recommendations Primary vaccine store Up to 6 Months Intermediate vaccine store Region- up to District- up to 3 months one month Health centre Up to one month Health post Up to we month OPV -WC to -WC BCG Measles. MR. MMR YF Mb freeze-dried Meningococcal AMC HepB 2°C to +8°C (-WC lo-WC oho (*WWI IPV DT DTP. DTP Hep B Hb liquid Td TT +2°C to +8°C Never Freeze ! +2°C to +8°C EFTA01072476 Data suggests that vaccine effectiveness is impaired by age as well as logistics issues MCVI Vaccine Effectiveness by age of administration and select WHO region 1E0 77 1 96 1 92 92 77 1 1 AFR SEAR EUR GUDE 4 92%. >12 ma a vo 1- Generally lower VE estimates in AFR and SEAR hale been 'Orbited by studies to pagearmialle differences including cdd chin Sues. eadeepate vaccine handing. pow vacdne stooge. ad inadequate wain* adriiristralion Age a: altnnistraton apmars to have signfloant inosel an MCVI VE 9411 moneys 3.12mouge 61 EFTA01072477 Legacy from the early EPI days: arr Focus on enforcing standard practices in a robust infrastructure • SOPs for all aspects of the programmes - Simple rules and procedures/guidelines - Easy to convey through cascade training - Easy to remember and monitor • Training large numbers of staff Training materials, large numbers of training courses, cascade training - Focus on mid level managers and health workers - All partners engaged in supporting/conducting training sessions • Health Care workers trained to follow SOPs not to make decisions - Keep vaccines cold ! (freezing occurring with TT and DTP but because freezing point> were low, freezing was not a real concern until Hep B was introduced) Vaccine management rules: Discard vaccines vials open at the end of the session Discard vaccine vials taken for outreach and returned unused Open a 10 dose vial even if only one child comes to the session to avoid missed opportunities High rates of vaccine wastage was encouraged (acceptable for penny vaccines but is no longer) WM can help change paradigm - this is still not exploited in an optimal manner to move towards a more flexible and efficient supply chain EFTA01072478 Changing environment - More vaccines with diverging storage requirements Heat sensitivity Most sensitive 2 LOBS sent:! Days 7 at 37°C 14 30 Traditional cold chain u) ca a, -J Soutec hfiltben. J. TechN6421 ConsOation • 2006 Freeze sensitivity EFTA01072479 Prices and packed volume pre dose have been increasing over time DTP Mesas wµ1 rm Prteumo Rots rmw• 5 0 7D 10 Yon. Kenny IND ION 2000 2000 art. De< a DroDY'ReDi It wf .teans pea Pun DI a... OP•MOCI Kludge (CM30016:44.1 ' UNICEF ad PMIO - Plard sesame Nos ••CMH Pilo DVD*011000) 64 EFTA01072480 Supply chain strained by new vaccines Figure 1: Demands on vaccine delivery systems are rhino dramatically.= Demotes on drWorey swami am growing onwiterkelly ram— sic &tomtit/1P 00 ratan inns. MSS awkilbad.mwtt. oar No oar 11119113 10.1•1•1 Voloaddlow 1101WWIIMpoll P.vaS•ft ••••.<4•11 mart misfile lorw*Aart Ski tom iSW NW MC IS nt• rn Iffl lfK IS WO an 2004 2000 000a 200 NW $01 • Plierad Ilipedbabi • New and inaeased•volume packaging require more storage space and baking / supervision on disposal • Hq.er cost of vaccines increases financial risk and exacerbates fled of MO wastage 65 EFTA01072481 Commodi y Logistics System in Kenya complexity genres el 4 , Fob For oninmeAlina Prom••••••• AsonUnad./ lanent anili Amnon-ID •441.1.1.11 t 401.• let I. 00•••••• sn OnIAP A TB( litr••7 oh, sare Man.n. I utacts S ERZ C C Q1A A108. TB I.. maw MEN kiCOS wsl POPIILS Man 66 EFTA01072482 Best practices: SCMS regional distribution centers run by PEPFAR SCMS regional distribution centres and coverage Management of warehousing and distribution - could be outsourced to parastatais and autonomous supply a? Uncles 67 EFTA01072483 Enduring weaknesses- EVM assessments in 24 countries lvM Ptionaty Intl IM so 60 40 0 U 12 0 14 81 C6 82 88 19 100 so 60 40 20 EVM SubNallonal level L1 L4 45 IS P to 19 1-Arrival ; 2-Temperatures: 3- Capacity: 4 Infrastructure; 5- Maintenance; 6- Stock Mgt 7- Distribution: 8- Vaccine mgt; 9-Information Sys 80 % is considered as the score of an effective system EWA Lowest Doling level ice 80 60 90 20 fl f5 IA IS K f7 to (9 EVM Service Mot Level 100 so 60 1 1S l0 20 0 Cl to IS IS Cl 1$ T EFTA01072484 Effective Vaccine Store Management metrics • primary • intermediate • service point 69 EFTA01072485 Two highlighted interventions to address issues Optimize (WHO, PATH partnership with funding from BMGF) • Since 2007 has aimed to use technological and scientific advances to guide the development of new products and ensure maximum efficiency and safety in the field • e.g. passively cooled produce-delivery carts, battery-free solar refrigerators Vaccine Presentation and Packaging Advisory Group (VPPAG) • Provides forum for representatives of UN agencies, experts involved in public sector delivery of vaccines, and industry representatives to discuss vaccine presentation and packaging issue • Originally run by GAVI in 2007 to deal with new pneumo vaccine, now run by WHO and expanded in scope to address HPV and other pipeline vaccines 70 EFTA01072486 Aspects of transportation affecting effectiveness and efficiency *9 mxor !op/ erNo:ia•.: ricrper. to: Mix of vehicles [ sen Lively WHIM at mimeos le • doses rm. _ patbeis soon in motile dole) VW* 0(101a! veherpt/ in vocreong order Avadabaity mg Waif COUP. Iu mows. mentenar03. rep PC el cost of running Health impact imPrri On Man. 5t50/11I,P pled / Mingo:pre, Waite GM/aryl nITIresof in weed rrerbe, 'end mTlq Noes done Witted cot rd..eled Per We edeirrerytriPine ean500e00 µ.loon$ reach defirnaf on the of Sticks eri Who goes parfOrinie to Iran, 71 EFTA01072487 Comparison of transportation efficiency measures across ea_ two countries and two vehicle types 411vDt* ■0...tr a Km Running Total cost vehicle Mgmt cost I km I km Availability Utilization month Stele 1 013 _J NO.05 006 006 015 Yinhyol ao OW 00 01 0.2 00 05 10 0 S S 50 100 0 50 100 0 1200 4.000 0 % bwlvekkblms. Mgmtscoati Ghanaian resources aro around 50% more effective than the Cote d'Ivoiro transport resources in most efficiency measures 72 EFTA01072488 Planning vaccination services and managing resources needs improvement • Emphasizing low vaccine wastage (e.g. only vaccinating one day a week: not opening a multi-dose vial for few children) may mean more missed opportunities Poor stock control and lack of transport for vaccine cksbibution meal stock-outs are common Mothers fumed away because of stock-outs. attendance on days not designated for vaccination. outreach team not arriving on time. health workers concern about vaccine wastage or false contra. indications. may be discouraged from returning • Children who are vaccinated are not always protected, as inadvertent freezing of freeze-sensitive vaccines is now more common than damage by excessive heat transport of vaccine to outreach needs to maintain appropriate temperatures for heat-sensitive and freezing-sensitive vaccines • Lack of planned preventive maintenance greatly reduces the working life of transport and cold chat equipment • Projects have demonstrated increased utilization rates of transport by improving transport police'. (e.g. using most cost-effective means of transport) and maintenance • Effective Vaccine Store management (EVSM) evaluations since 2000 constantly identify the need for more, higher-grade and better-trained logisticians to plan and implement efficient vaccine supply chain management. especially now that expensive new vaccines are being introduced. • Refresher training must be updated and repeated due to frequent staff turnover. • Governments need to create posts for logistics and transport managers • The best mix of strategies (e.g. daffy vaccination at fixed sites: reducing missed opportunities: using most cost-effective transport and human resoisces) needs to be evaluated in different settings EFTA01072489 Distribution of clinics versus population density and DPT3 vaccination coverage highlights problem areas in Nigeria DPT3 Vaccination coverage Cri Population & clinic density 74 EFTA01072490 GAVI-countries rely on GAVI for new vaccine support -r a of applications approved and recommended for approval (cumulative) 180 a 160 E 140 *T„, 120 = °100 80 a fit. 60 '3 I 1 0 0 40 20 0 1 M ■ FtOtavirus Pneumococcal •—• Measles 2-, dos, I I F Yellow fever Mil I g m _ _ Hib containing M I M I k m I I Hepatitis f. 2000 2001 2002 2003 2000 2005 2006 2007 2008 2009 Year 75 EFTA01072491 Data for decision-making barriers (I) Policy Technology Barrier Inadequate IlACI (integrated management of childhood ifnesses) policies No national poky of using a general homebased 'health card* for al health interactions Difliculty knowing vx status for dedren who are ill Difficulty in diagnosing aetiological agent of disease syndromes Cause of death dab ere very difficult to obtain in low income countries Rationale, evidence, assumptions • Ikta policies don't emphasize (a) need to bring health:. card lo outpatient care. (b) need to use all opportunities t• chid for vx. including attendance for curative care • Evidences rthiewol NCI training • Need card that captures al health services (e.g. growth =flirting. vaccinations and sick visits). • Would help reduce rested opportunities and monitor vaccination status of children with VPDs • Evidence: redone, experience • Vaccination status of daltren who are it is often unknown (bit vx card often not bought) or not recorded (bit Poe' of health worked) • VPO surveilanoe therefore often lacks into on vx status c' which could be used to asses vx effectiveness • Evidence: personal experience • Difficulty ie diagnosing aetiological agent of disease syndromes lie diarrhoea. sepsis and pneumonia makes surveillance complex to organize; only feasible in sentinel sites • Evidence: personal experience • Poetrbly need technology to improve autopsies (poletriallY Plot • modem detection of infectious agents) • Need improved completeness and quality of death registration • Evidence: Personal experience 76 EFTA01072492 Data for decision-making barriers (II) Technology (colt.) Opera tions Barrier Improved methods are needed to record infamatign on M of vaccine-dose ccoduinatons each child has receiver( Lack of inexpensive Geldbendy antibody assays Lack of communications technology Lack of data toallow highlevel managers and policymakers to plan and manage vaccination points ellicieray Inadequate disease uneaten:a Inadequate skills and resoutes to conduct ussd outbreak investigations Rationale, evidence, assumptions • For surreys. infer-nation is usually obtained via home-based records • For admirrstrative data. the numerator may be taken from tally sheets, but what is recorded on those tally sheets depends on what was on the health card when the chid was vaccinated • Evidence:TOD • Needed for use in finger-prick blood spots or oral fluid reduce Vit. potential to use serosurveinance and model resulting data to estimate impact • Evidence:TOD • Needed to track (and reduce the eminence of): 'Nor:louts' of vaccine. transport. fuel. or health waken • Evidence: northern Nigeria piled project? RED evaluation • Dab on population movements. urbanization etc not easily available and not matched with data on physics infrastructure (roads. eactricity eb), communications and other planing rectrirementx • Evidence: Personal experience • Constrained by due to Oeflicient use of tools. lack of skiled motivated human resources: lack of laboratory reamer:es. lack access to curative care fa sick chicken • Evidence: F Cutts Landscape analysis on surveillance for EnAGI 2D:: • Inability to determine causes of outbreak (Wire to vaconale vs vaccine failure) or root causes r rick factors • Evidence: TOO 77 EFTA01072493 Data for decision-making barriers (III) Barrier Rationale, evidence, assumptions Operations (coot.) Overall Inadequate monitoring of numbers. dianbution and maintenance of inputs Inadequate AEFI stemillanze False perception that coverage equals population protection Inadequate skins. motivation and co-ordination to relieve and use data • For heath services metrics (e.g. infrastructure. health workers. transport) • For vaccination program metrics (e.g. cold chain. vaccines. suppliet • Monitoring systems need to be integrated and adequately supervised • Evidence: IRAN retools. Cutts & O e11k report. Project Opt • Limited by same constraints as above as well as • ladt. , ' dissemination of dear definitions for AEFIs • Evidence: TOO • Need also to know vaccine effectiveness or surrogates of VE Ie vaccines stored and transported under temperatues that do inactfrara them or reduce their potency • riddance: TOO • Inadequate combined reviesn of data on larger population. inpx. outputs and impact. Wadequate use of information for action • riddance: TOO 78 EFTA01072494 Comparison of WHO and DHS for DPT3 WHO and DHS coverage estimates for DPT3 in 11 countries emaitn1 Draw. asa,ar. Data DX 04(4400. nuMlny Key observations • DHS coverage tends to be lower • OHS not influenced by administrative data 79 EFTA01072495 Advantages vaccination and coverage Disadvantages of methods to measure Data maddtalon• Disadvanuus. Rased I electronic) i an cue complete and mcorme intitimumi on cumulative vaccination claim. of individuals alb] populations fan he used to set appointment,. issue reminders and recalls. Cre of ebb:tonic rystenw could reduce tinw rpm on paper registers tout am widespread in low income COnntrICI. and often not used Need good eomp tit': c zccc, Need complete drib registry for we &nominal°. Need unique In ILLUIII/Cf throllf*IIII lift If held locally. dilficuh to track rumination of migrates If held nationally. feedbocletme at local level may b: slow Requires adequate funding and human resources Need secure ploccdurerm nuMain confidentialky Routine coport of -. accinations delivered Simple in conception Continuous infomution alkros monaoring of cumulative coverage through the year and by districhhealth facility Can he used at local kcal to track coverage and dropout rates Population denominator.. often inaccurate Priv me SOMIr ohm does not recur', Exaggeration of asses administered common le.g. double-counting of same child if home-based recoil! mislaid. inclusion of children outside target age musk or purpueful evEgeratioM Transenmion errors at each health system level when runcebosed wstemt. used Surveys _population If well conducted. can pmssate accurate information Other indicators (e.g. missed opponunilick caretaker kw-whilst:lean be assessed Involvement of health woders can to teaming copodunity lamenn etc inine)s kw multiple programs can reduce cosh. lot quality sample surreys can he used to identity health facilities and low coverage subunits ACCIOJCy of Jam depends on adequate surrey design. training. suparbion and quality control Sampling frame often based on nutdatcd census inform.uion nigh rick subgroups (e.g. migrams. street children, nuy be missed Iloarebased remit may be mitring or incomplete mil accuracy of verbal history of vaccination varies Panic ipmion rate affects reliability of mutts fallen long delays moil results arc known. Small sample sates give imprecise results: Large sample sires arc expensive and more hmewomuntinv cm. se. 4 ...•••• onn kuono 1 80 EFTA01072496 Draft conclusions on state of coverage Dora for decisionmaking Ogg.: ot challenges are: • Rape ly changing population demographics. e.g. urbar zation. changing birth rates. Want survival rates. chant:jag stonily settings • Polcal context of denorninala measurement • thmsbarnts on high.qualliy survey implementation especially in politically unstable countries. conlielaffected areas. and urban slums • Increasing cornpexity of vaccination schedule inaeases chances of errors in recording 8 compting numerator de, Ways to improve coverage estimates: • New or improved siereY methods can be developed. but wil only address parts of the problem (i.e. can reduce serection bias (though security constraints may persist), can reduce but not ekrin.the observer bias. and can airwave data management). • Fuller analysis of existing data can Sao improve coverage estimates (e.g. combining data from routine reports and surveys into models (Lassie!) • Registries may be longterm solution but are CiffiClit to implement even in righinccene countnes • %Welber measured by survey or other maws. accurate completion of primary records of vaccination is assentor lit regimes strong managervant and superrocon To decide where to invest. need to determine priorities for use of coverage data: • Asa tool to estimate poputsbon protection. coverage a limited by assumptions about •vaccine effectiveness and thus a not sufficient • Triangdate data on vaccinations with data Wen effective vaccine management assessments. surveillance. outbreak iwasligatens. and special strides (e.g. case contra slides) to obtain fuller picture of program impact • Asa tool to identify under-served populations for local (e.g. district)usa. coverage is very helpful and existing methods are adequate if implemented welt • Investment in improving recording and transmission of data on vaccinations. and strengthening managerial use and feedback of data. wil improve all methods of measurement 111==== 81 EFTA01072497 Data quality audits show 48% of countries have a poor verification factor Data from Data Quality Audits (DOA') conducted between 2002.2005 in 41 countries 40% no 2r% I Mg NM WM mainorniromitentireratimi IItn ar4iniadseigiwa.=vtiutimpimpit IIIIIIMIJIIII iiiiiJiMiliil WI II or. 0" lailliielS1 URIIIIIIIIii! hal ILMININIIII I IIII i 0,4 lin Mal 2r4 SIM § gi li t §g 11011101raMMICAMEJNI1 - . 5% MN/ CI INni 46% of countries obtained a VF (verification factor) below 80% (needed for continued GAVI support 82 EFTA01072498 Weaknesses in the information systems apparent at all levels WENN Immunization reporting system quality guidelines % of countries % of districts % of health units achieving [repeated 3 times] VSO Of computers 10 manage ellMtaltann data 103a 41 Use of drawers denominatces accordng lo year to cabman DTP3 we .A 4, Vaunts ledgers are tp )3 clota tor TT 54 r-76 _q oencoiratogs for DTP3 (*Anal wading 10 WHOO8AnlhOnS 92 WA [repeated 3 times] PubliCalkon MO immtwoz8C01 0848 B2 1 Se ',acmes ledgers are tp to date foe DIP _ .I 70 .T3 Existence of data reporting guidelines 74 89 WA reeflOsch On immunizaten laloser level it 53 t, - Integf8tOrt Min. reporting 8,18/0081 from hILIS tO fliStriCI level 61 Intagraton dem. reportng systems from dolma to national level 56 WA Existence of charnel* showing immunization partcananoe indicators -a5 63 56 Mcnaorino COPTI.3 drop cut 1810 EXitt8000 M OtiWolOOS 10 report AEFI C000CI OSIIM8401 of vaccine wastage Doncfronabrs used at national and dstncl levels woods Existence of gurdelnes to deal web laeo roponng Avaltablity Of Conant taly sheet, kg OPT Avaltablity M reports Existence avaccine ledgers :36 32 * 32 14 I3 WA [repeated 3 times] O 50 100 WA WA 4M. 59 _ 46 .) 1 r31 64 WA 60 WA WA 87 0 50 ID) WA WA W 8 .. E 65 56 0 50 100 83 EFTA01072499 However. countries have demonstrated ability to improve Verification Factors Compared performance of countries that undertook two DOAs across 2-3 years VF 10) I Ikrti+af t. Carewc,), Ounoa PM" 03A VF Curregt 00A vr Nona 1 84 EFTA01072500 Indicators to monitor immunization program performance Program Indicators component % d vaccinated cisldren (if routne reports are used. OTP3 taken as proxy) ulputs % drects with >80% OTP3 coverage in infants' % districts with (390% measles vaccine coverage in infants' % of planned outreach seasons that were conducted on schedule :uluery: % of planned fixed site sessions that were conducted on schedule Access to % of chiiiren up-to -dale (BCG and DTPIn:eel) by age 2 months ,vices (lacking 'Dropper- difference in percentage receiving DTP1f0PVI and either DTP3e0PV3 or measles actenties raCtine Use of all Percentage of children receiving all vaccines for which they are elgibe al each visit opportunities Safety Proporton of districts that have been suppled with adequate (equal or more) nurribee ite AM for all routine immunizations during the yea' igistics and Proporton of districts that had no interruption in vaccine supply' iuld chain Percentage of facilities storing vaccine at recommended temperatures Vaccine effectiveness in expected range We each vaccine everualed Transport' Klometerdvehide or motorbikeirronth thigh km • high utilization) Percent use for service deivery and service delivery support (hgher•more effective) Poficy of panned preventive maintenance (PPM) & % PPM activities conducted Full cost per km (low cost • more efficient use of vehicles/instal:dies) % expected detect disease surveillance reports recereed al national level' Sumeiltance/ ron's:ring % expected detect coverage reports received at national levee Managenwnl Country has 5year immunization plan and supervision % dregs having miapplans that include immunization actreffies' % cistricis that did >t supervisory iisit to all Health facilities in last year' 2ideder Proportion of providers who know and follow recommended guidelines. inducing those on ituncedtref simultnnecus administration. contraindications, and sale injection procedures 3 ri 85 EFTA01072501 S6 EFTA01072502 For most survey respondents, goal-setting had strong coverage component Whether as a discrete strategy or coordinating entity and from your vantage point what would you propose as the overarching goal(s) of RI investments at the foundation? Sustainability also a recurring theme in goal-setting (but spelled in many ways() Yt erep RIB ir2,1 ce."-11'=-17 improv_ xis*. *Di me4ff:tern::: . w programs wrirr' eli i plarteemr seams wheave 14 ell merlon coverage 'Size of words correspond to frequency of use across responses Note: Includes surveys completed through 1/31; will share full version on Monday 87 EFTA01072503 Survey respondents generally set four different categories of goals Improving Coverage 'cyst ©Improving the RI system and data ©Achieving health impact ORnating Founded/an goals ,,rd 10 l'eSt P,PAII0n3 • Cantle rmmstrnerent• 61, 91 owl teensy • WHO/ ntIldbin al • AI ;nail 9)% 41 WI pray Oe-,a,yriosae IndI Hixee Performame of RI wsie-rn Baling sustainable pe,th F.x.inare Ma control Wthnit an RI Vtalegy %upon, nths Ma erwing coverage al PnXialles le ellen for Mere enianewn thrower, are Palteta, *anionic., el VPOs • Cried pawl Wanes ewmaion a,y leharin • DM In all rlistentsal • Innemeniwawcw. Wanton SIM art RI • Chicken eclat one. wren of eNla boothg age.(ain posse,/ adalescorta) • Per GAM goes rerun • Greater ofitdoncy one (Wanly (V audante eIwd imemaiome neon br CO. • Swat pea ennosem • Uninbrsal PrceraT. • CoweeesxM 1.91, infant =Malt/ fates de le VPDs • wero..re Caber/ OPIX080,4 whew needed • UpdringeroaarninnasAlem • HOnxtden. Icenerlorming armlet" • WPM'" cod <non and legelas • 'lake of be unarms onlne • Icopraed program cnanagemem • Achieve eeprty n *Nemec, • Impratd *InmatesCl • Foam on WM embed 0-9 nee waCCr415 YAM' el On Moray • INIMOMINIO RIOr:terra Event/one wants to improve eeverege, but Note: Includes surveys completed through has Monet Ideas en where to leas 1131: will share full version on Monday 88 EFTA01072504 Internal and external interviews reveal key themes in where people think the foundation should engage External (n = 3)' Strong alignment on foundation's role in advocacy The (your) voice to motivate the donor community to loved in systems.' Support governments building cepaeity (and sustaushg thin the health system.' help LMlCAIIfCs get enough information to aegoasle effectively with menufactu fen.' Poacyrnalters !idea to (the co-charsl cOrrefenny... ITheigperspeetive is valuable and powerful? (2 people) One interviewee also highlighted foundation's intellectual leadership -(BIAG') is very good a! rhattenging our assuatithimutttomIlhirfield.paniculasly on togistics management.' Internal (n = 4) Strong alignment on foundation's role in advocacy and supply chainllogistics lisc the to-ct:w voce to make RI a priority_ for countries.' 'Bring partners together to work on this issue. but to do so we'd need to have some skin In the game.' 'Focus on the supply chain: (2 people) Direction less clear in data improvement and human resources • Improve immunization data.' ( 2 PesPle) • We can push others to hnorove rantrirt- • ;Success of sysavn is based on human management. we need to toothier whether tie ham a fore. and if so, bow to be MSc initurnsannagrams.at "(2peopt) I 89 EFTA01072505 Foundation investments to date that are relevant to RI 90 EFTA01072506 Ongoing efforts at the foundation have largely focused on supply barriers 'Samoa owe -er1.9y not DB conoishenti•v Domand Point of vaccination Aware. Ware I M Trailed Mall nunby Mann Ourdny eeMce & nom MAO ªr mama aeon ow mon Systam wide CWT Global: SIM • 1, pC,Si 54AM SUM AI MISE• PITT. Cit., ' fun .42.5B 135AM ,-51.2B ONO 'SID • OPO - <42%0) onqatogro vow M I.p••• PAGE 46 6) VINCE Fit. 4,14 0•144 oreina M.) - Yil•On m:IS0 4, • WC Wry ti Country: Local: sk., • 69Vimv Avow*, Yr VA.C.SA Nconf Miele rem et.VOM eaeaftacc......e.sa 19.91& 'mu pm VP, 35.3A 539M 58.3M 110AM Ergo %Man 'a OW On, • V010. WM* mar, • TrGm WI TH.I•yt PAM:0 Fawn; III II SOA5M SUM Data for decision-making ohmic stineliancoll $25M 91 EFTA01072507 Summary (.ante S2 CPRF description of PARs directly relating °woolly misled le Fa ['MO to RI PO Preliminary! An doompe. Rivalonon lo0•MPf Firq WvpnDotvo.?.... i Sue of yranl (WI 4 4 -. ,a adOreSSIM 2010 201 Whal on hemmer:O/d w' c.io Global: cohmry local Local LI NOSE Leamr, Went 0,0plite eel:ohe-4/m gedorrnaroo of (Cele* norruniyamn venom. In Ned .>nn Markyra 20002012 Phoome 2. lAaneHmom Gaol 414.1‘10 ErnbOSSUPP:CYAltin the ra..val Mmanzabon M07l0nFl trioent 32 Owl riery•WI 2011.2013 PlAnneo) & hlamr-emeM Couhry 01.0 Ronnalanal 024.000-200 WHO erman20501 )Meriulm 10 Onect Man 2011.2012 loontel Carmirrenl 8 poky Meng Olowl .0-0 Dowor43 a COM:e0hireno0 Han be 0 M andna ea:ene satiny revefloreg weans:IOLAand Heyde* 11 Proo Mall 20202011 Poem' CaTenbrool 8 pOlce seer.: n A Total funding of grants SISLIt• reeding lo Rt. -$22.7M 'Sample grants -may n0I Oe eV egeehenSite 92 EFTA01072508 Summary Smote C....fai description of PARs indirectly relating to Gently 'elms to RI PO „,„ ,,,, RI (I) Preliminary' Stu of grant Iron nescn0een 0441 Vao:rn. 1 um) ,, ,, Trawl Waal on harnessank it addresses Global! country/ local ATKI. UNICEF. Rot Global Polo Endogan Inialha pantoWHO 15573443 UNICEF it2IXIMI.anf Rotary (14061A1 122U WW1 Ten 2006. Winne SyMirrado Global PATH ewonca1on and Heath PfoRsistognIrA and Po, Cad CARA of Ts Future 34.7 meted SIte 2007.2011 RuCcfy Wm 6 LCRISIICS County Ay1O Aconeraffng. Wog, the WHO orequalkaion Foam access to wenee for to doietoons) worl0 27.0 Mersa Want 2007/011 Peirica commnront /3. polcy war, Globz4 SVRVAC Grant co deem. sunearco 22.0 mend Linda V. 20062014 Moose Ravenna WA PATTI Catelytescro nfl, OK rt. gently ad poteely obtain awns 13 40140nal-PlitAILMIal biendbROS. ana adrenal Ire 62,029,00r4 of (Okay Infar.41-T.I0 nano. taxch Me clnoS ono' Ono 11.0 Metal Slew 2003prowl SupPlY RUT° A Lorin Glob! 1.140102 In/aim Roatto muslin, enonour and sustain those telucicoom la -Sturm Alma 11.0 mon Tim 2009-2011 SmtewrOto Globe) 4149 Sortx•Ing lie tobtlishenen of nion', processes to 4nranco 0•10orco.olortrod docisica meting in wrifronficnespith 99 POW Vs> 20062014 Pow& cotmtrront & polcr were Cony PATH Evaluabln of DopcoatioCoruidgo Jot Infactots. Rogi4atory. Ecorpfnic and PrcgraInnalc Fonitilty 99 meted Sitio 2007presort ()way sante 6 0441 msnaRmon1 Local Sabin Adfocacy Of GAvi <Rum, powwow (Of Sus/Anti. Prrruniff mon Financoa 92 WSW Vb 2007.2012 FuLvnt-g 6 Pnxuanni Cony 93 EFTA01072509 Summary Want** M40 description of PARs indirectly relating to Drodly Whsle to m PO :nitro:, S:o.o RI (II) Preliminary' Soo of rant 5hon des.:,,oto,, i 9.0 i$ACe)SirenotxresviillO'snominvean4 maw SOON ludttlbeNSSN menulzab:41 200610 68 Timing pw......, venni on frsme.ork 4 add,. st s Paimar cormn, '", 4 pont wen, Global! country/ local c.4:4.ar Lon. Club 0:00.Ct 510 mar NnctfaChg &woolen lot MI and Ostabula lamb PAI VIA/Whims SA Maria Michael 201/2012 Firurcev E. PCOCUCITSII Global AMP Eglet40 a 'MOM VOOMM kir tionnunent lognhans, to OM moneresnl end tecProial MUSLIM* capiellos la developing Gantry wain* loWsics (eV* cyan tromt 4 3 Inflect Taeleem 2011.2015 SuIVY 6M 8 6 lo;oslics cower/ AnO temNei Oprobriatze poky <Mimeo No country level oackiless. town& occurala aormalon Maas* was*, co cad than Inaba erd vaccine MONIQtasnl IS Metal Siam 20111014 Pnnnr0 0 menasemord County wi'0001 Ceiba. of Lorton Dowilop loan> outdo( ornoroarce WO ItYp4CI C. mews unhanorg °won niocrc. 1D In:Wed McNeal 2000-2011 Myron Giond Tog Foto. kr Distal Nee" Promcrla a strong 1486orUlp torn for HOYS el Stale n MICA In SUSialiting TO Inman:10as frogass WM ovules 050 Indeed fAchael 20091012 PrIcalzatkn 6 poky tang County SEEDR tr4a:no cots boon lot Ina. 041;060(03d Mari 045 Insect Ppoorva 2010. prowl &xi:4y cnon 6 MOM. Loco; Tolal funding Oran° Inane* f &Ming 40 RI: -$3.592M 'Sano‘e g03014 -may n0400 Cenorenen8ht 94 EFTA01072510

Technical Artifacts (17)

View in Artifacts Browser

Email addresses, URLs, phone numbers, and other technical indicators extracted from this document.

Domainc.io
Domainludzan.in
IPv62D::
Phone15573443
Phone2466640
Phone414.1401
Phone4444444
Phone4460494
Phone6006441
Phone610-2005
Phone6464410
Phone800.1111
Tail #N220
Tail #N800
Wire RefRefresher
Wire Refreferences
Wire Refrefrigerators

Forum Discussions

This document was digitized, indexed, and cross-referenced with 1,400+ persons in the Epstein files. 100% free, ad-free, and independent.

Annotations powered by Hypothesis. Select any text on this page to annotate or highlight it.