E-Metrics: Lessons Learned from the ARL E-Metrics Project,

E-Metrics: Lessons Learned from the ARL E-Metrics Project, Challenges and Opportunities Martha Kyrillidou 226th American Chemical Society National Meeting CINF Section B, Jacob K. Javits Convention Center, Room 1E20 September 8, 2003 New York, NY Association of Research Libraries www.arl.org Association of Research Libraries Mission: Shaping and influencing factors affecting the future of Research Libraries in the process of scholarly communication Members: 124 major research libraries in North America Users: More than 3 million students and faculty served Service measures: 75 million circulations 17 million reference transactions 42,000 FTE staff employed Members total expenditures are over $3.2 billion Association of Research Libraries www.arl.org ARL Library Expenditures 2001-02 114 ARL University Libraries Other Operating $353,755,527 14% Library Materials $954,401,999 39% Total Salaries $1,143,942,869 46%

Association of Research Libraries Contract Binding $25,168,718 1% www.arl.org Graph 2 Monograph and Serial Costs in ARL Libraries, 1986-2002 250% Avg. Annual % Change Serial Expenditures (+227%) 200% 7.7% Serial Expenditures 7.7% Serials Purchased 0.6% Monograph Unit Cost 3.6% Monograph

Expenditures 3.1% 150% % Change Since 1986 Serial Unit Cost Serial Unit Cost (+227%) 100% Monograph Unit Cost (+75%) CPI (+64% ) 50% Monographs Purchased -0.3% CPI 3.2% Monograph Expenditures (+62%) Serials Purchased (+9%) 0% -50% 1986

Monographs Purchased (-5%) 1988 1990 1992 1994 1996 1998 2000 2002 Source: ARL Statistics 2001-02 , Association of Research Libraries, Washington, D.C. Association of Research Libraries www.arl.org Graph 4 Expenditure Trends in ARL Libraries, 1986-2002 Serial Expenditures (+227%) 230% Avg. Annual % Change Library Materials (+184%) 200%

Serial Expenditures 7.7% Monograph Expenditures 3.1% Total Materials Expenditures 6.7% Total Salary Expenditures 4.7% Operating Expenditures 4.2% 50% Total Library Expenditures 5.1% 20% CPI 3.2% % Change Since 1986 170%

TOTAL (+120%) 140% Total Salaries (+108%) 110% Operating Expenditures (+92%) 80% CPI (+64%) Monograph Expenditures (+62%) -10% 1986 1988 1990 1992 1994 1996 1998 2000 2002 Source: ARL Statistics 2001-02 , Association of Research Libraries, Washington, D.C.

Association of Research Libraries www.arl.org LibQUAL+ 2003 Colleges or Universities Library Use Association of Research Libraries www.arl.org Expenditures for Electronic Resources 19.54% of the library materials budget Association of Research Libraries www.arl.org Total Electronic Serials Expenditures, 1995-2002 180,000,000 160,000,000 140,000,000 120,000,000 100,000,000 80,000,000 60,000,000 40,000,000 20,000,000 1995

1996 1997 1998 1999 Year Association of Research Libraries www.arl.org 2000 2001 2002 Yearly Increases inAverage Electronic Resources and Total Library Materials Expenditures 50 47.46% 45 40 37.28% 32.69% 35 27.06% 30 23.22% 24.29% 24.81%

22.5% 25 20 12.86% 15 8.48% 10 9.18% 5.53% 4.18% 5 9.12% 6.35% 5.92% 3.4% 4.32% 0 1992-93 1993-94 1994-95 1995-96 1996-97 Increase in Average Library Materials Expenditures Association of Research Libraries

1997-98 1998-99 1999-2000 2000-01 Increase in Average Electronic Resources Expenditures www.arl.org 2001-02 Developing measures and evaluation techniques for networked services will take time, effort, and on-going learning on everyones part but we must begin now. (Carla Stoffle, University of Arizona) We not only need to measure things in new ways but we also need to measure new things. (Sherrie Schmidt, Arizona State University) Association of Research Libraries www.arl.org Data Collection How/What to Collect Sources of Data Systems Based OPAC, Web, Vendor Data (Canned Reports, Other Reports) Electronic/Web Resource (costs & use) Non-Systems (manual) Library Counts o o

o o o Reference Activities ILL Transactions Document Delivery Turnstile Counts Other Manual Counts Qualitative Data Sources (Surveys, Focus Groups, Process Analysis) Association of Research Libraries www.arl.org Data Examples Source: TUG (Tri-University Group of Libraries - University of Guelph, Wilfrid Laurier University & University of Waterloo) SilverPlatter ERL (Electronic Reference Library) Usage Statistics Association of Research Libraries www.arl.org Data Examples Example Consortia CSA Database Use Data Network Databases 1999/2000 - TUG CSA Use Vendor Database Biological Sciences CSA CSA CSA CSA CSA CSA Searches UG Biological Sciences

Biological Digest MEDLINE Plant Science Recent References Related to Your Search (New) Web Resources Related to Your Search (New) Total Environmental Sciences & Polution Mgmt. Collection CSA CSA CSA CSA CSA Conference Papers Index Environmental Engineering Abstracts Environmental Sciences & Polution Mgmt. Risk Abstracts TOXLINE Total Sociological Abstracts Collection CSA CSA CSA CSA ERIC Sociological Abstracts Social Services Abstracts Recent References Related to the Social Sciences (New) Web Resources Related to the Social Sciences (New) CSA Total Grand Total

CSA % UG Searches UW % UW Searches Searches % WLU % WLU - Remote Remote CSA Tolal % Total Use 206,318 134,607 112,601 46,245 78.1% 80.2% 72.3% 76.8% 46,398 26,175 32,489 11,230 17.6% 15.6% 20.9% 18.6% 2,691 2,019 3,812 907

1.0% 1.2% 2.4% 1.5% 8,701 5,021 6,814 1,871 3.3% 3.0% 4.4% 3.1% 264,108 167,822 155,716 60,253 21.7% 13.8% 12.8% 4.9% 213,480 213,578 926,829 74.7% 74.7% 76.0% 58,422 58,533 233,247 20.4% 20.5% 19.1%

5,310 5,317 20,056 1.9% 1.9% 1.6% 8,663 8,667 3.0% 3.0% 3.3% 285,875 286,095 23.4% 23.5% 64.8% 35,616 17 123,006 0 47,809 206,448 71.7% 60.7% 67.4% 0.0% 75.0% 69.8% 11,241 2 49,744 1 13,240 74,228

22.6% 7.1% 27.3% 14.3% 20.8% 25.1% 801 0 2,572 0 728 4,101 1.6% 0.0% 1.4% 0.0% 1.1% 1.4% 37,085 36,169 57,075 72.4% 59.6% 73.4% 10,361 15,095 8,954 20.2% 24.9% 11.5% 2,128 7,408 8,479

57,075 64.1% 20,148 22.6% 57,075 244,479 1,377,756 64.1% 66.5% 73.1% 20,148 74,706 382,181 22.6% 20.3% 20.3% 39,737 2,000 9 7,214 6 1,953 1,219,869 49,658 28 182,536 7 63,730 11,182

4.0% 32.1% 4.0% 85.7% 3.1% 3.8% 295,959 16.8% 0.0% 61.7% 0.0% 21.5% 15.7% 4.2% 12.2% 10.9% 1,678 2,030 3,285 3.3% 3.3% 4.2% 51,252 60,702 77,793 13.9% 16.5% 21.2% 8,479 9.5% 3,285

3.7% 88,987 24.2% 8,479 34,973 59,130 9.5% 9.5% 3.1% 3,285 13,563 64,482 3.7% 3.7% 3.4% 88,987 367,721 1,883,549 24.2% 19.5% Source: TUG (Tri-University Group of Libraries - University of Guelph, Wilfrid Laurier University & University of Waterloo) CSA (Cambridge Scientific Abstracts) Usage Statistics Association of Research Libraries www.arl.org Recommended Statistics & Measures Patron Accessible Electronic Resources (R1-3)

Use of Networked Resources & Services (U1-5) Expenditures for Networked Resources & Related Infrastructure (C1-3) Library Digitization Activities (D1-3) Association of Research Libraries www.arl.org Patron Accessible Electronic Resources R1 Number of electronic full-text journals R2 Number of electronic reference sources R3 Number of electronic books Association of Research Libraries www.arl.org Use of Networked Resources & Related Infrastructure U1 Number of electronic reference transactions U2 Number of logins (sessions) to electronic databases U3 Number of queries (searches) in electronic databases U4 Items requested in electronic databases U5 Virtual visits to librarys website and catalog Association of Research Libraries

www.arl.org Expenditures for Networked Resources & Related Infrastructure C1 Cost of electronic full-text journals C2 Cost of electronic reference sources C3 Cost of electronic books C4 Library expenditures for bibliographic utilities, networks & consortia C5 External expenditures for bibliographic utilities, networks & consortia Association of Research Libraries www.arl.org Library Digitization Activities D1 Size of library digital collection D2 Use of library digital collection D3 Cost of digital collection construction & management (Collecting these data requires staff familiar with the digital environment.) Association of Research Libraries www.arl.org The E-Metrics Assessment Implementation Loop Identify Tasks, Data & Needs Data Collection

Mission/Purposes Objectives Managing Information Preparation Reporting, Learning & Implementing Preparation for Assessing Network Services is as Important as the Assessment Itself ! Association of Research Libraries www.arl.org Mind the Gap Mine the Gap Association of Research Libraries www.arl.org Thank you [email protected] Association of Research Libraries www.arl.org

Recently Viewed Presentations

  • 7 Y 8 DE FEBRERO Para Empezar Contesten

    7 Y 8 DE FEBRERO Para Empezar Contesten

    The conjugation for commands in the tú form is the EXACT same conjugation as the usted, él or ella.***Do not add the opposite vowel!***Ejemplos:¡Come!¡Duerme!¡Camina! Irregulares afirmativos haz
  • Teaching and Learning Elementary

    Teaching and Learning Elementary

    If any "Day 2" courses are taken in combination with a Math Materials Training, individuals can earn 1 AEA License Renewal or Drake EDEX Credit. If taken in conjunction with a Math Materials training, participants can get AEA/Drake EDEX Credit....
  • This is Post- Classical China

    This is Post- Classical China

    This is Post- Classical China. AP World- Sui, Tang, Song. Tang Dynasty618-907 CE. Golden age of Imperial China. Cosmopolitan society. Buddhism continued to Rise (BELIEF CHANGE) Founder: Li Yuan (dynastic duke of Tang) Expanded and Consolidated Empire.
  • Quiz time! - intranet.holgate-ac.org.uk

    Quiz time! - intranet.holgate-ac.org.uk

    An Inspector Calls: Who is the first character we hear about being involved in the cause of Eva Smith's suicide? ... quotes . accurate. use of subject terminology. Challenge: perceptive. understanding, judicious. range of quotes with . sophisticated.
  • קטרת - Amazon Web Services

    קטרת - Amazon Web Services

    came into Peter's house, He saw his wife's mother lying sick with a fever. He touched her hand, and the fever left her. She got up and served Him. When evening came, they brought to Him many possessed with demons.
  • NEXTEL 2002 Service Improvement Plan August 29, 2002 - Verizon

    NEXTEL 2002 Service Improvement Plan August 29, 2002 - Verizon

    With TAXI directly linking a company's application to Verizon's backend, no need to train on the Verizon's application (VTAG or LSI-TA). All work performed on customer's own application. Enhancement requests for items outside industry standards will be managed by the...
  • Enchanted Care Kids Campus Summer Camp-Summer 2014 New

    Enchanted Care Kids Campus Summer Camp-Summer 2014 New

    Summer Camp 2014. WELCOME. 4394 Davidson Road Hilliard, Ohio 43026| (877)959-3739. Summer Camp offers an experience that is unforgettable! During the summer, campers jump into action, participating in exciting sports programs, exploring nature, becoming involved in performing and creative arts,...
  • The Torah

    The Torah

    These books are called: Genesis, Exodus, Leviticus, Numbers and Deuteronomy. When Jewish people talk about the Torah, they sometimes include other important books written by people to help explain the Jewish laws. What's in the Torah? The Torah is a...