{"id":113,"date":"2025-04-10T00:09:46","date_gmt":"2025-04-10T00:09:46","guid":{"rendered":"https:\/\/eportfolio.ericaleff.io\/?page_id=113"},"modified":"2025-04-15T17:03:11","modified_gmt":"2025-04-15T17:03:11","slug":"competency-n","status":"publish","type":"page","link":"https:\/\/eportfolio.ericaleff.io\/index.php\/competency-n\/","title":{"rendered":"Competency N"},"content":{"rendered":"

Use assessment measures to evaluate programs and services.<\/p><\/blockquote>\n

\n

Introduction<\/h1>\n

If information organizations do not evaluate their programs and services, there is no way to know how they can be improved. In a society where \u201ctimes are changing and the very existence of physical libraries is being questioned,\u201d evaluation is more important than ever to ensure services are efficient and cost-effective (Cassell & Hiremath, 2023, p. 395). Without assessing how the organization is working, it cannot be improved upon. Evaluations must use measurable criteria, or there would be no way of knowing how programs are performing. This is similar to a creating a \u201cSMART\u201d goal: a goal that is specific, measurable, achievable, relevant, and time-bound.<\/p>\n

Assessment<\/h2>\n

Over the past few decades, assessment has become more common in information organizations. Ryan (2006) defines assessment (in a library setting specifically) as \u201cany activities that seek to measure the library\u2019s impact on teaching, learning and research as well as initiatives that seek to identify user needs \u2026 with the overall goal being the data-based and user-centered continuous improvement of our collections and our services.\u201d Assessment can be thought of as a cycle: developing assessment questions or objectives, identifying assessment methods and data gathering, analyzing and interpreting data in terms of the assessment question or objective, integrating results into operational and strategic planning, and disseminating results \u2014 then the cycle can continue from the beginning (Bakkalbasi, 2017, p. 215). Assessment is an ongoing process.<\/p>\n

According to Cassell & Hiremath (2023), the most used methods of assessment are, in order of simplest to most complex, suggestion boxes, surveys, interviews, observations, focus groups, case studies, and user experience (p. 397). Quantifiable data can make a big difference when seeking external support or funding. Since this can be time consuming and expensive, an information organization might want to consider buying a toolkit like LibQUAL, a library user survey tool which can \u201cidentify best practices, analyze deficits, and effectively allocate resources\u201d (LibQUAL, n.d.).<\/p>\n

Measurable Criteria<\/h2>\n

Outcomes need to be measurable, otherwise there is no way to know if progress is being made. Rubin (2006) defines an indicator (another term for criteria in this instance) as \u201ca statistic that summarizes the user\u2019s achievement of an outcome\u201d (p. 33). More specifically, an indicator \u201chas a verb, an object for the verb, a quantity, and a time frame\u201d (Rubin, 2006, p. 34). For example, if a desired outcome for a program is \u201cparticipants learn of new job or career opportunities,\u201d its indicator could be, \u201cparticipant lists four more job options after the program than before the program\u201d (p. 34).<\/p>\n

Some organizations have standardized guidelines or criteria that can be used by information organizations. The Reference and User Services Association (RUSA) offers guidelines for the behavioral performance of \u201clibrary workers in reference and information services, in all types of libraries, who answer informational questions or conduct reference interviews\u201d (RUSA, 2023). An example guideline is approachability, which is important to maintaining a welcoming atmosphere. An approachable library worker meets criteria like \u201ccan be easily identified as a staff member\u201d and \u201cavoids jargon and clarifies confusing terminology.\u201d The International Organization for Standardization (ISO) publishes standards for a wide range of sectors, and one of their standards, ISO 11620:2023, \u201cInformation and documentation \u2014 Library performance indicators,\u201d is designed for assessing libraries of all kinds.<\/p>\n

Evidence<\/h1>\n

Artifact 1<\/h2>\n

Assignment:<\/strong> Comparative Analysis of Major Subscription Databases: JSTOR and Project MUSE<\/a>
\nCourse:<\/strong> INFO 210, Reference and Information Services
\nDescription:<\/strong> This was a group assignment that tasked us with comparing two major databases, JSTOR and Project MUSE. We were to analyze the databases from the point of view of a small library with limited financial resources, so a careful examination of what to spend money on would be necessary. We were given specific criteria to analyze the databases: scope, quality of content, accuracy, currency, authority, ease of use, arrangement, and appropriateness.<\/p>\n

This assignment demonstrates my ability to evaluate services using criteria. In addition to some of the overall writing and editing of the report, my main contribution to this assignment was the section about the ease of use criteria. According to Cassell & Hiremath (2018), \u201cthe most relevant factors [for ease of use] are whether the program is easy to search and how quickly it responds to commands or queries,\u201d as well as if it allows Boolean operators, has basic and advanced search capabilities, whether it is easy to browse, and whether it has \u201cHelp\u201d or \u201cHow to\u201d sections (p. 352). Through testing, I found that JSTOR had a better support page, allowed Boolean operators in text searches, had a Help button, and loaded search results faster. Thus, I was able to determine that JSTOR was the better option for our library based on ease of use.<\/p>\n

Artifact 2<\/h2>\n

Assignment:<\/strong> Unit 2 Discussion Post<\/a>
\nCourse:<\/strong> INFO 210, Reference and Information Services
\nDescription:<\/strong> One part of this three-part discussion assignment asked me to perform a content evaluation for a website of my choosing using provided criteria. The criteria fell into the categories of first look, information providers, information currency, information quality, and further information. At the end, I had to tally up whether each criteria applied and rate the website\u2019s usefulness overall.<\/p>\n

I chose to evaluate a local art museum\u2019s website. I found that the website was overall very useful because it met criteria like having contact information, being updated frequently, linking to other currently working sites, being well organized, and being free of bias. Using the evaluation criteria also highlighted the website\u2019s weaknesses, a lack of information about pages\u2019 authors and no revision dates. Since those weaknesses were minor and few in number compared to the number of criteria it met.<\/p>\n

Artifact 3<\/h2>\n

Assignment:<\/strong> Reference and Information Services Interactions<\/a>
\nCourse:<\/strong> INFO 210, Reference and Information Services
\nDescription:<\/strong> For this assignment, I needed to prepare two questions to ask reference librarians at one virtual and one in-person library. I used the RUSA guidelines to analyze the reference interviews, focusing on the criteria of approachability, interest, listening, searching, and follow-up (Cassell & Hiremath, 2018, p. 25-26). I also used the hidden observation method, meaning I acted as a patron asking a reference question and not an MLIS student conducting an evaluation. I used the unobtrusive observation questions worksheet to guide my thoughts as well (p. 405).<\/p>\n

This demonstrates my ability to evaluate reference services based on established guidelines. Both experiences were overall positive for me, even though there were some actions I wish the librarians had taken. I was able to connect both visits to the guidelines and questions from the text while having successful reference experiences. The criteria helped guide my understanding of what to look for.<\/p>\n

Conclusion<\/h1>\n

In the future, I plan to utilize these skills to evaluate how my information organization is performing. I will remain current by keeping up with organizations like RUSA that publish guidelines, as well as professional development like the American Library Association\u2019s webinars on evaluating services.<\/p>\n

References<\/h1>\n

Bakkalbasi, N. (2017). Assessment and evaluation, promotion, and marketing of academic library services. In T. Gilman (Ed.), Academic Librarianship Today<\/em> (pp. 211-221). Rowman & Littlefield.<\/p>\n

Cassell, K. A., & Hiremath, U. (2018). Reference and information services: An introduction<\/em> (4th ed.). ALA Neal-Schuman.<\/p>\n

Cassell, K. A., & Hiremath, U. (2023). Reference and information services: An introduction<\/em> (5th ed.). ALA Neal-Schuman.<\/p>\n

LibQUAL. (n.d.). Survey FAQs<\/em>. https:\/\/www.libqual.org\/about\/faq_survey<\/a><\/p>\n

Reference and User Services Association [RUSA]. (2023). Guidelines for behavioral performance of reference and information service providers<\/em>. American Library Association. https:\/\/www.ala.org\/rusa\/resources\/guidelines\/guidelinesbehavioral<\/a><\/p>\n

Rubin, R. J. (2006). Demonstrating results: Using outcome measurement in your library<\/em>. American Library Association.<\/p>\n

Ryan, P. (2006). About<\/em>. Library Assessment. https:\/\/web.archive.org\/web\/20170920081259\/http:\/\/libraryassessment.info\/?page_id=7<\/a><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Use assessment measures to evaluate programs and services. Introduction If information organizations do not evaluate their programs and services, there is no way to know how they can be improved. In a society where \u201ctimes are changing and the very existence of physical libraries is being questioned,\u201d evaluation is more important than ever to ensure … Read moreCompetency N<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-113","page","type-page","status-publish"],"_links":{"self":[{"href":"https:\/\/eportfolio.ericaleff.io\/index.php\/wp-json\/wp\/v2\/pages\/113","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/eportfolio.ericaleff.io\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/eportfolio.ericaleff.io\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/eportfolio.ericaleff.io\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/eportfolio.ericaleff.io\/index.php\/wp-json\/wp\/v2\/comments?post=113"}],"version-history":[{"count":2,"href":"https:\/\/eportfolio.ericaleff.io\/index.php\/wp-json\/wp\/v2\/pages\/113\/revisions"}],"predecessor-version":[{"id":129,"href":"https:\/\/eportfolio.ericaleff.io\/index.php\/wp-json\/wp\/v2\/pages\/113\/revisions\/129"}],"wp:attachment":[{"href":"https:\/\/eportfolio.ericaleff.io\/index.php\/wp-json\/wp\/v2\/media?parent=113"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}