User Guides

Standard Setting

User Guides
Standard Setting

Standard setting is a process used in educational assessment and testing to determine the minimum level of performance required to pass an exam or achieve a specific score or grade. It involves establishing the cut-off point or passing score that differentiates between those who meet the proficiency criteria and those who do not.

Practical methods for standard setting include:

  1. Angoff Method: In this approach, a panel of subject matter experts evaluates each test item and estimates the probability that a "minimally competent" examinee would answer it correctly. The average of these ratings determines the passing score.

  2. Bookmark Method: Examinees' test scores are analyzed to identify a point on the score scale that separates those who are "proficient" from those who are "non-proficient."

  3. Contrastive Groups Method: Two or more groups with different levels of proficiency are compared, and the passing score is set at the point where the performance difference between the groups is considered meaningful.

  4. Borderline Group Method: A panel of experts reviews the performance of borderline examinees who are close to the passing score and makes decisions based on their characteristics.

  5. Modified-Angoff Method: Similar to the Angoff method, but it involves group discussions and adjustments to the ratings based on group consensus.

  6. Ebel Method: Item statistics are used to identify the difficulty level of each test item, and a passing score is set based on the cumulative item difficulty.

  7. Contrastive-T Groups Method: Similar to the contrastive groups method, but it uses "T groups" that represent typical examinees, rather than contrastive groups.

  8. Extended Angoff Method: This method combines the Angoff approach with a follow-up review session, allowing experts to discuss and revise their initial judgments.

The choice of standard setting method depends on the context, the nature of the exam, available resources, and the expertise of the individuals involved in the process. Each method has its strengths and limitations, and careful consideration is required to ensure a fair and valid standard is set for the assessment

Item Analysis

User Guides
Item Analysis

Item analysis is a statistical technique used in educational and psychological testing to evaluate the quality and effectiveness of individual test items (questions). Its primary purpose is to assess how well each test item discriminates between individuals who possess the attribute being measured (e.g., knowledge, ability, or trait) and those who do not.

The main goals of item analysis include:

  1. Item Difficulty: Item difficulty refers to how many test-takers answered a particular item correctly. This helps test developers understand whether the item is too easy, too difficult, or of an appropriate level of difficulty for the target population.

  2. Item Discrimination: Item discrimination measures how well a particular item differentiates between high-performing individuals and low-performing individuals. It identifies how effective the item is at distinguishing between those who possess the attribute being tested and those who do not.

  3. Item Reliability: Item reliability indicates the consistency of an item's performance across different groups of test-takers. Items with high reliability produce consistent results across different administrations of the test.

By conducting item analysis, test developers can identify problematic items that need revision or elimination from the test, improve the overall test quality, and enhance the test's ability to measure the intended construct accurately.

Item analysis is often performed using various statistical methods, such as the point-biserial correlation, item-total correlation, and the calculation of item difficulty indices (e.g., p-value, percent-correct). These analyses help researchers and educators to refine the test and ensure its validity and reliability.

Privacy Policy

Privacy Policy

Last updated: 1 Aug 2023

This Privacy Policy describes how [Rubritic] ("we," "us," "our") collects, uses, and shares personal information when you visit [www.rubritic.com] (the "Website").

By accessing and using the Website, you agree to the terms of this Privacy Policy. If you do not agree with the practices described in this Privacy Policy, please do not use the Website.

Information We Collect

  • Personal Information: We may collect personal information such as your name, email address, postal address, and phone number when you voluntarily provide it to us. For example, you may provide us with your personal information when you sign up for a newsletter, submit a contact form, or make a purchase through the Website.

  • Non-Personal Information: We may also collect non-personal information such as your IP address, browser type, operating system, and referring website. This information is collected automatically through the use of cookies and other tracking technologies.

Use of Information

We may use the information we collect for various purposes, including but not limited to:

  • Providing and maintaining the Website.
  • Responding to your inquiries and fulfilling your requests.
  • Sending you newsletters, updates, and promotional materials (if you have opted to receive them).
  • Processing and completing transactions, including purchases made through the Website.
  • Improving our products and services.
  • Understanding how users interact with the Website to enhance its functionality and user experience.
  • Complying with legal obligations and enforcing our rights.

Cookies and Tracking Technologies

The Website uses cookies and similar tracking technologies to collect and store certain information automatically. Cookies are small files that are placed on your device when you access and use the Website. They help us analyze user behavior, remember user preferences, and provide a more personalized experience.

You can control the use of cookies at the individual browser level. If you prefer not to accept cookies, you can adjust your browser settings to block or delete them. However, please note that blocking cookies may impact the functionality of the Website.

Third-Party Services

We may use third-party service providers to assist us in various aspects of our operations, such as website hosting, analytics, and payment processing. These service providers may have access to your personal information, but they are contractually obligated to keep it confidential and use it only for the purposes specified by us.

Data Security

We take reasonable measures to protect your personal information from unauthorized access, disclosure, alteration, or destruction. However, please be aware that no method of transmission over the internet or electronic storage is completely secure, and we cannot guarantee the absolute security of your data.

Your Rights

You have certain rights regarding your personal information, including the right to access, correct, update, and delete your data. If you wish to exercise any of these rights, please contact us using the contact information provided below.

Changes to This Privacy Policy

We may update this Privacy Policy from time to time to reflect changes in our practices or for other operational, legal, or regulatory reasons. The updated version will be posted on this page with the "Last updated" date revised accordingly. We encourage you to review this Privacy Policy periodically to stay informed about how we are protecting your information.

Contact Us

If you have any questions or concerns regarding this Privacy Policy or our data practices, please contact us at:

info@rubritic.com