Common Education Data Standards (CEDS) Supporting Assessment Systems

Common Education Data Standards (CEDS) Supporting Assessment Systems

Common Education Data Standards (CEDS) Supporting Assessment Systems Development 26th Annual Management Information Systems [MIS] Conference February 14, 2013 Washington, DC Copyright IMS Global and SIF Association Overview Need What is AIF Status Demonstration Prototypes Discussion and Questions Copyright IMS Global and SIF Association Created by Wordle.net Copyright IMS Global and SIF Association Need Standards Confusing

Assessment RTTA and Consortia Formative Accountability Inform Instruction Stock photo. Planning & blueprinting Item types Content development & universal design Learning standard alignment Assessment Lifecycle Psychometric analysis Equating Score tables - scaling, norming Performance levels / cut scores Field test analysis

Post-Test Aligning results with Administration curriculum / instruction Program and teacher effectiveness Individual reporting Diagnostic reporting Informing & personalizing instruction Performance on standards Dashboard / summary reporting Aggregation / disaggregation Exchanging results / data Content and data reviews Test form construction Field testing Item banking & statistics Content exchange / interoperability Administration planning & scheduling Registration, assignment, Form sampling Online infrastructure readiness assessment Pre-Test Pre-session planning Administration (paper / online) & setup Alternate form assignment Content

Development Assessment Life Cycle Reporting Scoring Computer scoring Professional scoring Algorithmic (AI) scoring Portfolio scoring Sub test / strand scoring Test form delivery Platform (paper, online, mobile) presentation Item content & tools Adaptive testing Test Response collection Administration Proctoring controls Form content security Desktop security Accessibility

Testing anomalies Attemptedness Performance levels Scaling / norming Growth scores Range finding What is AIF? Systemic view of an assessment system and applications Demonstrates points of interoperability between applications within system Outlines the data model and transport Copyright IMS Global and SIF Association Assessment Platform Main Components APIP Assessment Creation & Management System (ACMS) APIP APIP Assessment Delivery System (ADS) Assessment Score APIP Processing System (ASPS) SIF

APIP Assessment Reporting System (ARS) ? SIF LOCAL Systems REGIONAL Systems SIF STATE Systems Learning Standards Assessment Platform Sub-Components 22 22 1 Assessment Creation & Management System (ACMS) Test Banking 20 Assessment Delivery System (ADS) 3 4

Assessment Score 6 Processing System (ASPS) Assessment Presentation & Session Management System (APSMS) Adaptive Engine Assessment Reporting System (ARS) Assessment Scoring Analytics System (ASAS) 9 PNP Assessment Registration & Administration System (ARAS) Assessment Analytics System (AAS) 18 17

2 Item Banking Assessment Scoring Management System (ASMS) 11 8 19 Assessment Results Operational Reporting (AROR) 13 12 Assessment Data Warehouse (ADW) 21 15 10 14

16 PNP LOCAL (LEA/School) SIS, LMS, Gradebook, Reporting System REGION STATE / Consortia SLDS, Accountability/AYP, Growth USDoE / EDFacts Status Use cases outlined Elements complete Public review complete Prototype demonstrations complete Best practice document complete Available on ceds.ed.gov/aif.aspx Demonstration Pilots Logical and Physical Testing Arrow 1 Arrow 10

Arrow 14 Arrow 1 A s s e s s m e n t P latfo rm-CSoumb p o n e n ts Item Bank to Item Bank Learning Standards 22 22 1 Assessment Creation & Management System (ACMS) Test Banking 20 Assessment Delivery 4 System (ADS) 3 Assessment Score 6 Processing System (ASPS) Assessment Presentation & Session Management System (APSMS) Adaptive

Engine Assessment Reporting System (ARS) Assessment Scoring Analytics System (ASAS) 9 PNP Assessment Registration & Administration System (ARAS) Assessment Analytics System (AAS) 18 17 2 Item Banking Assessment Scoring Management System (ASMS) 11

8 19 Assessment Results Operational Reporting (AROR) 13 12 Assessment Data Warehouse (ADW) 21 15 10 14 16 PNP LOCAL (LEA/School) SIS, LMS, Gradebook, Reporting System REGION STATE / Consortia SLDS, Accountability/AYP, Growth USDoE / EDFacts

Arrow 1 Diagram Assessment Creation & Management System (ACMS) Item Bank Admin Consortia Item Banks Test Banking Item Banking Assessment Delivery System (ADS) Assessment Registration & Administration System (ARAS) Assessment Presentation & Session Management System (APSMS) Assessment Score Processing System (ASPS) Assessment Scoring Analytics System (ASAS) Assessment Scoring Management System (ASMS) Assessment Reporting System (ARS) Assessment Results Operational Reporting (AROR) Assessment Data Warehouse (ADW) Assessment Analytics System (AAS) 10 Item Bank Interoperability State Item Banks Local Item Banks Author or Psychometrician

Arrow 1 Test Scenario Scenario Description The purpose of this scenario is to demonstrate assessment items moving from an item authoring system to an item bank or from one item bank to another. This scenario covers only assessment items moving from an item authoring system to an item bank. A consortium has secured item authoring system A. This Item authoring system will not house the items; it is simply a means for item creation. The items will reside in item banking system B. Item authoring system A has created the assessment items and the editing and revision cycle has been complete. Item authoring system A is ready to send the items to item banking system B for storage and assessment instrumentCopyright creation. IMS Global and SIF Association Arrow 1 Test Scenario Contd Test Scenario Components Required Item authoring system Item banking system Pre-Condition Assessment content (items, instruments, etc.) is ready to be transferred in the sending item bank. Post-Conditions Content is now ready for use including reviews, edit, extensions, assessment instrument creation, passing of instruments to delivery system, etc. Copyright IMS Global and SIF Association Arrow 1 Process Flow Copyright IMS Global and

SIF Association Arrow 10 A s s e s s m e n t P la tfo-Cr mo mS up bo n e n t s Assessment Registration Learning Standards 22 22 1 Assessment Creation & Management System (ACMS) Test Banking 20 Assessment Delivery 4 System (ADS) 3 Assessment Score 6 Processing System (ASPS) Assessment Presentation & Session Management System (APSMS) Adaptive

Engine Assessment Reportin g System (ARS) Assessment Scoring Analytics System (ASAS) 9 PNP Assessment Registration & Administration System (ARAS) Assessment Analytics System (AAS) 18 17 2 Item Banking Assessment Scoring Management System (ASMS) 11 8

19 Assessment Results Operational Reporting (AROR) 13 12 Assessment Data Warehouse (ADW) 21 15 10 14 16 PNP LOCAL (LEA/School) SIS, LMS, Gradebook, Reporting System REGION STATE / Consortia SLDS, Accountability/AYP, Growth USDoE / EDFacts

Copyright IMS Global and SIF Association Arrow 10 Diagram Assessment Creation & Management System (ACMS) Test Banking Item Banking Test Coordinator or Teacher Local SIS or LMS Assessment Delivery System (ADS) Assessment Registration & Administration System (ARAS) Assessment Presentation & Session Management System (APSMS) Assessment Score Processing System (ASPS) 20 - Registration Local Data Admin or Teacher State SLDS or Info System Consortia Info Systems State Data Admin Assessment Scoring Analytics System (ASAS) Assessment Scoring Management System (ASMS)

Assessment Reporting System (ARS) Consortia Data Admin Assessment Results Operational Reporting (AROR) Assessment Data Warehouse (ADW) Assessment Analytics System (AAS) Copyright IMS Global and SIF Association Arrow 10 Test Scenario Scenario Description This scenario describes the necessary components for an assessment registration. This scenario covers student demographic, teacher, hierarchy and PNP information. A consortium is ready to give an assessment. The student, school, LEA, PNP and teacher information have already been entered into the SIS or data warehouse. Assessment registration and administration system A pulls over all of the necessary information from the SIS or data warehouse B. The students are then assigned to a specific administration of an assessment. The registration and administration information is then passed from the assessment registration and administration system A to the assessment delivery system C. An alternate scenario would be that the PNP information is entered into the registration system after the information has been pulled over from the SIS or data warehouse. Copyright IMS Global and SIF Association Arrow 10 Test Scenario Contd Test Scenario Components Required Student information system or data warehouse that houses all of

the necessary information for registration Assessment registration and administration system Assessment delivery system Pre-Condition All of the student, school, LEA and teacher information have been entered into the SIS and/or Data Warehouse. An administration of an assessment(s) has been identified. Post-Conditions The students are registered for a specific administration(s) of an assessment. Copyright IMS Global and SIF Association Arrow 10 Process Flow Copyright IMS Global and SIF Association Arrow 14 A sse ssm e n t P latfo rm -CS uo bm p o n e n ts Reporting System to Data Warehouse Learning Standards 22 22 1 Assessment Creation & Management System (ACMS) Test Banking

20 Assessment Delivery 4 System (ADS) 3 Assessment Score 6 Processing System (ASPS) Assessment Presentation & Session Management System (APSMS) Adaptive Engine Assessment Reporting System (ARS) Assessment Scoring Analytics System (ASAS) 9 PNP Assessment Registration & Administration System (ARAS) Assessment

Analytics System (AAS) 18 17 2 Item Banking Assessment Scoring Management System (ASMS) 11 8 19 Assessment Results Operational Reporting (AROR) 13 12 Assessment Data Warehouse (ADW)

21 15 10 14 16 PNP LOCAL (LEA/School) SIS, LMS, Gradebook, Reporting System REGION STATE / Consortia SLDS, Accountability/AYP, Growth USDoE / EDFacts Copyright IMS Global and SIF Association Arrow 14 Diagram Assessment Creation & Management System (ACMS) Test Banking Item Banking Assessment Delivery System (ADS) Assessment Registration & Administration System (ARAS) Assessment Presentation & Session Management System (APSMS) 40 Distribute Results (local)

Local SIS or LMS Assessment Score Processing System (ASPS) Assessment Scoring Analytics System (ASAS) 120 Distribute Summary (local) Local Data Admin or Teacher LEA Information or Reporting System Assessment Scoring Management System (ASMS) LEA Data Admin Assessment Reporting System (ARS) Assessment Results Operational Reporting (AROR) Assessment Data Warehouse (ADW) 50 Distribute Results (state) Assessment Analytics System (AAS) 130 Distribute Summary (State) State SLDS or Info System

State Data Admin Consortia Information or Reporting System Consortia Data Admin Copyright IMS Global and SIF Association Arrow 14 Test Scenario Scenario Description The purpose of this scenario is to demonstrate sending assessment results to the SEA from the Consortium administered assessment. The consortium has administered an assessment. The assessment results system A has received and compiled all information based upon the assessment. Assessment results system A compile, packages and disseminates the information to the SEA data warehouse B. Copyright IMS Global and SIF Association Arrow 14 Test Scenario Contd Test Scenario Components Required Assessment results system State data warehouse or reporting system Pre-Condition Assessment results are available and have been collected so that summaries can be produced. Post-Conditions The state system has the results loaded. Copyright IMS Global and SIF Association

Arrow 14 Process Flow Copyright IMS Global and SIF Association Data Available by Entity Assessment Family Assessment Assessment Form Assessment Form Section Assessment Form Subtest Assessment Subtest Result Assessment Performance Level Assessment Item Assessment Item Possible

Response Assessment Item Response Assessment Item Rubric Assessment Participant Session Learner Action Assessment Administration Assessment Registration Assessment Session Organization Registration Accommodation Person Achievement Evidence Achievement Learning Goal Learning Assignment Learning Resource Learning Resource Learner Activity Learning Standard Document Learning Standard Item Competency Item_Competency Set

Competency Set Learning Standard Item Grade Level Assessment Levels for Which Designed Assessment Form Subtest Levels for Which Designed Copyright IMS Global and SIF Association Documentation Assessment Interoperability Framework Definitions and Requirements Use Cases for the Assessment Interoperability Framework Data Elements Best Practices Demonstration Prototype Copyright IMS Global and SIF Association Work Moving Forward Continue to evolve the technical standard within IMS and SIF respectively and reflect back to CEDS Implementation Additional pilots API and transport Certification Copyright IMS Global and SIF Association Contact Jill Abbott, CEO Abbott Advisor Group

[email protected] Rob Abel, CEO IMS Global Consortium [email protected] Larry Fruth, CEO SIF Association [email protected] All current documentation can be found at http://ceds.ed.gov/aif.aspx Assessment Interoperability Framework (AIF)

Recently Viewed Presentations

  • Metric System - Carl Schurz High School

    Metric System - Carl Schurz High School

    Length Meter (m) Mass Gram (g) Volume Liter (L) Temperature °C Metric Prefixes Common prefixes from large to small: kilo (k) - 1000 centi (c )- 1/100th milli (m)- 1/1000th We can add these prefixes before any of our basic...
  • QAD Enterprise Edition Segregation of Duties Presented By:

    QAD Enterprise Edition Segregation of Duties Presented By:

    Non-Standard QAD Security Models not integrated with SOD. EAM. Channel Islands. Page 6. Components of QAD SOD. SOD Categories. An Collection of QAD Security Roles. SOD Matrix. A Relationship of a SOD Category to All other SOD Categories. Defines conflicted...
  • Climate of SW Asia - Thomas County School District

    Climate of SW Asia - Thomas County School District

    Climate of SW Asia . ... What can you tell about the population of the Middle East? Why do people tend to live near water? Compared to the United States, do the countries in the Middle East have access to...
  • Are T-phases blocked by bathymetry? A study of seismic events ...

    Are T-phases blocked by bathymetry? A study of seismic events ...

    Wavefront diagrams based on Cagniard (1962) for a water-basalt interface. The Direct Wave Root for Buried or Borehole Receivers Water-basalt interface Head waves exist at the interface between homogeneous media Diving waves exist when there is a vertical velocity gradient...
  • Overview of MA Refugee Resettlement Program

    Overview of MA Refugee Resettlement Program

    Overview of MA Refugee Resettlement Program. December 8, 2015 DRAFT (for BBA 12 ... The ORI Executive Director serves as the State Refugee Coordinator in accord with the Refugee Act of 1980 and state law. ... All refugees are required...
  • Individual Markets:

    Individual Markets:

    Title: Individual Markets: Author: jclifford Last modified by: Alexander Giarmo Created Date: 1/8/2005 6:15:53 AM Document presentation format
  • Powder Metallurgy (P/M) Method:  Make fine metal powders

    Powder Metallurgy (P/M) Method: Make fine metal powders

    Powder Metallurgy (P/M) Method: Make fine metal powders and sort Mix powders to get "alloy" Iron alloys most common, also Bronze Compaction Powder is pressed into a "green compact"
  • Chapter 11

    Chapter 11

    Wealth used to support deceased in afterlife. New ruler compelled to acquire new wealth through conquest to ensure his one care in afterlife. Gender-specific roles in the home and in society. Emphasis on cooperation. ... Aztec trade and markets more...