-
Ensuring that credentialing exam item pools grow
-
The aggregate pools thereof meet psychometric
standards of reliability and validity and are developed according to
certification industry standards
-
Assure the integrity of items for credential
examinations, including but not limited to, quantity, quality, domain
alignment, replenishment, and timing of utilization. Assure examination
content deliverables are met for new exam availability.
-
Coordinate the
development, administration, scoring and interpretation of multirater
assessments.
-
Enter and review the content of exam
items within established guidelines for test construction and within
established software protocols.
-
Perform analyses of examination pass/fail rates
including by version, site, and other salient variables. Identify and
report disparity from generally accepted and established guidelines for pass
rates.
-
Create and assure completion of project plans
and schedules for new exam content availability for computer-based and/or
paper pencil testing.
-
Obtain timeline information from vendors.
Facilitate item writing and review sessions as needed including presentation
and review of testing audiences, item writing criteria, and definitions.
Sustain positive objective team-based outcomes.
-
Bachelor’s degree with experienced related to
measurement, assessment, testing, quantitative analysis preferred; advanced
education preferred.
-
Minimum 5 years experience in a service organization
(such as consulting, business analyst or assessment) with a demonstrated track
record of monitoring and assuring valid and reliable products or
services.
-
Evidence of creating, scoring, interpreting multi-rater
assessment instruments required. Providing guidance on professional
development action planning using multi-rater results preferred.
-
Demonstrable experience with developing, deploying and
maintaining high integrity certification examinations, surveys, or educational
testing; global experience preferred.
-
Ability to analyze data in context; demonstrated
assessment acumen toward identifying the salient and relevant information and
recognizing the short and long-range impact of modifications.