Sunday, December 17, 2006

Ordinate Technology

The patented Ordinate ® testing system is based on of years of research in speech processing, statistical modeling, linguistics, and testing theory. The technology uses a speech processing system that is specifically designed to analyze speech from native and non-native speakers of English. In addition to recognizing words, the system also locates and evaluates relevant segments, syllables, and phrases in speech. The Ordinate system then uses statistical modeling techniques to assess the spoken performance.

Independent studies have shown that Versant tests are more objective, and more reliable than today's best human-rated tests, including one-on-one oral proficiency interviews. Using criteria developed by expert linguists, the Ordinate testing system scores candidate responses to test items, which have been validated with reference to human judgments of proficiency, fluency, and pronunciation.





Grading Technology

How the Ordinate® Testing System Works The Ordinate testing system uses speech processing technology that was built to handle the different rhythms and varied pronunciations used by native and non-native English speakers. The system generates scores based on the exact words used in the spoken responses, as well as the pace, fluency, and pronunciation of those words in phrases and sentences. In addition to recognizing the words uttered, the system also aligns the speech signal, i.e., it locates the part of signal containing relevant segments, syllables, and words. Base measures are then derived from the linguistic units (segments, syllables, words), based on statistical models of native speakers. The base measures are combined into four diagnostic sub-scores using advanced statistical modeling techniques. Two of the diagnostic sub-scores are based on the content of what is spoken, and two are based on the manner in which the responses are spoken. An Overall Score is calculated as a weighted combination of the diagnostic sub-scores.
Scored Item Tasks For the Versant for English test, responses to four item tasks are currently used for automated scoring. These are: reading aloud, repeating sentences, building sentences, and giving short answers to questions. In scoring, there is exactly one correct word sequence expected for each response to the Reading and Repeat items. Expert judgment was used to define correct answers to the short-answer question and sentence-build items. Most of the short-answer and some of the sentence-build items have multiple answers that are accepted as correct. All short-answer questions were pre-tested on diverse samples of native and non-native speakers. All items retained in the item banks were answered correctly by at least 90% of the native sample.






Frequently Asked Questions

1. What is Ordinate technology?
The patented Ordinate® testing system is based on of years of research in speech recognition, statistical modeling, linguistics, and testing theory. The technology uses a speech recognition system that is specifically designed to analyze speech components from native and non-native speakers of English. In addition to recognizing words, the system also locates and evaluates relevant segments, syllables, and phrases in speech. The Ordinate system then uses statistical modeling techniques to assess the spoken performance.

2. What spoken languages does Versant support?
Versant tests are available for English and Spanish. We are currently working on tests for French and Japanese and are always looking for partners interested in helping us produce tests for other languages.

3. Do you have correlation information between a Versant test and competing tests?
Correlation data with major tests are available upon request. Please contact your local measurement consultant.

4. What age groups are appropriate for each test?
Business and College Editions: Versant for English , Versant Abbreviated , Versant for Spanish = 15 and up
School Edition: Versant for English – Elementary Level = 8-11 Versant for English – Middle School Level = 12-14 Versant for English – High School Level = 15 -18

5. How do I check my test score?
Each test paper has a unique Test Identification Number (TIN) in the upper right corner. After locating this number, go to www.VersantTest.com, click on ‘”Get Test Scores” and type in your number. You will then receive your score report.

6. I lost my TIN. Can you give me my test score?
No. Please contact the institution that gave you the test. If it was a demo test, you will need to request another one and retake it to get your test score.

7. What if I do not want my students/employees to see their scores?
In ScoreKeeper, scores can be locked so they can only be viewed by the test administrator.

8. When is the test considered “used”?
After the spoken directions for Part A are completed.

9. Do you sell practice tests?
No. However, you may request a
free demo test via Web site at VersantTest.com.

No comments: