DiETDiagnostic and Evaluation Tools for Natural Language ApplicationsEU Language Engineering Program, LE3-4204, Apr 97 - Mar 99

• Testing and evaluation package for developers and users of NLP applications such as

  • Grammar Checking
  • Controlled Language Checking
  • Machine Translation
  • Translation Memory Systems

• Systematic and controlled construction of test and evaluation data

  • including positive and negative test items
  • building on the results of
    • TSNLP
    • FraCaS
  • for:
    • morphology
    • grammar
    • discourse
  • in:
    • English
    • French
    • German

• Database technology for administration and maintenance of test suites

• Graphical user interfaces to aid annotation of corpora/test items

• Tools to combine corpora and test suites e.g.

  • annotated, representative corpora
  • support for customisation of test data to specific domains (e.g. through lexical replacement)

• Partners and contacts

  • DFKI: Klaus Netter, netter@dfki.de
  • Aerospatiale : Sylvie Regnier-Prost, sylvie.regnier@siege.aerospatiale.fr
  • IBM Germany: Tibor Kiss, tibor@heidelbg.ibm.com
  • ISSCO: Susan Amstrong, Susan.Amstrong@issco.unige.ch
  • Localisation Resources Centre: Reinhard Schäler, Reinhard@cslan.ucd.ie
  • SRI International, Cambridge: David Milward, milward@cam.sri.com

Back to first slide

View graphic version