• Hydrogen Technologies Standards form the basic framework for market ramp-up

    More information
  • Climate change Standards and specifications support climate targets

    More information
  • Smart Farming Standards and specifications are drivers for the digitalization of agriculture

    More information
Project

Artificial Intelligence - Evaluation methods for accurate natural language processing systems

Abstract

This document specifies the evaluation of natural language processing systems, in the sense of measuring the quality of a system's results to assess its functional suitability. It provides a definition of evaluation methods for those systems, together with guidance on how to select, implement and interpret them. This document covers quantitative metrics as well as other evaluation methods. It includes requirements on the implementation of the described metrics, and further requirements on the technical resources involved in the evaluation process.

Begin

2024-02-02

WI

JT021012

Planned document number

DIN EN ISO/IEC 23282

Project number

04301055

Responsible national committee

NA 105-00-06-01 GAK - Joint working group NAT/NIA: Natural Language Processing  

Responsible european committee

CEN/CLC/JTC 21/WG 3 - Engineering aspects  

Responsible international committee

ISO/IEC JTC 1/SC 42/JWG 5 - Joint Working Group ISO/IEC JTC1/SC42 - ISO/TC 37 WG: Natural language processing  

Contact

Annette Preissner

Am DIN-Platz, Burggrafenstr. 6
10787 Berlin

Tel.: +49 30 2601-2012
Fax: +49 30 2601-42012

Send message to contact