NA 105

DIN Standards Committee Terminology

Project

Artificial Intelligence - Evaluation methods for accurate natural language processing systems

Abstract

This document specifies the evaluation of natural language processing systems, in the sense of measuring the quality of a system's results to assess its functional suitability. It provides a definition of evaluation methods for those systems, together with guidance on how to select, implement and interpret them. This document covers quantitative metrics as well as other evaluation methods. It includes requirements on the implementation of the described metrics, and further requirements on the technical resources involved in the evaluation process.

Begin

2023-11-22

WI

JT021012

Planned document number

prEN ISO/IEC 23282

Responsible national committee

NA 105-00-06-01 GAK - Joint working group NAT/NIA: Natural Language Processing  

Responsible european committee

CEN/CLC/JTC 21/WG 3 - Engineering aspects  

Contact

Annette Preissner

Am DIN-Platz, Burggrafenstr. 6
10787 Berlin

Tel.: +49 30 2601-2012
Fax: +49 30 2601-42012

Send message to contact