Accuracy Metrics for Entity Extraction

Abstract

Entity extraction software is typically evaluated based on the widely-accepted accuracy metrics of precision, recall, and F-measure. These metrics are certainly useful but limited in their scope. Additional factors including the types of errors, the cost of different error types, the facility of making changes to the system, and the efficiency of the system compared to human tagging should also be incorporated when evaluating entity extraction software. This paper illustrates the need for these additional factors and demonstrates how they can be implemented in evaluation. Read Full Text Here

 


Recent posts

Related Posts

Parserless Extraction; Using a Multidimensional Transient State Vector Machine

Introduction

Rosoka uses a novel approach to extracting information from text, which is not based...

CONTINUE READING

Analyzing Newswire and Social Media Data Using Multi-Vector Sentiment Analysis

Abstract

The vast amount of written text available on the Internet provides a treasure trove of...

CONTINUE READING

Quote Analysis Using the Rosoka Python API

Introduction

In this paper we describe how Rosoka’s Python API can be used to easily extract...

CONTINUE READING