NLP Systems Evaluation




An investigation into the validity of some metrics for automatically evaluating natural language generation systems
[PDF] from psu.eduE Reiter... - Computational Linguistics, 2009 - MIT Press
Page 1. An Investigation into the Validity of Some Metrics for Automatically Evaluating
Natural Language Generation Systems Ehud Reiter * University of Aberdeen Anja
Belz ** University of Brighton There is growing interest ... 
Cited by 16 - Related articles - All 15 versions - Import into BibTeX


A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies
[PDF] from psu.eduJ Schatzmann, K Weilhammer, M Stuttle... - The Knowledge ..., 2006 - portal.acm.org
... In Proceedings of the IEEE 64, 532-556. 47. Karen Sparck Jones , Julia R. Galliers ,
JR Galliers, Evaluating Natural Language Processing Systems: An Analysis and
Review, Springer-Verlag New York, Inc., Secaucus, NJ, 1996. ... 
Cited by 105 - Related articles - BL Direct - All 9 versions - Import into BibTeX


[HTML] An open-source framework for large-scale, flexible evaluation of biomedical text mining systems
[HTML] from biomedcentral.comW Baumgartner, KB Cohen... - Journal of ..., 2008 - archive.biomedcentral.com
... BMC Bioinformatics 2005., 6(Suppl 1): OpenURL. Jones KS, Galliers JR, (Eds): Evaluating
Natural Language Processing Systems, An Analysis and Review, Volume 1083 of Lecture
Notes in Computer Science. Springer; 1996. OpenURL. ... 
Cited by 20 - Related articles - Cached - All 14 versions - Import into BibTeX


[PDF] Automatic learning and evaluation of user-centered objective functions for dialogue system optimisation
[PDF] from brandeis.eduV Rieser... - Proc. of LREC, 2008 - pages.cs.brandeis.edu
... In Proc. CHI, pages 1343-1346. Karen Sparck Jones and Julia Galliers. 1996. Evaluating Natural
Language Processing Systems: An Analysis and Review. Springer Verlag. Oliver Lemon and
Olivier Pietquin. 2007. Machine learn- ing for spoken dialogue systems. In Proc. ... 
Cited by 10 - Related articles - View as HTML - All 11 versions - Import into BibTeX


Correlation between ROUGE and human evaluation of extractive meeting summaries
[PDF] from psu.eduF Liu... - Proceedings of the 46th Annual Meeting of the ..., 2008 - portal.acm.org
... The icsi meeting corpus. In ICASSP. KS Jones and J. Galliers. 1996. Evaluating natural language
processing systems: An analysis and review. Lecture Notes in Artificial Intelligence. D. Jones,
F. Wlof, E. Gilbson, E. Williams, E. Fedorenko, D. Reynolds, and M. Zissman. 2003. ... 
Cited by 15 - Related articles - All 12 versions - Import into BibTeX


[PDF] Comparing automatic and human evaluation of NLG systems
[PDF] from upenn.eduA Belz... - Proceedings of EACL, 2006 - acl.ldc.upenn.edu
Page 1. Comparing Automatic and Human Evaluation of NLG Systems Anja Belz Natural
Language Technology Group CMIS, University of Brighton UK ASBelz@brighton.ac.uk Ehud
Reiter Dept of Computing Science University of Aberdeen UK ereiter@csd.abdn.ac.uk Abstract ... 
Cited by 52 - Related articles - View as HTML - All 19 versions - Import into BibTeX


Is text-to-speech synthesis ready for use in computer-assisted language learning?
[PDF] from cnrs.frZ Handley - Speech Communication, 2009 - Elsevier
Cited by 7 - Related articles - All 6 versions - Import into BibTeX


An efficient statistical approach for automatic organic chemistry summarization
[PDF] from florianboudin.orgF Boudin, JM Torres-Moreno... - Advances in Natural ..., 2008 - Springer
... 2, pp. 723-734 (2002) 15. Spärck Jones, K., Galliers, JR: Evaluating Natural Language
Processing Systems: An Analysis and Review. Springer, Heidelberg (1996) 16. Lin,
CY: Rouge: A Package for Automatic Evaluation of Summaries. ... 
Cited by 6 - Related articles - All 9 versions - Import into BibTeX


Introducing shared tasks to NLG: The TUNA shared task evaluation challenges
A Gatt... - Empirical methods in natural language generation, 2011 - Springer
Page 1. Introducing Shared Tasks to NLG: The TUNA Shared Task Evaluation
Challenges Albert Gatt1,2 and Anja Belz3 1 Institute of Linguistics, Centre for
Communication Technology, University of Malta albert.gatt@um.edu ... 
Cited by 11 - Related articles - All 3 versions - Import into BibTeX


Chinese text automatic summarization based on affinity propagation cluster
C Zhao, Q Peng... - 2009 Sixth International Conference on ..., 2009 - computer.org
... [9] Frey, BJ and D. Dueck, "Clustering by passing messages between data points", Science,
2007. 315(5814): pp. 972-976. [10] Jones KS, Galliers J R. Evaluating Natural Language
Processing Systems : An Analysis and Review. Berlin: Springer,1996. ... 
Related articles - All 4 versions - Import into BibTeX


[PDF] Do we still need gold standard for evaluation
[PDF] from psu.eduT Poibeau... - Proceedings of the Language Resources and ..., 2008 - Citeseer
... Computational Linguistics, 32(2):159-194. Karen Sparck Jones and Jean Gallier. 1996.
Evaluating Natural Language Processing Systems: An Analysis and Review. Oxford University
Press, Oxford. Karel Van Den Eynde and Claire Blanche-Benveniste. 1978. ... 
Cited by 8 - Related articles - View as HTML - All 14 versions - Import into BibTeX


[BOOK] Handbook of Research on Text and Web Mining Techologies
[PDF] from abo.fiM Song... - 2009 - abo.fi
Page 1. Handbook of Research on Text and Web Mining Technologies Min Song New Jersey
Institute of Technology, USA Yi-fang Brook Wu New Jersey Institute of Technology, USA Hershey •
New York INFORMATION SCIENCE REFERENCE Volume II Page 2. ... 
Cited by 4 - Related articles - View as HTML - Library Search - All 13 versions - Import into BibTeX


[PDF] Reference-based vs. task-based evaluation of human language technology
[PDF] from unipi.itA Popescu-Belis - ELRA Workshop on Evaluation Looking into ..., 2008 - mailserver.di.unipi.it
... 613-620. SparckJones K. and Galliers JR (1996). Evaluating Natural Language Processing
Systems: An Analysis and Review, Berlin/New York, Springer-Verlag. Sparck Jones K.(2001).
Automatic language and information processing: rethinking evaluation. ... 
Related articles - View as HTML - All 7 versions - Import into BibTeX


GEMS: Generative Modeling for Evaluation of Summaries
R Katragadda - Computational Linguistics and Intelligent Text ..., 2010 - Springer
... pyramid based manual scores. References 1. Hirschman, L., Mani, I.: Evaluation (2001)
2. Jones, KS, Galliers, JR: Evaluating Natural Language Processing Systems: An
Analysis and Review. Springer, New York (1996) 2 We have ... 
Cited by 1 - Related articles - Import into BibTeX


Statistical Automatic Summarization in Organic Chemistry
[PDF] from arxiv.orgF Boudin, P Velazquez-Morales... - Arxiv preprint arXiv: ..., 2009 - arxiv.org
... In: JADT. Volume 2. (2002) 723-734 15. Spärck Jones, K., Galliers, JR: Evaluating Natural
Language Processing Systems: An Analysis and Review. Springer (1996) 16. Lin, CY:
Rouge: A Package for Automatic Evaluation of Summaries. ... 
Related articles - All 4 versions - Import into BibTeX


Automatic Summarization: An Overview
H Saggion - Revue française de linguistique appliquée, 2008 - cairn.info
... In Proceedings of LREC 2002. Spärck Jones, K. & Galliers, JR (1995). Evaluating Natural
Language Processing Systems: An Analysis and Review. Lecture Notes in Artificial Intelligence,
1083. Spärck Jones, K. (1999). Automatic summarising: factors and directions. ... 
Cited by 4 - Related articles - All 2 versions - Import into BibTeX


Multilingual summarization evaluation without human models
[PDF] from aclweb.orgH Saggion, JM Torres-Moreno, I Cunha... - Proceedings of the 23rd ..., 2010 - portal.acm.org
Page 1. Coling 2010: Poster Volume, pages 1059-1067, Beijing, August 2010
Multilingual Summarization Evaluation without Human Models Horacio Saggion
TALN - DTIC Universitat Pompeu Fabra horacio.saggion@upf.edu ... 
Related articles - All 11 versions - Import into BibTeX


Textual properties and task based evaluation: investigating the role of surface properties, structure and content
[PDF] from aclweb.orgA Gatt... - Proceedings of the 6th International Natural ..., 2010 - portal.acm.org
Page 1. Textual Properties and Task Based Evaluation: Investigating the Role of
Surface Properties, Structure and Content. Albert Gatt Institute of Linguistics University
of Malta albert.gatt@um.edu.mt François Portet Laboratoire ... 
Related articles - All 8 versions - Import into BibTeX


[PDF] Extrinsic summarization evaluation: A decision audit task
[PDF] from psu.eduG Murray, T Kleinbauer, P Poller, T Becker... - ACM Transactions on ..., 2009 - Citeseer
Page 1. 2 Extrinsic Summarization Evaluation: A Decision Audit Task GABRIEL
MURRAY University of British Columbia THOMAS KLEINBAUER, PETER POLLER
and TILMAN BECKER German Research Center for Artificial ... 
Cited by 6 - Related articles - View as HTML - All 19 versions - Import into BibTeX


Exploring correlation between ROUGE and human evaluation on meeting summaries
F Liu... - Audio, Speech, and Language Processing, IEEE ..., 2010 - ieeexplore.ieee.org
Page 1. IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL.
18, NO. 1, JANUARY 2010 187 Exploring Correlation Between ROUGE and Human Evaluation
on Meeting Summaries Feifan Liu and Yang Liu, Member, IEEE ... 
Cited by 4 - Related articles - All 4 versions - Import into BibTeX


[PDF] A Robust and Adaptable Summarization Tool
[PDF] from atala.orgH Saggion - Traitement Automatique des Langues, 2008 - atala.org
Page 1. SUMMA A Robust and Adaptable Summarization Tool Horacio Saggion Department
of Computer Science University of Sheffield 211 Portobello Street - Sheffield, England, UK
saggion@dcs.shef.ac.uk Tel: +44-114-222-1947 Fax: +44-114-222-1810 ABSTRACT. ... 
Related articles - View as HTML - All 2 versions - Import into BibTeX


A semantic graph-based approach to biomedical summarisation
L Plaza, A Díaz... - Artificial Intelligence in Medicine, 2011 - Elsevier
Related articles - Import into BibTeX


[PDF] Critical points in assessing learning performance via cross-validation
[PDF] from tkk.fiH Suominen, T Pahikkala... - Proceedings of the 2nd ..., 2008 - research.ics.tkk.fi
Page 1. CRITICAL POINTS IN ASSESSING LEARNING PERFORMANCE VIA
CROSS-VALIDATION Hanna Suominen, Tapio Pahikkala, Tapio Salakoski Turku Centre
for Computer Science (TUCS) and University of Turku, Department ... 
Cited by 2 - Related articles - View as HTML - All 3 versions - Import into BibTeX


Supervised automatic evaluation for summarization with voted regression model
T Hirao, M Okumura, N Yasuda... - Information Processing & ..., 2007 - Elsevier
Cited by 6 - Related articles - All 4 versions - Import into BibTeX


Shared-task evaluations in HLT: Lessons for NLG
[PDF] from upenn.eduA Belz... - Proceedings of the Fourth International Natural ..., 2006 - portal.acm.org
... In Proc. INLG'06. K. Spärck Jones and JR Galliers. 1996. Evaluating Natural Language Processing
Systems: An Analysis and Review. Springer Verlag. K. Spärck Jones, 1981. Information Retrieval
Experi- ment, chapter 12. Butterworth & Co. 5Belz, March 2006. 135 
Cited by 10 - Related articles - All 33 versions - Import into BibTeX


Classification procedures for software evaluation
[PDF] from archives-ouvertes.frM Amar, S David, R Panckhurst... - 2008 - hal.archives-ouvertes.fr
... Pariente J.-CL. (1973), Le langage et l'individuel, Paris : Armand Colin. Sparck-Jones
K., Gallier JR (1996), Evaluating Natural Language Processing Systems: an Analysis
and Review, Berlin: Springer-Verlag. TREC: http://trec ... 
Cited by 1 - Related articles - All 9 versions - Import into BibTeX


[PDF] Computational linguistics beyond the processing of english
[PDF] from linguateca.ptD Santos - 2007 - linguateca.pt
... Journal of Experimental and Theoretical Artificial Intelligence, 13(1):9-23, 2001. [9] Karen
Sparck-Jones and Julia R. Galliers. Evaluating Natural Language Processing Systems: An
Analysis and Review. Springer, 1996. [10] Zeno Vendler. Verbs and times. ... 
Cited by 1 - Related articles - View as HTML - All 2 versions - Import into BibTeX


Learning query-biased web page summarization
[PDF] from psu.eduC Wang, F Jing, L Zhang... - Proceedings of the sixteenth ..., 2007 - portal.acm.org
Page 1. Learning Query-Biased Web Page Summarization 1 Changhu Wang Department
of EEIS, University of Science and Technology of China Hefei 230027, China
(86)13581984028 wch@ustc.edu Feng Jing * , Lei Zhang * , Hong-Jiang Zhang † ... 
Cited by 13 - Related articles - All 9 versions - Import into BibTeX


Automatic evaluation of summaries using n-gram co-occurrence statistics
[PDF] from upenn.eduCY Lin... - Proceedings of the 2003 Conference of the North ..., 2003 - portal.acm.org
Page 1. Automatic Evaluation of Summaries Using N-gram Co-Occurrence Statistics Chin-Yew
Lin and Eduard Hovy Information Sciences Institute University of Southern California 4676
Admiralty Way Marina del Rey, CA 90292 {cyl,hovy}@isi.edu Abstract ... 
Cited by 623 - Related articles - All 32 versions - Import into BibTeX


User-model based personalized summarization
A Díaz... - Information Processing & Management, 2007 - Elsevier
Cited by 21 - Related articles - All 2 versions - Import into BibTeX


Automatic multidocument summarization of research abstracts: Design and user evaluation
[PDF] from wlv.ac.ukS Ou, CSG Khoo... - Journal of the American Society ..., 2007 - Wiley Online Library
Skip to Main Content. ... 
Cited by 4 - Related articles - BL Direct - All 7 versions - Import into BibTeX


Automatic analysis of medical dialogue in the home hemodialysis domain: structure induction and summarization
[PDF] from psu.eduRC Lacson, R Barzilay... - Journal of biomedical informatics, 2006 - Elsevier
Cited by 6 - Related articles - Library Search - All 13 versions - Import into BibTeX


[PDF] Sumgraph: text summarization using centrality in the pathfinder network
[PDF] from iadis.netK Patil... - IADIS International Journal on Computer Science and ..., 2007 - iadis.net
Page 1. IADIS International Journal on Computer Science and Information Systems
Vol. 2, No. 1, pp. 18-32 ISSN: 1646-3692 18 SUMGRAPH: TEXT SUMMARIZATION
USING CENTRALITY IN THE PATHFINDER NETWORK ... 
Cited by 2 - Related articles - View as HTML - Import into BibTeX


NP animacy identification for anaphora resolution
[PDF] from psu.eduC Orasan... - Journal of Artificial Intelligence Research, 2007 - aaai.org
Page 1. Journal of Artificial Intelligence Research 29 (2007) 79-103 Submitted 09/06;
published 06/07 NP Animacy Identification for Anaphora Resolution Constantin
Or?asan C.Orasan@wlv.ac.uk Richard Evans RJEvans@wlv.ac.uk ... 
Cited by 5 - Related articles - All 13 versions - Import into BibTeX


[PDF] Summary Evaluation with and without References
[PDF] from ipn.mxJM Torres-Moreno, H Saggion, I da Cunha... - Polibits, 2010 - cidetec.ipn.mx
... [3] Proceedings of the Text Analysis Conference. Gaithesburg, Maryland, USA: NIST, November
17-19 2008. [4] K. Spärck Jones and J. Galliers, Evaluating Natural Language Processing Systems,
An Analysis and Review, ser. Lecture Notes in Computer Science. ... 
Related articles - View as HTML - All 3 versions - Import into BibTeX


[PDF] GEMS: Generative Modeling for Evaluation of Summaries
[PDF] from iiit.ac.inK Rahul - 2010 - web2py.iiit.ac.in
... pyramid based manual scores. References 1. Hirschman, L., Mani, I.: Evaluation.
(2001) 2. Jones, KS, Galliers, JR: Evaluating Natural Language Processing Systems:
An Analysis and Review. Springer-Verlag New York, Inc ... 
Related articles - View as HTML - Import into BibTeX


Evaluating Web search result summaries
[PDF] from psu.eduS Liang, S Devlin... - Advances in Information Retrieval, 2006 - Springer
... 11. Pagano, RR: Understanding statistics in the behavioural sciences. Wadsworth/Thomson
Learning, USA (2001). 12. Sparck Jones, C. and Galliers, JR: Evaluating natural language
processing systems: an analysis and review. Springer, New York (1996). 13. ... 
Cited by 6 - Related articles - BL Direct - All 10 versions - Import into BibTeX


General Principles of User-Oriented Evaluation Margaret King
M King - Evaluation of Text and Speech Systems, 2007 - Springer
Page 1. Chapter 5 GENERAL PRINCIPLES OF USER-ORIENTED EVALUATION
Margaret King ISSCO - School of Translation and Interpretation, ETI University of
Geneva, Switzerland Maghi.King@gmail.com Abstract This chapter ... 
Cited by 4 - Related articles - All 4 versions - Import into BibTeX


An E?cient Statistical Approach for Automatic Organic Chemistry Summarization
JMTM FlorianBoudin1... - Advances in natural ..., 2008 - books.google.com
... 2, pp. 723-734 (2002) 15. Sparck Jones, K., Galliers, JR: Evaluating Natural Language
Processing Systems: An Analysis and Review. Springer, Heidelberg (1996) 16. Lin,
CY: Rouge: A Package for Automatic Evaluation of Summaries. ... 
Related articles - Import into BibTeX


Identifying commented passages of documents using implicit hyperlinks
[PDF] from archives-ouvertes.frJY Delort - Proceedings of the seventeenth conference on ..., 2006 - portal.acm.org
Page 1. Identifying Commented Passages of Documents Using Implicit Hyperlinks
Jean-Yves Delort University of Montpellier 2 Montpellier, France delort@lirmm.fr
ABSTRACT This paper addresses the issue of automatically ... 
Cited by 7 - Related articles - All 10 versions - Import into BibTeX


[PDF] Establishing a methodology for benchmarking speech synthesis for computer-assisted language learning (CALL)
[PDF] from psu.eduZ Handley... - Language Learning and Technology, 2005 - Citeseer
Page 1. Language Learning & Technology http://llt.msu.edu/vol9num3/handley/
September 2005, Volume 9, Number 3 pp. 99-120 Copyright (c) 2005, ISSN 1094-3501
99 ESTABLISHING A METHODOLOGY FOR BENCHMARKING ... 
Cited by 14 - Related articles - View as HTML - All 8 versions - Import into BibTeX


[PDF] Task-based MT evaluation: from who/when/where extraction to event understanding
[PDF] from mt-archive.infoJ Laoudi, CR Tate... - LREC-2006: Fifth International ..., 2006 - mt-archive.info
... Annotation. LAMP-TR-126. U. of Maryland, College Park. Spaerck-Jones, K. and JR
Gallier. (1996). Evaluating Natural Language Processing Systems: An Analysis and
Review. Springer, Berlin. Tate, C., S. Lee, C. Voss (2003). Task ... 
Cited by 4 - Related articles - View as HTML - All 6 versions - Import into BibTeX


A Framework for the Measurement of Simulated Behavior Performance
[PDF] from dtic.milCM Cooper - 2011 - DTIC Document
Page 1. A FRAMEWORK FOR THE MEASUREMENT OF SIMULATED BEHAVIOR
PERFORMANCE THESIS Christopher M. Cooper, 2d Lt, USAF AFIT/GCE/ENG/11-02
DEPARTMENT OF THE AIR FORCE AIR UNIVERSITY AIR FORCE INSTITUTE OF TECHNOLOGY ... 
Related articles - All 3 versions - Import into BibTeX


[PDF] Multi-document biography summarization
[PDF] from upenn.eduL Zhou, M Ticrea... - Proceedings of EMNLP, 2004 - acl.ldc.upenn.edu
... New Brunswick, New Jersey: Association for Computational Linguistics. Karen Spärck Jones
and Julia R. Galliers. 1996. Evaluating Natural Language Processing Systems: An Analysis and
Review. Lecture Notes in Artificial Intelligence 1083. Berlin: Springer. ... 
Cited by 25 - Related articles - View as HTML - All 22 versions - Import into BibTeX


[PDF] Do summaries help? a task-based evaluation of multi-document summarization
[PDF] from psu.eduK McKeown, RJ Passonneau, DK Elson... - Proceedings of ..., 2005 - Citeseer
Page 1. Do Summaries Help? A Task-Based Evaluation of Multi-Document
Summarization Kathleen McKeown Columbia University kathy@cs.columbia.edu
Rebecca J. Passonneau Columbia University becky@cs.columbia.edu ... 
Cited by 26 - Related articles - View as HTML - All 12 versions - Import into BibTeX


[PDF] A Chinese Automatic Text Summarization system for mobile devices
[PDF] from aclweb.orgL Yu, M Liu, F Ren... - The Pacific Asia Conference on ..., 2006 - aclweb.org
... 8. HP Edmundson.: New Methods in Automatic Extraction[A]. In Advances in Automatic Text
Summarization[C]. (1998) 23-42 9. S. Jones and J. Galliers.: Evaluating Natural Language
Processing Systems: an Analysis and Review. Springer, New York, (1996) 10. I. Mani. ... 
Cited by 2 - Related articles - View as HTML - All 6 versions - Import into BibTeX


Do summaries help?
K McKeown, RJ Passonneau, DK Elson... - Proceedings of the ..., 2005 - portal.acm.org
Page 1. Do Summaries Help? A Task-Based Evaluation of Multi-Document
Summarization Kathleen McKeown Columbia University kathy@cs.columbia.edu
Rebecca J. Passonneau Columbia University becky@cs.columbia.edu ... 
Cited by 21 - Related articles - All 2 versions - Import into BibTeX


Letsum, an automatic legal text summarizing system
[PDF] from psu.eduA Farzindar... - Legal knowledge and information ..., 2004 - books.google.com
... law. ICAIL, pages 84-93, 1987. [11] Karen Spark-Jones and Julia R. Galliers.
Evaluating Natural Language Processing Systems: An Analysis and Review. Number
1083 in Lecture Notes in Artificial Intelligence. Springer, 1995. 
Cited by 14 - Related articles - All 8 versions - Import into BibTeX


[PDF] Generation of reference summaries
[PDF] from psu.eduM Hassel... - Proceedings of 2nd Language and Technology ..., 2005 - Citeseer
... WA. Spark-Jones, K. and JR Galliers. 1995. Evaluating Natural Language Processing
Systems: An Analysis and Review. Number 1083 in Lecture Notes in Artificial
Intelligence. Springer. Winkel, A. and D. Radev. 2002. MEADeval ... 
Cited by 7 - Related articles - View as HTML - All 9 versions - Import into BibTeX


Extracting conceptual relationships from specialized documents
[PDF] from ncu.edu.twB Hui... - Data & Knowledge Engineering, 2005 - Elsevier
Cited by 14 - Related articles - All 5 versions - Import into BibTeX


[BOOK] Resource lean and portable automatic text summarization
[PDF] from psu.eduM Hassel - 2007 - Citeseer
Page 1. Resource Lean and Portable Automatic Text Summarization MARTIN HASSEL
Doctoral Thesis Stockholm, Sweden 2007 Page 2. TRITA-CSC-A 2007:9
ISSN-1653-5723 ISRN-KTH/CSC/A--07/09--SE ISBN-978-91-7178-704-0 ... 
Cited by 13 - Related articles - View as HTML - Library Search - All 11 versions - Import into BibTeX


World wide web site summarization
[PDF] from psu.eduY Zhang, N Zincir-Heywood... - WEB INTELLIGENCE AND ..., 2004 - IOS Press
Page 1. Web Intelligence and Agent Systems: An international journal 2 (2004)
39-53 39 IOS Press World Wide Web site summarization Yongzheng Zhang, Nur
Zincir-Heywood and Evangelos Milios Faculty of Computer Science ... 
Cited by 26 - Related articles - BL Direct - All 18 versions - Import into BibTeX


Consensus Text Summarizer Based on Meta-Search Algorithms
V Thapar, AA Mohamed... - Signal Processing and ..., 2006 - ieeexplore.ieee.org
... Technologies, 1993. [13] K. Spärck-Jones and JR Galliers, "Evaluating Natural
Language Processing Systems: An Analysis and Review" presented at Lecture
Notes in Artificial Intelligence 1083, Springer-Verlag, 1996. 407 
Cited by 1 - Related articles - All 2 versions - Import into BibTeX


Generating user-focused, content-based summaries for multi-documents using document graphs (PDF)
AA Mohamed - 2005 - computer.org
... Documentation, 28(1): 11-21, 1972. [19] K. Spärck-Jones and JR Galliers, "Evaluating
Natural Language Processing Systems: An Analysis and Review," Lecture Notes
in Artificial Intelligence 1083. Springer-Verlag, 1996. 679 
Cited by 4 - Related articles - All 2 versions - Import into BibTeX


Accuracy and suitability: New challenges for evaluation
M King - Language resources and evaluation, 2005 - Springer
Page 1. Accuracy and Suitability: New Challenges for Evaluation MARGARET KING TIM/ISSCO,
School of Translation and Interpretation, University of Geneva, Uni-Mail, 40 blvd du Pont d'Arve,
CH-1205, Geneva E-mail: Margaret.King@issco.unige.ch 1. Paradigms of Evaluation ... 
Cited by 3 - Related articles - BL Direct - All 5 versions - Import into BibTeX


[PDF] Believable conversational agents: Introducing the intention map
[PDF] from shef.ac.ukP Wallis - International conference on autonomous agents and ..., 2005 - nlp.shef.ac.uk
... [19] B. Reeves and C. Nass. The Media Equation. CSLI Publications, Stanford, 1996. [20] K.
Sparck-Jones and JR Galliers. Evaluating Natural Language Processing Systems: An analysis
and review. Lecture Notes in Artificial Intelligence. Springer, 1996. [21] H. Tennant. ... 
Cited by 2 - Related articles - View as HTML - All 5 versions - Import into BibTeX


Principles of Evaluation in Natural Language Processing
[PDF] from archives-ouvertes.frP Paroubek, S Chaudiron... - Traitement ..., 2007 - halshs.archives-ouvertes.fr
Page 1. Principles of Evaluation in Natural Language Processing Patrick Paroubek1 -
Stéphane Chaudiron2 - Lynette Hirschman3 LIMSI - CNRS, Bât. 508 Université Paris
XI BP 133 - 91403 ORSAY Cedex - France pap@limsi.fr 1 ... 
Related articles - All 7 versions - Import into BibTeX


[PDF] Résumé automatique multi-document et indépendance de la langue: une premiere évaluation en français
[PDF] from univ-avignon.frF Boudin... - ... de la Langue Naturelle (TALN'09 ..., 2009 - lia.univ-avignon.fr
... Information Processing and Management, 40(6), 919-938. SPÄRCK JONES K. & GALLIERS
JR (1996). Evaluating Natural Language Processing Systems : An Analysis and Review. Springer.
TEUFEL S. & MOENS M. (1997). Sentence extraction as a classification task. ... 
Cited by 2 - Related articles - View as HTML - All 6 versions - Import into BibTeX


Mice from a mountain: Reflections on current issues in evaluation of written language technology
R Gaizauskas... - Charting a New Course: Natural Language ..., 2005 - Springer
Page 1. 195 John I. Tait (ed.), Charting a New Course: Natural Language Processing and
Information Retrieval. Essays in Honour of Karen Spärck Jones. 195-238 (c) 2005 Springer.
Printed in the Netherlands. ROBERT GAIZAUSKAS AND EMMA J. BARKER ... 
Cited by 2 - Related articles - All 2 versions - Import into BibTeX


A text summarizer based on meta-search
[PDF] from iiita.ac.inAA Mohamed... - Proceedings of the Fifth IEEE ..., 2005 - computer.org
... Documentation, 28(1): 11-21, 1972. [15] K. Spärck-Jones and JR Galliers, "Evaluating
Natural Language Processing Systems: An Analysis and Review," Lecture Notes
in Artificial Intelligence 1083, Springer-Verlag, 1996. 674 
Cited by 1 - Related articles - All 3 versions - Import into BibTeX


[HTML] Evaluation of NLP technology for AAC using logged data
[HTML] from stanford.eduA Copestake, D Flickinger - ... at http://www-csli. stanford. edu/ ..., 2003 - www-csli.stanford.edu
... Proceedings of the Technology and Persons with Disabilities Conference (CSUN-98),
Los Angeles, CA. Sparck Jones, K. and JR Galliers (1995) `Evaluating Natural Language
Processing systems: an analysis and review'. Springer-Verlag. 
Cited by 12 - Related articles - Cached - Import into BibTeX


[HTML] CESTA: The European MT Evaluation Campaign
[HTML] from multilingual.comM DABBADIE, WM EL HADI... - Multilingual Computing & ..., 2004 - multilingual.com
... Sparck-Jones K., Gallier, JR (1996). Evaluating Natural Language Processing Systems: An
Analysis and Review, Springer, Berlin. TREC, NIST Website, last updated, August 1st, 2000,
visited by the authors, 23-03-2003. Vanni, M. and K. Miller (2001). ... 
Cited by 3 - Related articles - Cached - All 12 versions - Import into BibTeX


[PDF] Extrinsic evaluation of automatic metrics for summarization
[PDF] from psu.eduB Dorr, C Monz, D Oard, S President, D Zajic... - 2004 - Citeseer
Page 1. 1 LAMP-TR-115 July 20, 2004 CAR-TR-999 CS-TR-4610 UMIACS-TR-2004
Extrinsic Evaluation of Automatic Metrics for Summarization * Bonnie Dorr, Christof
Monz, Douglas Oard, Stacy President, David Zajic University ... 
Cited by 5 - Related articles - View as HTML - All 18 versions - Import into BibTeX


Living up to standards
[PDF] from aclweb.orgM King - Proceedings of the EACL 2003 Workshop on ..., 2003 - portal.acm.org
... ELSE project. (Evaluation in Speech and Language Engineering). Sparck-Jones, K. and
Galliers JR 1996. Evaluating Natural Language Processing Systems:An Analysis and Review.
Lecture Notes in Artificial Intelligence 1083. Springer-Verlag. 
Cited by 7 - Related articles - All 7 versions - Import into BibTeX


[CITATION] LYNETTE HIRSCHMAN
I MANI - The Oxford handbook of computational ..., 2005 - Oxford University Press, USA
Related articles - Import into BibTeX


Summarizing Web sites automatically
[PDF] from psu.eduY Zhang, N Zincir-Heywood... - Advances in Artificial Intelligence, 2003 - Springer
Page 1. Summarizing Web Sites Automatically Yiquing Zhang Zhang, Nur
Zincir-Heywood, and Evangelos Milios Dalhousie University Abstract. This research
is directed towards automating the Web Site summarization task. ... 
Cited by 10 - Related articles - BL Direct - All 22 versions - Import into BibTeX


Work-in-progress project report: CESTA-machine translation evaluation campaign
[PDF] from upenn.eduW Mustafa El Hadi, M Dabbadie, I Timimi... - Proceedings of the ..., 2004 - portal.acm.org
Page 1. Work-in-Progress project report : CESTA - Machine Translation Evaluation
Campaign Widad Mustafa El Hadi IDIST / CERSATES Université de Lille 3 Domaine
universitaire du "Pont de Bois" rue du Barreau BP 149 59653 ... 
Cited by 2 - Related articles - All 16 versions - Import into BibTeX


[PDF] Le rôle des métriques d'évaluation dans le processus de recherche en TAL
[PDF] from atala.orgA Popescu-Belis - TAL (Traitement Automatique de la Langue, 2008 - atala.org
Page 1. TAL. Volume 48 - n° 1/2007, pages 67 à 91 Le rôle des métriques d'évaluation
dans le processus de recherche en TAL Andrei Popescu-Belis IDIAP Research Institute
Centre du Parc Av des Prés-Beudin 20 Case postale ... 
Cited by 5 - Related articles - View as HTML - All 4 versions - Import into BibTeX


Corporizando algumas questões
[PDF] from rcaap.ptD Santos - Avanços da linguística de Corpus no Brasil, 2008 - books.google.com
... Amsterdam/Philadelphia, Benjamins, 2006, pp. 55-72. SPARCK-JONES, Karen & Julia R.
GALL1ERS. Evaluating Natural Language Processing Systems: An Analysis and Review.
Springer, 1996. SVARTVIK, Jan. Corpus linguistics 25+ years on. ... 
Related articles - All 3 versions - Import into BibTeX


Making miracles: Interactive translingual search for cebuano and hindi
[PDF] from psu.eduD He, DW Oard, J Wang, J Luo... - ACM Transactions on ..., 2003 - portal.acm.org
Page 1. Making MIRACLEs: Interactive Translingual Search for Cebuano and Hindi
DAQING HE, DOUGLAS W. OARD, JIANQIANG WANG, JUN LUO, DINA
DEMNER-FUSHMAN, KAREEM DARWISH, and PHILIP RESNIK University ... 
Cited by 21 - Related articles - All 17 versions - Import into BibTeX


Reuse and challenges in evaluating language generation systems: Position paper
[PDF] from psu.eduK Bontcheva - Proceedings of the EACL 2003 Workshop on ..., 2003 - portal.acm.org
... Journal of Applied Artificial Intelligence, 9(3):259- 287. Karen Sparck Jones and Julia R. Galliers.
1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Number 1083
in Lec- ture Notes in Artificial Intelligence. Springer Verlag, Berlin, Heidelberg. ... 
Cited by 2 - Related articles - All 10 versions - Import into BibTeX


[PDF] A daily scrum meeting summarizer for Agile software development teams
[PDF] from ucalgary.caS Park - 2007 - ase.cpsc.ucalgary.ca
Page 1. UNIVERSITY OF CALGARY A Daily Scrum Meeting Summarizer for Agile Software
Development Teams By Shelly Park A THESIS SUBMITTED TO THE FACULTY OF GRADUATE
STUDIES IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE ... 
Related articles - View as HTML - All 11 versions - Import into BibTeX


The diversity-based approach to open-domain text summarization* 1
T Nomoto... - Information processing & management, 2003 - Elsevier
Cited by 14 - Related articles - All 7 versions - Import into BibTeX


[PDF] Disseminating Research in Accessible Ways: the Globalization and Autonomy Compendium
[PDF] from mcmaster.caW Coleman... - ... on Text Analysis November 19-21 ..., 2004 - tapor1.mcmaster.ca
... ICAIL, pages 84-93. Karen Spark-Jones and Julia R. Galliers. 1995. Evaluating Natural
Language Processing Systems: An Analysis and Review. Number 1083 in Lecture Notes
in Artificial Intelligence. Springer. 36| CaSTA 2004-The Face of Text 
Related articles - View as HTML - All 2 versions - Import into BibTeX


[PDF] Evaluation of Automatic Text Summarization
[PDF] from psu.eduM Hassel - Licentiate thesis, School of Computer Science and ..., 2004 - Citeseer
Page 1. Evaluation of Automatic Text Summarization A practical implementation MARTIN
HASSEL Licentiate Thesis Stockholm, Sweden 2004 Page 2. TRITA NA 2004-08 ISSN
0348-2952 ISRN KTH/NA/R--04/08--SE ISBN 91-7283-753-5 ... 
Cited by 1 - Related articles - View as HTML - All 7 versions - Import into BibTeX


[PDF] A local grammar for proper names
[PDF] from psu.eduHN Traboulsi - 2004 - Citeseer
Page 1. A Local Grammar for Proper Names Hayssam N Traboulsi Submitted for the
MPhil to PhD Transfer from the University of Surrey Information Extraction and
Multimedia Group Department of Computing School of Electronics ... 
Cited by 5 - Related articles - View as HTML - All 2 versions - Import into BibTeX


Extracting conceptual relationships from specialized documents
[PDF] from buffalo.eduB Hui... - Conceptual Modeling-ER 2002, 2003 - Springer
... Academic Press, Inc. (1993) 7. Sparck-Jones, K., Galliers, J.: Evaluating natural language
processing systems: an analysis and review. New York: Springer (1996) 8. Hovy, E.,
Marcu, D.: Automated Text Summarization: Tutorial Notes. ... 
Cited by 1 - Related articles - BL Direct - All 11 versions - Import into BibTeX


MetaTools-Investigating Metadata Generation Tools-Final Report
[PDF] from jisc.ac.ukM Polfreman... - 2008 - ie-repository.jisc.ac.uk
Page 1. Project Acronym: MetaTools Version: 1a Contact: (until 31 October 2008): Malcolm
Polfreman (malcolm.polfreman@kcl.ac.uk) Contact: (after 31 October 2008): Steve Grace
(stephen.grace@kcl.ac.uk) Date: 30/10/2008 JISC Final Report MetaTools Final Report Project ... 
All 6 versions - Import into BibTeX


[PDF] An intrinsic approach to the evaluation of a conceptual generator
[PDF] from psu.eduL Specia... - 2003 - Citeseer
... 311-318. [17] Sparck-Jones, K. and Galliers, JR Evaluating Natural Language Processing Systems:
an Analysis and Review. Springer-Verlag, 1996. [18] Teufel, S. and Moens, M. Argumentative
classification of extracted sentences as a first step towards flexible abstracting. ... 
Related articles - View as HTML - All 6 versions - Import into BibTeX


[PDF] Addressing a Bottleneck in Data Integration using Automated Learning Techniques
[PDF] from psu.eduE Hovy, J Ambite... - EMISSION INVENTORIES- APPLYING NEW ..., 2003 - Citeseer
... Journal of Autonomous Agents and Multi-Agent Systems 4:93-114. Spärck Jones, K. and JR
Galliers. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review.
New York: Springer. Tejada, S., CA Knoblock, and S. Minton. 2001. ... 
Related articles - View as HTML - All 4 versions - Import into BibTeX


[PDF] ?? HowNet ?????????????
[PDF] from clr.org.cn??, ???, ???... - ??????, 2005 - clr.org.cn
... ????????????????. ??????. 2003.6(24),531~534 [10] Sparck-Jones,
K., and Galliers, J. 1996. Evaluating Natural Language Processing Systems: An Analysis and
Review. Lecture Notes in Artificial Intelligence 1083. Springer-Verlag. ... 
Cited by 23 - Related articles - View as HTML - All 7 versions - Import into BibTeX


??????????????????????
?? - 2006 - nthur.lib.nthu.edu.tw
... Vol. 38, No. 6, pp. 420-422. [36] Jones, KS, and Galliers, J., 1996, "Evaluating Natural
Language Processing Systems: An Analysis and Review," Technical Report
TR-291, Computer Laboratory, University of Cambridge. [37 ... 
All 2 versions - Import into BibTeX


[PDF] Production automatique du résumé de textes juridiques: évaluation de qualité et d'acceptabilité
[PDF] from umontreal.caA Farzindar... - TALN 2005, 2005 - rali.iro.umontreal.ca
... In DUC03, p. 160-167, Edmonton, Alberta, Canada: Association for Computational Linguistics.
SPARK-JONES K. & GALLIERS JR (1995). Evaluating Natural Language Processing Systems:
An Analysis and Review. Number 1083 in Lecture Notes in Artificial Intelligence. ... 
Cited by 9 - Related articles - View as HTML - All 5 versions - Import into BibTeX


[PDF] Évaluation des systèmes d'acquisition de terminologie: nouvelles pratiques, nouvelles métriques
[PDF] from univ-paris3.frI Timimi - Actes des 8e Journées internationales d'Analyse ..., 2006 - cavi.univ-paris3.fr
... Page 12. ISMAÏL TIMIMI JADT 2006 : 8es Journées internationales d'Analyse statistique des
Données Textuelles 906 Sparck-Jones K. and Gallier JR (1996). Evaluating Natural Language
Processing Systems : An Analysis and Review. Springer, Berlin, 1996. Timimi I. (1998). ... 
Related articles - View as HTML - All 3 versions - Import into BibTeX


Outiller la linguistique: de l'emprunt de techniques aux rencontres de savoirs
B Habert - Revue française de linguistique appliquée, 2004 - cairn.info
Cited by 8 - Related articles - All 3 versions - Import into BibTeX


[PDF] ConPor: um modelo de geração conceitual para o português
[PDF] from wlv.ac.ukL Specia... - 2003 - clg.wlv.ac.uk
... 318. Sparck-Jones, K. and Galliers, JR (1996) "Evaluating Natural Language
Processing Systems: an Analysis and Review", Springer-Verlag. Uchida, H. (2001)
"UNL Knowledge Base", UNU/IAS/UNL Center, Tokyo. Uchida ... 
Related articles - View as HTML - All 9 versions - Import into BibTeX


[PDF] O processo de avaliação do sistema ConPor
[PDF] from ufscar.brL Specia... - 2003 - dc.ufscar.br
Page 1. Universidade de São Paulo - USP Universidade Federal de São Carlos - UFSCar
Universidade Estadual Paulista - UNESP O processo de avaliação do sistema ConPor Lucia
Specia Lucia Helena Machado Rino NILC-TR-03-05 Fevereiro, 2003 ... 
Related articles - View as HTML - All 3 versions - Import into BibTeX


Filtrage pour la construction de résumés multi-documents guidée par un profil
[PDF] from archives-ouvertes.frO Ferret, S Leila Châar... - Traitement ..., 2004 - hal-cea.archives-ouvertes.fr
Page 1. TAL. Volume X - n° X/2004, pages X à Y Filtrage pour la construction de
résumés multi-documents guidée par un profil Sana Leila Châar, Olivier Ferret et
Christian Fluhr CEA - LIST/LIC2M (Laboratoire d'Ingénierie ... 
Related articles - All 4 versions - Import into BibTeX


[PDF] Prendre en compte la dimension globale d'un corpus dans la contextualisation du sens: expérimentations en informatique linguistique
[PDF] from archives-ouvertes.frP Beust... - 2006 - hal.archives-ouvertes.fr
Page 1. PRENDRE EN COMPTE LA DIMENSION GLOBALE D'UN CORPUS DANS
LA CONTEXTUALISATION DU SENS : EXPÉRIMENTATIONS EN INFORMATIQUE
LINGUISTIQUE Pierre BEUST, Thibault ROY GREYC CNRS ... 
Cited by 1 - Related articles - View as HTML - All 8 versions - Import into BibTeX