A Survey on Ontology Evaluation Methods

Khalilian, Saiede

doi:10.30473/mrs.2020.48615.1402

Document Type : Research Paper

Author

saiede khalilian

Ph.D Candidate, Knowledge and Information Sience, University of Isfahan, Isfahanو Iran.

https://doi.org/10.30473/mrs.2020.48615.1402

Abstract

Purpose: Ontologies are an important part of the semantic web, and as ontologies are increasingly used and developed in areas such as knowledge management, information extraction and the semantic web, they need to be improved and standardized. Valuating ontologies (especially defining what constitutes a“good”or“better”ontology) is therefore of central importance for the Semantic Web community. The purpose of this article is to examine the ontology evaluation criteria and also to categorize them based on their relationship.
Methodology: The present study is an analytical review and library method was used to collect data.
Results: Despite much theoretical and conceptual work on ontology evaluation, there is still no consensus on ontology evaluation and it can be said that there is no method for evaluating ontology which is best or preferred. Instead, choosing the appropriate approach Depending on our purpose of evaluation, the application that the ontology is created for and what aspect of ontology we want to use and since ontology evaluation is a new and very important topic, especially for the semantic web, more research is needed and it is better to use it when used.he presented ontology evaluation techniques can be grouped into four categories: gold standard-based, corpus-based, task-based and criteria based approaches

Keywords

Main Subjects

References

فتحیان دستگردی، اکرم (1390). ارزیابی هستی‌شناسی‌ها: بررسی معیارها، رویکردها و سطوح. پردازش و مدیریت اطلاعات. ویژه‌نامه ذخیره، بازیابی و مدیریت اطلاعات، 25-3.

Amith, M., Heb, Z., Bian, J., Lossio-Ventura, J.A. & Tao, C. (2018). Assessing the practice of biomedical ontology evaluation: gaps and opportunities. Journal of Biomedical Informatics. 80, 1-13.

Bandeiraa, J., Bittencourta, I. I,. Espinheirab, P. &Isotanic, S. (2017). FOCA: A Methodology for Ontology Evaluation. arXiv preprint arXiv:1612.03353.

Brank, J., Mladenic, D. & Grobelnik, M. (2006). Gold standard based ontology evaluation using instance assignment. paper presented at the 4th International Workshop on Evaluation of Ontologies for the Web(EON) at the 15th International World Wide Web Conference, available at: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.71.3681&rep=rep1&type=pdf.

Brewster, C., Alani, H., Dasmahapatra, S. & Wilks, Y. (2004). Data driven ontology evaluation. paper presented at International Conference on Language Resources and Evaluation.available at: www.cbrewster.com/papers/BrewsterLREC.pdf

d’Aquin, M., Baldassarre, C., Gridinoc, L., Angeletou, S., Sabou, M. & Motta, E. (2007). Characterizing knowledge on the semantic web with Watson. Busan, Korea.1–10.

Degbelo, A. (2017). A Snapshot of Ontology Evaluation Criteria and Strategies. InProceedings of Semantics, Amsterdam, Netherlands, September 11-14,8.

Fathian Dastgerdi, A. (2012). Ontology Evaluation: Consideration of Criteria, Approaches and Layers. Information processing management, special issue: on Information Storage, retrieval nrj

G´omez-P´erez, A. (1994). Some ideas and examples to evaluate ontologies. Knowledge Systems Laboratory, Stanford University.

G´omez-P´erez, A. (2001). Evaluation of ontologies. International Journal of intelligent systems, 16(3), 391-409.

G´omez-P´erez, A. (2003). Ontology evaluation. In Handbook on ontologies (1sted.), S Staaband R Studer (Eds.). Springer Berlin Heidel berg ,251–273.

Gangemi, A. (2006). Modelling ontology evaluation and validation. Springer Berlin Heidelberg, 140-154.

Gangemi, A., Catenacci, C., Ciaramita, M., & Lehmann, J. (2006). Modelling ontology evaluation and validation. In The Semantic Web: Research and Applications, 3rd European Semantic Web Conference (ESWC 2006). Springer, Budva, Montenegro,140–154.

Gruber, T. (1995). Toward principles for the design of ontologies used for knowledge sharing. International Journal of Human-Computer Studies 43(5-6),907– 928.

Gruninger, M. & Fox, M.S. (1995). Methodology for the design and evaluation of ontologies. In Proceedings of the IJCAI Workshop on Basic Ontological Issues in Knowledge Sharing. Montreal, Quebec, Canada

Guarino, N. (1998). Formal ontology in information systems: Proceedings of the ﬁrst international conference (FOIS’98), June 6-8, Trento, Italy, 46, IOS press.

Guarino, N. and Welty, C. (2002). Evaluating ontological decisions with OntoClean. Commun. ACM ,45(2),61–65

Hlomani, H. (2014). Approaches, methods, metrics, measures, and subjectivity in ontology evaluation: A survey. Semantic Web Journal, 1, 1-5.

Kehagias, D. D., Papadimitriou, I., Hois, J., Tzovaras, D., & Bateman, J. (2008). A methodological approach for ontology evaluation and refinement. In The 2nd International Conference of ASK-IT. Nuremberg, Germany.

kim, s., & Sam, G. O. (2019). Extracting and applying evaluation criteria for ontology quality assessment. Library Hi Tech ahead-of-print (ahead-of-print).

Kuhn, W. (2009) Semantic engineering. In Research Trends in Geographic Information Science, G Navratil (Ed.). Springer Berlin Heidelberg,63–76.

Lozano-Tello, A., & G´omez-P´erez, A. (2004). Onto metric: a method to choose the appropriate ontology. Journal of Database Management 2(15),1–18.

Maedche, A., & Staab, S. (2002). Measuring similarity between ontologies. In Knowledge engineering and knowledge management: Ontologies and the semantic web. Springer Berlin Heidelberg, 251-263.

McIlraith, S. A., Son, T. C. & Zeng, H. (2001). Semantic web services. IEEE Intelligent Systems, 16, (2), 46– 53.

Noy, N.F and Hafner, C.D. (1997). The state of the art in ontology design: a survey and comparative review. AI Magazine 18, (3),53.

Obrst, L., Ceusters, W., Mani, I., Ray, S., and Smith, B. (2007). The evaluation of ontologies. In Semantic Web - Revolutionizing Knowledge Discovery in the Life Sciences, CB a kerand K Cheung(Eds.). Springer,139–158.

Raad, J., and Cruz, C. (2015). a survey on ontology evaluation methods, in Proc. of the 7^th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K2015.179–186.

Ulanov, A., Shevlyakov, G., Lyubomishchenko, N., Mehra, P., & Polutin, V. (2010). Monte Carlo Study of Taxonomy Evaluation. In Database and Expert Systems Applications (DEXA), Workshop on IEEE, 164-168

Vrandecic., D. (2009). Ontology evaluation. In Handbook on ontologies (2nded.), S Staab and R Studer(Eds.). SpringerBerlinHeidelberg,293–313.

Welty, C. A., Mahindru, R., & Chu-Carroll, J. (2003). Evaluating ontological analysis. In Semantic Integration Workshop, 92.

Yu, J., Thom, J. A., & Tam, A. (2009). Requirements-oriented methodology for evaluating ontologies. Information Systems, 34(8), 766–791.

Digital and Smart Libraries Researches

A Survey on Ontology Evaluation Methods

References

References

Volume 6, Issue 2
June 2019
Pages 25-34

A Survey on Ontology Evaluation Methods

References

References

Volume 6, Issue 2June 2019Pages 25-34

Volume 6, Issue 2
June 2019
Pages 25-34