Ontolog Forum

Ontology Summit 2013: Ontology Evaluation Across the Ontology Lifecycle

8th in the series of a 3-month open annual event, by and for the Ontology Community. This Summit is co-organized by Ontolog, NIST, NCOR, NCBO, IAOA & NCO_NITRD

see: OntologySummit2013_Communique, our Website, and OntologySummit

What's New

{{{ ... [ Full proceedings for the session below are available online; just click on the respective ConferenceCall_{date}_ session page, and look under the "Archives" section ] ... }}}

  • The OntologySummit2013_Hackathon_Clinics Program will be taking place over the three Saturdays, 30-Mar-2013, 6-Apr-2013 & 13-Apr-2013 - Seven (7) projects are being featured - Participants can join us for the whole day's activities, and observers might be interested to dial into each project's "open webcast segment" of their workday - see access details under the Hackathon-Clinics Master Calendar

Ontology Summit 2013 Focus

Theme: "Ontology Evaluation Across the Ontology Lifecycle"

Description, Goals & Objectives

Currently, there is no agreed methodology for development of ontologies, and there are no universally agreed metrics for ontology evaluation. At the same time, everybody agrees that there are a lot of badly engineered ontologies out there, thus people use -- at least implicitly -- some criteria for the evaluation of ontologies.

The goal for Ontology Summit 2013 is to identify best practices for ontology development and evaluation. We will consider the entire lifecycle of an ontology -- from requirements gathering and analysis, through to design and implementation. In this endeavor, the Summit will seek collaboration with the software engineering and knowledge acquisition communities. Research in these fields has led to several mature models for the software lifecycle and the design of knowledge-based systems, and we expect that fruitful interaction among all participants will lead to a consensus for a methodology within ontological engineering. Following earlier Ontology Summit practice, the synthesized results of this season's discourse will be published as a Communiqué.

Process & Deliverables

Similar to our last 7 summits, this Ontology Summit will comprise of three-and-a-half (3.5) months of virtual discourse (over our archived mailing lists) and virtual panel sessions (over augmented conference calls), and culminate in a 2-day face-to-face workshop/symposium held on May 2~3, 2013 (Thu & Fri) at NIST (Gaithersburg, Maryland, US) during which we, among other things, present our distilled thoughts in a collaboratively developed communique. (ref.)

Structure and Discourse: Ontology Evaluation Across the Ontology Lifecycle

Co-chairs, Tracks and Champions


  • Online Forum - active discussion is also carried on over the [ ontology-summit ] mailing list - see participation details here
    • When starting a new thread on the list, please prefix the subject line with one of the following track labels, and make sure message content are on topic (i.e. that the discussion/message relates well to the subject line):
      • {intrinsic-aspects} for Track A: Intrinsic Aspects of Ontology Evaluation
      • {extrinsic-aspects} for Track B: Extrinsic Aspects of Ontology Evaluation
      • {quality-methodology} for Track C: Building Ontologies to Meet Evaluation Criteria
      • {software-environment} for Track D: Software Environments for Evaluating Ontologies
      • {biblio} for the Bibliographic Repository (Library on Zotero)
      • {communique} for discussions relating to the communique
      • {symposium} for Symposium related matters
      • (pr} for Public Relations related matters
      • a combination like {aaaaa-bbbbb} (where "aaaaa" could be "extrinsic-aspects", etc.)
      • no prefix, if they don't belong to any discussion track
    • Discussion that are not focused on the theme of this summit (but is ontology-related) should be deferred to the [ ontolog-forum ] mailing list

The Team

  • Co-organizers:
    • ONTOLOG (LeoObrst, PeterYim)
    • NIST (RamSriram)
    • NCOR (BarrySmith, FabianNeuhaus)
    • NCBO (MarkMusen, TrishWhetzel)
    • IAOA (MichaelGruninger, JohnBateman)
    • NCO_NITRD (GeorgeStrawn, ErnieLucier)

You are cordially invited to join us!

  • Like all activities Ontolog has been hosting, this is open to everyone.
    • Do join us if you concur with the theme and objective of this endeavor and would like to participate in, or follow the progress of the discourse
  • specific individuals who may be interested include (but not limit to):
    • members of ontology communities
    • potential user organizations
    • potential funders of ontology R&D and ontological engineering work
    • people in policy, industry, research, academia and the web working on sharing knowledge, semantic interoperability, knowledge representation, artificial intelligence ... who are engaged in the research, development, engineering and implementation of these subject matters
    • ...
  • Please join us in the "Ontology Summit 2013" virtual discourse (as one of the conveners of this initiative),
    • If you are already an Ontolog Member:
      • to participate in the "Ontology Summit 2013" virtual discourse, please subscribe to the [ontology-summit] forum (the convener's mailing list), by sending an empty (no message body is needed) message to: ontology-summit-join [at]
      • to browse the forum archives, see:
      • if you run into any problem, please send your subscription request directly to <>
    • If you are not already an Ontolog Member, and is interested to join the community:
      • please take a look at the details in our "Membership" section on the Ontolog WikiHomePage.
      • if you have additional questions or have run into any problem, please email <>

Discussion Archives & Shared-File Workspace

  • Mailing List Discussion Archives:
    • [ontology-summit] - Ontology Summit 2013 participants' discussion Archives - (open)
      • to participate in the virtual discourse, please subscribe to this [ontology-summit] forum (the summit participants' mailing list), by sending an empty (no message body is needed) message to: ontology-summit-join [at]
      • anyone responding to the RSVP for any of the summit events will be taken as having expressed interest to participate, and will be subscribed to this [ontology-summit] mailing list (write <> to let him know, if that is not the case.)
    • [ontology-summit-org] - Ontology Summit 2011 Organizing Committee List Archives - (password protected)

Conference Call, Meeting & Workshop

Event Calendar: Open Sessions

  • Master calendar: (still subject to modification)
    • Thu 2012.12.13 - (Pre-Launch) Community Brainstorm
    • Thu 2013.01.17 - Launch Event
    • Thu 2013.01.24 - session-02 - Track-B-I virtual panel session
    • Thu 2013.01.31 - session-03 - Track-A-I
    • Thu 2013.02.07 - session-04 - Track-C-I
    • Thu 2013.02.14 - session-05 - Track-D-I
    • Thu 2013.02.21 - session-06 - "Synthesis-I; Communique Outline & Organizing the Hackathon-Clinics"
    • Thu 2013.02.28 - session-07 - Track-B-II
    • Thu 2013.03.07 - session-08 - Track-A-II
    • Thu 2013.03.14 - session-09 - Track-C-II
    • Thu 2013.03.21 - session-10 - Track-D-II
    • Thu 2013.03.28 - session-11 - Getting the "hackathon," "clinics" and related activities going
    • Sat 2013.03.30 - Hackathon-Clinics (day-1)
    • Thu 2013.04.04 - session-12 - Synthesis-II
    • Sat 2013.04.06 - Hackathon-Clinics (day-2)
    • Thu 2013.04.11 - session-13 - Communique-draft-review
    • Sat 2013.04.13 - Hackathon-Clinics (day-3)
    • Thu 2013.04.18 - session-14 - Communique-finalize
    • Thu 2013.04.25 - session-15 - pre-symposium prep
    • Thu & Fri 2013.05.02 & 03 - Symposium (F2F)
    • Thu 2013.05.16 - Postmortem

Event Archives

OntologySummit2013_Symposium - Thu & Fri 2~3 May 2013 - at NIST, Gaithersburg, Maryland, USA

Organizing Committee Sessions

  • see: OntologySummit2013/GettingOrganized
  • 3rd Organizing Committee meeting - Fri 2012.01.11 - see details here
  • 2nd Organizing Committee meeting - Fri 2012.01.11 - see details here
  • 1st Organizing Committee meeting - Fri 2012.12.14 (those who are planning to join the committee should mark their calendars and come to this meeting) - see details here
  • First co-organizers meeting - getting started - 2012.11.28

Ontology Summit 2013 in the News, Blogosphere & Literature

... (insert content here, latest at the top)
  • 2013.02.04 - "Выступление на Ontology Summit 2013" [blogged in Russian] ("Presentation at the Ontology Summit 2013") - on AnatolyLevenchuk's Livejournal (blog), where his talk about virtual panel session-04 (7-Feb-2013) where he and other panelists will be presenting at - see:
  • Please use "#OntologySummit2013" or "#ontologysummit2013" (case insensitive) as twitter hashtag (elsewhere, too)

Additional Resources

This page is maintained by members of the [ OntologySummit2013 Organizing Committee].

Please send any suggestions, comments and edits for this page to <>

or to any other committee member. Thanks. =ppy/2012.12.06