View source for OntologySummit2010 PertinentQuestions

= [[OntologySummit2010|Ontology Summit 2010]]: Pertinent Questions  =

''This is a draft workspace to help us identify the pertinent questions that we want this summit to help answer. These questions are intended to help us focus our discussion and prepare survey instruments to collect input from the community ...'' 

== [[OntologySummit2010|Ontology Summit 2010]]: Description, Goals and Objectives  ==

:'''Increasingly, major national and international projects centered on ontology technology are being advanced by governments and by scientific and industrial organizations. This brings a growing need for ontology expertise and thus for new methods and institutions for the training of ontologists. The 2010 Ontology Summit will explore strategies to address this need in terms of curriculum, establishment of new career tracks, role of ontology support organizations and funding agencies, as well as training in the analysis and comparison of methodologies for designing, maintaining, implementing, testing and applying ontologies and associated tools and resources.''' 

== Pertinent Questions identified  ==

(mostly from input of the track champions) 

* Content-Present: 
**  
*** Which educational programmes are there, if any, which are mainly or entirely devoted to ontology and related topics? 
*** Within other educational programmes, what modules/courses are there which are mainly or entirely devoted to ontology and related topics? 
*** Are there any other programmes or modules/courses with sufficient ontologically relevant content? 
*** Are there curricular models (a.k.a. curricular guidelines) that include ontology-related topics? 
*** US, UK ... and other countries? 

* Content-Future: 
**  
*** What are the content topics (knowledge and skills), i.e., the competencies, necessary for training and educating an ontologist? 
*** What does an ontologist need to learn and in what order? 
*** What are the content topics useful or optionally desired for training and educating an ontologist? 
*** Is there a spectrum of ontologist positions (e.g., from taxonomist to developer of logical theories) and if so, what is the content and competencies required for each? 

* Quality-Present: 
**  
*** By what bodies, if any, are the programmes identified as having substantial ontological content currently accredited? 
*** By what bodies, if any, are ontology professionals currently certified? 
*** What other forms of quality assurance exist that may be relevant to the track mission? 

* Quality-Future 
**  
*** Are existing forms of quality assurance appropriate for the purposes of assuring educational provision as suitable for professional ontologists? 
*** How will training and educational programs and institutions delivering these programs be accredited? 
*** What forms of certification should be used? 
*** What other forms of quality control may be relevant to the track mission? 

* Requirements-Present: 
**  
*** Where do ontologists currently work? 
**** What organization types (companies, departments, institutions, agencies, etc.)? 
**** What project types (long/short term, part of larger system/program, focus on IT|KM|search|interop|metadata|other)? 
**** What fields or industries? 
*** What folks are doing KOS work that is within or heading toward ontology, but may not be labeled as such? 
*** What tasks do working ontologists perform and as roughly how much of their time (requirements gathering, elicitation, informal modeling, formal modeling, formal testing, user testing, "gold standard" and/or regression testing)? 
*** What skills do working ontologists typically acquire on the job, and what via formal training? 
**** What training do they wish they had, but don't have? 
*** What skills do employers expect? What formal training do employers expects? 
**** How do employers select ontologists when hiring? 
** additionally (from the 2009.12.10 session): 
*** how are expectations from ontologists different from those of knowledge engineers of the past? 
*** Is there any consistent relationship between job labels (ontologist | knowledge engineer | ontological engineer | concept modeler | ...) and activities/skills? 
*** What are the measures of effectiveness and performance? 

* Developments-Future: 
** from the perspectives of: 
*** (a) the market - potential employer of the ontologist; 
*** (b) the educator - the ontology training / education provider; and 
*** (c) the individual - the ontologist or ontologist-to-be); 
** for time horizon: ( ... and identify plausible developments and trends) 
*** (a) now 
*** (b) in 2.5 years 
*** (c) in 5 years 
*** (d) in 10 years 
*** (e) in 20 years 
** Questions: 
*** what are the skillsets that employers of ontologists will be looking for? 
*** when will the market be needing ontologists, and how many of them? 
*** from what academic background (disciplines) will ontologists come from? 
*** when will we start having "ontology departments" in universities and enterprises? 
*** what needs to happen between now and the day when we will have "ontology departments" in universities and enterprises? 
**** what would be typical career paths of individuals with ontology training? 
**** if an individual is inclined to pursue an ontology career, what are the education/training paths that he/she can pursue? 

----

=== Suggested Questionnaire from ArturoSanchez-AntonyGalton et al.  ===

ref. http://interop.cim3.net/forum//ontology-summit-org/2009-12/msg00024.html 

* (1) Name of institution 

* (2) Location of institution (city/country) 

* (3) Name of unit within the institution (e.g., department of, school of, college of, etc.) 

* (4) Person to contact 

* (5) If your institution offers an Ontology-related program, please answer the following questions. Otherwise, please skip to question 6 below 
** (5.1) Name of the program 
** (5.2) Type of program (e.g., degree, certificate, etc.) 
** (5.3) If the program is a degree, please indicate the type of degree (e.g., BS, MS, PhD, Associate, etc.) 
** (5.4) If the program is a not a degree, please indicate the level of the program (e.g., undergraduate, graduate, etc.) 
** (5.5) Discipline of program (e.g., Computing, Engineering, etc.) 
** (5.6) Course(s) which can be taken within the program. For each course, please indicate its name and mention the Ontology-related content covered 
** (5.7) If your program is accredited by an accreditation organization or body, please indicate its name 

* (6) If your institution does not offer an Ontology-related program, but does offer entire courses with Ontology-related content, please answer the following questions. Otherwise, please skip to question 7 below. 
** (6.1) Name of the program 
** (6.2) Type of program (e.g., degree, certificate, etc.) 
** (6.3) If the program is a degree, please indicate the type of degree (e.g., BS, MS, PhD, Associate, etc.) 
** (6.4) If the program is a not a degree, please indicate the level of the program (e.g., undergraduate, graduate, etc.) 
** (6.5) Discipline of program (e.g., Computing, Engineering, etc.) 
** (6.6) Course(s) which can be taken within the program entirely dedicated to Ontology-related content. For each course, please indicate its name and mention
the Ontology-related content covered 
** (6.7) If your program is accredited by an accreditation organization or body, please indicate its name 

* (7) If your institution does not offer an Ontology-related program, and does not offer entire courses with Ontology-related content, but does offer courses tha have some Ontology-related content, please answer the following quesions. Otherwise, skip to question 8 below. 
** (7.1) Name of the program 
** (7.2) Type of program (e.g., degree, certificate, etc.) 
** (7.3) If the program is a degree, please indicate the type of degree (e.g., BS, MS, PhD, Associate, etc.) 
** (7.4) If the program is a not a degree, please indicate the level of the program (e.g., undergraduate, graduate, etc.) 
** (7.5) Discipline of program (e.g., Computing, Engineering, etc.) 
** (7.6) Course(s) which can be taken within the program with some Ontology-related content. For each course, please indicate its name and mention the Ontology-related content covered 
** (7.7) If your program is accredited by an accreditation organization or body, please indicate its name 

* (8) If you know of any organization that certifies ontologists as professionals, please include its name and a web-link to it. Please list all organizations you are aware of, mentioning the name of the certificate. 

* (9) Please include any relevant comment related to ontology content and quality assurance you are aware of that is not covered by the questions in this survey 

* Remarks: 
** ''AntonyGalton'': we need to be aware of the potential for confusion (already mentioned in previous meetings) arising from different usages for terms such as 'programme' and 'course' (and 'module', 'unit', etc which are used by some institutions, at least in the UK). We might need to have 'cultural variants' of the questionnaire to allow for this (or at any rate, some 'note on terminology' to be added to the questionnaire). 

----

== Quality Track Questions  ==

(from [[FabianNeuhaus|Fabian Neuhaus]] with comment from Leo - ref. [http://interop.cim3.net/forum//ontology-summit-org/2009-12/msg00031.html exchange] 

* 1) If you would hire an ontologist for your organization
- what are the three most important skills that you would be looking
for? (suggested answers: philosophical ontology, logic/formal
semantics, ontology mapping, ontology lifecycle management, ontology
evaluation/best practices, data modelling, knowledge of tools) 
** [[LeoObrst|Leo Obrst]]: ADD: knowledge representation/AI 
** [[AldoGangemi|Aldo Gangemi]]: ontology design, conceptual modelling, ontology reengineering and refactoring, knowledge extraction, ... 

* 2) What level of ontological education would you be looking for
(suggested answers: software engineer or domain expert with a
certified participation in 10 days course on applied ontology / a
software engineer or domain expert with one 1 year of additional
training in applied ontology / somebody with a 2 year masters degree
in applied ontology / someone with PhD in applied ontology) 
** [[AldoGangemi|Aldo Gangemi]]: applied ontology is not clear to anyone (even within ontology community I should say after my experience ;)) ... better ontology/knowledge engineering? 

* 3) What kind of accreditation of the educational institution are you
looking for (???) 
** [[LeoObrst|Leo Obrst]]: ADD: (currently, just an accredited school with a good reputation in AI, computer science, linguistics/semantics of language, formal ontology/philosophy). 
** [[AldoGangemi|Aldo Gangemi]]: ??? masters, PhD, references, teamworking experience, responsibilites taken, ... 

----

=== Suggested Survey Questions for Requirements Track - Present, from Amanda Vizedom  ===

==== Objective  ====

To discover and clarify requirements for ontologist training, from the perpective of consumers of such training: trainees, employers, and others who might rely on the quality of such training and/or the reliability of any certification it produces. 

This survey is designed to elicit information about the knowledge and skills ontologists need, or are expected to have, in a variety of working contexts. In addition to harvesting such knowledge from currently working ontologists, the survey extends inquiry to other potential stake-holders in the training of future ontologists: those who might look to such training as a solution to changing job requirements or market conditions, and those who hire, manage, evaluate, or otherwise depend upon the work of ontologists. By such broad-ranging requirements gathering, the Ontology Summit Organizing Committee hopes to produce a clearer, more realistic picture of the needs to be met by training of ontologists. 

Additionally, the Organizing Committee is deeply aware of varied and multidisciplinary nature of ontology today. A single set of requirements, satisfying the needs and expectations of all current working contexts, is unlikely. In the design of ontology training curricula, it will therefore be important to know not only what content might be covered, but also how the elements of that content relate to various kinds of working situations and tasks that trained ontologists might face. That is, it is good to have as comprehensive a training menu as is feasible; it is even better to understand how to prioritize content and assemble curricula from that menu to suit particular training needs. 

==== Special Instructions  ====

The questions below can be divided into two main groups: those that elicit information about ontologist training needs and those that elicit information about the context in which the these needs are present. Any genuine responses to the needs questions will help to fill out the picture of needs and expectations. However, the survey will be most effective if each set of answers to the needs questions comes from a consistent point of view and a working context. Many of those we hope will respond have multiples roles and working contexts from which perspectives you might answer.  You are encouraged to take the survey multiple times, each time utilizing the initial questions about your organization and role to roughly identify the point of view and working context with which your remaining answers are best associated. Your cooperation in this investigation, including your willingness to specify context as just described, are greatly appreciated and of great potential benefit to our field's self-understanding. 

Therefore, if you have more than one relationship to Ontologists (e.g., are one, hire them, train them, etc.) and/or have such a relationship with more than one organization (e.g., employer, clients, academic affiliation), please select one such role/relationship and complete the survey with consistently from the perspective of that role/relationship. You are encouraged to then repeat the survey for as many such role/relationships as you have and deem relevantly different.  In 1a you are asked to to provide the organization and role for this set of answers; differing responses here are sufficient for us to distinguish duplicate from intentionally varied submissions. Thank you. 

Final Note: Throughout this survey, please interpret "ontology" to mean formal ontology, a field involving formal representation of knowledge organization structures or, alternatively, formal modeling of concepts and relationships, often for computational purposes. In contrast, "ontology" herein is *not* intended to refer to the traditional philosophical subfield of ontology, also called "metaphysics" and often paired or contrasted with epistemology. Correspondingly, "ontologist" should be interepreted to mean a practitioner of the contemporary, formal field. If you are involved in the philosophical field but not the formal, representational field, please keep this disambiguation in mind and answer "no" when asked whether you are a practicing ontologist. 

==== Questions  ====

* 1a[[RespondantBasicInfo]]. 
** Name _________________ 
** Organization (for this set of answers)_________________ 
** Role (for this set of answers)_________________ 
** Contact E-mail address _________________ 
** Contact Phone number   _________________ 
** Contact Preferences 	_________________ 

* 1b[[RespondantPrimarySector]].
What is your Organization's primary Sector of operation? Please answer with reference to the organization you identified in 1a.  A small collection of very general Sectors is given here. However, you are very much encouraged to be more specific, especially by utilizing one of the existing organization classification schemes such as the International Standard Industrial Classification  of All Economic Activities (ISIC) (see http://unstats.un.org/unsd/cr/registry/regcst.asp?Cl=27)or North American Industry Classification System (NAICS) (see http://www.census.gov/eos/www/naics/ - search box in upper left lets you find sector descriptions containing keywords) or International. Please remember that here you are characterizing your organization, rather than your own specialty or function within it. 
** Education 
** Government 
** Transportation 
** Manufacturing 
** Service Industries 
** Utilities (water, electricity, etc.) 
** Agriculture / Aquaculture 
** Management of Natural Resources (forestry, parks) 
** Natural Resource Extraction (mining, drilling) 
** Scientific and Technical Research and Development 
** Finance 
** Medicine 
** Arts and Entertainment 
** Administrative services 
** Construction 
** Information Technology 
** Information Content (publishing, writing, recording, etc.) 
** Cross-sector consulting 
** ISIC Sector Code: ________ 
** NAICS Sector Code: ________ 
** Other (Please Identify) ______________ 

* 1c[[RepondantPrimaryFunction]].
What is your primary function within your organization? A small collection of common roles is given here, However, you are welcome to be more specific, especially by utilizing one of the existing occupation classification schemes such as the International Standard Classification of Occupations (ISCO) (see http://www.ilo.org/public/english/bureau/stat/isco/isco88/major.htm) Standard Occupational Classification (SOC) codes (see http://www.bls.gov/soc/soc_majo.htm) or the Occupational Information Network (O*NET) Occupational Listings (see http://online.onetcenter.org/) 
** Research 
** Teaching and Training 
** Testing and Evaluation 
** Scientific and Technical Advisor 
** Technical Lead (development) 
** Project Management 
** Department or other Sub-organization Management 
** Enterprise-level Management 
** Business Development 
** Knowledge Management 
** Internal IT Infrastructure 
** Product Development 
** Financial Management 
** Supply Chain Management 
** Decision Support to Executive Level 
** Resource Management 
** Compliance 
** Web Services 
** Operations 
** External-facing Information gathering and Analysis (Business Intelligence or otherwise) 
** Internal-facing Information gathering and Analysis  Organizational self-monitoring, preparedness, compliance, or otherwise) 
** ISCO Code: _______________________ 
** SOC Code: ________________________ 
** O*NET Code: ______________________ 
** Other (Please Identify) _________________ 

* 1d[[RespondantPersonalOntologyWork]].
Do you personally design, develop, test, evaluate, or conduct research on formal ontologies? Or, have you done significant work of this sort in the past? If so, please indicate the nature of the work.  If not, please select the last option. 
** I personally develop formal ontology content 
** I personally design formal ontologies to meet functional and/or situational requirements 
** I personally evaluate formal ontologies. 
** I personally conduct research in the area of formal ontology and/or its applications. 
** I have personally developed or designed ontologies in the past, but don't currently. (how long past?) 
** I hope or expect to personally develop or design ontologies in the future. (how long future?) 
** I personally work in a related field and am not sure whether I'm an ontologist or not. [If this is your answer, be sure to see 1g-1i, below.] 
** Other (Please Identify) ______________________ 
** I don't personally design, develop, test, evaluate, or conduct research on formal ontologies. 

* 1e[[RespondantOtherRelationshipToOntologyWork]].
Within the organization and role you identified, do you have a relationship to ontologist and/or ontology work, other than or in addition to personally performing work as described in 1d?  Or, have you had a significant relationship to ontology work in the past? If so, please indicate the nature of this relationship. If not, please select the last option. 
** I personally develop applications that make use of ontologies 
** I personally design applications that make use of ontologies 
** I personally develop systems in which the system or one or more components incorporate ontologies 
** I personally design systems in which the system or one or more components incorporate ontologies 
** I personally oversee an ontology design or development team 
** I personally oversee a team whose responsibilities include ontology design or development 
** I personally oversee a project or program that includes ontology design or development 
** I personally am involved with a project, program, or team that depends on ontology design or development performed elsewhere. 
** I am personally involved in the hiring of ontologists 
** I am personally involved in the evaluation of ontologists 
** I am personally involved in the training of ontologists 
** I am personally involved in the assignment of ontologists to projects 
** Other (Please Identify) ______________________________ 
** I don't have a significant relationship to ontology work other than, or in addition to, personally performing it. 

* 1g[[RespondantInNeighboringField]].
Have you personally designed or developed taxonomies, thesauri, controlled vocabularies, classification systems, data models, knowledge models, category structures, or other Knowledge Organization Structures beyond (or in addition to) full formal ontologies? Or, have you done significant work of this sort in the past?  If so, please indicate what kinds of KOS or models you have developed: 
** Taxonomies 
** Semantic Networks 
** Controlled Vocabularies 
** Thesauri 
** Subject/Classification Heirarchies 
** Concept Maps 
** Topic Maps 
** Data Models 
** Entity Relationship Models 
** Other (Please Identify) ____________________ 
** Haven't developed 

* 1h[[NeighborFieldRelationToOntology]]. If you answered no to 1e but yes to 1g, do you consider this work to be ontology work, and yourself in this capacity to have worked as an ontologist? If this doesn't apply to you, please choose the last option. 
** Yes 
** No 
** Not sure 
** Not applicable 

* 1i[[RespondantAsTrainer]]-TrainingContent.
Are you involved in the development or delivery of Ontology Training? If so, what content do you cover? If not, please choose the last option. 
** Principles or Fundamentals of Ontology 
** History 
** Languages 
** Tools 
** Applications 

* 2a[[RespondantAsPotentialTrainee]].
Are you looking for or considering receiving training in ontology?  If so, please indicate the level of training you are considering. If not, please choose the last option. 
** Survey or familiarization (one day to one week) 
** Introductory Technical Course (one semester or equivalent thereof) 
** Professional Certification (Potentially several years, intermittent/part-time, with tests of compentence required for certification) 
** Hands-on training without certification (Potentially internship or project-oriented, lab-like course) 
** Hands-on training with certification (Potentially internship or lab-like course, with production and/or tests required for certification) 
** Undergraduate degree (4 year) 
** Masters degree 
** Ph.D. 
** Other (Please Identify) _____________________ 
** I'm not considering such training. 

* 2b[[ReasonForInterestInOntology]].
If you are considering training in ontology, what is the reason for this interest? If you are not considering such training, please choose the last option. 
** I work in a neighboring field and find myself wanting or adding features associated with ontologies to other kinds of KOSes or models. 
** I think that some or all of the problems I'm working on are better addressed with ontologies. 
** My organization needs ontologists 
** My project needs ontologists 
** The job prospects for ontologist are better than those in my current area 
** Personal interest 
** I want to work on other kinds of problems or projects that involve ontologies. 
** Other (Please Identify) _______________________ 
** Not applicable 

* 2c[[RespondantRelatedBackgroundArea]].
If you are considering training in ontology, do you have prior background (formal training and/or experience) that, in your view, helps you understand or perform ontology work? If so, please state the nature of this background. If you are not considering ontology training, please choose the last option. 
** Taxonomy 
** Library Science 
** Computer Science (general) 
** Programming 
** Logic 
** Mathematics 
** Philosophy 
** Cognitive Science 
** Linguistics 
** Computational Linguistics 
** Knowledge Management 
** Data Modeling 
** Artificial Intelligence 
** Other (Please Identify) 
** I don't have relevant training 
** Not applicable 

* 2d[[RespondantRelatedBackgroundDepth]].
If you identified related background above, what is the nature and extent of this background? If you did not identify such background, please choose the last option. 
** Work experience (# years? ________) 
** Academic background (duration of study or degree? __________) 
** On the job training (duration?___________ source?_____________) 
** Professional course(s) or Program(s) (Please Identify)______________________ 
** Other (Please Identify) ________________ 
** Not applicable 

* 2e[[PotentialTraineeNeeds]]
If you are considering training in ontology, which of the following areas of knowledge or skill are you looking for? In other words, if you were selecting a training program today, what content would you expect it to have?  If you are not considering training, please choose the last option. 
** Theory and principles 
** Logic 
** Set Theory 
** Overview of common ontology languages 
** Specific ontology language(s) (Please Identify) _____________________ 
** Overview of common ontology tools 
** Specific ontology tool(s) (Please Identify) _________________ 
** Overview of common ontology applications and uses 
** Specific ontology application(s) and use(s) (Please Identify)____________ 
** Overview of ontology development approaches, contrasts and trade-offs 
** Specific ontology development approach(es) (Please Identify) ____________ 
** Techniques for ontology development from various source types (e.g., domain documents, Subject Matter Experts (SMEs), data models, business process models, other) 
** Techniques for ontology development from specific source types (Please Identify)______________ 
** Ontology Lifecycle (requirements, design, development, testing, deployment ...) 
** Other (Please Identify) _________________________________________ 
** Not applicable 

* 3a[[RespondantHiringOfOntologists]].
Are you involved in the hiring or recruitment of ontologists? Or, have you done so in the past?  If so, please indicate nature of this activity. If not, please choose the last option. 
** I am a professional recruiter and recruit ontologists for multiple employers. 
** I am a professional recruiter and recruit ontologists for employment inside my organization. 
** I am an HR professional and hire ontologists for employment within my organization. 
** I am a manager or executive and am involved in hiring ontologists for an organization, department, program, project, or team. 
** I 
** I am not involved in hiring or recruitment of ontologists. 

* 3b[[DesiredDepthOfTraining]].
If you are involved in the hiring or recruitment of ontologists, please indicate what level of training or experience you look for in an ontologist candidate. If you are not involved in hiring or recruitment, please choose the last option. 
** Academic degree 
** Experience with job title "ontologist" 
** Experience with job title "applied ontologist" 
** Experience with job title "knowledge engineer" 
** Experience with other job title (Please Specify) _________________ 
** Experience as a software engineer or domain expert, plus certified participation in a 10 day course on ontology / applied ontology / knowledge engineering / knowledge representation 
** Experience as a software engineer or domain expert, plus 1 year of additional training in ontology / applied ontology / knowledge engineering / knowledge representation 
** An undergraduate degree, from an accredited school with a good reputation 
** A Masters degree or equivalent, from an accredited school with a good reputation 
** A PhD or equivalent, from an accredited school with a good reputation 
** A degree specifically in the field of applied ontology / applied ontology / knowledge engineering / knowledge representation 
** A degree specifically in a directly relevant field, possibly including (select those you would include): 
*** computer science, 
*** artificial intelligence, 
*** linguistics 
*** philosophy 
*** formal logic 
*** cognitive science 
*** library and information science 
*** other (please specify) _______________ 
** Experience on projects similar to the one for which I am hiring 
** Experience on a range of ontology projects 
** Experience working in teams with other ontologists 
** Experience working with subject matter experts 
** Experience working with programmers / application developers 
** Experience with the full ontology lifecycle 
** Other Experience (Please Specify) ________________ 
** Specific Ontology Training or Certification (Please Specify) ______________ 
** Not applicable 

* 3c[[DesiredAreasOfTrainingOrExperience]].
If you are involved in the hiring or recrutiment of ontologists, please indicate what knowledge, skills, experience, and/or characteristics you look for in an ontologist candidate. If you are not involved in hiring or recruitment, please choose the last option. 
** Working with Subject Matter Experts (SMEs) 
** Extracting knowledge from existing corpora of document 
** Working with data models 
** Philosophical ontology 
** Logic/formal semantics, 
** Ontology mapping 
** Ontology lifecycle management, 
** Ontology evaluation/best practices 
** Data modeling 
** Familiarity with Ontology tools 
** Knowledge Representation 
** Artificial Intelligence 
** Conceptual modeling 
** Ontology re-engineering and re-factoring 
** Knowledge extraction and elicitation 
** Context modeling 
** Linguistics 
** Semiotics 
** Cognitive modelling 
** Object Oriented Programing 
** Database design or administration 
** Requirements Elicitation 
** Ontology testing 
** Ontology-based Information Indexing and/or Search and Retrieval 
** Ontology-based data integration 
** Web development 
** Semantic Web 
** Service development 
** Knowledge and information management 
** IT administration 
** Enterprise architecture 
** Business process modelling and/or analysis 
** Special Domain Knowledge (Please Identify) ___________________ 
** Project Management 
**  
** Other (Please Identify) ____________________________ 
** Not applicable 

* 3d[[TopPrioritiesWhenHiringOntologists]].
If you identified some areas as desirable in 3b, please select *just three* that you would rank as most important in your hiring decisions. If you are not involved in hiring, please select the last option. 
** <repeat list from 3c> 

* 4a[[RespondentEvaluationOfOntologists]]
Are you involved in the evaluation of ontologist skill, knowledge, and/or performance? If so, please indicate what knowledge, skills, and characteristics you think are important for ontologist quality and success. If not, please choose the last option 
** <repeat list from 3c> 

* 5a[[OntologistSelfIDTrainingNeeds]]
If you are a working ontology developer, are there areas of training you wish you had, for current, past, or possible future ontology positions?  If so, please identify them from the list below or add under "Other" if they are not listed. If you do not personally perform ontology work, please select the last option. 
** <repeat list from 3c> 

----

=== Florescu-Yim questionnaire  ===

* Profiling questions: 
** Name 
** organization 
** Job title 
** Industry 
** Country 
** Role in ontology-related employment or education 
** ___ years of experience in ontology-related work 
** ___ years of experience in __________ [project-management / education-training / development-engineering] 
** remarks: ______________________ 

* 1. For my organization ____________, I would estimate the number of ontology-related jobs to be: 
** now ................ _________ 
** in 2.5 years ....... _________ 
** in 5 years ......... _________ 
** in 10 years ........ _________ 
** in 20 years ........ _________ 

* 2. For my organization, we (already have) would estimate that there will be:
An O-Dept   An O-program   O-employees 
** now ................ _________    __________    _________ 
** in 2.5 years ....... _________    __________    _________ 
** in 5 years ......... _________    __________    _________ 
** in 10 years ........ _________    __________    _________ 
** in 20 years ........ _________    __________    _________ 

* 3. what needs to happen between now and the day when we will have "ontology departments" in universities and enterprises? 

* 4. what would be typical career paths of individuals with ontology training? 

* 5. if an individual is inclined to pursue an ontology career, what are the education/training paths that he/she can pursue? 

=== Questions to elicit Developments for the RTDelphi  ===

* When responding to the following questions, please think along the following time frame: 
** now, 
** in 2.5 years, 
** in 5 years, 
** in 10 years, and 
** in 20 years 

Please provide the most probable answer, in your opinion, to each of the questions below. From your answers, we will distill the "developments" (statements) that will help get an outlook on the future of ontology and ontologists. 

* What major "Development(s)" (please express in one statement) do you foresee happening to the domain of Ontology or to the Ontologist profession over the following 20 years?  (e.g. recognition of ontology as a science) 

* What do you see as important emerging trends concerning ontology, ontologists or ontology training/education over the next 20 years? 

* About how many "ontologists" (or professionals doing work that requires an "ontology education or training") do you estimate the world might need over the next 20 years? 

* What are the potential futures of ontology in academia? (e.g. university departments, mandatory credit courses, undergrad, grad, PhD, etc) 

* What are the potential futures of ontology in enterprises? (e.g. job title, skill required, etc.) 

* What needs to happen between now and the day when we will have "ontology departments" in universities and enterprises? 

* If you were to educate the general public about "ontology," what do you expect them to learn, know or understand? 

=== 16 Developments selected for use in the RTDelphi Study  ===

''Ref.: [[OntologySummit2010_FutureDevelopments_Synthesis|Syntheses of the [[OntologySummit2010|Ontology Summit 2010]] Panel Session-1 Input]]'' 

# on a global basis, at least 10 universities have a Ontology Science department 
# on a global basis, at least 10 universities have a Ontology Engineering department 
# on a global basis, at least 10 universities have cross-disciplinary programs in Ontology Science and/or Engineering department offering Master degrees (for career professionals) or PhD degrees (for researchers) 
# at least 5% of all professionals in system architecture, systems design and engineering, software engineering and information technology will be required to have proper ontology training (and a larger number will need some background in ontology) 
# accredited programs are available from educational institutions that train certified professionals Ontologists (with the kind of standings that other professionals like scientists, engineers, architects, lawyers, doctors, nurses, pharmacists, etc.) 
# the terms and the disciplines of "Formal Ontology" and "Ontology in Information Science" are properly understood by academia and industry (in related fields) 
# the "ontology" word, and teaching of the basics of it, shows up in secondary/high school education 
# the "ontology" word, and teaching of the basics of it, shows up in primary/elementary school education 
# the discipline of "Ontology" is properly understood by everyday people (the way disciplines like mathematics, physics, psychology, music, art, etc. is understood) 
# International Standards are regularly being developed and expressed, BOTH in a natural language and as an ontology 
# persistent repositories of quality ontologies are available for professional and public use (and they are being regularly used) 
# compelling tools that allow everyday data and information to be "ontologized" by everyday people emerge ... suggest what those tools might be 
# compelling "ontology enabled" applications emerge ... suggest what they might be 
# compelling evidence of the benefits of "Ontology" emerge ... suggest what that might be 
# significant increase (10x the current level or better; assuming current level is non-zero) in R&D funding is put into developing Ontology science and engineering 
# a major breakthrough is made in the field of Ontology 

----

== The online Surveys and RTDelphi study - see: [[OntologySummit2010_Survey]]  ==

----

== Resources and Reference  ==

* Best Practices for Survey Design - see: http://s3.amazonaws.com/SurveyMonkeyFiles/UserManual.pdf 
* "The Delphi Method" - see: http://www.millennium-project.org/FRMv3_0/04-Delphi.pdf  
* "The Real-Time Delphi Method" - see: http://www.millennium-project.org/FRMv3_0/05-Real-Time_Delphi.pdf  

----

== Remarks & other input  ==

* Amanda / 2009.12.15: asking the community "who else should we ask?" 

[[Category:OntologySummit]]    [[Category:OntologySummit2010]]