ConferenceCall 2024 03 20 - Revision history

Forum: /* Discussion */

2024-03-21T01:51:57Z

Discussion

← Older revision		Revision as of 01:51, 21 March 2024
Line 51:		Line 51:

	== Discussion ==		== Discussion ==
			[12:11] Ravi Sharma: Are symbols of chemistry so well understood that it can not only identify the chemical but also whether these are allowed based on valence etc?

			[12:15] Ravi Sharma: Till the classical is more than training set as it incorporates rules of chemistry as well?

			[12:21] Ravi Sharma: where do you use reasoners?

			[12:22] Ravi Sharma: so AI enhances deep learning further but does it use transformers?

			[12:23] John Sowa: For many important applications, 99% accuracy is unacceptable. In finance, for example, accuracy to a fraction of a cent is an absolute requirement.

			[12:25] John Sowa: How can formal deduction be used to ensure absolute consistency with a database and a precise ontology?

			[12:25] Ravi Sharma: Bidirectional learning with filtering is a great feature but how much is improvement due to this?

			[12:28] Phil Jackson: Can the approach be applied to discovery of patterns of information within DNA molecules?

			[12:28] Ravi Sharma: is the pretraining improvement because it learns the chemical rules?

			[12:28] Douglas R. Miles: Can a Transformer be used store clause rules ?

			[12:29] Douglas R. Miles: store and suggest rules that is*

			[12:41] Todd Schneider: John, wouldn’t it be the case that LLMs and neural networks should not be used for some applications?

			[12:46] Michael Grüninger: No — the point is that the models of the axioms are isomorphic to graphs (as mathematical structures)

			[12:47] Michael Grüninger: It’s not the language that is graphical

			[12:48] Todd Schneider: Michael, is your response to John’s comment about ‘linear’ languages’ and graphs?

			[12:50] Michael Grüninger: Yes

			[12:57] John Sowa: Every graph can be linearized, and every linear notation can be mapped to a graph.

			[12:58] John Sowa: But there are an enormous number of different kinds of graphs and linear notations.

			[12:58] John Sowa: For different applications and different problems or questions, different representations may be better than others.

			[12:59] John Sowa: Fundamental principle: there is no single paradigm that is ideal for all possible applications.

			[13:00] John Sowa: Two paradigms are better than one, and multiple paradigms are even better.

			[13:00] Michael Grüninger: A Molecular Structure Ontology for Medicinal Chemistry Chui and Grüninger FOIS 2016

			[13:00] Riley Moher: Does the attention in the classifier reveal any kind of features or structural properties of graphs? And would you expect this to be correlated with axioms of the ontology?

			[13:02] Fabian Neuhaus: @Michael: we also have translated the structural representation in ChEBi in FOL. Unfortunately, the many non-leaf nodes in ChEBI do not contain structural definitions, and of those many are incomplete. Thus, the translation to FOL lead to wrong axioms / definition.

			[13:04] Lotti Tu: thank you for the great talk!

			[13:05] Riley Moher: Thank you, very interesting

			[13:06] Bev Corwin: Thank you

	== Resources ==		== Resources ==

Forum: /* Resources */

2024-03-21T01:48:58Z

Resources

← Older revision		Revision as of 01:48, 21 March 2024
Line 53:		Line 53:

	== Resources ==		== Resources ==
			* [https://bit.ly/3TDfNqM Slides]
	* [https://bit.ly/3Tzib0u Video Recording]		* [https://bit.ly/3Tzib0u Video Recording]

Forum: /* Resources */

2024-03-21T01:48:30Z

Resources

← Older revision		Revision as of 01:48, 21 March 2024
Line 53:		Line 53:

	== Resources ==		== Resources ==
			* [https://bit.ly/3Tzib0u Video Recording]

	== Previous Meetings ==		== Previous Meetings ==

Forum: /* Agenda */

2024-03-21T01:47:46Z

Agenda

← Older revision		Revision as of 01:47, 21 March 2024
Line 24:		Line 24:
	** Abstract: Reference ontologies play an essential role in organising knowledge in the life sciences and other domains. They are built and maintained manually. Since this is an expensive process, many reference ontologies only cover a small fraction of their domain. We develop techniques that enable the automatic extension of the coverage of a reference ontology by extending it with entities that have not been manually added yet. The extension shall be faithful to the (often implicit) design decisions by the developers of the reference ontology. While this is a generic problem, our use case addresses the Chemical Entities of Biological Interest (ChEBI) ontology with classes of molecules, since the chemical domain is particularly suited to our approach. ChEBI provides annotations that represent the structure of chemical entities (e.g., molecules and functional groups).<br/>We show that classical machine learning approaches can outperform ClassyFire, a rule-based system representing the state of the art for the task of classifying new molecules, and is already being used for the extension of ChEBI. Moreover, we develop RoBERTa and Electra transformer neural networks that achieve even better performance. In addition, the axioms of the ontology can be used during the training of prediction models as a form of semantic loss function. Furthermore, we show that ontology pre-training can improve the performance of transformer networks for the task of prediction of toxicity of chemical molecules. Finally, we show that our model learns to focus attention on more meaningful chemical groups when making predictions with ontology pre-training than without, paving a path towards greater robustness and interpretability. This strategy has general applicability as a neuro-symbolic approach to embed meaningful semantics into neural networks.		** Abstract: Reference ontologies play an essential role in organising knowledge in the life sciences and other domains. They are built and maintained manually. Since this is an expensive process, many reference ontologies only cover a small fraction of their domain. We develop techniques that enable the automatic extension of the coverage of a reference ontology by extending it with entities that have not been manually added yet. The extension shall be faithful to the (often implicit) design decisions by the developers of the reference ontology. While this is a generic problem, our use case addresses the Chemical Entities of Biological Interest (ChEBI) ontology with classes of molecules, since the chemical domain is particularly suited to our approach. ChEBI provides annotations that represent the structure of chemical entities (e.g., molecules and functional groups).<br/>We show that classical machine learning approaches can outperform ClassyFire, a rule-based system representing the state of the art for the task of classifying new molecules, and is already being used for the extension of ChEBI. Moreover, we develop RoBERTa and Electra transformer neural networks that achieve even better performance. In addition, the axioms of the ontology can be used during the training of prediction models as a form of semantic loss function. Furthermore, we show that ontology pre-training can improve the performance of transformer networks for the task of prediction of toxicity of chemical molecules. Finally, we show that our model learns to focus attention on more meaningful chemical groups when making predictions with ontology pre-training than without, paving a path towards greater robustness and interpretability. This strategy has general applicability as a neuro-symbolic approach to embed meaningful semantics into neural networks.
	** Bio: Till Mossakowski is a professor of theoretical computer science at Otto-von-Guericke University of Magdeburg, Germany. He has co-designed the distributed ontology, model and specification language DOL, as well as the corresponding Heterogeneous Tool Set. His research interests are logic, knowledge representation, semantics, and neural-symbolic integration, as well as applications in energy network simulation models, chemistry and material sciences.		** Bio: Till Mossakowski is a professor of theoretical computer science at Otto-von-Guericke University of Magdeburg, Germany. He has co-designed the distributed ontology, model and specification language DOL, as well as the corresponding Heterogeneous Tool Set. His research interests are logic, knowledge representation, semantics, and neural-symbolic integration, as well as applications in energy network simulation models, chemistry and material sciences.
			** [https://bit.ly/3Tzib0u Video Recording]

	== Conference Call Information ==		== Conference Call Information ==

Forum: /* Participants */

2024-03-21T01:47:00Z

Participants

← Older revision		Revision as of 01:47, 21 March 2024
Line 43:		Line 43:
	* Lotti Tu		* Lotti Tu
	* [[MichaelGruninger\|Michael Grüninger]]		* [[MichaelGruninger\|Michael Grüninger]]
	* ~~[[PhilJackson\|~~Phil Jackson]]		* Phil Jackson
	* [[RaviSharma\|Ravi Sharma]]		* [[RaviSharma\|Ravi Sharma]]
	* Riley Moher		* Riley Moher

Forum: /* Participants */

2024-03-21T01:46:29Z

Participants

← Older revision		Revision as of 01:46, 21 March 2024
Line 35:		Line 35:

	== Participants ==		== Participants ==
			* [[BevCorwin\|Bev Corwin]]
			* [[DouglasRMiles\|Douglas R Miles]]
			* [[FabianNeuhaus\|Fabian Neuhaus]]
			* [[GaryBergCross\|Gary Berg-Cross]]
			* [[JohnSowa\|John Sowa]]
			* [[KenBaclawski\|Ken Baclawski]]
			* Lotti Tu
			* [[MichaelGruninger\|Michael Grüninger]]
			* [[PhilJackson\|Phil Jackson]]
			* [[RaviSharma\|Ravi Sharma]]
			* Riley Moher
			* [[TillMossakowski\|Till Mossakowski]]
			* [[ToddSchneider\|Todd Schneider]]

	== Discussion ==		== Discussion ==

Forum: /* Agenda */

2024-03-14T01:13:57Z

Agenda

← Older revision		Revision as of 01:13, 14 March 2024
Line 21:		Line 21:

	== Agenda ==		== Agenda ==
	* '''Till Mossakowski''' ''Neuro-symbolic integration for ontology-based classification of structured objects'' [https://bit.ly/3TDfNqM Slides]		* '''[[TillMossakowski\|Till Mossakowski]]''' ''Neuro-symbolic integration for ontology-based classification of structured objects'' [https://bit.ly/3TDfNqM Slides]
			** Abstract: Reference ontologies play an essential role in organising knowledge in the life sciences and other domains. They are built and maintained manually. Since this is an expensive process, many reference ontologies only cover a small fraction of their domain. We develop techniques that enable the automatic extension of the coverage of a reference ontology by extending it with entities that have not been manually added yet. The extension shall be faithful to the (often implicit) design decisions by the developers of the reference ontology. While this is a generic problem, our use case addresses the Chemical Entities of Biological Interest (ChEBI) ontology with classes of molecules, since the chemical domain is particularly suited to our approach. ChEBI provides annotations that represent the structure of chemical entities (e.g., molecules and functional groups).<br/>We show that classical machine learning approaches can outperform ClassyFire, a rule-based system representing the state of the art for the task of classifying new molecules, and is already being used for the extension of ChEBI. Moreover, we develop RoBERTa and Electra transformer neural networks that achieve even better performance. In addition, the axioms of the ontology can be used during the training of prediction models as a form of semantic loss function. Furthermore, we show that ontology pre-training can improve the performance of transformer networks for the task of prediction of toxicity of chemical molecules. Finally, we show that our model learns to focus attention on more meaningful chemical groups when making predictions with ontology pre-training than without, paving a path towards greater robustness and interpretability. This strategy has general applicability as a neuro-symbolic approach to embed meaningful semantics into neural networks.
			** Bio: Till Mossakowski is a professor of theoretical computer science at Otto-von-Guericke University of Magdeburg, Germany. He has co-designed the distributed ontology, model and specification language DOL, as well as the corresponding Heterogeneous Tool Set. His research interests are logic, knowledge representation, semantics, and neural-symbolic integration, as well as applications in energy network simulation models, chemistry and material sciences.

	== Conference Call Information ==		== Conference Call Information ==

Forum: /* Agenda */

2024-03-13T20:48:39Z

Agenda

← Older revision		Revision as of 20:48, 13 March 2024
Line 21:		Line 21:

	== Agenda ==		== Agenda ==
	* '''Till Mossakowski''' ''~~Modular design patterns for neural~~-symbolic integration~~: refinement and combination~~'' [https://bit.ly/3TDfNqM Slides]		* '''Till Mossakowski''' ''Neuro-symbolic integration for ontology-based classification of structured objects'' [https://bit.ly/3TDfNqM Slides]

	== Conference Call Information ==		== Conference Call Information ==

Forum: /* Agenda */

2024-03-13T20:45:23Z

Agenda

← Older revision		Revision as of 20:45, 13 March 2024
Line 21:		Line 21:

	== Agenda ==		== Agenda ==
	* '''Till Mossakowski''' ''Modular design patterns for neural-symbolic integration: refinement and combination''		* '''Till Mossakowski''' ''Modular design patterns for neural-symbolic integration: refinement and combination'' [https://bit.ly/3TDfNqM Slides]

	== Conference Call Information ==		== Conference Call Information ==

Forum at 06:00, 17 February 2024

2024-02-17T06:00:50Z

← Older revision		Revision as of 06:00, 17 February 2024
Line 21:		Line 21:

	== Agenda ==		== Agenda ==
	* '''[[Till Mossakowski~~\|Till Mossakowski]]~~''' ''Modular design patterns for neural-symbolic integration: refinement and combination''		* '''Till Mossakowski''' ''Modular design patterns for neural-symbolic integration: refinement and combination''

	== Conference Call Information ==		== Conference Call Information ==

← Older revision		Revision as of 01:46, 21 March 2024
Line 35:		Line 35:

	== Participants ==		== Participants ==
			* [[BevCorwin\|Bev Corwin]]
			* [[DouglasRMiles\|Douglas R Miles]]
			* [[FabianNeuhaus\|Fabian Neuhaus]]
			* [[GaryBergCross\|Gary Berg-Cross]]
			* [[JohnSowa\|John Sowa]]
			* [[KenBaclawski\|Ken Baclawski]]
			* Lotti Tu
			* [[MichaelGruninger\|Michael Grüninger]]
			* [[PhilJackson\|Phil Jackson]]
			* [[RaviSharma\|Ravi Sharma]]
			* Riley Moher
			* [[TillMossakowski\|Till Mossakowski]]
			* [[ToddSchneider\|Todd Schneider]]

	== Discussion ==		== Discussion ==