| Date: | 2017, April 5 |
| Author: | Mossakowski, Till |
| Title: | Logic Tensor Networks |
Learning and Reasoning in Logic Tensor Networks:
Theory and Application to Semantic Image Interpretation
by Luciano Serafini, Ivan Donadello and Artur d’Avila Garcez.
This paper presents a revision of Real Logic and its imple-
mentation with Logic Tensor Networks and its application
to Semantic Image Interpretation. Real Logic is a frame-
work where learning from numerical data and logical rea-
soning are integrated using first order logic syntax. The
symbols of the signature of Real Logic are interpreted in
the data-space, i.e, on the domain of real numbers. The in-
tegration of learning and reasoning obtained in Real Logic
allows us to formalize learning as approximate satisfiability
in the presence of logical constraints, and to perform infer-
ence on symbolic and numerical data. After introducing a
refined version of the formalism, we describe its implemen-
tation into Logic Tensor Networks which uses deep learning
within Google’s TensorFlow TM. We evaluate LTN on the
task of classifying objects and their parts in images, where
we combine state-of-the-art-object detectors with a part-of
ontology. LTN outperforms the state-of-the-art on object
classification, and improves the performances on part-of re-
lation detection with respect to a rule-based baseline.