Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases

Research output: Chapter in book/report/conference proceedingConference contributionResearch

Authors

  • Maximilian Idahl
  • Megha Khosla
  • Avishek Anand

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publicationMachine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019
EditorsPeggy Cellier, Kurt Driessens
Pages229-240
Number of pages12
Volume1
Publication statusPublished - 2020
Event19th Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2019 - Wurzburg, Germany
Duration: 16 Sept 201920 Sept 2019

Publication series

NameCommunications in Computer and Information Science
Volume1167
ISSN (Print)1865-0929
ISSN (electronic)1865-0937

Abstract

In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.

Keywords

    Conceptual spaces, Interpretability, Node embeddings

ASJC Scopus subject areas

Cite this

Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. / Idahl, Maximilian; Khosla, Megha; Anand, Avishek.
Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019. ed. / Peggy Cellier; Kurt Driessens. Vol. 1 2020. p. 229-240 (Communications in Computer and Information Science; Vol. 1167).

Research output: Chapter in book/report/conference proceedingConference contributionResearch

Idahl, M, Khosla, M & Anand, A 2020, Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. in P Cellier & K Driessens (eds), Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019. vol. 1, Communications in Computer and Information Science, vol. 1167, pp. 229-240, 19th Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2019, Wurzburg, Germany, 16 Sept 2019. https://doi.org/10.48550/arXiv.1910.05030, https://doi.org/10.1007/978-3-030-43823-4_20
Idahl, M., Khosla, M., & Anand, A. (2020). Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. In P. Cellier, & K. Driessens (Eds.), Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019 (Vol. 1, pp. 229-240). (Communications in Computer and Information Science; Vol. 1167). https://doi.org/10.48550/arXiv.1910.05030, https://doi.org/10.1007/978-3-030-43823-4_20
Idahl M, Khosla M, Anand A. Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. In Cellier P, Driessens K, editors, Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019. Vol. 1. 2020. p. 229-240. (Communications in Computer and Information Science). doi: 10.48550/arXiv.1910.05030, 10.1007/978-3-030-43823-4_20
Idahl, Maximilian ; Khosla, Megha ; Anand, Avishek. / Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019. editor / Peggy Cellier ; Kurt Driessens. Vol. 1 2020. pp. 229-240 (Communications in Computer and Information Science).
Download
@inproceedings{68dd4b3ca9b34e43ad1e1f8d00ac9a22,
title = "Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases",
abstract = "In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.",
keywords = "Conceptual spaces, Interpretability, Node embeddings",
author = "Maximilian Idahl and Megha Khosla and Avishek Anand",
year = "2020",
doi = "10.48550/arXiv.1910.05030",
language = "English",
isbn = "9783030438227",
volume = "1",
series = "Communications in Computer and Information Science",
pages = "229--240",
editor = "Peggy Cellier and Kurt Driessens",
booktitle = "Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019",
note = "19th Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2019 ; Conference date: 16-09-2019 Through 20-09-2019",

}

Download

TY - GEN

T1 - Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases

AU - Idahl, Maximilian

AU - Khosla, Megha

AU - Anand, Avishek

PY - 2020

Y1 - 2020

N2 - In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.

AB - In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.

KW - Conceptual spaces

KW - Interpretability

KW - Node embeddings

UR - http://www.scopus.com/inward/record.url?scp=85083711218&partnerID=8YFLogxK

U2 - 10.48550/arXiv.1910.05030

DO - 10.48550/arXiv.1910.05030

M3 - Conference contribution

AN - SCOPUS:85083711218

SN - 9783030438227

VL - 1

T3 - Communications in Computer and Information Science

SP - 229

EP - 240

BT - Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019

A2 - Cellier, Peggy

A2 - Driessens, Kurt

T2 - 19th Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2019

Y2 - 16 September 2019 through 20 September 2019

ER -