Explainable Natural Language Processing

Description

Acknowledgments Introduction Two Common Distinctions Local and Global Explanations Intrinsic and Post-Hoc Explanations Shortcomings of Existing Taxonomies Guidotti et al. (2018) Adadi and Berrada (2019) Carvalho et al. (2019) Molnar (2019) Zhang et al. (2020) Danilevsky et al. (2020) Das et al. (2020) Atanasova et al. (2020) Kotonya and Toni (2020) The Method-Form Fallacy Inconsistent Classifications A Novel Taxonomy A Framework for Explainable NLP NLP Architectures Linear and Nonlinear Classification Recurrent Models Transformers Overview of Applications and Architectures Local and Global Explanations Backward Methods Forward Explaining by Intermediate Representations Forward Explaining by Continuous Outputs Forward Explaining by Discrete Outputs Local-Backward Explanations Vanilla Gradients Guided Back-Propagation Layer-Wise Relevance Propagation Deep Taylor Decomposition Integrated Gradients DeepLift Global-Backward Explanations Post-Hoc Unstructured Pruning Lottery Tickets Dynamic Sparse Training Binary Networks and Sparse Coding Local-Forward Explanations of Intermediate Representations Gates Attention Attention Roll-Out and Attention Flow Layer-Wise Attention Tracing Attention Decoding Global-Forward Explanations of Intermediate Representations Gate Pruning Attention Head Pruning Local-Forward Explanations of Continuous Output Word Association Norms Word Analogies Time Step Dynamics Global-Forward Explanations of Continuous Output Correlation of Representations Clustering Probing Classifiers Concept Activation Influential Examples Local-Forward Explanations of Discrete Output Challenge Datasets Local Uptraining Influential Examples Global-Forward Explanations of Discrete Output Uptraining Meta-Analysis Downstream Evaluation Evaluating Explanations Flavors of Explanations Heuristics Human Annotations Human Experiments Perspectives General Observations Beyond Taxonomy Moral Foundations of Explanations Resources Code Datasets and Benchmarks Bibliography Author's Biography