Evaluation of Logic Programs with Built-Ins and Aggregation: A Calculus for Bag Relations

We present a scheme for translating logic programs, which may use aggregation
and arithmetic, into algebraic expressions that denote bag relations over
ground terms of the Herbrand universe. To evaluate queries against these
relations, we develop an...

Word Frequency Does Not Predict Grammatical Knowledge in Language Models

Neural language models learn, to varying degrees of accuracy, the grammatical
properties of natural languages. In this work, we investigate whether there are
systematic sources of variation in the language models' accuracy. Focusing on
subject-verb...

Excalibur: A Non-Parametric, Hierarchical Wavelength-Calibration Method for a Precision Spectrograph

Excalibur is a non-parametric, hierarchical framework for precision
wavelength-calibration of spectrographs. It is designed with the needs of
extreme-precision radial velocity (EPRV) in mind, which require that
instruments be calibrated or...

Modeling and Optimization Trade-off in Meta-learning

By searching for shared inductive biases across tasks, meta-learning promises
to accelerate learning on novel tasks, but with the cost of solving a complex
bilevel optimization problem. We introduce and rigorously define the trade-off
between...

Algorithms for Causal Reasoning in Probability Trees

Probability trees are one of the simplest models of causal generative
processes. They possess clean semantics and -- unlike causal Bayesian networks
-- they can represent context-specific causal dependencies, which are necessary
for e.g. causal...

Fast Interleaved Bidirectional Sequence Generation

Independence assumptions during sequence generation can speed up inference,
but parallel generation of highly inter-dependent tokens comes at a cost in
quality. Instead of assuming independence between neighbouring tokens
(semi-autoregressive...

Optimal transport for multi-commodity routing on networks

We present a model for finding optimal multi-commodity flows on networks
based on optimal transport theory. The model relies on solving a dynamical
system of equations. We prove that its stationary solution is equivalent to the
solution of an...

Random walks and community detection in hypergraphs

We propose a one parameter family of random walk processes on hypergraphs,
where a parameter biases the dynamics of the walker towards hyperedges of low
or high cardinality. We show that for each value of the parameter the resulting
process defines...

Generating 3D Molecular Structures Conditional on a Receptor Binding Site with Deep Generative Models

Deep generative models have been applied with increasing success to the
generation of two dimensional molecules as SMILES strings and molecular graphs.
In this work we describe for the first time a deep generative model that can
generate 3D...

Improved Neural Language Model Fusion for Streaming Recurrent Neural Network Transducer

Recurrent Neural Network Transducer (RNN-T), like most end-to-end speech
recognition model architectures, has an implicit neural network language model
(NNLM) and cannot easily leverage unpaired text data during training. Previous
work has proposed...

Probing Task-Oriented Dialogue Representation from Language Models

This paper investigates pre-trained language models to find out which model
intrinsically carries the most informative representation for task-oriented
dialogue tasks. We approach the problem from two aspects: supervised classifier
probe and...

Improving Limited Labeled Dialogue State Tracking with Self-Supervision

Existing dialogue state tracking (DST) models require plenty of labeled data.
However, collecting high-quality labels is costly, especially when the number
of domains increases. In this paper, we address a practical DST problem that is
rarely...

Predict and Use Latent Patterns for Short-Text Conversation

Many neural network models nowadays have achieved promising performances in
Chit-chat settings. The majority of them rely on an encoder for understanding
the post and a decoder for generating the response. Without given assigned
semantics, the...

Reading Between the Lines: Exploring Infilling in Visual Narratives

Generating long form narratives such as stories and procedures from multiple
modalities has been a long standing dream for artificial intelligence. In this
regard, there is often crucial subtext that is derived from the surrounding
contexts. The...

Interpretation of NLP models through input marginalization

To demystify the "black box" property of deep neural networks for natural
language processing (NLP), several methods have been proposed to interpret
their predictions by measuring the change in prediction probability after
erasing each token of an...