Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,982 papers · 148 categories

Trend · papers per month

12.5%25.0%37.5%50.0% · Dec 199319922001200920172026
48 results for copy mechanism

End-to-end character-level model for text generation without delexicalization.

problem Generating text without delexicalization and tokenization.
method Character-level sequence-to-sequence model with attention mechanism, copy mechanism, and transfer learning.
result Competitive performance in text generation metrics.

Generating logical form equivalents of human language is a fresh way to employ neural architectures where long short-term memory effectively captures dependencies in both encoder and decoder units. The logical form of the sequence usually preserves information from the natural language side in the form of similar token…

2018-07-19abs ↗pdf ↗

Paper proposes a neural network for generating better questions from text.

problem Automatic generation of relevant questions from sentences and paragraphs.
method Adaptive copying recurrent neural network model with a copying mechanism added to a bidirectional LSTM architecture.
result The model outperforms state-of-the-art methods in question generation metrics.

In many real-world systems, information can be transmitted in two qualitatively different ways: by copying or by transformation. Copying occurs when messages are transmitted without modification, e.g., when an offspring receives an unaltered copy of a gene from its parent. Transformation occurs when messages are modifi…

2019-03-21abs ↗pdf ↗

Bayesian theory explains abrupt emergence of copy subcircuit in attention.

problem Understanding the abrupt emergence of the copy subcircuit in attention during training.
method Deriving a closed-form posterior over the attention matrix and reducing it to a low-dimensional order parameter space.
result Derive a phase transition in the amount of training data.

The paper introduces a new method to improve model generalization by routing model copies through permutations.

problem Improving model generalization in machine learning.
method The method replicates a model \(M\) times and rewire the contexts in which local learning messages are computed using permutations.
result The method improves generalization by structured message sharing rather than coupling parameters.

Descriptive titles provide crucial context for interpreting tables that are extracted from web pages and are a key component of table-based web applications. Prior approaches have attempted to produce titles by selecting existing text snippets associated with the table. These approaches, however, are limited by their d…

2018-06-30abs ↗pdf ↗

RBMs learn archetypes when trained on blurred copies of them, revealing a critical sample size.

problem Determining the critical sample size for RBMs to learn archetypes.
method Formal equivalence between RBMs and Hopfield networks, statistical-mechanics of disordered systems, Monte Carlo simulations.
result A phase diagram highlights regions where learning can be accomplished.

A mechanical linkage is a mechanism made of rigid rods linked together by flexible joints, in which some vertices are fixed and others may move. The partial configuration space of a linkage is the set of all the possible positions of a subset of the vertices. We characterize the possible partial configuration spaces of…

2014-01-06abs ↗pdf ↗

We study model-agnostic copies of machine learning classifiers. We develop the theory behind the problem of copying, highlighting its differences with that of learning, and propose a framework to copy the functionality of any classifier using no prior knowledge of its parameters or training data distribution. We identi…

2019-03-05abs ↗pdf ↗

This paper introduces DPI, a new metric to assess data-copying risk in tabular data.

problem Measuring privacy risk of data-copying in tabular generative models.
method Proposes Data Plagiarism Index (DPI) for evaluating data-copying risk.
result DPI identifies data-copying threats to tabular data models, highlighting privacy and fairness issues.

New seq2seq model can copy entire spans, outperforming simpler models in editing tasks.

problem Editing documents or source code using seq2seq models with explicit token copying.
method Extended seq2seq model capable of copying entire input spans to output in one step, new training and inference methods.
result New model consistently outperforms simpler baselines in editing tasks of natural language and source code.

A mechanical linkage is a mechanism made of rigid rods linked together by flexible joints, in which some vertices are fixed and others may move. The partial configuration space of a linkage is the set of all the possible positions of a subset of the vertices. We characterize the possible partial configuration spaces of…

2014-07-25abs ↗pdf ↗

Paper analyzes gradient descent with noisy data copies for linear regression, showing regularization and acceleration effects.

problem Improving generalization in machine learning through data augmentation with noise.
method Gradient descent with on-line noisy copies for linear regression analysis.
result Training with on-line noisy copies is equivalent to ridge regularization with a specific regularization parameter.

Shapes can roll downhill following any curve, but often return to initial orientation after crossing multiple copies.

problem How to design shapes that roll downhill along a given curve and its translations.
method Analyzing the geometric properties and motion of shapes on inclined planes.
result Most curves allow shapes to roll downhill following them and their translations, but some require crossing multiple copies.

Every lens space has a locally flat embedding in a connected sum of 8 copies of the complex projective plane and a smooth embedding in n copies of the complex projective plane for some positive integer n. We show that there is no n such that every lens space smoothly embeds in n copies of the complex projective plane.

2019-03-04abs ↗pdf ↗

GMC benchmark isolates retrieval in Transformers, revealing max-margin alignment.

problem Understanding how Transformers develop match-and-copy behavior on natural data.
method Introducing Gaussian Match-and-Copy (GMC) as a minimalist benchmark.
result Gradient descent drives parameters to diverge while aligning with max-margin separator.

Under-parameterized networks can either copy or average teacher weights, leading to universal optimal solutions.

problem Approximating a teacher network with an under-parameterized student network.
method Analyzing shallow neural networks with erf activation function and unitary teacher weights, proving copy-average configurations are critical points and finding the optimal solution.
result The optimal solution for under-parameterized networks has a universal structure, whether copying or averaging teacher neurons.

The paper finds small exotic 4-manifolds with free abelian groups.

problem Finding small exotic 4-manifolds with specific fundamental groups.
method Pairwise non-diffeomorphic closed irreducible 4-manifolds with free abelian fundamental group of rank less than three.
result Explicit mechanism to compute equivariant intersection form and stabilization result for exotic structures.

Recurrent neural networks are a widely used class of neural architectures. They have, however, two shortcomings. First, it is difficult to understand what exactly they learn. Second, they tend to work poorly on sequences requiring long-term memorization, despite having this capacity in principle. We aim to address both…

2019-01-25abs ↗pdf ↗

A simple patch copying method reduces black-box adversarial attack queries by 81%.

problem The effectiveness of black-box adversarial attacks depends on the initialization method.
method Copying small patches from other images as initialization points.
result Reduces the number of queries required for a state-of-the-art Boundary Attack by 81%

A knot K in the 3-sphere is said to have Property nR if, whenever K is a component of an n-component link L and some integral surgery on L produces the connected sum of n copies of S^1 x S^2, there is a sequence of handle slides on L that converts L into a 0-framed unlink. The Generalized Property R Conjecture is that …

2009-08-19abs ↗pdf ↗

Is it possible to generally construct a dynamical system to simulate a black system without recovering the equations of motion of the latter? Here we show that this goal can be approached by a learning machine. Trained by a set of input-output responses or a segment of time series of a black system, a learning machine …

2017-07-24abs ↗pdf ↗

A free action of the direct product of two copies of the symmetric group on 3 elements on the cartesian product of two copies of the 3-sphere is constructed. This nonlinear action is constructed using surgery. The action provides a counterexample to a conjecture of Lewis made in 1968.

1998-06-06abs ↗pdf ↗

Optimal securities lending mechanism incentivizes truthfulness and privacy.

problem Maximizing resource usage in securities lending while ensuring truthful reporting and privacy.
method Bayesian optimal algorithm adapted for differential privacy, combined with market equilibrium dynamics.
result An algorithm that is simultaneously private, approximately optimal, and approximately dominant-strategy truthful.

For a closed 4-manifold X and closed 3-manifold M we investigate the smallest integer n (perhaps infinity) such that M embeds in the connected sum of n copies of X. It is proven that any lens space (or homology lens space) embeds topologically locally flatly in a connected sum of 8 copies of the complex projective plan…

2001-12-21abs ↗pdf ↗

A fibration of Rn{\mathbb R}^n by oriented copies of Rp{\mathbb R}^p is called skew if no two fibers intersect nor contain parallel directions. Conditions on pp and nn for the existence of such a fibration were given by Ovsienko and Tabachnikov. A classification of smooth fibrations of R3{\mathbb R}^3 by skew oriente…

2014-12-29abs ↗pdf ↗

We construct branched double coverings by certain direct products of manifolds for connected sums of copies of sphere bundles over the 2-sphere. As an application we answer a question of Kotschick and Loeh up to dimension five. More precisely, we show that: (1) every simply connected, closed four-manifold admits a bran…

2012-10-04abs ↗pdf ↗

This paper presents a novel end-to-end approach to program repair based on sequence-to-sequence learning. We devise, implement, and evaluate a system, called SequenceR, for fixing bugs based on sequence-to-sequence learning on source code. This approach uses the copy mechanism to overcome the unlimited vocabulary probl…

2018-12-24abs ↗pdf ↗

We discuss the relationship between the m-th homotopy group of the one-point union of r copies of the two-dimensional sphere and the m-th homotopy group of the one-point union of r+1 copies of the Thom space of the oriented two-dimensional universal vector bundle. Using a suitably choosen isomorphism between them a for…

2002-05-28abs ↗pdf ↗

Characterizes a specific type of Courant algebroid with a Calabi-Yau structure.

problem Understanding specific types of Courant algebroids with Calabi-Yau structures.
method Explains how a homotopy BV algebra with certain properties characterizes these algebroids.
result A Courant algebroid with a Calabi-Yau structure is a homotopy BV algebra with specific properties.

We present a novel recurrent neural network (RNN) based model that combines the remembering ability of unitary RNNs with the ability of gated RNNs to effectively forget redundant/irrelevant information in its memory. We achieve this by extending unitary RNNs with a gating mechanism. Our model is able to outperform LSTM…

2017-06-08abs ↗pdf ↗

CORE optimizes molecules by copying or generating substructures, improving accuracy.

problem Inaccurate substructure prediction in molecule optimization.
method Copy & Refine (CORE) strategy combining scaffolding tree generation and adversarial training.
result Significant improvement in various molecule optimization metrics.

A new model for graph sampling that preserves structure without explicit targeting.

problem Graphs are often not fully representative of true relationships, leading to biased machine learning models.
method Node copying model: randomly replaces each node's neighbors with those of a randomly sampled similar node.
result The model achieves higher accuracy in node classification and mitigates adversarial attacks.