Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

82163245326 · Jun 202019922001200920172026
48 results for Three-Phase Systems

The Allen-Cahn system on manifolds yields multiple phase distributions.

problem Finding the number of solutions to the Allen-Cahn system on manifolds.
method Volume-fixing variations approach to classify isoperimetric clusters.
result The number of solutions is bounded by topological invariants for parallelizable manifolds.

New algorithm extracts device profiles for short-term power predictions in commercial buildings.

problem Short-term power prediction in commercial buildings with high accuracy.
method Unsupervised extraction of device profiles from aggregate power measurements, disaggregation using particle swarm optimization, and state changes forecast by artificial neural networks.
result Developed approach outperforms existing methods with high accuracy.

The classification of phase transitions is a central and challenging task in condensed matter physics. Typically, it relies on the identification of order parameters and the analysis of singularities in the free energy and its derivatives. Here, we propose an alternative framework to identify quantum phase transitions,…

2019-04-02abs ↗pdf ↗

Paper proposes hybrid machine learning for tuning first principles models in engineering systems.

problem Inaccurate first principles models in process engineering due to changing conditions.
method Hybrid machine learning framework using Bayesian Neural Networks.
result Uncertainty estimates improve operation decisions in multiphase flow modeling.

Study shows how anisotropic data affects learning dynamics in phase retrieval.

problem Understanding learning dynamics in phase retrieval with anisotropic Gaussian inputs.
method Developed a tractable reduction to reveal a three-phase trajectory and derived scaling laws.
result Found that anisotropy leads to a three-phase trajectory: fast escape, slow convergence, and spectral-tail learning.

Framework for AI healthcare products from concept to market.

problem Failure of AI products to reach clinics despite promising potential.
method Decision-making framework for AI healthcare product development.
result Guides through a three-phase process to market launch of validated AI products.

DP-RandP improves privacy-utility tradeoff in DP-SGD by learning priors from random processes.

problem Improving the performance of differentially private stochastic gradient descent (DP-SGD) on private data.
method A three-phase approach that learns priors from images generated by random processes and transfers these priors to private data.
result New state-of-the-art accuracy on CIFAR10, CIFAR100, MedMNIST, and ImageNet for various privacy budgets.

In this technical report, we discuss several sampling algorithms for Determinantal Point Processes (DPP). DPPs have recently gained a broad interest in the machine learning and statistics literature as random point processes with negative correlation, i.e., ones that can generate a "diverse" sample from a set of items.…

2018-02-23abs ↗pdf ↗

New method reduces DSI complexity using RAE and LSTM for better posterior predictions.

problem Reducing complexity in data-space inversion for subsurface flow simulations.
method Recurrent Autoencoder (RAE) for dimension reduction and LSTM for flow-rate time series representation.
result RAE-based parameterization outperforms existing DSI treatments in statistical agreement with reference results.

Study shows how transformers learn to combine simple tasks into complex ones.

problem Understanding how transformers learn to perform complex tasks not seen during training.
method Controlled setting involving variable assignment and modular addition; partitioned training data analysis.
result Small transformers can generalize to unseen combinations of variables and numbers.

Model approximates continuous functions in 1-Wasserstein space.

problem Approximating continuous functions in 1-Wasserstein space.
method Probabilistic Transformer (PT) model with three phases: feature map, deep neural network, and probabilistic extension of attention mechanism.
result Can approximate any continuous function from R^d to P1(R^D) uniformly on compact sets.

New analysis of Muon and SignSGD on matrix-valued least squares problems.

problem Understanding the behavior of Muon and SignSGD on matrix-valued least squares problems.
method Derive explicit deterministic dynamics to study learning behavior of Muon and SignSGD.
result Muon and SignSGD exhibit different optimal learning rates and convergence characteristics based on batch size and data covariance.

DONNA rapidly finds optimal neural networks across diverse spaces.

problem Efficient scaling and handling of diverse architectural search-spaces in NAS.
method Three-phase pipeline: accuracy predictor, rapid evolutionary search, and optimal model finetuning.
result 100x faster than MNasNet in finding state-of-the-art architectures on-device.

FEDS distills LIC model knowledge into a lightweight student for efficient compression.

problem Efficiently compress images with high performance and low resources.
method FEDS combines feature alignment and entropy-based loss for lightweight compression.
result Student model matches teacher's performance while reducing parameters and speeding up.

The study uses Random Matrix Theory to identify structural changes in stock markets during shocks.

problem Understanding structural changes in stock markets during exogenous shocks.
method Random Matrix Theory and complexity gap analysis.
result The complexity gap collapses during shocks, indicating strong synchronization, and widens before shocks, signaling a rich structure.

Gradient descent slows significantly in over-parameterized single neuron learning.

problem Learning a single neuron with over-parameterization and square loss.
method Analysis of gradient descent dynamics, proving convergence rates and lower bounds.
result Over-parameterization can exponentially slow down the convergence rate of gradient descent.

Study on multi-head softmax attention dynamics for in-context learning.

problem Understanding and optimizing multi-head softmax attention models for multi-task linear regression.
method Gradient flow analysis and spectral mapping technique.
result Gradient flow converges to optimal multi-head softmax attention model, with task allocation emerging during training.

Gradient descent trains both layers of a ReLU network to fit a linear model.

problem Training dynamics of a ReLU network to fit a linear target function.
method Jointly training both layers of a one-hidden-layer ReLU network in a realizable setting with Gaussian inputs and labels.
result Gradient descent from a small random initialization converges to a global minimizer at a linear rate with optimal sample complexity.

Novel anti-grokking phase discovered in neural networks, revealed by HTSR layer quality metric.

problem Understanding and detecting overfitting in neural networks.
method 3-layer MLP, weight decay, HTSR layer quality metric αα, correlation traps, Kolmogorov–Smirnov tests.
result Anti-grokking phase detected late in training, revealed by α<2α< 2 and correlation traps.

Gradient descent with small random init mimics spectral methods for low-rank matrix recovery.

problem Reconstructing a low-rank matrix from few measurements.
method Gradient descent with small random initialization followed by a few iterations.
result Gradient descent from small random init converges to a well-generalizing solution.

Bayesian approach improves car-following model calibration and validation with limited data.

problem Difficulties in calibrating car-following models using limited data for work zones.
method Bayesian programming for data analysis and parameter estimation.
result Bayesian methods enhance model calibration and validation accuracy.

Overview of integrable systems with symmetries, focusing on toric and semitoric systems.

problem Classifying and understanding integrable systems with symmetries.
method Using decorated polygons and controlled bifurcations in one-parameter families of systems.
result Construction of explicit semitoric systems with prescribed invariants.

Learning to control linear systems is statistically hard, especially for underactuated systems.

problem Statistical difficulty of learning to control linear systems, especially underactuated ones.
method Utilized minimax lower bounds and structural assumptions to prove learning complexity can be exponential.
result Learning complexity can be at most exponential with the controllability index of the system.

Discrete-time systems can be characterized by simple flat coordinates and their shifts.

problem Characterizing flatness of discrete-time systems.
method Developed a map from flat coordinates and their shifts to system state and input, fulfilling system equations identically.
result Derived necessary conditions for a system to be flat, without requiring differential geometry methods.

The paper explores when linear system identification is hard or easy, especially for under-actuated systems.

problem Statistical hardness of learning linear systems, especially under-actuated or under-excited systems.
method Using tools from minimax theory and recent statistical tools for finite sample analysis of system identification.
result The controllability index of linear systems affects the sample complexity of identification, making some systems hard to learn.

This paper improves system identification by reducing sample complexity for high-dimensional linear dynamical systems.

problem High sample complexity for learning partially observed linear dynamical systems in high dimensions.
method Introduces an 1\ell_1-regularized estimation method that reduces sample complexity from linear to logarithmic with system dimension.
result Markov parameters can be learned with logarithmic number of samples relative to system dimension, improving sample complexity.

In integrable hydrodynamic systems, coordinates exist where generators and symmetries are simple.

problem Existence of Riemannian invariants for integrable systems of hydrodynamic type.
method Finding coordinates where the generator and all symmetries are diagonal.
result In integrable hydrodynamic systems, there exist coordinates where the generator and all symmetries are diagonal.