Paper proposes dp-VAE for preserving spatial context in gene expression data.
problem Inaccessibility of spatial context in single-cell gene expression data.
method Generic representation learning and transfer learning framework with a distance-preserving regularizer.
result dp-VAE effectively reconstructs and imputes spatial context from gene expression data.
Method converts speech with attention and context preservation.
problem Voice conversion with improved stability and efficiency.
method Sequence-to-Sequence learning with attention and context preservation.
result Synthesized speech quality comparable to advanced methods.
Paper introduces privacy-preserving inventory policy learning for feature-based newsvendor with unknown demand.
problem Privacy-preserving inventory policy learning for feature-based newsvendor with unknown demand distribution and nonsmooth loss function.
method Developed a clipped noisy gradient descent algorithm based on convolution smoothing for optimal inventory estimation within f-differential privacy framework.
result Achieved privacy-preserving optimal inventory policy with provable privacy guarantees and desirable statistical precision.
LLMs compress financial texts, but distort decision-making.
problem LLMs compress financial texts, altering decision-making.
method Analyzed two diagnostic patterns: decontextualization and model dependency. Proposed Agentic Context Compression.
result LLM-compressed financial texts alter decision-making.
InstaGAN tackles image-to-image translation for images with multiple instances and significant shape changes.
problem Challenging cases, especially images with multiple target instances and significant shape changes.
method Instance-aware GAN (InstaGAN) that incorporates instance information and context preserving loss.
result Improves multi-instance transfiguration while maintaining permutation invariance of instances.
Fine-tuning harms in-context learning, but restricting updates to the value matrix improves zero-shot performance.
problem Fine-tuning harms in-context learning, reducing zero-shot performance on unseen tasks.
method Theoretical analysis of linear attention models, identifying conditions for degraded few-shot performance.
result Restricting updates to the value matrix improves zero-shot performance while preserving in-context learning.
A new method learns Hamiltonian functions from noisy data.
problem Learning Hamiltonian functions from noisy observations.
method Structure-preserving kernel ridge regression method.
result The method yields excellent numerical performances.
CRAUM-Net improves salient object detection with context and uncertainty modeling.
problem Accurate salient object detection with precise boundary delineation.
method Contextual Recursive Attention with Uncertainty Modeling, multi-scale context aggregation, attention mechanisms, edge-aware decoder, Monte Carlo Dropout.
result Superior performance in producing accurate and reliable saliency maps.
GCML preserves geometric structure in manifold clustering for diverse data types.
problem Loss functions in manifold clustering can corrupt latent space structure.
method GCML framework with isometric and ranking losses for geometric structure preservation.
result GCML outperforms other methods in latent space structure preservation and performance metrics.
Develops a privacy-preserving algorithm for sparse robust regression.
problem Privacy-preserving machine learning for sparse robust regression.
method Develops FRAPPE algorithm for non-smooth loss under differential privacy.
result Achieves better privacy and statistical accuracy trade-off.
Paper studies optimal federated learning for nonparametric regression with privacy constraints.
problem Federated learning for nonparametric regression with heterogeneous differential privacy constraints.
method Proposes distributed privacy-preserving estimators and investigates their risk properties.
result Establishes matching minimax lower bounds for global and pointwise estimation.
With the recent advancement in the deep learning technologies such as CNNs and GANs, there is significant improvement in the quality of the images reconstructed by deep learning based super-resolution (SR) techniques. In this work, we propose a robust loss function based on the preservation of edges obtained by the Can…
Topological autoencoders preserve complex structures in latent spaces.
problem Preserving topological structures in latent representations of autoencoders.
method Using persistent homology, a topological data analysis technique, to calculate topological signatures of input and latent spaces and derive a differentiable topological loss term.
result Our approach preserves multi-scale connectivity information in latent representations, leading to favorable latent representations on synthetic and real-world data.
Paper discusses privacy issues in IoT and proposes a lightweight neural network approach.
problem Privacy concerns in IoT due to extensive data collection and processing.
method Developed a privacy-preserving inference approach for IoT objects and a deep neural network in the cloud.
result Satisfactory performance of the proposed approach on the MNIST dataset.
Paper examines constraints on cryptocurrency networks to improve liquidity and capital costs.
problem Improving liquidity in cryptocurrency networks with limited capital deposits.
method Introduces constraints to bound loss in default scenarios and simplifies network structure.
result Achieves optimal tradeoff between liquidity and capital costs in payment networks.
We consider the problem of training probabilistic conditional random fields (CRFs) in the context of a task where performance is measured using a specific loss function. While maximum likelihood is the most common approach to training CRFs, it ignores the inherent structure of the task's loss function. We describe alte…
Generative synthetic data can preserve predictive accuracy but distort causal inference.
problem Distortion of average treatment effect estimates in synthetic data.
method Hybrid synthetic-data framework that generates covariates while modeling treatment and outcome mechanisms separately.
result Hybrid synthesis improves causal fidelity compared to fully generative baselines.
In this note we consider the relationship between the dressing action and the holonomy representation in the context of constant mean curvature surfaces. We characterize dressing elements that preserve the topology of a surface and discuss dressing by simple factors as a means of adding bubbles to a class of non finite…
A new method for federated survival analysis using Cox models.
problem Non-separability of Cox PH model loss function in federated learning.
method Discrete-time Cox model, separable loss function, federated learning.
result Improved performance and communication efficiency compared to previous methods.
Transformers approximate Bayesian posteriors but not exactly.
problem Bayesian accounts of in-context learning face challenges due to task-preserving order changes in transformers.
method Showed that excess prequential code length is exactly cumulative predictive KL, decomposing expected regret into order-averaged predictor and order-averaging gain.
result Transformers approximate Bayesian posteriors but not exactly, priced by log loss.
Paper improves privacy-preserving measurement of advertising incrementality.
problem Privacy degradation in randomized lift tests for advertising measurement.
method Formulates a robust causal decision problem under signal losses, projecting clean worlds onto incrementality.
result Sharp decision frontier shows valid certification or rejection outside the frontier.
Proposes using probabilistic models for privacy-preserving synthetic data.
problem Designing high-quality synthetic data for privacy preservation.
method Formulate the problem through probabilistic modelling, choosing a model for the data.
result Statistical discoveries can be reliably reproduced from synthetic data.
New insights on pruning deep networks by preserving function locality.
problem Designing effective pruning methods for deep neural networks.
method Revisited loss modeling using first and second order Taylor expansions, emphasizing locality.
result Both first and second order Taylor expansions can achieve similar performance in pruning.
Transformers preserve support and can approximate any continuous map.
problem Understanding the mathematical properties of transformers.
method Characterizing maps between measures that can be represented as transformers and proving their properties.
result Transformers preserve support and have uniformly continuous Fréchet derivatives.
EAGLE-Net enhances foundation models by integrating patch-level features for better tissue understanding.
problem Foundation models lack mechanisms for global tissue structure and local context in computational pathology.
method EAGLE-Net combines multi-scale spatial encoding, attention-guided loss functions, and background suppression to aggregate patch-level features into slide-level predictions.
result EAGLE-Net improves classification accuracy and concordance indices across multiple cancer types, producing biologically coherent attention maps.
We prove an existence result for local and global G-structure preserving affine immersions between affine manifolds. Several examples are discussed in the context of Riemannian and semi-Riemannian geometry, including the case of isometric immersions into Lie groups endowed with a left-invariant metric, and the case of …
Paper proposes a method to estimate counterfactual outcomes without a known SCM.
problem Estimating counterfactual outcomes without a known structural causal model.
method Introduces rank preservation assumption and a novel ideal loss for unbiased learning of counterfactual outcomes.
result The proposed method is effective and unbiased, as shown by theoretical analysis and experiments.
The paper studies quasimorphisms on density-preserving diffeomorphisms of the Möbius band.
problem Exploring quasimorphisms on groups of diffeomorphisms of non-orientable manifolds.
method Investigates the group of density-preserving diffeomorphisms on the Möbius band and shows the existence of unbounded quasimorphisms.
result The group of density-preserving diffeomorphisms on the Möbius band admits countably many unbounded quasimorphisms.
Transformers can handle endogeneity in linear regression using IV methods.
problem Endogeneity in in-context linear regression models.
method Transformer architecture with gradient-based bi-level optimization and in-context pretraining.
result Transformers provide more robust predictions and estimates than 2SLS in endogenous scenarios.
LIMP learns latent shapes with metric preservation, improving generative models.
problem Insufficient training data for high-fidelity latent representations.
method Metric preservation as a prior, geometric distortion criterion, geodesic loss.
result Synthetic samples of higher quality achieved through metric preservation.
Zero-shot contrastive loss improves text-guided image style transfer without extra training.
problem Stochastic nature of diffusion models leads to trade-offs between style transformation and content preservation.
method Proposes a zero-shot contrastive loss for diffusion models that doesn't require additional fine-tuning or auxiliary networks.
result Method outperforms existing methods while preserving content and requiring no additional training.
Improved privacy-preserving methods for convex optimization with heavy-tailed data.
problem Privacy-preserving optimization of convex functions with heavy-tailed data.
method Developed algorithms for private mean estimation and convex optimization under concentrated differential privacy constraints.
result Achieved improved upper bounds on excess population risk for convex and strongly convex loss functions.
Federated learning is a recent advance in privacy protection. In this context, a trusted curator aggregates parameters optimized in decentralized fashion by multiple clients. The resulting model is then distributed back to all clients, ultimately converging to a joint representative model without explicitly having to s…
A new framework explains why early pruning works well.
problem Understanding why early pruning of neural networks leads to good performance.
method Gradient flow framework to unify pruning measures.
result Magnitude-based pruning removes least contributing parameters, leading to faster convergence.
Improves dialogue response model interpretability using attention and regularization.
problem Improving interpretability of dual encoder models for dialogue response suggestions.
method Integrates attention mechanism and novel regularization loss to emphasize important words.
result Improves model accuracy and interpretability compared to existing methods.
Optimal algorithm for contextual bandits with unknown context distributions.
problem Designing efficient algorithms for contextual bandits with unknown context distributions.
method Cross-learning setting, novel technique for coordinating multiple epochs.
result Nearly tight regret bound of O ~ ( T K ) \widetilde{O}(\sqrt{TK}) O ( T K ) for learning to bid in first-price auctions and sleeping bandits. Novel simplex-valued distribution improves on existing models.
problem Limitations of existing simplex-valued distributions like Dirichlet.
method Introducing continuous categorical distribution.
result Continuous categorical resolves limitations of Dirichlet.
Theory integrates loss aversion into expected utility for monetary returns.
problem Modeling loss aversion in expected utility theory.
method Develops state-dependent linear utility functions incorporating loss aversion.
result Contracts from monopolists in insurance markets.
MCNet improves uncertainty calibration in online advertising by modeling complex relations and balancing performance.
problem Lack of effective calibration for complex relations and context features in online advertising.
method Introduces MCNet with MCF, order-preserving, and field-balance regularizers.
result Superior performance in generating well-calibrated probability predictions on public and industrial datasets.
Enhanced privacy, utility, and efficiency through MUST subsampling.
problem Balancing privacy, utility, and computational efficiency in data analysis.
method MUltistage Sampling Technique (MUST) for privacy amplification in differential privacy.
result MUST offers stronger privacy guarantees ( ϵ \epsilon ϵ ) than one-stage subsampling methods while maintaining similar utility and computational efficiency. We analyze impermanent loss in AMMs and show G3Ms are simplest.
problem Understanding impermanent loss in automated market makers.
method Developed a general framework and analyzed Geometric Mean Market Makers (G3Ms).
result G3Ms have the simplest impermanent loss characteristics.
A new learning scheme improves model efficiency and performance.
problem Characterizing correlation between batch-level and global data distributions.
method Epoch-evolving Gaussian Process Guided Learning (GPGL) scheme with context labels and triangle consistency loss.
result Significantly outperforms existing models on mainstream datasets.
Scales attention for long contexts in LLMs.
problem Development of attention mechanisms for long context inference.
method Scale-invariant total attention and sparsity conditions, with a position-dependent transformation of logits.
result Scale-invariant attention scheme improves validation loss and long-context retrieval.
A new algorithm improves federated learning by combining knowledge distillation and weighted combination loss.
problem Non-IID client data in federated learning leads to model drift and poor generalization.
method pFedKD-WCL integrates knowledge distillation with bi-level optimization to address non-IID challenges.
result pFedKD-WCL outperforms state-of-the-art algorithms in accuracy and convergence speed.
In this paper we provide a systematic discussion of how to incorporate orientation preserving symmetries into the treatment of Willmore surfaces via the loop group method. In this context we first develop a general treatment of Willmore surfaces admitting orientation preserving symmetries, and then show how to induce f…
Language models learn from training data and can leak private information.
problem Language models lack context understanding and can expose private data.
method Discussing the limitations of current privacy protection methods for language models.
result Existing privacy protection methods are insufficient for language models.
DMT enhances deep neural networks to better preserve data structures.
problem Preserving geometric, topological, and distributional structures of data in NLDR.
method Deep manifold transformation (DMT) using cross-layer LGP constraints.
result DMT networks outperform existing NLDR methods in preserving data structures.
Enhances graph embeddings by preserving graph topology.
problem Node2vec struggles to recreate the topology of input graphs.
method Introduces a topological loss term to Node2vec, aligning the persistence diagram of the embedding to that of the input graph.
result Reconstructs both geometry and topology of input graphs.