New method uses geometric properties for better density estimation.
problem Uncertainty quantification in ambiguous tasks.
method Winner-takes-all training with centroidal Voronoi tessellations.
result Improved quantization and density estimation.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,878 papers · 148 categories
Trend · papers per month
48 results for “winner-take-all competition”
The study develops a supervised and unsupervised WTA model for sparse binary projections.
problem Sparse binary projections in high-dimensional spaces.
method Supervised and unsupervised WTA models with efficient algorithms.
result Significantly improved results in similarity search tasks.
Stochastic LWTA networks resist adversarial attacks while maintaining accuracy.
problem Adversarial robustness of neural networks.
method Replaced ReLU with stochastic LWTA activations, trained with Variational Bayesian and PGD.
result Stochastic LWTA networks achieve state-of-the-art robustness against adversarial attacks.
New study shows FTRL mechanism works with correlated events.
problem Forecasting competitions with correlated events.
method Introduces block correlation and uses FTRL mechanism.
result FTRL mechanism retains -optimal guarantee with events for correlated events.
TimeMCL forecasts diverse time series futures using neural networks and WTA loss.
problem Forecasting multiple plausible time series futures.
method Multiple Choice Learning (MCL) framework with Winner-Takes-All (WTA) loss.
result TimeMCL efficiently predicts diverse time series futures at low computational cost.
aMCL uses annealing to improve hypothesis diversity in ambiguous tasks.
problem Limitations of Winner-takes-all in predicting plausible hypotheses.
method Combines simulated annealing with Multiple Choice Learning (MCL).
result Enhanced exploration of hypothesis space during training.
New model improves deep learning robustness against adversarial attacks.
problem Improving adversarial robustness of deep learning models.
method Local competition principle, LWTA nonlinearities, Bayesian non-parametrics.
result The new model achieves high robustness to adversarial perturbations on MNIST and CIFAR10 datasets.
This work tackles representation learning by introducing stochastic competition-based activations.
problem Learning diversified representations in deep learning models.
method Combining information-theoretic arguments with stochastic competition-based activations, using Stochastic Local Winner-Takes-All (LWTA) units.
result The proposed method yields significant discriminative representation learning abilities and allows for a principled investigation of intermediate network representations.
We propose a simple change to existing neural network structures for better defending against gradient-based adversarial attacks. Instead of using popular activation functions (such as ReLU), we advocate the use of k-Winners-Take-All (k-WTA) activation, a C0 discontinuous function that purposely invalidates the neural …
LoRA-MCL improves language models by generating diverse sentence continuations.
problem Language models struggle with generating diverse, plausible sentence continuations.
method Low-Rank Adaptation combined with Multiple Choice Learning (MCL) to handle ambiguity.
result LoRA-MCL generates high-diversity and relevant outputs in various tasks.
New deep learning model robust to adversarial attacks using stochastic LWTA units.
problem Adversarial robustness in deep learning networks.
method Introduces deep networks with stochastic LWTA activations, combining them with Bayesian non-parametric tools.
result Achieves high robustness to adversarial perturbations, outperforming state-of-the-art methods.
Sharp Capacity Thresholds in Linear Associative Memory: From Winner-Take-All to Listwise Retrievalstat.ML
Linear memory stores associations up to a logarithmic scale, but listwise retrieval can handle a quadratic scale.
problem How many key-value associations can a linear memory store?
method Analyzed linear memory models for top-1 and listwise retrieval, proving phase transitions and developing asymptotic theories.
result Linear memory has a logarithmic capacity for top-1 retrieval and a quadratic capacity for listwise retrieval.
New analysis shows rational actors will deploy AGI despite negative social value due to catastrophic risk.
problem Rational actors will deploy AGI despite negative social value due to shared catastrophic risk.
method Continuous-time preemption game with shared catastrophic externalities, showing suicide region and welfare distortion.
result The suicide region widens as catastrophic risk grows, and two mechanisms can close it.
VOWEL trains WTA-SNNs for multi-valued events, overcoming resource limitations.
problem Training WTA-SNNs for multi-valued events is challenging due to non-differentiability and recurrent behavior.
method Develops a variational online local training rule (VOWEL) for WTA-SNNs using local pre- and post-synaptic information and a common reward signal.
result VOWEL outperforms conventional binary SNNs in real-world neuromorphic datasets with multi-valued events.
Prototype-based interpretation of the functionality of neurons in winner-take-all neural networkscs.LG
A new neural network method improves interpretability and detection of outliers.
problem Improving interpretability and detection of outliers in neural networks.
method Prototype-based learning (PbL) using a winner-take-all (WTA) network with two prototypes: positive and negative.
result The negative prototype is similar to the positive one, aligning with the BCM theory.
We present a modelling framework for the investigation of prototype-based classifiers in non-stationary environments. Specifically, we study Learning Vector Quantization (LVQ) systems trained from a stream of high-dimensional, clustered data.We consider standard winner-takes-all updates known as LVQ1. Statistical prope…
We examine methods for clustering in high dimensions. In the first part of the paper, we perform an experimental comparison between three batch clustering algorithms: the Expectation-Maximization (EM) algorithm, a winner take all version of the EM algorithm reminiscent of the K-means algorithm, and model-based hierarch…
rMCL improves on MCL by preserving diversity in predictions for regression problems.
problem Multimodal density estimation in regression settings with multiple targets.
method rMCL uses a learned scoring scheme based on Voronoi tessellations to maintain diversity among predictions.
result rMCL outperforms existing MCL variants in sound source localization tasks.
Neuromorphic column performs online unsupervised clustering.
problem Real-time clustering of streaming data.
method Localized, spike timing-dependent plasticity (STDP) neural column.
result Prototype column performs similarly to k-means clustering.
Power-law Portfoliosq-fin.PM
Power-law portfolios improve diversification by scaling weights sub-linearly.
problem Optimization methods struggle with unstable pair correlations and non-Gaussian risk measures.
method Construct portfolios with penalty proportional to arbitrary order moment of returns, leading to sub-linear weight scaling.
result Infinite order power-law portfolios are perfectly diversified, improving diversification over Kelly portfolios.
Fat Tailed Factorsq-fin.PM
A new factor analysis method using ICA reduces portfolio concentration and diversifies excess kurtosis.
problem Standard factor analysis suffers from issues with pairwise correlations of asset returns.
method Identifies factors based on non-Gaussianity instead of variance, using ICA.
result Fat-tailed portfolios significantly reduce portfolio concentration and winner-takes-all problem.
NTP struggles to learn relationships without increased exploration.
problem NTP's performance in extracting true relationships among data is poor.
method Created synthetic logical datasets with injected relationships to test NTP's performance and identify algorithmic issues.
result Increasing exploration in NTP's algorithm improves its performance in recovering relationships.
DASNet improves neural network efficiency by dynamically pruning activations.
problem Reducing neural network size and computational complexity in embedded systems.
method Dynamic Activation Sparsity (DAS) using a winners-take-all (WTA) dropout technique.
result DASNet achieves better computation cost reduction compared to static feature map pruning methods.
Proposes CoPO, a new policy optimization method for competitive games.
problem Designing efficient optimization methods for competitive Markov decision processes.
method Competitive policy optimization (CoPO) approach that exploits game-theoretic nature of competitive games.
result Stable optimization, convergence to sophisticated strategies, and higher scores compared to baseline methods.
Kaggle competitions offer valuable insights for business forecasting.
problem Lack of attention to Kaggle competitions in academic forecasting studies.
method Review of results from six Kaggle competitions featuring real-life business forecasting tasks.
result Global ensemble models outperform local single models in Kaggle competitions.
New research shows many recent defenses against adversarial examples are ineffective against black-box attacks.
problem The robustness of recent defenses against adversarial examples is insufficient, especially against black-box attacks.
method Evaluation of nine defenses on two black-box adversarial models and six attacks on CIFAR-10 and Fashion-MNIST datasets.
result Most recent defenses provide only marginal improvements in security () compared to undefended networks.
The origin of economic crises is a key problem for economics. We present a model of long-run competitive markets to show that the multiplicity of behaviors in an economic system, over a long time scale, emerge as statistical regularities (perfectly competitive markets obey Bose-Einstein statistics and purely monopolist…
New framework promotes reproducible, domain-agnostic reinforcement learning algorithms.
problem Domain-specific, compute-resource-maximizing, and non-reproducible participant solutions in reinforcement learning competitions.
method Submission retraining, domain randomization, desemantization through domain obfuscation, and compute/environment-sample budget limitation.
result Participant submissions are reproducible, non-specific to the competition environment, and sample/resource efficient.
The real estate is a pillar industry of China's national economy. Due to changes in policy and market conditions, the real estate companies are facing greater pressures to survive in a competitive environment. They must improve their financial competitiveness. Based on the conceptual framework of financial competitiven…
First ABAW 2020 Competition analyzes affective behavior tasks.
problem Automatic analysis of valence-arousal, basic expressions, and action units in real-world scenarios.
method Provided Aff-Wild2 database, described Challenges, evaluation metrics, and top-performing systems.
result Demonstrated the feasibility of automatic affective behavior analysis in real-world settings.
Study examines machine learning competitions' impact on AI development.
problem Fostering innovation and skill development in AI.
method Analysis of major competition platforms, workflows, and participant demographics.
result MLCs promote collaboration, reproducibility, and continuous innovation in AI.
Bayesian rating system for large competitions improves prediction and efficiency.
problem Rating systems for large, competitive events like online programming contests.
method Developed a Bayesian rating system for many participants, proving robustness and runtime.
result The system outperforms existing systems in accuracy and computation speed.
Retrospective Analysis of the 2019 MineRL Competition on Sample Efficient Reinforcement Learningcs.LG
MineRL Competition reduced reinforcement learning sample needs.
problem Sample inefficiency in reinforcement learning.
method Human demonstrations and imitation learning integrated into reinforcement learning algorithms.
result Top solutions used deep reinforcement learning and imitation learning.
This paper evaluates financial competitiveness of Indian real estate companies using entropy method.
problem Improving financial competitiveness of Indian real estate companies in a competitive market.
method Financial competitiveness evaluation index system using key financial ratios and a scoring system.
result Companies with high scores have strong profitability and operational capacity, while those with lower scores struggle with solvency and working capital.
Paper tackles online optimization with memory and competitive control.
problem Minimizing hitting and switching costs in online optimization problems.
method Optimistic Regularized Online Balanced Descent algorithm.
result Achieves a constant, dimension-free competitive ratio.
In this paper, the optimal pricing strategy in Avellande-Stoikov's for a monopolistic dealer is extended to a general situation where multiple dealers are present in a competitive market. The dealers' trading intensities, their optimal bid and ask prices and therefore their spreads are derived when the dealers are info…
Model predicts growth competition on curved surfaces.
problem Growth dynamics of two subsets on Riemannian manifolds.
method Modeling growth rates on spherically symmetric Riemannian manifolds.
result Conditions for bounded or unbounded growth on different manifolds.
Market competition depends on computational complexity, P != NP makes it impossible.
problem Competitive market outcomes require computational intractability.
method Analyzes the computational hardness of collusion detection in markets.
result If P != NP, collusion detection is computationally infeasible, making collusion unstable.
The M5 competition tackles overdispersed retail sales forecasting with GAMLSS.
problem Overdispersed and zero-inflated retail sales data.
method Distributional forecasting using GAMLSS framework.
result GAMLSS provides better probabilistic forecasting for count data.
Model predicts competition between similar products in sales.
problem Predicting cannibalization between similar products in sales.
method Developed a neural network model that computes a 'competitiveness' function based on product features.
result The model outperforms traditional methods in predicting market share.
Improved forecasting in daily time series competition using a correlator method.
problem Forecasting daily time series with data leakage issues.
method Ensemble of five statistical forecasting methods and a correlator method.
result The correlator method was responsible for most of the gains over naive forecasting.
The NIPS 2018 Adversarial Vision Challenge is a competition to facilitate measurable progress towards robust machine vision models and more generally applicable adversarial attacks. This document is an updated version of our competition proposal that was accepted in the competition track of 32nd Conference on Neural In…
A new method for multi-expert learning-to-defer avoids optimization issues.
problem Optimization issues in multi-expert learning-to-defer systems.
method A decoupled surrogate with a softmax classifier head and independent sigmoid heads per expert.
result First multi-expert L2D guarantee with a constant not growing with the expert pool.
How to Host a Data Competition: Statistical Advice for Design and Analysis of a Data Competitionstat.AP
Data competitions rely on real-time leaderboards to rank competitor entries and stimulate algorithm improvement. While such competitions have become quite popular and prevalent, particularly in supervised learning formats, their implementations by the host are highly variable. Without careful planning, a supervised lea…
Politicians world-wide frequently promise a better life for their citizens. We find that the probability that a country will increase its {\it per capita} GDP ({\it gdp}) rank within a decade follows an exponential distribution with decay constant . We use the Corruption Perceptions Index (CPI) and the Global …
Bose-Einstein Condensation in Competitive Processescond-mat.stat-mech
We introduce an irreversible discrete multiplicative process that undergoes Bose-Einstein condensation as a generic model of competition. New players with different abilities successively join the game and compete for limited resources. A player's future gain is proportional to its ability and its current gain. The the…
The study assesses how market competitiveness affects electricity price forecasting.
problem Impact of market competitiveness on electricity price estimation.
method Used a multi-layer perception model with back propagation and Levenberg-Marquardt mechanism, incorporating market power indices and other variables.
result Market power indices enhance forecasting accuracy of daily electricity prices.
We present a broad agenda for meaningful banking regulation reform aiming the creation of evolutive competitive environment to maximize the effectiveness of international financial system through the introduction of fair competition process among the banks in free market capitalism. We assume that the international fin…