Improved algorithm for multidimensional scaling reduces stress.
problem Stress in multidimensional scaling.
method Proposed modifications of the smacof algorithm.
result Convergent majorization algorithm for Kruskal's stress formula two.
Majority-of-Three is Optimal
problem Optimality of Voting Learners
method Majority vote of three classifiers
result Proves optimality for the simplest voting scheme
Majority bit estimation in noisy random recursive DAGs.
problem Estimating the majority bit in a noisy random recursive DAG.
method Majority rule among nodes, with bit flipping and noisy channel.
result Identification of the threshold for p at which majority rule yields errors. Paper reinterprets majorizing measure theorem in terms of coding theory.
problem Understanding boundedness of random processes.
method Information-theoretic perspective using variable-length codes.
result Boundedness of random processes linked to efficient coding.
Best-of-Majority improves inference performance in Pass@k settings.
problem Inference in difficult tasks often underperforms with single-shot selection methods.
method Combining majority voting and Best-of-N, Best-of-Majority restricts candidates to high-frequency responses.
result Best-of-Majority achieves minimax optimal regret and outperforms other methods.
The paper studies a stochastic majority vote approach to improve classifier accuracy.
problem Improving classifier accuracy over ensembles of classifiers.
method Minimizing a PAC-Bayes generalization bound with Dirichlet distributions.
result Achieves state-of-the-art accuracy and tight generalization bounds.
Geometrically proves majorizing measure theorem on Hadamard manifolds.
problem Volume size relation between random process index space and its convex hull.
method Assumed Hadamard manifold, derived upper bound for volume ratio, applied to prove majorizing measure theorem.
result Upper bound for volume ratio between index space and convex hull.
Study on price formation in a market with a major player and minor firms.
problem Equilibrium price formation in a market with a major financial firm and many minor firms.
method Analyzes the equilibrium price process in both finite and mean field models, considering idiosyncratic and common noises.
result Derives the functional form of price impact for the major firm in both market sizes.
Optimal trading strategies identified in electricity markets with a major player.
problem Price formation and optimal trading in intraday electricity markets with strategic interactions.
method Stochastic control theory and mean field games with a major player.
result Nash equilibrium identified in closed form for the asymptotic case.
We tackle the issue of classifier combinations when observations have multiple views. Our method jointly learns view-specific weighted majority vote classifiers (i.e. for each view) over a set of base voters, and a second weighted majority vote classifier over the set of these view-specific weighted majority vote class…
Majorizing measures control sequential complexities for online learning.
problem Extending classical empirical processes theory to sequential cases.
method Generic chaining, majorizing measures, fractional covering numbers.
result Sharp control of worst-case sequential Rademacher complexity.
Simpler majority vote of three classifiers achieves optimal error bounds.
problem Developing an optimal PAC learning algorithm in the realizable setting.
method Returning the majority vote of three ERM classifiers.
result Achieves optimal in-expectation bound on error.
Novel analysis improves weighted majority vote in multiclass classification.
problem Improving the performance of weighted majority vote in multiclass classification.
method Analyzes expected risk of weighted majority vote, considering prediction correlations and provides a bound for efficient minimization.
result Minimization of the new bound typically does not degrade the test error of the ensemble.
In this paper, we propose majority voting neural networks for sparse signal recovery in binary compressed sensing. The majority voting neural network is composed of several independently trained feedforward neural networks employing the sigmoid function as an activation function. Our empirical study shows that a choice…
Estimates for polynomial operators using determinant majorization and subharmonics.
problem Bounding solutions of polynomial operators on Euclidean domains.
method Combines Alexandrov estimate and determinant majorization, using subharmonics and semiconvex approximation.
result Includes classical Alexandrov-Bakelman-Pucci estimate for linear operators.
New algorithms minimize PAC-Bayesian C-Bound for majority voting, leading to scalable and accurate predictors.
problem Improving majority vote classifiers using PAC-Bayesian bounds.
method Directly optimizing PAC-Bayesian guarantees on the C-Bound with gradient descent.
result Self-bounding majority vote learning algorithms with scalable and accurate predictors.
In his seminal work, Schapire (1990) proved that weak classifiers could be improved to achieve arbitrarily high accuracy, but he never implied that a simple majority-vote mechanism could always do the trick. By comparing the asymptotic misclassification error of the majority-vote classifier with the average individual …
Unified approach for federated learning using MM optimization.
problem Scaling stochastic optimization to federated learning.
method Unified Majorize-Minimize (MM) framework for stochastic optimization, extended to federated learning.
result Unified algorithm \QSMM\ for federated learning that aggregates surrogate majorizing functions.
The paper extends logistic regression for unbounded majority classes and derives asymptotic properties.
problem Infinitely imbalanced logistic regression inference.
method Derive a second order expansion for slope parameter under unbounded majority class.
result The second order term converges to a normal distribution with a variance depending only on the minority class's mean.
Wisdom of the crowd revealed a striking fact that the majority answer from a crowd is often more accurate than any individual expert. We observed the same story in machine learning--ensemble methods leverage this idea to combine multiple learning algorithms to obtain better classification performance. Among many popula…
Model explains periodic trading in financial markets through game theory.
problem Understanding periodic trading activities in financial markets.
method Mean-field liquidation game with major-minor players.
result Existence and uniqueness of Nash equilibrium established.
New margin bound improves generalization for voting classifiers.
problem Improving generalization bounds for voting classifiers.
method Established a new margin-based generalization bound.
result Derives an optimal weak-to-strong learner with matching theoretical lower bound.
We explain why numbers occurring in the classification of polygon spaces coincide with numbers of self-dual equivalence classes of threshold functions, or of regular Boolean functions, or of decisive weighted majority games.
Proposes MM-DUST for efficient generalized lasso solution paths.
problem Efficiently solve generalized lasso problems in large-scale and non-linear models.
method Majorization-minimization dual stagewise algorithm incorporating quadratic majorizers and stagewise learning.
result Established the uniform convergence of approximated solution paths.
A new oversampling framework generates minority samples by perturbing majority classes.
problem Oversampling in imbalanced classification often neglects majority classes, leading to samples spread across the minority space.
method Introduces a counterfactual objective to generate new minority samples by perturbing majority samples.
result Generated minority samples are near the decision boundary and significantly outperform state-of-the-art methods.
Framework uses machine learning to distinguish major COVID-19 variants.
problem Discriminate and visualize associations between major COVID-19 variants based on genome sequences.
method Unsupervised machine learning methods, including k-mer analysis, PCA, t-SNE, UMAP, and agglomerative hierarchical clustering.
result Framework effectively distinguishes between major variants and identifies emerging variants.
The paper establishes a majorization result for symmetric matrices.
problem Majorization of symmetric matrices under certain conditions.
method Using Garding-Dirichlet operator and properties of I-central operators. result A definitive inequality for symmetric matrices.
Geometric approach to majorizing measures for polyhedra and general compact objects.
problem Understanding the relationship between a space and its convex hull in geometric measure theory.
method Geometric approach using covering number relationships and volume ratios.
result Established a method to evaluate covering number and volume ratios for various spaces.
Introduces PPMM algorithm for nonconvex robust regression problems.
problem Nonconvex tuning-free robust regression problems.
method PPMM algorithm with inner subproblems solved by SSN-PPA.
result Converges to d-stationary point with KL property.
Framework learns to transform majority to minority samples for balanced classification.
problem Imbalanced classification leading to biased predictions.
method Minimizes MMD and uses triplet loss for global alignment and boundary awareness.
result Consistent improvements over classical and generative baselines in AUROC, G-mean, F1-score, and MCC.
Proposes BMME for optimizing nonsmooth nonconvex problems with block structure.
problem Optimizing nonsmooth nonconvex problems with block structure.
method Block Alternating Bregman Majorization Minimization with Extrapolation (BMME).
result Subsequential convergence to a first-order stationary point under mild assumptions, global convergence under stronger conditions.
Cryptocurrencies show stable prices as a medium of exchange.
problem Price stability of cryptocurrencies as a medium of exchange.
method Filtered daily returns of major cryptocurrencies compared to major financial assets using Pearson correlations, dynamic time-warping method, and Black-Scholes model.
result Cryptocurrencies exhibit stable daily returns relative to major financial assets over the years 2016-2020.
This paper proposes an approach to detect emotion from human speech employing majority voting technique over several machine learning techniques. The contribution of this work is in two folds: firstly it selects those features of speech which is most promising for classification and secondly it uses the majority voting…
Crowdsourcing has become an effective and popular tool for human-powered computation to label large datasets. Since the workers can be unreliable, it is common in crowdsourcing to assign multiple workers to one task, and to aggregate the labels in order to obtain results of high quality. In this paper, we provide finit…
The paper improves confidence regions for band-limited functions using tighter norm bounds and majority voting.
problem Constructing reliable confidence regions for band-limited functions from noisy data.
method Improved norm bounds using Hoeffding's inequality and empirical Bernstein bound, majority voting to aggregate intervals.
result Confidence intervals retain their simultaneous coverage guarantee even when aggregated from random subsamples.
The present paper introduces a majority orienting model in which the dealers' behavior changes based on the influence of the price to show the oscillation of stock price in the stock market. We show the oscillation of the price for the model by applying the van der Pol equation which is a deterministic approximation of…
Contrastive examples improve fairness in face recognition by balancing minority and majority groups.
problem Face recognition algorithms favor majority groups in training data.
method Create contrastive examples by swapping group memberships in the training dataset.
result Contrastive examples improve fairness metrics like equalized odds.
Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal processing. In this paper, we intend to make this principle scalable. We introduc…
We studied the topology of correlation networks among 34 major currencies using the concept of a minimal spanning tree and hierarchical tree for the full years of 2007-2008 when major economic turbulence occurred. We used the USD (US Dollar) and the TL (Turkish Lira) as numeraires in which the USD was the major currenc…
We propose an inference method to estimate sparse interactions and biases according to Boltzmann machine learning. The basis of this method is L1 regularization, which is often used in compressed sensing, a technique for reconstructing sparse input signals from undersampled outputs. L1 regularization impedes the …
We give a general overview of the influence of William Thurston on the French mathematical school and we show how some of the major problems he solved are rooted in the French mathematical tradition. At the same time, we survey some of Thurston's major results and their impact. The final version of this paper will appe…
We introduce the minority game theory for two kinds of the Korean treasury bond (KTB) in Korean futures exchange markets. Since we discuss numerically the standard deviation and the global efficiency for an arbitrary strategy, our case is found to be approximate to the majority game. Our result presented will be compar…
Transfer entropy shows abnormal brain connectivity in depression.
problem Abnormal brain connectivity in depression.
method Transfer entropy analysis on EEG recordings.
result Aberrated dynamics and direction of information between brain centers in depression.
Develops variational framework for LQG risk-sensitive MFGs with major-minor interactions.
problem Risk-sensitive optimal control in LQG systems with major-minor interactions.
method Variational approach, nonlinear necessary and sufficient condition of optimality, equivalent risk-neutral measure, Markovian closed-loop best-response strategies.
result Derives optimal control strategies for LQG risk-sensitive MFGs with major-minor interactions, establishing Nash and ε-Nash equilibria. New algorithm for nonconvex optimization on constrained Riemannian manifolds converges quickly.
problem Optimization on constrained Riemannian manifolds.
method Block majorization-minimization (BMM) for smooth nonconvex objectives with Riemannian constraints.
result Converges to stationary points within O(ε−2) iterations. A new method for 1-bit matrix completion that is faster and more accurate.
problem Estimating a low-rank matrix from binary observations.
method Majorization-Minimization Gauss-Newton (MMGN) method.
result MMGN outperforms existing methods in accuracy and speed.
This paper examines autocorrelation in major crypto markets, finding persistent correlations on short time frames.
problem Assessing the efficiency of major cryptocurrency markets through autocorrelation analysis.
method Pearson's autocorrelation coefficient, Ljung-Box test, rolling window analysis.
result Persistent autocorrelation on 5m and 1H time frames, disagreement on 1D and 1W time frames.
New algorithm speeds up NMF with β-divergence.
problem Efficiently factorize nonnegative matrices with β-divergence. method Joint majorization-minimization with multiplicative updates.
result Significant reduction in computation time for NMF.