Introduces ramp-based twin support vector clustering for robust clustering.
problem Traditional clustering methods amplify cost, leading to less robust clustering.
method Introduces ramp cost function into plane-based clustering to propose RampTWSVC.
result RampTWSVC finds intrinsic clusters more robustly and efficiently.
In this paper we propose a tractable quadratic programming formulation for calculating the equilibrium term structure of electricity prices. We rely on a theoretical model described in [21], but extend it so that it reflects actually traded electricity contracts, transaction costs and liquidity considerations. Our nume…
Study develops a machine learning-based ramp metering model to improve freeway efficiency.
problem Improving ramp metering to maintain freeway efficiency under various traffic conditions.
method Machine learning approach using historical data to predict and manage traffic flow.
result The novel model outperforms a baseline traffic-responsive ramp metering algorithm.
Modeling solar ramping events with spatio-temporal point processes.
problem Predicting solar ramping events influenced by weather conditions.
method Novel spatio-temporal categorical point process model.
result Effective modeling of spatio-temporal correlations in solar ramping events.
Novel ramp loss method improves weakly supervised machine translation and parsing.
problem Training neural models without gold labels in weak supervision scenarios.
method Adapted ramp loss objectives to promote positive outputs and discourage negative ones.
result Bipolar ramp loss objectives outperform other methods on weakly supervised tasks.
In this paper we show all possible ramps where an object can move with constant speed under the effect of gravity and friction. The planar ramp are very easy to describe, just rotate a curve with velocity vector (tanh(as),sech(as)). Recall that tanh(as)^2+sech^2(as) = 1. Therefore, the solution of the planar constant s…
The paper finds that circles and logarithmic spirals are the only constant-speed ramps for a specific force field.
problem Determining planar curves for constant-speed motion under specific force conditions.
method Analyzing the motion of a particle under friction and a central force field.
result Every solution to the constant-speed motion problem approaches either a circle or a logarithmic spiral.
Study improves adversarial classification using distributionally robust models.
problem Improving robustness against adversarial attacks in classification models.
method Distributionally robust chance constraints with Wasserstein ambiguity, reformulated as a regularized ramp loss minimization problem.
result Standard descent methods can converge to the global minimizer for the distributionally robust adversarial classification model.
Seesaw optimizes training by balancing learning rate and batch size, accelerating model pretraining.
problem Optimizing training efficiency for large language models with adaptive optimizers.
method Develops a principled framework for batch-size scheduling, introducing Seesaw which multiplies learning rate by 1/√2 and doubles batch size.
result Empirically, Seesaw reduces wall-clock time by approximately 36% compared to cosine decay, matching theoretical limits.
Automates detection of fast-ramped flexibility events for DSOs.
problem Monitoring and supervising flexibility activations in power systems.
method Unsupervised detection and open-set classification.
result Automatically identifies critical flexibility activations for early intervention.
Automates phased release strategy to balance risk and speed.
problem Balancing risk and speed in phased product releases.
method Formalizes as constrained batched bandit problem, uses adaptive Bayesian approach.
result Proposes algorithm that determines optimal release percentages.
Deep neural networks generalize well despite having many more parameters than data.
problem Theoretical basis for deep learning's ability to generalize with many more parameters than data.
method Examined the statistical risk of multi-layer networks with ℓ1-type parameter controls and ramp activation functions. result The risk is upper bounded by [(L3logd)/n]1/2, demonstrating that input dimensions can be much larger than sample sizes. Paper proposes algorithms for active learning of reject option classifiers.
problem Active learning of reject option classifiers is unaddressed in machine learning.
method Developed novel algorithms using double ramp and double sigmoid loss functions.
result Proposed algorithms efficiently reduce the number of labeled examples required.
The paper constructs minimizers for deep learning networks and analyzes their geometric structure.
problem Underparametrized deep learning networks and their minimizers.
method Direct construction of minimizers without gradient descent, considering specific settings.
result Explicit family of minimizers for the global minimum and a set of degenerate local minima.
Paper establishes generalization bounds for RNNs and improves existing results.
problem Theoretical understanding and generalization bounds for RNNs.
method New generalization error bound and Rademacher complexity calculation.
result Improved generalization bounds for RNNs, tighter than existing bounds.
Project promoters, forecasters, and managers sometimes object to two things in measuring inaccuracy in travel demand forecasting: (1) using the forecast made at the time of making the decision to build as the basis for measuring inaccuracy and (2) using traffic during the first year of operations as the basis for measu…
The paper predicts human-like driving behavior of other vehicles for safer AVs.
problem Safe and efficient interaction of AVs with other vehicles.
method Hierarchical inverse reinforcement learning considering both discrete and continuous decisions.
result The proposed approach accurately predicts both discrete and continuous driving behaviors.
We use surrogate losses to obtain several new regret bounds and new algorithms for contextual bandit learning. Using the ramp loss, we derive new margin-based regret bounds in terms of standard sequential complexity measures of a benchmark class of real-valued regression functions. Using the hinge loss, we derive an ef…
Let f⋆ be a function on Rd with an assumption of a spectral norm vf⋆. For various noise settings, we show that E∥f^−f⋆∥2≤(vf⋆4nlogd)1/3, where n is the sample size and f^ is either a penalized lea…
We study dynamic hedging of counterparty risk for a portfolio of credit derivatives. Our empirically driven credit model consists of interacting default intensities which ramp up and then decay after the occurrence of credit events. Using the Galtchouk-Kunita-Watanabe decomposition of the counterparty risk price paymen…
This paper characterizes and designs loss functions for robust classification with abstention.
problem Ensuring robustness against adversarial attacks and knowing when to abstain from prediction.
method Proposes adversarial robust reject option loss and characterizes surrogates for calibration.
result Shifted Double Ramp Loss and Shifted Double Sigmoid Loss satisfy the calibration conditions.
In this paper, we systemally study the long time behavior of the curve shortening flow in a closed or non-compact complete locally Riemannian symmetric manifold. Assume that we have a global flow. Then we can exhibit a a limit for the global behavior of the flow. In particular, we show the following results. 1). Let $\…
Case study shows impact of co-optimizing energy and reserve for wind energy.
problem Impact of lack of co-optimization of energy and reserve in high wind penetration scenarios.
method Developed two models with and without co-optimization, calibrated with Spanish market parameters.
result Models show significant differences in energy and reserve management.
Structured learning is appropriate when predicting structured outputs such as trees, graphs, or sequences. Most prior work requires the training set to consist of complete trees, graphs or sequences. Specifying such detailed ground truth can be tedious or infeasible for large outputs. Our main contribution is a large m…
Algorithm extracts wavefront sets from images using deep learning.
problem Extracting wavefront sets from images for imaging sciences.
method Combines shearlet transform and deep neural networks.
result Algorithm outperforms other methods in edge and ramp orientation detection.
We analyze adversarial learning using a minimax approach.
problem Analyzing risk bounds in adversarial learning problems.
method Reducing adversarial learning to a minimax statistical learning problem and proving a new risk bound.
result Deriving adversarial risk bounds for SVMs, deep neural networks, and PCA.
New method combines FMEA and Bayesian Network for root cause analysis in lithium-ion battery production.
problem Complex cause-effect relationships in lithium-ion battery production.
method Combining FMEA with Bayesian Network to detect and resolve inconsistencies.
result Holistic method builds large-scale cross-process Bayesian Failure Network for root cause analysis.
SPADE improves demand forecasting accuracy by 4.5% for post-promotion periods.
problem Overreacting to peak events in demand forecasting leads to biased forecasts.
method SPADE splits forecasting into two tasks: one for peak events and another for post-peak events, using masked convolution filters and a specialized Peak Attention module.
result Overall PPE improvement of 4.5%, 30% improvement for most affected forecasts after promotions and holidays, and 3.9% improvement in PE accuracy.
Deep neural nets on 1-D data are convex Lasso models with reflection features.
problem Training neural networks on 1-D data.
method Proving equivalence to convex Lasso problems with discrete, explicitly defined dictionary matrices.
result Reflection features in neural networks with certain activations.
Agents learn sophisticated tool use and coordination in hide-and-seek.
problem Training agents to perform complex tasks in multi-agent environments.
method Multi-agent competition with hide-and-seek as a simple objective.
result Agents develop emergent strategies requiring sophisticated tool use and coordination.
The paper examines A/B tests in recommendation systems to detect biased algorithm comparisons due to shared data.
problem Bias in comparing recommendation algorithms due to shared data.
method Formalized as a multi-armed bandit problem, analyzed the sign of difference-in-means estimator vs true GTE.
result Data sharing can lead to biased comparisons of recommendation algorithms, and a detection procedure is proposed.
As automotive electronics continue to advance, cars are becoming more and more reliant on sensors to perform everyday driving operations. These sensors are omnipresent and help the car navigate, reduce accidents, and provide comfortable rides. However, they can also be used to learn about the drivers themselves. In thi…
Proposes a framework for predicting traffic situations involving multiple interacting agents.
problem Predicting the behavior of multiple interacting agents in traffic scenarios.
method Two-layer Hidden Markov Model (TLHMM) for situation distribution and learning-based dynamic scene evolution model for trajectory sampling.
result Demonstrates effectiveness and accuracy in highway ramp merging scenario.
A hybrid model combines Q-learning and PID controller for continuous vehicle control.
problem Learning unsatisfactory results with discrete action space in autonomous driving.
method Combining Q-learning and PID controller, using Quadratic Q-function approximation and action network.
result Autonomous vehicle successfully learns smooth and efficient driving behavior.
The support vector machine (SVM) is one of the most successful learning methods for solving classification problems. Despite its popularity, SVM has a serious drawback, that is sensitivity to outliers in training samples. The penalty on misclassification is defined by a convex loss called the hinge loss, and the unboun…
SAT improves adversarial training by smoothing the loss landscape through curriculum learning.
problem Adversarial training sacrifices clean accuracy for robustness and suffers from large generalization error.
method SAT uses curriculum learning to smooth the adversarial loss landscape, improving both clean and robust accuracy.
result SAT models improve clean and robust accuracy significantly compared to adversarial training and other baselines.
MLM models match or exceed RN in generating wind power time series without location info.
problem Generating accurate long-term wind power time series without location information.
method Applied neural networks to MERRA2 wind speed data with and without location info.
result MLM models produce time series of equal or better quality than RN.
iGNN tackles inverse graph prediction using invertible neural networks.
problem Inverse graph prediction problem in data analysis and machine learning.
method Developed invertible graph neural network (iGNN) to solve inverse prediction problem on graphs.
result iGNN model allows efficient generation from output labels and forward prediction.
Safe sample screening improves RSVM performance without sacrificing accuracy.
problem Improving RSVM performance under noisy conditions.
method Proposed two safe sample screening rules based on CCCP framework for RSVM.
result Significant reduction in computational time for RSVM.
Decision trees and shallow neural networks have different geometric complexities, impacting their interpretability and accuracy.
problem The geometric simplicity of decision boundaries in decision trees conflicts with the approximation capabilities of shallow neural networks.
method Analysis of the Radon total variation (RTV) seminorm to compare geometric complexity of decision regions and neural network approximations.
result Smooth barrier scores can approximate decision regions with finite RTV, but their performance depends on the tube-mass condition near the decision boundary.
Understanding efficiency in high dimensional linear models is a longstanding problem of interest. Classical work with smaller dimensional problems dating back to Huber and Bickel has illustrated the benefits of efficient loss functions. When the number of parameters p is of the same order as the sample size n, $p \…
European steel industry shifts to electric arc furnaces, reducing scrap imports and increasing competition.
problem Reducing CO2 emissions in the European steel industry through electric arc furnaces.
method Combining trade data with business intelligence to model the impact of EAF capacity on scrap trade.
result Scrap imports decrease as EAF capacity increases, highlighting the need for a new business ecosystem.
Cost-aware BO minimizes function evaluations with varying costs.
problem Optimization with varying evaluation costs in expensive functions.
method Cost Apportioned Bayesian Optimization (CArBO) combining initial and cost-cooled phases.
result CArBO finds better hyperparameter configurations with the same cost budget.
Paper optimizes broker performance by estimating execution costs.
problem Minimizing execution costs for large trades.
method Intraday modeling of execution cost components (linear and quadratic).
result Substantial improvements in estimating execution costs.
Paper proposes new costs for learning multiple centers in MDNs.
problem Learning multiple centers for density approximation in MDNs.
method Combines MDNs with contrastive costs using four types of kernelized matrix costs.
result New costs improve data density approximation in MDNs.
Using a methodology similar to that used the in the worldwide research, the cost performance of Dutch large-scale transport infrastructure projects is determined. In the Netherlands, cost overruns are as common as cost underruns but because cost overruns are larger than cost underruns projects on average have a cost ov…
Cost-aware multi-objective Bayesian optimization for non-uniformly expensive functions.
problem Non-uniform cost of function evaluations in Bayesian optimization.
method Introduces cost-aware constraints and a new acquisition function to optimize multi-objective functions with varying costs.
result Demonstrates improved optimization in hyperparameter tuning of neural networks and random forests.
Proposes resilience metrics for large blackout costs with logarithmic resilience.
problem Large variations in blackout costs make estimating risk impractical.
method Uses mean of log of large blackout costs, tail slope index, and frequency.
result Solves problems of heavy tail and large variations in blackout costs.