We found a 'Goldilocks zone' in neural network loss landscapes that correlates with good initialization.
problem Understanding and optimizing neural network loss landscapes for better initialization.
method Random and low-dimensional hypersurfaces to evaluate the Hessian of loss functions.
result The Goldilocks zone is a region of unusually high convexity and positive curvature, correlated with good network performance.
Goldilocks activation functions improve neural network performance.
problem Improving neural network performance and understanding signal transformation.
method Introducing Goldilocks activation functions that locally deform input signals.
result Goldilocks networks outperform or match SELU and RELU on CIFAR-10 and CIFAR-100 datasets.
In this paper we introduce a new class of domains in complex Euclidean space, called Goldilocks domains, and study their complex geometry. These domains are defined in terms of a lower bound on how fast the Kobayashi metric grows and an upper bound on how fast the Kobayashi distance grows as one approaches the boundary…
Model explains surprising properties of neural network training landscapes.
problem Understanding the geometry of neural network loss landscapes.
method Developed a simple theoretical model of gradients and Hessians.
result Unified model accounts for 4 surprising properties of neural loss landscapes.
Proposes a multilingual email segmentation benchmark and model.
problem Lack of multilingual email zoning corpora and models.
method Analysis of existing corpora, development of multilingual benchmark, introduction of OKAPI model.
result OKAPI model achieves state-of-the-art performance in English and generalizes well to unseen languages.
Brillouin zones were introduced by Brillouin in the thirties to describe quantum mechanical properties of crystals, that is, in a lattice in Rn. They play an important role in solid-state physics. It was shown by Bieberbach that Brillouin zones tile the underlying space and that each zone has the same area. We gene…
Study option pricing in sideways markets and target zones.
problem Option pricing in sideways markets and target zones.
method Closed-form option pricing formulas for sideways markets and target zones.
result Closed-form option pricing formulas for sideways markets and target zones.
Machine learning predicts CO2 emissions in power grids, reducing uncertainty.
problem Forecasting CO2 emission intensities in power grids.
method Developed a machine learning algorithm using LASSO, feature selection, and Softmax weighted average.
result Marginal emissions are independent of DK2 zone conditions, suggesting external generators.
Paper presents a WiFi-based indoor sensor localization technique.
problem Indoor localization in wireless sensor networks.
method Zoning-based localization using statistical learning.
result Efficient sensor zone determination in indoor environments.
Study examines stock market connections before, during, and after the 2008 financial crisis.
problem Effects of the 2008 global financial crisis on stock market connectivity.
method Generated complex networks from cross-correlation matrices, using threshold networks and minimal spanning trees.
result During the crisis, countries in different zones had varying levels of connectivity.
Study uses evolutionary deep learning to identify galaxies obscured by star densities.
problem Identifying galaxies in the Zone of Avoidance due to high star densities and extinction.
method Evolutionary algorithm to optimize CNN architecture for near-infrared images.
result Best evolved CNN outperforms other variants in identifying galaxies in the Zone of Avoidance.
Study shows critical width for rigidity of equatorial zones on spheres.
problem Mean curvature rigidity of equatorial zones on spheres.
method Used tangency principle and trap-slice lemma for strong rigidity, and constructed nontrivial perturbations using Delaunay surfaces for non-rigidity.
result Critical width exists for rigidity, beyond which zones are non-rigid.
Paper introduces a new power-dominance axis in estimator design.
problem Estimator design trade-off between bias and variance.
method Introduces a third power regime, `power-dominant', with an unavoidable error penalty.
result Any estimator in the `power-dominant' regime is structurally sub-optimal.
For a given lattice, we establish an equivalence involving a closed zone of the corresponding Voronoi polytope, a lamina hyperplane of the corresponding Delaunay partition and a quadratic form of rank 1 being an extreme ray of the corresponding L-type domain.
The Zeeman-Hamilton operators of free charged particles are identified with the Laplacians of certain Riemannian manifolds, called Zeeman manifolds. The quantum Hilbert space decomposes into subspaces (Zeeman zones) which are invariant under the actions both of the Zeeman operator and the natural Heisenberg group repre…
Model predicts and optimizes trading of electricity price spreads across multiple zones.
problem Forecasting and optimizing day-ahead versus real-time price spreads in U.S. electricity markets.
method Unified statistical model for positive and negative spikes, structural price impact model based on bid stacks.
result Optimal trading strategy improves risk-return profile and highlights market heterogeneity.
Optimizes portfolio with two controls to minimize trades and maintain signal integrity.
problem Optimizing a single-asset portfolio with transaction costs and signal autocorrelation.
method Formulated an optimization problem to minimize trades while maintaining signal integrity and achieving maximum return.
result Locally optimal solution minimizes trades and achieves maximum return, with a quantifiable improvement based on threshold and autocorrelation removed.
BUZz defends images from adversarial attacks using simple transformations.
problem Adversarial attacks on deep neural networks for image classification.
method Combination of deep neural networks and simple image transformations.
result Achieves significant improvement over state-of-the-art defenses with a modest drop in clean accuracy.
CoDeQ simplifies joint model compression by integrating pruning and quantization.
problem Joint pruning and quantization methods are complex and require additional procedures.
method CoDeQ uses a dead-zone quantizer to directly induce sparsity and learn quantization parameters.
result CoDeQ achieves high sparsity and low-precision accuracy with minimal bit operations.
In the present paper which a sequel to dg-ga/9511005 and dg-ga//9610013 a global Weierstrass representation of an arbitrary closed oriented surface of genus ≥1 in the the three-space is constructed. The Weierstrass spectrum of a torus immersed into R3 is introduced and finite-zone planes as well as finite-zone…
We study the problem of optimal trading using general alpha predictors with linear costs and temporary impact. We do this within the framework of stochastic optimization with finite horizon using both limit and market orders. Consistently with other studies, we find that the presence of linear costs induces a no-tradin…
Study reveals different drivers of electricity price volatility across Europe.
problem Understanding the drivers of electricity price volatility across different European zones.
method Developed estimators of weekly integrated variance using a stochastic partial differential equation approach, accounting for mean-reversion and semigroup-smoothing.
result Each European generation zone has distinct drivers of volatility, and leverage effects are not generally asymmetric.
Algorithm finds safe zones in policy Markov Decision Processes to limit trajectory escape.
problem Finding safe zones in policy Markov Decision Processes to limit trajectory escape.
method Bi-criteria approximation learning algorithm with polynomial sample complexity.
result Achieves almost 2 approximation for both escape probability and safe zone size.
The paper presents a recognition system for Pashto letters using KNN and ANN.
problem Challenging handwritten character recognition, especially for Pashto letters.
method Designed a database of 4488 images, used zoning feature extractor, KNN, and ANN classifiers.
result Achieved overall classification accuracy of 70.05% using KNN and 72% using ANN.
Hierarchical GANs reduce anomaly detection costs.
problem Balancing anomaly detection accuracy and sampling costs.
method Hierarchical GANs for nonuniform sampling and buffer zones.
result Proposed GAN-based detector outperforms baseline in detection delay and average cost of error.
Unified principle LZN unifies generative modeling, representation learning, and classification.
problem Disjoint solutions for generative modeling, representation learning, and classification.
method LZN creates a shared latent space for all tasks, using encoders and decoders for each data type.
result LZN improves FID on CIFAR10 and outperforms existing methods in representation learning and joint generation/classification.
Optimal trading and liquidation strategies with signals and regulatory constraints.
problem Optimal trading and liquidation in models with price predictions and regulatory limits.
method Almgren-Chriss model with general signals, target zone models, and lookback option analysis.
result Explicit formulas for optimal liquidation rates in Bachelier and Black-Scholes dynamics.
Adopting a zonal structure of electricity market requires specification of zones' borders. In this paper we use social welfare as the measure to assess quality of various zonal divisions. The social welfare is calculated by Market Coupling algorithm. The analyzed divisions are found by the usage of extended Locational …
Deep neural network improves EEG-based epilepsy diagnosis.
problem Automated identification of seizure onset zones in epilepsy patients.
method Residual deep convolutional neural network trained on raw EEG data.
result State-of-the-art performance on epilepsy classification benchmarks.
Framework fuses satellite and OSM data for local climate zone classification.
problem Heterogeneity of multimodal satellite and OSM data.
method Separate processing of satellite and OSM data, followed by fusion at the model level.
result Framework outperforms baseline by 6-2% in classification accuracy.
In this note we discuss - in what is intended to be a pedagogical fashion - FX option pricing in target zones with attainable boundaries. The boundaries must be reflecting. The no-arbitrage requirement implies that the differential (foreign minus domestic) short-rate is not deterministic. When the band is narrow, we ca…
Central bank strategy to maintain currency exchange rate within limits.
problem Maintaining a currency exchange rate within a target zone despite adverse economic trends.
method Modeling the problem with a continuous-time market impact model and solving it as a stochastic control problem.
result Optimal strategy minimizes accumulated inventory of foreign currency.
Our analysis of financial data, in terms of super-exponential growth, suggests that the seed of the 2002/03 crisis of the Dutch supermarket giant AHOLD was planted in 1996. It became quite visible in 1999 when the post-bubble destabilization regime was well-developed and acted as the precursor of an inevitable collapse…
GAN model simulates 3D particle trajectories in flame zones.
problem Simulating 3D Lagrangian particle trajectories in flame zones.
method Generative adversarial network (GAN) model with stochastic and convoluted neural networks.
result Best-trained GAN model produced trajectories indistinguishable from ground truth.
Optimal trading strategy with predictor and costs, derived equations and shape.
problem Optimal trading strategy in presence of price predictor, costs, and risk control.
method Path-integral method to derive equations for band edges, solved explicitly for Ornstein-Uhlenbeck predictor.
result Explicit equations and shape of the optimal band strategy derived and analyzed.
Deep learning optimizes vehicular communication zones for efficient data dissemination.
problem Overdimensioning and inefficient communication in vehicular floating content.
method Deep learning is used to select optimal broadcasting areas (Anchor Zones) for efficient message dissemination.
result The proposed method achieves an accuracy of 89.7% in predicting optimal Anchor Zones, saving up to 27% of resources.
A new SL strategy optimizes HVAC DR in multi-zone buildings.
problem Optimal DR of HVAC units in multi-zone buildings is challenging.
method Supervised learning with ANN replication and DNN integration.
result SLAMP achieves effective DR schedules with reduced computation time.
We introduce a mathematical model on the dynamics of demand and supply incorporating collectability and saturation factors. Our analysis shows that when the fluctuation of the determinants of demand and supply is strong enough, there is chaos in the demand-supply dynamics. Our numerical simulation shows that such a cha…
A novel ν-SVQR model for automatic quantile estimation.
problem Quantile estimation with automatic accuracy control.
method Uses ν fraction of training data points and asymmetric ε-insensitive zone. result Automatic control over accuracy achieved through ν-SVQR model. In this paper, we introduce an insurance ruin model with adaptive premium rate, thereafter refered to as restructuring/refraction, in which classical ruin and bankruptcy are distinguished. In this model, the premium rate is increased as soon as the wealth process falls into the red zone and is brought back to its regul…
Understanding the spatiotemporal distribution of people within a city is crucial to many planning applications. Obtaining data to create required knowledge, currently involves costly survey methods. At the same time ubiquitous mobile sensors from personal GPS devices to mobile phones are collecting massive amounts of d…
Study uses mobile phone data to map Chagas disease risk zones.
problem Identifying geographical spread of Chagas disease.
method Analyzing geolocalized call records and public health information.
result Generated risk maps for public health campaigns.
Paper analyzes electricity price and demand data to detect cyber-attacks using time series methods.
problem Detecting cyber-attacks in electricity price and demand data.
method Time series analysis, including moving average, moving standard deviation, and augmented Dickey-Fuller test.
result Identified anomalies in the data using time-series stationary criteria.
Optimal trading patterns adjust based on market efficiency and slippage costs.
problem Balancing active alphas and trading costs in active portfolios.
method Maximization of utility including projected alpha-based profits, slippage costs, and risk aversion.
result Optimal trading involves a no-trade zone width that scales as Δ∼c1/2, differing from stochastic settings. Gaussian beams describe the amplitude and phase of rays and are widely used to model acoustic propagation. This paper describes four new results in the theory of Gaussian beams. (1) A new version of the Červený equations for the amplitude and phase of Gaussian beams is developed by applying the equivalence of Hamilton-…
Study improves motor insurance claim prediction using geographic data.
problem Limited location identifiers in public actuarial datasets.
method Zone-level modeling framework with environmental and orthoimagery data.
result Geographic information improves MTPL claim prediction accuracy.
New ML model predicts long-term power generation at large areas.
problem Accurate forecasting of long-term power generation from renewable sources.
method Machine learning model applied to aggregated power generation data.
result The model predicts power generation with high accuracy over 15 days.
Bayesian method improves deep learning for noisy EEG seizure detection.
problem Label noise in scalp EEG data hinders deep learning performance.
method Integrates domain knowledge into a Bayesian framework to inform deep learning models of label ambiguities.
result BUNDL enhances robustness of seizure detection systems under noisy label conditions.