We study the problem of black-box optimization of a noisy function in the presence of low-cost approximations or fidelities, which is motivated by problems like hyper-parameter tuning. In hyper-parameter tuning evaluating the black-box function at a point involves training a learning algorithm on a large data-set at a …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “low-cost evaluations”
MUMBO optimizes multiple tasks efficiently, even with low-cost related functions.
problem Efficiently optimizing multiple related functions with low-cost evaluations.
method Derives a novel multi-task version of entropy search.
result Robust performance with low computational overhead across various optimization challenges.
Low-cost sensors improve air quality prediction accuracy significantly.
problem Improving air quality monitoring networks with affordable sensors.
method Developed a high-resolution air quality prediction engine using low-cost sensors and official data.
result The use of low-cost sensors improves prediction accuracy by 25% and 15% for PM2.5 and PM10 respectively in densely monitored areas.
A deep learning algorithm designs low-cost SPP films.
problem Designing SPP films with high accuracy and low cost.
method Guided deep learning algorithm with low-cost sample replacement.
result Deep CNN learns to replace precious metals with ordinary metals, reducing cost.
Low-Cost Outdoor Air Quality Monitoring and Sensor Calibration: A Survey and Critical Analysiseess.SP
Surveying low-cost sensors for air quality monitoring and calibration.
problem Limited spatial resolution due to expensive environmental monitoring stations.
method Low-cost sensors with machine learning for calibration.
result Machine learning improves sensor accuracy over time.
Paper presents a low-cost algorithm for bipartite ranking with improved sample size requirements.
problem Bipartite ranking's quadratic dependence on sample size makes it computationally expensive.
method Uses a novel uniform risk bound based on matrix and vector concentration inequalities to achieve low cost and competitive performance.
result Shows that the sample size required for competitive performance is not quadratic, improving efficiency.
This paper analyzes air pollution trends in Rwanda using low-cost sensors and machine learning.
problem Lack of reliable air pollution data in Rwanda due to high costs of equipment.
method Analysis of existing data and development of forecasting models using low-cost sensors and machine learning.
result Proposes forecasting models for air pollution data collected by low-cost sensors.
Due to their ubiquitous and pervasive nature, Wi-Fi networks have the potential to collect large-scale, low-cost, and disaggregate data on multimodal transportation. In this study, we develop a semi-supervised deep residual network (ResNet) framework to utilize Wi-Fi communications obtained from smartphones for the pur…
Ranger improves DNNs' fault resilience without re-computation.
problem Transient faults in DNNs cause errors, reducing reliability.
method Range restriction to transform critical faults to benign faults.
result Significant improvement in error resilience (3x to 50x) with no accuracy loss.
Study characterizes PM2.5 dynamics in Bujumbura using low-cost sensors.
problem Characterize spatio-temporal variability of PM2.5 in Bujumbura.
method Used low-cost sensors to collect data from August 2022 to August 2023. Analyzed hourly, daily, and seasonal PM2.5 concentrations using RNN with LSTM.
result Hourly and annual PM2.5 concentrations in Bujumbura exceed WHO standards.
Machine learning improves air pollution predictions in low-cost sensor networks.
problem Invalid predictions from low-cost sensors in resource-constrained countries.
method Probabilistic machine learning to model sensor calibration as distributions or Gaussian processes.
result Improves air pollution predictions and decision-making processes.
Recurrent neural networks are a powerful tool, but they are very sensitive to their hyper-parameter configuration. Moreover, training properly a recurrent neural network is a tough task, therefore selecting an appropriate configuration is critical. Varied strategies have been proposed to tackle this issue. However, mos…
MoA framework improves financial LLM responses at low cost.
problem Complexity and cost in LLM research for financial domains.
method Mixture of Agents (MoA) framework using customized small models.
result MoA produces higher quality responses at lower costs.
The multimodal web elements such as text and images are associated with inherent memory costs to store and transfer over the Internet. With the limited network connectivity in developing countries, webpage rendering gets delayed in the presence of high-memory demanding elements such as images (relative to text). To ove…
A lightweight FPGA-based reinforcement learning approach for edge devices.
problem Resource constraints and inefficiency of DQN on edge devices.
method OS-ELM based training algorithm and L2 regularization for stability.
result 29.77x and 89.40x faster than conventional DQN-based approach for CartPole-v0 task.
Study assesses CNN model robustness to noise in low-cost CT scans.
problem Evaluate CNN model performance on noisy, artifact-prone low-cost CT images.
method Developed and tested a CNN model for head CT triage, varying tube current and projections.
result Model remains robust to reduced tube current and fewer projections, maintaining AUROC close to original.
Rapid point-of-care Hemoglobin measurement through low-cost optics and Convolutional Neural Network based validationphysics.med-ph
A low-cost, robust, and simple mechanism to measure hemoglobin would play a critical role in the modern health infrastructure. Consistent sample acquisition has been a long-standing technical hurdle for photometer-based portable hemoglobin detectors which rely on micro cuvettes and dry chemistry. Any particulates (e.g.…
DIGIT is a low-cost tactile sensor for in-hand manipulation.
problem Difficulty in sensing contact forces limits robotic manipulation.
method DIGIT miniaturizes and improves a vision-based tactile sensor.
result DIGIT enables better control of interactions with the environment.
In this work, a new approach for Sun tracking systems is presented. Due to the current system limitations regarding costs and operational problems, a new approach based on low cost, computer vision open hardware and deep learning has been developed. The preliminary tests carried out successfully in Plataforma solar de …
A new, low-cost method speeds up membership inference attacks on large language models.
problem Membership inference attacks on large language models.
method An ensemble of small quantile regression models to determine model training set membership.
result Comparable or improved accuracy with significantly reduced computational cost.
RESPIRE calibrates low-cost air-quality sensors for CO levels, resistant to outliers.
problem Calibrating LCAQ sensors against regulatory-grade monitors is expensive and time-consuming.
method PROvably outlier-resistant semi-parametric regression technique.
result RESPIRE offers improved prediction in cross-site, cross-season, and cross-sensor settings.
Low-cost sensor fusion for organic substance classification.
problem Non-destructive classification and quality control of organic substances.
method Arduino Mega 2560 microcontroller with three sensors, supervised learning models, hyperparameter tuning, PCA/LDA, ensemble voting classifier.
result Test accuracies of 93-94% for identifying organic compounds.
Implementing large-scale deep neural networks with high computational complexity on low-cost IoT devices may inevitably be constrained by limited computation resource, making the devices hard to respond in real-time. This disjunction makes the state-of-art deep learning algorithms, i.e. CNN (Convolutional Neural Networ…
PARyOpt is a python based implementation of the Bayesian optimization routine designed for remote and asynchronous function evaluations. Bayesian optimization is especially attractive for computational optimization due to its low cost function footprint as well as the ability to account for uncertainties in data. A key…
Using Satellite Imagery and Machine Learning to Estimate the Livelihood Impact of Electricity Accessecon.GN
Satellite imagery and ML improve livelihood measurements and estimate electrification's impact.
problem Sparse data hinders policy development and evaluation.
method Satellite imagery, machine learning, and ML inference techniques.
result Grid access improves rural asset wealth by 0.17 standard deviations.
Debiasing LLMs by Fine-tuningq-fin.GN
Fine-tunes LLMs to correct bias in predictions.
problem LLMs exhibit bias in predictions from data.
method Supervised fine-tuning with Low-Rank Adaptation (LoRA).
result Fine-tuning corrects bias in both controlled and real-world settings.
Crowdsourcing platforms emerged as popular venues for purchasing human intelligence at low cost for large volume of tasks. As many low-paid workers are prone to give noisy answers, a common practice is to add redundancy by assigning multiple workers to each task and then simply average out these answers. However, to fu…
Recent years have seen a growing interest in understanding deep neural networks from an optimization perspective. It is understood now that converging to low-cost local minima is sufficient for such models to become effective in practice. However, in this work, we propose a new hypothesis based on recent theoretical fi…
Bio-inspired neuromorphic hardware is a research direction to approach brain's computational power and energy efficiency. Spiking neural networks (SNN) encode information as sparsely distributed spike trains and employ spike-timing-dependent plasticity (STDP) mechanism for learning. Existing hardware implementations of…
The usability and practicality of any machine learning (ML) applications are largely influenced by two critical but hard-to-attain factors: low latency and low cost. Unfortunately, achieving low latency and low cost is very challenging when ML depends on real-world data that are highly distributed and rapidly growing (…
This paper introduces a novel low-cost device prototype for the automatic diagnosis of diseases, utilizing inputted symptoms and personal background. The engineering goal is to solve the problem of limited healthcare access with a single device. Diagnosing diseases automatically is an immense challenge, owing to their …
Proposes TPIS for early and low-cost TB vs. pneumonia diagnosis.
problem Challenges in differentiating TB from pneumonia.
method Two-step decision support system with stacked ensemble classifiers.
result TPIS outperforms other methods in early and final diagnosis.
As societies around the world are ageing, the number of Alzheimer's disease (AD) patients is rapidly increasing. To date, no low-cost, non-invasive biomarkers have been established to advance the objectivization of AD diagnosis and progression assessment. Here, we utilize Bayesian neural networks to develop a multivari…
Study uses remotely sensed data to infer economic outcomes in experiments and quasi-experiments.
problem Imperfect measurement of economic outcomes by remotely sensed variables.
method Combines experimental and observational data to identify causal parameters, using satellite imagery and mobile phone activity.
result Developed a robust method for n^{-1/2} inference that does not restrict remotely sensed variable processing algorithms.
Smartphones and portable devices have become ubiquitous and part of everyone's life. Due to the fact of its portability, these devices are perfect to record individuals' traces and life-logging generating vast amounts of data at low costs. These data is emerging as a new source for studies in human mobility patterns ra…
GNMR controls runtime stability in low-precision language model training.
problem Efficient low-precision training faces numerical risks at specific operators.
method GNMR compares gradient norms to historical means, applying bounded recovery actions.
result GNMR preserves high-fidelity quality with sparse, budgeted recovery.
This paper proposes a method to use LLMs as auxiliary evaluators in place of human judges.
problem The need for cost-effective and scalable evaluation of AI systems.
method Formulates a two-stage sampling design with LLM evaluations and human ratings, using a doubly robust estimator.
result Proposes a method to determine optimal sample sizes for human and LLM ratings.
NGRC shows numerical instabilities with short lags and high-degree polynomials.
problem Numerical instabilities in NGRC feature matrix.
method Combining numerical linear algebra and dynamical systems theory, we study feature matrix conditioning. We evaluate different numerical algorithms for solving the regularized least-squares problem.
result SVD-based training achieves accurate forecasts without regularization, preferable for short lags and high-degree polynomials.
Researchers use Gaussian Process Regression to improve accuracy of a low-cost hot-wire anemometer.
problem Improving accuracy of low-cost hot-wire anemometers in varying temperatures.
method Probabilistic calibration using Gaussian Process Regression.
result The method provides good performance in estimating actual wind speeds, including uncertainty.
New method detects if data points were used in training models with low cost and high power.
problem Detecting if a particular data point was used in training a model.
method Fine-grained modeling of null hypothesis in likelihood ratio tests, leveraging reference models and population data.
result RMIA has superior test power compared to prior methods, even at extremely low false positive rates.
Determinantal point processes (DPPs) are an important concept in random matrix theory and combinatorics. They have also recently attracted interest in the study of numerical methods for machine learning, as they offer an elegant "missing link" between independent Monte Carlo sampling and deterministic evaluation on reg…
AI simplifies trading strategies, potentially making markets more efficient.
problem Efficient market hypothesis (EMH) relies on traders optimising trading strategies based on information.
method Generalised notion of market efficiency, distinguishing model complexity through investor beliefs and trading strategies.
result Increased availability of low-cost AI systems may push towards more advanced trading strategies, potentially harder for inefficient traders.
This work introduces a novel nonparametric density index defined on graphs, the Sum-over-Forests (SoF) density index. It is based on a clear and intuitive idea: high-density regions in a graph are characterized by the fact that they contain a large amount of low-cost trees with high outdegrees while low-density regions…
Text clustering method replaces centroids with summaries for interpretability and scalability.
problem Efficiently clustering text data while maintaining interpretability and scalability.
method k-NLPmeans and k-LLMmeans, which periodically replace numeric centroids with textual summaries.
result Consistently outperforms classical baselines and recent LLM-based clustering methods.
Market price simulator based on analog electrical circuitcond-mat.stat-mech
We constructed an analog electrical circuit which generates fluctuations in which probability density function has power law tails. In the circuit fluctuations with an arbitrary exponent of the power law can be obtained by adjusting the resistance. With this low cost circuit the random fluctuations which have the simil…
ROBEL is an open-source platform of cost-effective robots designed for reinforcement learning in the real world. ROBEL introduces two robots, each aimed to accelerate reinforcement learning research in different task domains: D'Claw is a three-fingered hand robot that facilitates learning dexterous manipulation tasks, …
The success of deep learning models is heavily tied to the use of massive amount of labeled data and excessively long training time. With the emergence of intelligent edge applications that use these models, the critical challenge is to obtain the same inference capability on a resource-constrained device while providi…
Bayesian coresets improved with random sampling and quasi-Newton optimization.
problem Efficiently approximate Bayesian posterior distributions for computationally expensive inference.
method Randomly select a subset of data points, then optimize weights using quasi-Newton method.
result First algorithm with high-probability KL divergence bound on coreset quality.