Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

59119178237 · Jun 202019922001200920172026
48 results for Official Statistics

Machine learning improves official statistics but needs rigorous validation.

problem Lack of methodological robustness in machine learning for official statistics.
method Total Machine Learning Error (TMLE) framework to validate ML models.
result TMLE addresses representativeness and measurement errors in ML models.

This paper examines risks and uncertainties of changing data sources in machine learning for official statistics.

problem Risks and uncertainties associated with changing data sources in machine learning for official statistics.
method An overview of risks, causes, and repercussions of changing data sources, with a checklist of measures.
result Maintaining integrity, reliability, consistency, and relevance in official statistics.

In the first half of 2018, the Federal Statistical Office of Germany (Destatis) carried out a "Proof of Concept Machine Learning" as part of its Digital Agenda. A major component of this was surveys on the use of machine learning methods in official statistics, which were conducted at selected national and internationa…

2018-12-13abs ↗pdf ↗

The study maps ML quality dimensions to fairness, enhancing the QF4SA framework.

problem Ensuring fairness in ML applications at NSOs to avoid social impacts.
method Employing the QF4SA framework, the study maps quality dimensions to fairness and investigates their interactions.
result Fairness is identified as a new quality dimension in the QF4SA framework.

The article proposes modified Gower's coefficients for handling mixed type variables in nearest neighbor methods.

problem Handling mixed type variables in nearest neighbor methods, especially imputation and statistical matching.
method Suggests modifications to the Gower's distance for interval and ratio scaled variables to address unbalanced contributions and outlier sensitivity.
result Improved distance calculations reduce the unbalanced contribution of different variable types and attenuate outlier effects.

Conventional surveillance systems for monitoring infectious diseases, such as influenza, face challenges due to shortage of skilled healthcare professionals, remoteness of communities and absence of communication infrastructures. Internet-based approaches for surveillance are appealing logistically as well as economica…

2018-11-27abs ↗pdf ↗

Framework generates precise synthetic populations for scalable modeling.

problem Generating accurate synthetic populations without personal data.
method Constraint-programming framework encoding aggregated statistics and structural relations.
result Exact control of demographic profiles without requiring microdata.

PyODDS is an end-to end Python system for outlier detection with database support. PyODDS provides outlier detection algorithms which meet the demands for users in different fields, w/wo data science or machine learning background. PyODDS gives the ability to execute machine learning algorithms in-database without movi…

2019-10-07abs ↗pdf ↗

This is the less official, English version of the proof of the fact that every closed atoroidal 3-manifold carries finitely many isotopy classes of tight contact structures.

2003-05-14abs ↗pdf ↗

We detail our ongoing work in Flint, Michigan to detect pipes made of lead and other hazardous metals. After elevated levels of lead were detected in residents' drinking water, followed by an increase in blood lead levels in area children, the state and federal governments directed over $125 million to replace water se…

2018-06-10abs ↗pdf ↗

We present a database of parliamentary debates that contains the complete record of parliamentary speeches from Dáil Éireann, the lower house and principal chamber of the Irish parliament, from 1919 to 2013. In addition, the database contains background information on all TDs (Teachta Dála, members of parliament), such…

2017-08-15abs ↗pdf ↗

A framework assesses the quality of crowdsourced weather data.

problem Quality control and assessment of crowdsourced weather data from third-party stations.
method Proposes a simple, scalable, and interpretable AI/Stats/ML framework to assess TPAWS data.
result Demonstrates the performance of the framework using synthetic and real data.

In this paper we present an analysis of power law statistics on land markets. There have been no other studies that have analyzed power law statistics on land markets up to now. We analyzed a database of the assessed value of land, which is officially monitored and made available to the public by the Ministry of Land, …

2003-02-24abs ↗pdf ↗

Study evaluates Tree-Ring Watermarking in rectified flow-based models, revealing detection and separability limitations.

problem Detecting and separating Tree-Ring Watermarks in rectified flow-based models.
method Extensive experimentation comparing SD 2.1 and FLUX.1-dev models with various text guidance configurations and augmentation attacks.
result Inversion limitations affect watermark recovery and statistical separation.

Record linkage involves merging records in large, noisy databases to remove duplicate entities. It has become an important area because of its widespread occurrence in bibliometrics, public health, official statistics production, political science, and beyond. Traditional linkage methods directly linking records to one…

2017-03-08abs ↗pdf ↗

This reviews the econophysics activities in Belgium from my admittedly biased point of view. Unknown historical notes or facts are presented for the first time explaining the aims, whence evolution of the research papers and friendly connections with colleagues. Comments on endeavors are also provided. The lack of offi…

2012-11-26abs ↗pdf ↗

Forest tree species mapped with high accuracy using satellite data.

problem Classifying dominant tree species in Swedish forests.
method Extreme gradient boosting model with Bayesian optimization, combining Sentinel-1/2 satellite data and field observations.
result Overall accuracy of 85%, F1 score of 0.82, Matthews correlation coefficient of 0.81.

Let G be a compact Lie-group, X a compact G-CW-complex. We define equivariant geometric K-homology groups K^G_*(X), using an obvious equivariant version of the (M,E,f)-picture of Baum-Douglas for K-homology. We define explicit natural transformations to and from equivariant K-homology defined via KK-theory (the "offici…

2009-02-03abs ↗pdf ↗

SVHN dataset's split affects generative models but not digit classification.

problem Distribution mismatch between SVHN training and test sets impacts generative models.
method Empirically showed distribution mismatch affects generative models; proposed mixing and re-splitting.
result Distribution mismatch in SVHN dataset significantly impacts probabilistic generative models.

New DP mechanism SWAG-PPM improves privacy in deep learning models.

problem Differential privacy struggles with real-world distributions, especially imbalanced data.
method SWAG-PPM uses a pseudo posterior distribution to downweight high-risk records.
result SWAG-PPM outperforms DP-SGD with similar privacy budget and modest utility degradation.

In recent years, the interest in Big Data sources has been steadily growing within the Official Statistic community. The Italian National Institute of Statistics (Istat) is currently carrying out several Big Data pilot studies. One of these studies, the ICT Big Data pilot, aims at exploiting massive amounts of textual …

2019-10-22abs ↗pdf ↗

We model bond's price curves corresponding to the sovereign uruguayan debt nominated in USD, as an alternative to the official bond prices publication released by the Central Bank of Uruguay (CBU). Four different gaussian models are fitted, based on historical data issued by the CBU, corresponding to some of the more f…

2015-08-01abs ↗pdf ↗

Proposes a machine learning predictor for survey data.

problem Limited integration of machine learning in traditional surveys.
method Predictor supported by machine learning algorithms, analyzing departures from model assumptions.
result Machine learning predictors are a good alternative, even under small departures from model assumptions.

We propose a model for the joint evolution of European inflation, the European Central Bank official interest rate and the short-term interest rate, in a stochastic, continuous time setting. We derive the valuation equation for a contingent claim depending potentially on all three factors. This valuation equation reduc…

2019-11-01abs ↗pdf ↗

Survey data imputation methods impact feature selection and importance assessment.

problem Impact of different imputation methods on feature selection and importance assessment in survey data.
method Investigated eight imputation methods (listwise deletion, MICE, missRanger, mixGBoost) and three learners (Random Forest, XGBoost, linear model) in a simulation study.
result Different imputation methods yield varying feature selection and importance assessments.

This research deals with the mathematical modeling of the physical capital diffusion through the borders of the countries. The physical capital is considered an important variable for the economic growth of a country. Here we use an extension of the economic Solow model to describe how the smuggling affects the economi…

2015-04-16abs ↗pdf ↗

A quantum framework optimizes collateral allocation for derivatives.

problem Legal constraints and operational rules in collateral allocation for derivatives.
method Certified higher-order quantum framework that normalizes margin requirements and builds a bounded neighborhood of actions.
result Quantum framework improves certified sample quality compared to classical methods.