Machine learning improves official statistics but needs rigorous validation.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
This paper examines risks and uncertainties of changing data sources in machine learning for official statistics.
In the first half of 2018, the Federal Statistical Office of Germany (Destatis) carried out a "Proof of Concept Machine Learning" as part of its Digital Agenda. A major component of this was surveys on the use of machine learning methods in official statistics, which were conducted at selected national and internationa…
The study maps ML quality dimensions to fairness, enhancing the QF4SA framework.
The article proposes modified Gower's coefficients for handling mixed type variables in nearest neighbor methods.
Conventional surveillance systems for monitoring infectious diseases, such as influenza, face challenges due to shortage of skilled healthcare professionals, remoteness of communities and absence of communication infrastructures. Internet-based approaches for surveillance are appealing logistically as well as economica…
Framework generates precise synthetic populations for scalable modeling.
PyODDS is an end-to end Python system for outlier detection with database support. PyODDS provides outlier detection algorithms which meet the demands for users in different fields, w/wo data science or machine learning background. PyODDS gives the ability to execute machine learning algorithms in-database without movi…
This is the less official, English version of the proof of the fact that every closed atoroidal 3-manifold carries finitely many isotopy classes of tight contact structures.
We present SemEval-2019 Task 8 on Fact Checking in Community Question Answering Forums, which features two subtasks. Subtask A is about deciding whether a question asks for factual information vs. an opinion/advice vs. just socializing. Subtask B asks to predict whether an answer to a factual question is true, false or…
We detail our ongoing work in Flint, Michigan to detect pipes made of lead and other hazardous metals. After elevated levels of lead were detected in residents' drinking water, followed by an increase in blood lead levels in area children, the state and federal governments directed over $125 million to replace water se…
Among other macroeconomic indicators, the monthly release of U.S. unemployment rate figures in the Employment Situation report by the U.S. Bureau of Labour Statistics gets a lot of media attention and strongly affects the stock markets. I investigate whether a profitable investment strategy can be constructed by predic…
We present a database of parliamentary debates that contains the complete record of parliamentary speeches from Dáil Éireann, the lower house and principal chamber of the Irish parliament, from 1919 to 2013. In addition, the database contains background information on all TDs (Teachta Dála, members of parliament), such…
A framework assesses the quality of crowdsourced weather data.
In this paper we present an analysis of power law statistics on land markets. There have been no other studies that have analyzed power law statistics on land markets up to now. We analyzed a database of the assessed value of land, which is officially monitored and made available to the public by the Ministry of Land, …
Study evaluates Tree-Ring Watermarking in rectified flow-based models, revealing detection and separability limitations.
Accurate real-time tracking of influenza outbreaks helps public health officials make timely and meaningful decisions that could save lives. We propose an influenza tracking model, ARGO (AutoRegression with GOogle search data), that uses publicly available online search data. In addition to having a rigorous statistica…
Record linkage involves merging records in large, noisy databases to remove duplicate entities. It has become an important area because of its widespread occurrence in bibliometrics, public health, official statistics production, political science, and beyond. Traditional linkage methods directly linking records to one…
This reviews the econophysics activities in Belgium from my admittedly biased point of view. Unknown historical notes or facts are presented for the first time explaining the aims, whence evolution of the research papers and friendly connections with colleagues. Comments on endeavors are also provided. The lack of offi…
Forest tree species mapped with high accuracy using satellite data.
Accurate real-time monitoring systems of influenza outbreaks help public health officials make informed decisions that may help save lives. We show that information extracted from cloud-based electronic health records databases, in combination with machine learning techniques and historical epidemiological information,…
Let G be a compact Lie-group, X a compact G-CW-complex. We define equivariant geometric K-homology groups K^G_*(X), using an obvious equivariant version of the (M,E,f)-picture of Baum-Douglas for K-homology. We define explicit natural transformations to and from equivariant K-homology defined via KK-theory (the "offici…
SVHN dataset's split affects generative models but not digit classification.
In retrospective assessments, internet news reports have been shown to capture early reports of unknown infectious disease transmission prior to official laboratory confirmation. In general, media interest and reporting peaks and wanes during the course of an outbreak. In this study, we quantify the extent to which med…
New DP mechanism SWAG-PPM improves privacy in deep learning models.
Model predicts real-time job applicant numbers for regional economic analysis.
This article reviews entity resolution methods and their applications.
Paper develops multilingual job classification for ISCO and KZiS.
In recent years, the interest in Big Data sources has been steadily growing within the Official Statistic community. The Italian National Institute of Statistics (Istat) is currently carrying out several Big Data pilot studies. One of these studies, the ICT Big Data pilot, aims at exploiting massive amounts of textual …
The article describes our submission to SemEval 2019 Task 8 on Fact-Checking in Community Forums. The systems under discussion participated in Subtask A: decide whether a question asks for factual information, opinion/advice or is just socializing. Our primary submission was ranked as the second one among all participa…
Machine learning improves risk assessment for gender-based violence victims.
Intensive development of urban systems creates a number of challenges for urban planners and policy makers in order to maintain sustainable growth. Running efficient urban policies requires meaningful urban metrics, which could quantify important urban characteristics including various aspects of an actual human behavi…
Study on excess mortality in Germany during 2020-21.
We model bond's price curves corresponding to the sovereign uruguayan debt nominated in USD, as an alternative to the official bond prices publication released by the Central Bank of Uruguay (CBU). Four different gaussian models are fitted, based on historical data issued by the CBU, corresponding to some of the more f…
Proposes a machine learning predictor for survey data.
We propose a model for the joint evolution of European inflation, the European Central Bank official interest rate and the short-term interest rate, in a stochastic, continuous time setting. We derive the valuation equation for a contingent claim depending potentially on all three factors. This valuation equation reduc…
Survey data imputation methods impact feature selection and importance assessment.
Study shows death ratio of COVID-19 deaths increases financial volatility.
This paper models yearly exchange rates between USD/KZT, EUR/KZT and SGD/KZT, and compares the actual data with developed forecasts using time series analysis over the period from 2006 to 2014. The official yearly data of National Bank of the Republic of Kazakhstan is used for present study. The main goal of this paper…
The aim of this work is to propose a meta-algorithm for automatic classification in the presence of discrete binary classes. Classifier learning in the presence of overlapping class distributions is a challenging problem in machine learning. Overlapping classes are described by the presence of ambiguous areas in the fe…
This research deals with the mathematical modeling of the physical capital diffusion through the borders of the countries. The physical capital is considered an important variable for the economic growth of a country. Here we use an extension of the economic Solow model to describe how the smuggling affects the economi…
A quantum framework optimizes collateral allocation for derivatives.
BusTr predicts bus travel times from real-time traffic forecasts.
Seasonal influenza infects between 10 and 50 million people in the United States every year, overburdening hospitals during weeks of peak incidence. Named by the CDC as an important tool to fight the damaging effects of these epidemics, accurate forecasts of influenza and influenza-like illness (ILI) forewarn public he…
Italy's daily COVID-19 cases stratified by age groups.
BARMPy offers a Python package for Bayesian Additive Regression Models.
This paper explores a real-world fundamental theme under a data science perspective. It specifically discusses whether fraud or manipulation can be observed in and from municipality income tax size distributions, through their aggregation from citizen fiscal reports. The study case pertains to official data obtained fr…
Corrected CBOW performs similarly to Skip-gram.