The paper proposes a rubric and incentives to prevent peer review from becoming a 'tragedy of the commons'.
problem The growth of machine learning threatens the sustainability of peer review.
method Proposes a rubric for objective review quality and financial compensation for reviewers.
result Avoiding a 'tragedy of the commons' outcome in peer review.
Machine learning analyzed peer reviews to find differences in quality by journal impact factor.
problem Determining if higher journal impact factors correlate with more thorough or helpful peer reviews.
method Hand-coded and machine-learned analysis of 10,000 peer review sentences from 1,644 journals.
result Peer reviews in higher impact factor journals are more thorough in discussing methods but less helpful in suggesting solutions and providing examples.
The principle of peer review is central to the evaluation of research, by ensuring that only high-quality items are funded or published. But peer review has also received criticism, as the selection of reviewers may introduce biases in the system. In 2014, the organizers of the ``Neural Information Processing Systems\r…
Online reviews provided by consumers are a valuable asset for e-Commerce platforms, influencing potential consumers in making purchasing decisions. However, these reviews are of varying quality, with the useful ones buried deep within a heap of non-informative reviews. In this work, we attempt to automatically identify…
Unified model combines scores and rankings for grant panel review.
problem Combining scores and rankings for quality assessment in panel review.
method Mallows-Binomial model with tree-search algorithm for exact MLE.
result Model combines scores and rankings to quantify object quality and measure consensus.
Study reveals bias in machine learning conference reviews.
problem Bias in machine learning conference review process.
method Comprehensive analysis of ICLR papers from 2017-2020.
result Strong institutional bias in accept/reject decisions.
We consider the problem of automated assignment of papers to reviewers in conference peer review, with a focus on fairness and statistical accuracy. Our fairness objective is to maximize the review quality of the most disadvantaged paper, in contrast to the commonly used objective of maximizing the total quality over a…
RevGAN generates personalized reviews with given sentiment and style.
problem Creating reviews that are both personalized and of high quality.
method RevGAN combines self-attentive recursive autoencoders, conditional discriminators, and personalized decoders.
result RevGAN outperforms state-of-the-art models in sentence quality, coherence, and personalization.
Neural Information Processing Systems (NIPS) is a top-tier annual conference in machine learning. The 2016 edition of the conference comprised more than 2,400 paper submissions, 3,000 reviewers, and 8,000 attendees. This represents a growth of nearly 40% in terms of submissions, 96% in terms of reviewers, and over 100%…
Paper uses pre-trained models and active learning to analyze customer reviews quickly.
problem Automatic review analysis with limited labeled data and time.
method Pre-trained language representation and active learning framework.
result Fully automatic review analysis achieved at a faster pace.
Experiment shows author rankings can improve peer review scores.
problem Improving accuracy in machine learning conference peer review.
method Used Isotonic Mechanism to calibrate review scores using author rankings.
result Calibrated scores outperform raw scores in estimating ground truth review scores.
Paper detects review abuse using tensor decomposition.
problem Detecting review abuse by sellers and reviewers.
method Semi-supervised binary multi-target tensor decomposition.
result The model achieves higher precision and recall.
Survey of data augmentation methods for improving deep learning on time series data.
problem Limited labeled data in real-world time series applications.
method Review and comparison of data augmentation methods for time series.
result Empirical comparison of data augmentation methods for various time series tasks.
This review explores causal decision-making to improve decision quality.
problem Effective decision-making requires understanding causal relationships.
method Causal structure learning, causal effect learning, and causal policy learning.
result Challenges in causal decision-making are identified and recent advances are discussed.
Paper reviews and synthesizes methods for evaluating dimensionality reduction techniques.
problem Evaluating and comparing dimensionality reduction techniques.
method Framework and toolkit in R for exploring and evaluating dimensionality reduction quality through visual insights.
result Helps researchers compare and select dimensionality reduction techniques using visual insights.
Machine learning models for COVID-19 detection and prognosis from chest images are flawed and unreliable.
problem Developing reliable machine learning models for COVID-19 diagnosis and prognosis from chest images.
method Systematic review of machine learning models published in 2020.
result None of the models identified are of clinical use due to methodological flaws and biases.
Algorithm improves SLR efficiency in financial narratives.
problem Fragmented understanding of financial narratives.
method NLP, clustering, interpretability tools.
result Unified narrative modeling approaches needed.
This study reviews and evaluates clustering methods for single-cell RNA-seq data.
problem Identifying and characterizing novel cell types from single-cell RNA-seq data.
method Review and performance comparison of clustering methods.
result Performance comparison experiments on two datasets.
Algorithm reduces audit costs by identifying best service configurations from biased textual evidence.
problem Designing service systems from textual evidence requires accurate selection despite biased automated scoring.
method Developed PP-LUCB algorithm combining LLM scores and selective audits to minimize costs.
result Correctly identified the best model in 40/40 trials with 90% cost reduction.
Survey on ML for wireless network optimization across PHY, MAC, and network layers.
problem Improving wireless network performance using machine learning.
method Comprehensive review of ML-based techniques for wireless network optimization.
result Machine learning can significantly enhance wireless network QoS and QoE across all layers.
The paper proposes a new recommender system combining ratings and textual reviews.
problem Lack of using textual reviews in recommender systems.
method Combines Latent Factor Model with Latent Dirichlet Allocation for textual reviews.
result Combining textual reviews with ratings improves recommendation quality.
Scoping review finds EEG key in MCI research, identifying ERP/EEG, QEEG, and machine learning.
problem Identifying MCI early and accurately.
method Scoping review with co-occurrence analysis and PAGER framework.
result Main research themes identified: ERP/EEG, QEEG, and EEG-based machine learning.
This review covers learning under concept drift, including detection, understanding, and adaptation.
problem Unforeseeable changes in data distribution over time impact machine learning performance.
method Reviews and analyzes methodologies and techniques for concept drift detection, understanding, and adaptation.
result Establishes a framework for learning under concept drift with three main components.
Annotation guidelines used to guide the annotation of training and evaluation datasets can have a considerable impact on the quality of machine learning models. In this study, we explore the effects of annotation guidelines on the quality of app feature extraction models. As a main result, we propose several changes to…
Paper introduces Isotonic Mechanism for better item scoring.
problem Noisy reviewer scores; owner prefers not to disclose true scores.
method Uses owner's ranking of items and raw scores to adjust and improve accuracy.
result Adjusted scores are significantly more accurate than raw scores.
The vast quantity of information brought by big data as well as the evolving computer hardware encourages success stories in the machine learning community. In the meanwhile, it poses challenges for the Gaussian process (GP) regression, a well-known non-parametric and interpretable Bayesian model, which suffers from cu…
Review of uncertainty representation methods in risk management.
problem Inadequate consideration of uncertainty in risk management.
method Systematic literature review of 370 publications.
result Probabilistic methods are predominant, but fuzzy and evidence-based approaches are also useful.
Study evaluates human vs. machine review generation, finds human assessments correlate better with lexical overlaps.
problem Evaluating natural language generation models for online reviews is challenging and inconsistent.
method Compared human evaluators with various automated evaluation methods, including discriminative and word overlap metrics.
result Human evaluators do not correlate well with discriminative evaluators, but correlate better with lexical overlaps.
This review analyzes RL in finance, highlighting its advantages and challenges.
problem Complex financial decision-making problems where traditional methods fail.
method Systematic review of 167 articles from 2017-2025, focusing on market making, portfolio optimization, and algorithmic trading.
result RL offers advantages over traditional methods, particularly in market making, but challenges remain.
We present a method for a wine recommendation system that employs multidimensional clustering and unsupervised learning methods. Our algorithm first performs clustering on a large corpus of wine reviews. It then uses the resulting wine clusters as an approximation of the most common flavor palates, recommending a user …
Hybrid Deep Embedding for aspect-level explanations in recommendations.
problem Challenges in personalization, dynamic explanations, and aspect-level granularity in recommendation systems.
method Proposes Hybrid Deep Embedding (HDE) to learn dynamic embeddings for user and item preferences, and aspect-level quality vectors.
result Demonstrates improved recommending performance and dynamic aspect-level explanations.
Mitigates bias in evaluations by considering known outcome information.
problem Bias in evaluations due to external factors like grades or acceptance.
method Formulates bias as a partial ordering, solves regularized optimization problem.
result The debiasing method improves evaluation accuracy by adapting regularization.
Generative model creates high-quality meshes from point clouds.
problem Creating accurate meshes from point cloud data.
method Modeling point cloud generation as sphere deformation through deep neural networks.
result The model efficiently generates high-quality meshes from point clouds.
This article evaluates explanations without ground truth in IML.
problem Lack of ground truth for evaluating explanations in IML.
method Rigorously defined problem, reviewed existing efforts, summarized three aspects of explanation, designed a unified evaluation framework.
result Unified evaluation framework for different scenarios in practice.
Paper reviews ranking systems in multi-layered architectures.
problem Ranking systems for effective machine learning models and real-time user responses.
method Examines data processing, representation learning, candidate selection, and online inference layers.
result Ranking systems are complex systems of multiple architectures.
This review examines various LOB simulation models in algorithmic trading.
problem Calibrating and fine-tuning automated trading strategies in financial markets.
method Classification and analysis of LOB simulation models based on methodology.
result Price impact is a crucial phenomenon to model in algorithmic trading.
LR-Robot automates SLRs with AI, expert oversight, and multidimensional analysis.
problem Efficient but contextually limited outputs from existing SLR frameworks.
method Human-in-the-loop process, structured knowledge sources, retrieval-augmented generation.
result Empirical demonstration of AI-driven literature synthesis in option pricing.
This paper explores data science applications in economics using a taxonomy of models and hybrid models showing higher accuracy.
problem Investigating data science applications in economics.
method Systematic literature review using Prisma method.
result Hybrid models showed higher prediction accuracy than other algorithms.
LR-Robot accelerates SLRs by combining expert oversight and AI, revealing trends and patterns in financial research.
problem Manual SLRs are impractical due to the scale and complexity of modern financial research.
method Domain experts define taxonomies and constraints, LLMs execute classification, and human evaluation ensures reliability.
result AI can understand and synthesize literature, revealing trends and core research directions.
This paper reviews weighted clustering ensemble methods.
problem Improving clustering results from individual methods.
method Different types of weights and approaches to determining weight values.
result Unified framework for selecting appropriate weighting mechanisms.
Improved computed tomography reconstruction with deep learning and deep image prior.
problem Low data efficiency in computed tomography reconstruction.
method Combining learned primal-dual methods with deep image prior for improved quality and generalization.
result Proposed methods outperform state-of-the-art in low data regime.
The study evaluates 15 scalarizing functions in Bayesian multiobjective optimization.
problem Using scalarizing functions in computationally expensive multi- and many-objective optimization.
method 15 scalarizing functions were studied and compared using Gaussian process models and expected improvement as infill criterion.
result Different scalarizing functions have varying performance on benchmark problems with different numbers of objectives.
STYLE-ANALYZER fixes code style inconsistencies without manual intervention.
problem Manual code reviews are time-consuming and error-prone.
method Unsupervised machine learning with decision tree forest model.
result STYLE-ANALYZER accurately fixes code formatting violations with interpretable rules.
A novel method automates quality control of fMRI scans, improving accuracy and generalizability.
problem Lack of automated QC for fMRI scans limits clinical neuroscience research.
method Train machine learning classifiers using runtime log features to predict scan quality.
result Classifiers trained on FLAG-QC features outperform previous methods (AUC=0.79 vs AUC=0.56).
Confident learning estimates label quality by identifying and correcting noisy data.
problem Label quality in datasets, especially in noisy environments.
method Combines principles of pruning, probabilistic thresholds, and ranking to estimate noise and uncorrupted labels.
result Generalized CL framework that provably finds label errors and improves model accuracy.
This paper reviews and introduces measures for data representativity in AI systems.
problem Ensuring appropriate inference from data in AI systems.
method Defined and evaluated three measurable concepts of representativity.
result Contrasts between coverage and distribution representativity are crucial for AI system building.
Predicts EHR features that improve prediction, learning coherent topics.
problem Balancing prediction quality and coherence in EHR topic models.
method Prediction-focused topic model that uses supervisory signal to retain relevant features.
result Prediction-focused topic models learn more coherent topics while maintaining competitive predictions.
In this dissertation, the main goal is visualisation of financial time series. We expect that visualisation of financial time series will be a useful auxiliary for technical analysis. Firstly, we review the technical analysis methods and test our trading rules, which are built by the essential concepts of technical ana…