The ICML 2013 Workshop on Challenges in Representation Learning focused on three challenges: the black box learning challenge, the facial expression recognition challenge, and the multimodal learning challenge. We describe the datasets created for these challenges and summarize the results of the competitions. We provi…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,181 papers · 148 categories
Trend · papers per month
48 results for “challenge results”
Challenge aims to recognize music genres from audio.
problem Recognizing music genres from audio recordings.
method Open data challenge with submissions evaluated.
result Results presented from the challenge.
Paper discusses ASD challenge for machine condition monitoring.
problem Detecting unknown anomalous sounds without labeled data.
method Design and evaluation of a large-scale ASD dataset, novel approaches.
result Several novel approaches developed, evaluation results analyzed.
AutoML challenge solved lifelong learning problems without i.i.d. data.
problem Designing lifelong learning systems without independent and identically distributed data.
method Developed and evaluated machine learning programs using CodaLab platform.
result More than 300 participants competed and solved complex lifelong learning problems.
VoxCeleb 2019 challenge assesses speaker recognition in uncontrolled settings.
problem Evaluate speaker recognition technology in unconstrained data.
method Public dataset, challenge, and workshop at Interspeech 2019.
result Baseline results and discussions provided.
Improved contact tracing models outperform NIST challenge results.
problem Contact tracing using phone data and machine learning.
method Developed two machine learning models (GBM and MLP) from phone instrumental data features.
result Outperformed the leading NIST challenge result by HKUST.
ICLR 2021 challenge in computational geometry and topology attracted 16 teams.
problem Designing and evaluating computational methods in differential geometry and topology.
method Designing and hosting an open-source competition with repositories Geomstats and Giotto-TDA.
result 16 teams participated in the challenge, showcasing innovative contributions to computational geometry and topology.
XPDNet wins MRI reconstruction challenge with neural network.
problem MRI reconstruction from under-sampled data.
method Inspired by MRI and computer vision best practices, XPDNet uses a neural network.
result XPDNet achieved state-of-the-art results in the 2020 fastMRI challenge.
NIST's CTS Challenge evaluates speaker recognition using telephony data.
problem Improving speaker recognition accuracy using telephony data.
method Large-scale neural network architectures, extensive data augmentation, proprietary data, and fine-tuning.
result Remarkable improvements in speaker recognition performance.
In this thesis I explore challenging discrete energy minimization problems that arise mainly in the context of computer vision tasks. This work motivates the use of such "hard-to-optimize" non-submodular functionals, and proposes methods and algorithms to cope with the NP-hardness of their optimization. Consequently, t…
Current state-of-the-art discrete optimization methods struggle behind when it comes to challenging contrast-enhancing discrete energies (i.e., favoring different labels for neighboring variables). This work suggests a multiscale approach for these challenging problems. Deriving an algebraic representation allows us to…
MedAusbild team won ISIC challenge by classifying seven skin diseases.
problem Skin disease classification using medical images.
method Employed deep learning, specifically convolutional neural networks (CNNs), for seven skin disease classification.
result MedAusbild team won ISIC challenge 2018.
audEERING improves emotion recognition in 1 minute.
problem Improving emotion recognition in short timeframes.
method Submissions and evaluations for the OMG emotion recognition challenge.
result Achieved high CCC scores for arousal and valence.
The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methodseess.AS
Challenge evaluates voice conversion systems using parallel and non-parallel data.
problem Evaluate and compare different voice conversion systems.
method Hub and Spoke tasks with crowdsourced evaluation.
result Naturalness and similarity ratings provided for submitted systems.
D2KLab's approach predicts tweet engagement using two stages.
problem Predicting user engagement with tweets.
method Two-stage approach: feature learning and ensemble XGBoost.
result Ranked 22 in the 2020 RecSys Challenge leaderboard.
Bayesian optimization outperformed random search in machine learning hyperparameter tuning challenge.
problem Optimizing hyperparameters of machine learning models using derivative-free methods.
method Bayesian optimization vs. random search on real datasets.
result Bayesian optimization significantly outperformed random search in held-out objective functions.
Algorithms for solving optimization problems arising from deep neural net models: smooth problemsmath.OC
Paper tackles optimization challenges in deep neural nets, presenting Newton-based methods.
problem Optimization challenges in solving deep neural net models for classification problems.
method Newton-based method incorporating negative curvature directions.
result Promising numerical results on security anomaly detection data.
NetML provides datasets and challenges for network traffic analysis.
problem Lack of representative datasets and reproducibility issues in network traffic analysis.
method Released three open datasets with flow features and raw packets, implemented machine learning methods.
result NetML datasets will serve as a common platform for AI-driven research.
Background: In this paper we present the approaches and methods employed in order to deal with a large scale multi-label semantic indexing task of biomedical papers. This work was mainly implemented within the context of the BioASQ challenge of 2014. Methods: The main contribution of this work is a multi-label ensemble…
This thesis tackles Gaussian Process challenges in low dimensions.
problem Constructing models for large datasets and selecting optimal models.
method Samplet-based approach to efficiently construct and train Gaussian Processes.
result Reduces cubic computational complexity to log-linear scale.
CVPR 2020 challenge evaluates continual learning in computer vision.
problem Making AI systems more adaptive and efficient.
method Evaluated different continual learning approaches on a common hardware with shared metrics.
result Reported main results, finalists, and prize winners.
Challenge evaluates semantic code search using annotated corpus.
problem Evaluating relevant code from natural language queries.
method Release of CodeSearchNet Corpus and expert annotations.
result 99 queries with 4k relevance annotations for evaluation.
Deep learning and entropy methods detect skin cancer outliers.
problem Detecting an outlier class in a skin cancer dataset.
method Ensemble of 13 CNNs, two outlier handling approaches, and meta-data integration.
result Successfully addressed the outlier class and improved diagnostic accuracy.
Fashion-Gen dataset offers high-res fashion images and descriptions for research.
problem Lack of high-quality, detailed fashion image datasets for research.
method Created a large dataset of fashion images and descriptions, provided baseline results, and launched a challenge.
result Baseline results on image generation and conditioning on text descriptions.
Algorithms for solving optimization problems arising from deep neural net models: nonsmooth problemsmath.OC
Paper tackles optimization challenges in deep neural nets with nonconvex and non-smooth objectives.
problem Optimization of deep neural net models with nonconvex and non-smooth objectives.
method Summarizes challenges, state of the art, and presents numerical results on a specific class of problems.
result Numerical results on non-convex and non-smooth optimization problems.
Challenge forecasts EV charging station usage accurately.
problem Better understanding of EV charging behaviors needed.
method Hierarchical forecasting of EV charging station occupancy.
result Hierarchical forecasting improves EV charging station occupancy predictions.
The Dynamic Pricing Challenge revealed varying algorithm performance across different market dynamics.
problem Complexity of pricing and learning in competitive markets.
method Participants submitted pricing and demand learning algorithms for numerical performance analysis in simulated environments.
result Algorithm performance varies significantly across different market dynamics.
Replication confirms CGD's effectiveness in competitive games.
problem Reproducibility of a novel Nash equilibrium algorithm.
method Replicated experiments and provided Python implementation.
result CGD avoids oscillatory and divergent behaviours.
New ML approach for edge devices tackles deployment challenges.
problem Challenges in deploying ML models on edge devices.
method Specialized ML development and deployment approach for edge devices.
result Prototype demonstrates efficient and high-quality solutions.
Model predicts next destination for users based on past trips and features.
problem Predicting the next destination in multi-destination trips.
method Used Cleora for city graph embedding and EMDE for prediction.
result Achieved 2nd place in Booking Data Challenge.
AI agents beat previous best on NetHack, but symbolic bots still outperform.
problem Developing AI agents that can ascend in the NetHack game.
method Used a procedurally generated NetHack Learning Environment for reinforcement learning.
result Symbolic bots outperform neural approaches on NetHack.
RL faces nine challenges to apply to real-world problems.
problem Applying RL to real-world problems is difficult due to assumptions rarely met.
method Identified nine challenges, provided definitions, literature approaches, and evaluation metrics.
result Addressing all nine challenges would make RL applicable to many real-world problems.
Deep RL agent secures 2nd place in CityLearn Challenge for district demand management.
problem Optimizing electrical demand of diverse buildings in a district.
method Centralised 'Soft Actor Critic' deep reinforcement learning agent.
result Achieved an averaged score of 0.967 on challenge dataset.
ADReSS Challenge at INTERSPEECH 2020 benchmarks speech recognition for Alzheimer's dementia.
problem Automated recognition of Alzheimer's dementia from spontaneous speech.
method Provides a benchmark speech dataset, defines two tasks (classification and regression), and presents baseline models.
result Demonstrates the feasibility of automated speech recognition for Alzheimer's dementia.
First ABAW 2020 Competition analyzes affective behavior tasks.
problem Automatic analysis of valence-arousal, basic expressions, and action units in real-world scenarios.
method Provided Aff-Wild2 database, described Challenges, evaluation metrics, and top-performing systems.
result Demonstrated the feasibility of automatic affective behavior analysis in real-world settings.
Study blockchain's impact on primary financial market challenges.
problem Challenges of blockchain in securities issuance and trading.
method Hybrid method combining interviews and surveys.
result Complex due diligence, mismatch, and difficult monitoring are significant challenges.
This review reports some key results in theoretical investigations on configurations of lipid membranes and presents several challenges in this field which involve (i) exact solutions to the shape equation of lipid vesicles; (ii) exact solutions to the governing equations of open lipid membranes; (iii) neck condition o…
Multi-label Classification for Automatic Tag Prediction in the Context of Programming Challengescs.LG
This paper automates tagging programming challenge descriptions.
problem Tagging programming challenge descriptions is tedious for creators.
method Used machine and deep learning methods for automation.
result Deep learning methods outperform traditional IR approaches.
Survey of deep learning methods for inverse problems, highlighting theoretical challenges.
problem Addressing theoretical gaps in deep learning for inverse problems.
method Survey of existing theoretical developments and open problems.
result Highlighting ongoing challenges in deep learning for inverse problems.
Study evaluates progress in common-sense reasoning tasks.
problem Assessing genuine progress in common-sense reasoning systems.
method Case studies of WSC and SWAG, protocol design to clarify results.
result Previous experimental designs had flaws, need for new protocols.
Investment challenge study finds luck and strategy equally important.
problem The role of luck and strategic considerations in M6 investment challenge performance.
method Introduced a stylized model to derive and analyze a portfolio strategy.
result Improving chances of winning without attaining abnormal returns possible.
Paper tackles handwritten annotation recognition in historic documents using FCNN.
problem Recognizing handwritten annotations in challenging historic German documents.
method End-to-end semantic segmentation using Fully Convolutional Neural Networks (FCNN).
result Best model achieves 95.6% IoU score on test documents.
Deep learning models are growing, posing new mathematical challenges.
problem Mathematical challenges in training, inference, generalization, and optimization of deep models.
method Formal mathematical analysis and communication with mathematicians, statisticians, and computer scientists.
result A set of new mathematical challenges in deep learning.
The paper presents algorithms for diagnosing Pathological Myopia and detecting retinal structures.
problem Diagnosing Pathological Myopia and detecting retinal structures in fundus images.
method The approach uses Deep Learning techniques, including transfer learning with Xception and YOLO architecture.
result The method has shown satisfactory results in the Pathologic Myopia Challenge.
RoyalFlush system improves multi-speaker ASR in M2MeT challenge.
problem Improving multi-speaker automatic speech recognition in noisy environments.
method Front-end processing with WPE and beamforming, data augmentation, and fusion of two ASR models.
result 12.22% absolute CER reduction on validation set and 12.11% on test set compared to baseline.
Survey examines challenges of ML in avionic systems certification.
problem Challenges in current certification standards for ML in avionic systems.
method Literature review focusing on robustness and explainability of ML results.
result Current certification standards do not support ML in avionic systems.
This paper presents the Speech Technology Center (STC) replay attack detection systems proposed for Automatic Speaker Verification Spoofing and Countermeasures Challenge 2017. In this study we focused on comparison of different spoofing detection approaches. These were GMM based methods, high level features extraction …
The paper discusses challenges and solutions in trading using AI.
problem Challenges in data-driven learning for electronic trading.
method Explains neural information processing and machine learning approaches.
result Outlines the challenges and solutions in trading AI.