FinRLlama wins FinRL Challenge 2024 by fine-tuning LLMs with market data.
problem Lack of contextual alignment for financial market applications in traditional LLMs.
method Fine-tuning LLaMA-3.2-3B-Instruct model with custom RLMF prompt design integrating historical data and reward feedback.
result RLMF-tuned FinRLlama framework outperforms baseline methods in signal consistency and trading outcomes.
FinRL-Meta creates diverse market environments for DRL in finance.
problem Inaccurate financial data and diverse market environments challenge DRL in finance.
method Open-source data processing tools, hundreds of market environments, and multiprocessing.
result FinRL-Meta improves DRL accuracy and speed in financial simulations.
PRUDEX-Compass evaluates FinRL methods on 6 axes for financial market investments.
problem Insufficient evaluation of FinRL methods in financial markets.
method Introduces PRUDEX-Compass with 6 axes and 17 measures for evaluation.
result Demonstrates the effectiveness of PRUDEX-Compass on 4 real-world datasets.
FinRL-Meta offers market environments and benchmarks for financial reinforcement learning.
problem Challenges in creating high-quality market environments and benchmarks for financial reinforcement learning.
method DataOps paradigm, automatic pipeline, community-wise competitions, Jupyter/Python demos.
result Openly accessible FinRL-Meta library for data-driven financial reinforcement learning.
FinRL-X unifies trading components for AI and rule-based strategies.
problem Inconsistent between research and live deployment in trading platforms.
method Modular architecture integrating data processing, strategy construction, backtesting, and execution.
result Unified protocol supports AI and rule-based trading components without altering execution.
FinRL simplifies deep RL for stock trading, making it accessible to beginners.
problem Lack of accessible tools for beginners in deep RL for stock trading.
method Developed a DRL library with reproducible tutorials and backtesting.
result FinRL streamlines development and comparison of trading strategies.
Safe-FinRL uses DRL for high-frequency stock trading, reducing bias and variance.
problem Challenges in applying DRL to high-frequency stock trading, especially bias and variance issues.
method Safe-FinRL separates financial time series into near-stationary short environments and uses Trace-SAC with a general retrace operator.
result Safe-FinRL reduces bias and variance significantly in near-stationary financial environments.
FinRL automates trading in quantitative finance with deep reinforcement learning.
problem Steep development curve for traders to automate trading decisions.
method Open-source framework implementing DRL algorithms and reward functions.
result FinRL simplifies strategy design and reduces debugging workloads.
FinRL-Podracer accelerates DRL trading strategies in finance with high performance and scalability.
problem Challenges in applying deep reinforcement learning to finance trading models.
method Proposes an RLOps framework and high-performance cloud solution for DRL trading.
result FinRL-Podracer outperforms existing DRL libraries by 12-35% in annual return, 0.1-0.6 in Sharpe ratio, and 3-7 times in training time.
Paper improves financial trading models using GPU parallelism.
problem Challenges in policy instability and sampling bottlenecks in reinforcement learning for financial tasks.
method Revisits ensemble methods with massively parallel simulations on GPUs.
result Significantly improved computational efficiency and robustness of financial decision-making strategies.
Paper introduces a trading agent using LLMs for risk assessment and trading recommendations.
problem Developing a trading agent that can handle financial risks effectively.
method Extending CPPO algorithm with LLM-generated risk assessment and trading signals from financial news.
result Backtesting shows improved performance of the trading agent compared to benchmarks.
Pre-trained LLM adapted with LoRA improves offline RL for quantitative trading.
problem Challenges in offline RL for quantitative trading due to complex temporal dependencies and overfitting.
method Integrates pre-trained GPT-2 weights and LoRA for efficient fine-tuning of a Decision Transformer.
result Outperforms existing offline RL methods in certain trading scenarios.
DRL improves ESG financial portfolio management by regulating returns based on ESG scores.
problem Improving ESG financial portfolio management through market regulation.
method Used Advantage Actor-Critic (A2C) agent and adapted OpenAI Gym environments for comparative analysis.
result DRL agent outperforms standard market conditions in ESG-regulated market.
Bayesian optimization improves DRL for ESG portfolio management.
problem Optimizing hyperparameters of DRL agents for ESG metrics.
method Bayesian optimization for noisy, expensive-to-evaluate functions.
result Multi-objective optimization yields optimal Pareto set of portfolios.
The ICML 2013 Workshop on Challenges in Representation Learning focused on three challenges: the black box learning challenge, the facial expression recognition challenge, and the multimodal learning challenge. We describe the datasets created for these challenges and summarize the results of the competitions. We provi…
NIST's CTS Challenge evaluates speaker recognition using telephony data.
problem Improving speaker recognition accuracy using telephony data.
method Large-scale neural network architectures, extensive data augmentation, proprietary data, and fine-tuning.
result Remarkable improvements in speaker recognition performance.
Deep learning models are growing, posing new mathematical challenges.
problem Mathematical challenges in training, inference, generalization, and optimization of deep models.
method Formal mathematical analysis and communication with mathematicians, statisticians, and computer scientists.
result A set of new mathematical challenges in deep learning.
Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL are often hard to leverage in real-world systems due to a series of assumptions that are rarely satisfied in practice. We pres…
Sparse DNNs face scalability issues; MIT/IEEE/Amazon challenge analyzes best solutions.
problem Scalability issues in Sparse Deep Neural Networks (DNNs).
method Mathematically defined DNN inference computation, community submissions from various fields.
result Sparse DNN execution time, TmDNN, is strongly dependent on the number of operations, Nmop. ICLR 2021 challenge in computational geometry and topology attracted 16 teams.
problem Designing and evaluating computational methods in differential geometry and topology.
method Designing and hosting an open-source competition with repositories Geomstats and Giotto-TDA.
result 16 teams participated in the challenge, showcasing innovative contributions to computational geometry and topology.
Paper discusses ASD challenge for machine condition monitoring.
problem Detecting unknown anomalous sounds without labeled data.
method Design and evaluation of a large-scale ASD dataset, novel approaches.
result Several novel approaches developed, evaluation results analyzed.
This report to our stage 1 submission to the NeurIPS 2019 disentanglement challenge presents a simple image preprocessing method for training VAEs leading to improved disentanglement compared to directly using the images. In particular, we propose to use regionally aggregated feature maps extracted from CNNs pretrained…
The VoxCeleb Speaker Recognition Challenge 2019 aimed to assess how well current speaker recognition technology is able to identify speakers in unconstrained or `in the wild' data. It consisted of: (i) a publicly available speaker recognition dataset from YouTube videos together with ground truth annotation and standar…
This report to our stage 2 submission to the NeurIPS 2019 disentanglement challenge presents a simple image preprocessing method for learning disentangled latent factors. We propose to train a variational autoencoder on regionally aggregated feature maps obtained from networks pretrained on the ImageNet database, utili…
XPDNet wins MRI reconstruction challenge with neural network.
problem MRI reconstruction from under-sampled data.
method Inspired by MRI and computer vision best practices, XPDNet uses a neural network.
result XPDNet achieved state-of-the-art results in the 2020 fastMRI challenge.
One of the best ways for developers to test and improve their skills in a fun and challenging way are programming challenges, offered by a plethora of websites. For the inexperienced ones, some of the problems might appear too challenging, requiring some suggestions to implement a solution. On the other hand, tagging p…
Challenge aims to develop automated meningioma MRI segmentation models.
problem Lack of automated, objective tools for meningioma assessment.
method Develop and evaluate models on largest annotated dataset.
result Improved care of patients with meningioma through automated segmentation.
We organized a competition on Autonomous Lifelong Machine Learning with Drift that was part of the competition program of NeurIPS 2018. This data driven competition asked participants to develop computer programs capable of solving supervised learning problems where the i.i.d. assumption did not hold. Large data sets w…
S2M optimizes mining for diverse data subpopulations.
problem Scalability and uniformity in training sets with many labels and diverse data.
method Doubly-stochastic mining (S2M) computes per-example and minibatch losses on hardest labels/examples.
result S2M ensures good performance across all data subpopulations.
Differentiable ABMs face challenges in inference and optimisation.
problem Challenges in parameter inference and optimisation for differentiable ABMs.
method Discussion and experiments highlighting challenges.
result Challenges remain in constructing differentiable ABMs.
Current state-of-the-art discrete optimization methods struggle behind when it comes to challenging contrast-enhancing discrete energies (i.e., favoring different labels for neighboring variables). This work suggests a multiscale approach for these challenging problems. Deriving an algebraic representation allows us to…
Generating molecules with desired chemical properties is important for drug discovery. The use of generative neural networks is promising for this task. However, from visual inspection, it often appears that generated samples lack diversity. In this paper, we quantify this internal chemical diversity, and we raise the …
Improved contact tracing models outperform NIST challenge results.
problem Contact tracing using phone data and machine learning.
method Developed two machine learning models (GBM and MLP) from phone instrumental data features.
result Outperformed the leading NIST challenge result by HKUST.
Bayesian optimization outperformed random search in machine learning hyperparameter tuning challenge.
problem Optimizing hyperparameters of machine learning models using derivative-free methods.
method Bayesian optimization vs. random search on real datasets.
result Bayesian optimization significantly outperformed random search in held-out objective functions.
This paper describes the Speech Technology Center (STC) antispoofing systems submitted to the ASVspoof 2019 challenge. The ASVspoof2019 is the extended version of the previous challenges and includes 2 evaluation conditions: logical access use-case scenario with speech synthesis and voice conversion attack types and ph…
Machine learning simplifies finance, but faces challenges.
problem Adopting machine learning in finance.
method Analyzing challenges in financial services adoption.
result Challenges in finance adoption of ML.
Quantum ML promises faster data analysis but faces trainability challenges.
problem Challenges in training quantum machine learning models.
method Review of current methods and applications of quantum neural networks and quantum deep learning.
result Opportunities for quantum advantage in quantum machine learning.
NetML provides datasets and challenges for network traffic analysis.
problem Lack of representative datasets and reproducibility issues in network traffic analysis.
method Released three open datasets with flow features and raw packets, implemented machine learning methods.
result NetML datasets will serve as a common platform for AI-driven research.
Brief history and challenges of interpretable machine learning.
problem Challenges in interpreting machine learning models, especially in scientific applications.
method Overview of state-of-the-art methods and discussion of challenges.
result Interpretable machine learning has a rich history but faces significant challenges.
This review discusses challenges and solutions for AI in chemical engineering.
problem Challenges in applying classical machine learning to chemical engineering data.
method Identifying four data characteristics and discussing their applications and solutions.
result Current research extends data science and machine learning to handle chemical engineering data challenges.
RL applied to finance tasks, highlighting challenges and future directions.
problem Decision-making tasks in finance using RL.
method Meta-analysis of RL applications, identifying challenges and proposing future directions.
result Challenges in RL performance and future research directions.
Researchers review challenges in interpreting additive models, especially neural additive models.
problem Challenges in interpreting additive models, particularly neural additive models.
method Review of generalized additive models and discussion of nonidentifiability.
result Challenges in claiming interpretability or suitability for safety-critical applications of additive models.
Bayesian design improves experimental optimization.
problem Computational challenges limit BED practical use.
method Recent advances in BED have reduced computational burdens.
result Effective BED design is now feasible.
D2KLab's approach predicts tweet engagement using two stages.
problem Predicting user engagement with tweets.
method Two-stage approach: feature learning and ensemble XGBoost.
result Ranked 22 in the 2020 RecSys Challenge leaderboard.
This paper examines challenges in analyzing NFT transaction data.
problem Challenges in analyzing NFT transaction data due to non-fungible nature and blockchain.
method Analysis of transaction history of eight NFT collections.
result Illustrates challenges such as price differentiation, lateral swaps, and volatility.
Challenge forecasts EV charging station usage accurately.
problem Better understanding of EV charging behaviors needed.
method Hierarchical forecasting of EV charging station occupancy.
result Hierarchical forecasting improves EV charging station occupancy predictions.
The MIT/IEEE/Amazon GraphChallenge.org encourages community approaches to developing new solutions for analyzing graphs and sparse data. Sparse AI analytics present unique scalability difficulties. The proposed Sparse Deep Neural Network (DNN) Challenge draws upon prior challenges from machine learning, high performanc…
AI enhances financial forecasting with challenges in regulation and privacy.
problem Challenges in integrating AI with financial services and regulations.
method Integration of AI technologies like deep learning and reinforcement learning.
result AI improves financial forecasting but faces regulatory and privacy issues.