Proposes a multivariate regression model for better analysis of multiple datasets.
problem Insufficient performance of single-dataset analysis in integrative studies.
method Sparse estimation for variable and group selection, alternating direction method of multipliers algorithm.
result Demonstrated improved performance through simulations and real data analysis.
Analyzes stock trends and e-commerce user behavior using Twitter data.
problem Understanding the relationship between stock prices, stock news, and e-commerce user behavior.
method Cross-domain analysis using Hadoop, Hive, and Tableau on three datasets.
result Identified correlations between stock sentiment, stock trends, and e-commerce user behavior.
New method clusters mixed data types using homogeneity analysis.
problem Clustering datasets with a mix of numerical and categorical attributes.
method Homogeneity analysis to determine a Euclidean representation.
result The method is useful for analyzing big datasets with mixed data types.
MusPy is a toolkit for symbolic music generation, providing tools for dataset management and analysis.
problem Facilitating the creation and analysis of symbolic music datasets.
method Development of an open-source Python library (MusPy) with features for dataset management, data I/O, preprocessing, and model evaluation. Demonstrated through statistical analysis and cross-dataset generalizability experiments.
result MusPy's dataset analysis reveals varying degrees of cross-genre representation across different music datasets.
We speed up factor analysis on large neuroimaging datasets.
problem Processing large multi-subject neuroimaging datasets efficiently.
method Optimized multi-subject factor analysis methods for parallel processing.
result Strong scaling up to 5.5x with 1024 nodes and 32,768 cores.
Pars-ABSA dataset for Persian aspect-based sentiment analysis.
problem Lack of public dataset for Persian aspect-based sentiment analysis.
method Manually annotated dataset with 5,114 positive, 3,061 negative, and 1,827 neutral samples.
result State-of-the-art performance of deep learning methods on Pars-ABSA compared to similar English datasets.
Proposes a method to analyze distributed datasets without sharing original data.
problem Difficulty in centralizing large, distributed datasets due to size and privacy concerns.
method Centralizes intermediate representations instead of original datasets.
result Achieves higher prediction performance compared to individual analyses.
Paper proposes MDER model to extract ML methods and datasets from papers.
problem Lack of focus on methods and datasets in literature analysis.
method Proposes MDER model for entity recognition of methods and datasets.
result Demonstrates preliminary performance of MDER model.
A new method, InfoGuide, improves automatic clustering analysis.
problem Lack of automatic clustering analysis frameworks.
method Capturing traces of information gain between clustering retrievals.
result InfoGuide can enable more automatic clustering analysis.
MCCA extracts shared structure from multiple tensor datasets.
problem Extracting shared structure from multiple tensor datasets.
method Multilinear common component analysis (MCCA) using Kronecker products of mode-wise covariance matrices.
result MCCA constructs a common basis that retains information from multiple tensor datasets.
Combines geometry and topology for analyzing hierarchical datasets.
problem Analyzing complex, hierarchical datasets with irregular structures.
method Combines manifold learning and topological data analysis.
result Superior classification results compared to state-of-the-art methods.
FNSPID dataset integrates financial news and stock prices for improved market predictions.
problem Lack of comprehensive datasets combining quantitative and qualitative financial data.
method Developed a large-scale dataset (FNSPID) with 29.7M stock prices and 15.7M financial news records.
result FNSPID significantly boosts market prediction accuracy and sentiment analysis.
A hierarchical approach improves classification accuracy in large datasets.
problem Improving classification accuracy in large datasets with high dimensionality.
method Hierarchical subspace learning to scale manifold learning methods.
result Average 5% increase in classification accuracy.
A new method for time series analysis that highlights important signals.
problem Finding signals that matter most in time series data.
method Contrastive Multivariate Singular Spectrum Analysis (CMSA) using a background dataset.
result CMSA identifies signals that are more relevant to the analyst than those with the highest variance.
CDPA identifies common and distinctive patterns in high-dimensional datasets.
problem Existing methods fail to capture the common pattern between coefficient matrices of shared latent factors.
method Proposes CDPA, an unsupervised learning method that incorporates both common and distinctive patterns of coefficient matrices.
result CDPA provides better characterization of common and distinctive patterns in high-dimensional datasets.
This study analyzes and predicts airline delays using machine learning models.
problem Improving the accuracy of predicting airline flight delays.
method The study combines airline and weather datasets, using various machine learning models (Logistic Regression, Naive Bayes, K-NN, Decision Tree, Random Forest) to predict flight delays.
result The Random Forest model achieved an accuracy of 82% in predicting flight delays of 15 minutes or more.
Canonical correlation analysis (CCA) is a valuable method for interpreting cross-covariance across related datasets of different dimensionality. There are many potential applications of CCA to neuroimaging data analysis. For instance, CCA can be used for finding functional similarities across fMRI datasets collected fr…
Interactive DR framework for comparing datasets.
problem Limited flexibility in existing DR methods for comparative analysis.
method Unified linear comparative analysis (ULCA) with interactive optimization and visualization.
result ULCA and optimization algorithm improve comparative analysis efficiency and flexibility.
StockEmotions dataset for financial sentiment and emotion analysis.
problem Limited resources for financial sentiment analysis.
method Collects 10,000 English comments from StockTwits, categorizes emotions into 12 classes.
result DistilBERT outperforms other models in sentiment classification, and Temporal Attention LSTM model achieves best performance in multivariate time series forecasting.
Deep learning models struggle with irrelevant features in survival analysis.
problem Deep learning models suffer from performance deficits when dealing with many irrelevant features in survival analysis.
method Developed novel feature selection methods for deep learning models in survival analysis.
result Substantial performance improvements are achievable with feature selection methods.
We introduce a method called multi-scale local shape analysis, or MLSA, for extracting features that describe the local structure of points within a dataset. The method uses both geometric and topological features at multiple levels of granularity to capture diverse types of local information for subsequent machine lea…
Graph Canonical Correlation Analysis improves CCA for multiomics datasets.
problem Limited ability of conventional CCA methods to incorporate structured patterns in cross-correlation matrices.
method Graph Canonical Correlation Analysis (gCCA) calculates canonical correlations based on the graph structure of cross-correlation matrices.
result gCCA outperforms competing CCA methods in simulations and multiomics dataset analysis.
Develops a novel approach for discriminative data analysis.
problem Challenges of analyzing multiple datasets using PCA.
method Solves a generalized eigenvalue problem by performing SVD once.
result Establishes optimality in the least-squares sense.
Contrastive ICA identifies features in experimental groups relative to controls.
problem Jointly analyzing experimental and control datasets to identify salient features.
method Developed contrastive ICA (cICA) using tensor decomposition.
result cICA identifies patterns and visualizes data effectively, outperforming existing methods.
Quantum dynamics reveals hidden geometric structure in data.
problem Understanding complex, high-dimensional datasets through geometric structure.
method Introducing semiclassical and microlocal analysis to data analysis.
result First tractable algorithm for approximating wave dynamics and geodesics on data manifolds.
Improves cancer classification accuracy using Random Projection combined with other methods.
problem Improving classification accuracy of Random Projection for cancer classification.
method Combining Random Projection with Principle Component Analysis, Linear Discriminant Analysis, and Feature Selection.
result FS followed by RP yields a 14.77% increase in classification accuracy on BC-TCGA dataset.
ArSentD-LEV dataset improves sentiment analysis in Levantine Arabic tweets.
problem Challenges in sentiment analysis of Arabic tweets, especially Levantine dialect.
method Created a dataset of 4,000 Levantine Arabic tweets with detailed sentiment and topic annotations.
result Improved performance of sentiment classifiers with detailed annotations.
Analyzes dependencies in sequential datasets to improve deep neural architectures.
problem Improving deep recurrent neural architectures by understanding long distance dependencies.
method Detailed analysis of dependency decay curves in various datasets, testing factors affecting decay, generating synthesized datasets.
result Factors influencing dependency decay curves (number of unique symbols, dataset size, interacting symbols, distance between symbols) can inform optimal hyper-parameters.
DP-SGD analysis shows many datapoints leak less privacy than previously thought.
problem Empirical evidence suggests DP-SGD leaks less privacy than current analysis predicts.
method Developed a per-instance DP analysis of DP-SGD, introducing dependence on dataset distribution.
result Formally shows DP-SGD leaks significantly less privacy for many datapoints on common benchmarks.
Meta-analysis improves interpretation and efficiency across similar but non-identical datasets.
problem Meta-analysis of heterogeneous data in high dimensions.
method Integrative sparse regression with a global parameter for adaptability and anonymity.
result Superior identification of global parameter for high-dimensional linear models.
This paper creates a comprehensive BTC transaction network dataset spanning 15 years.
problem Lack of a full-history BTC graph and network property dataset.
method Thorough analysis of BTC transaction network, creating a dataset and investigating decentralization.
result First systematic investigation of BTC's asset decentralization and design of decentralization degrees.
Neuroscience faces new challenges in data analysis as datasets grow richer.
problem How to analyze large, complex neuroscientific datasets effectively.
method Development of non-parametric, generative models combining frequentist and Bayesian approaches.
result New statistical methods will be essential for extracting meaningful insights from neuroscientific data.
We introduce a new discriminant analysis method (Empirical Discriminant Analysis or EDA) for binary classification in machine learning. Given a dataset of feature vectors, this method defines an empirical feature map transforming the training and test data into new data with components having Gaussian empirical distrib…
FUNSD dataset tackles noisy scanned forms, offering comprehensive annotations.
problem Extracting and structuring textual content from noisy scanned documents.
method Comprehensive dataset with real, fully annotated forms, including text detection, OCR, layout analysis, and entity linking.
result First publicly available dataset for form understanding, addressing challenges in noisy scanned documents.
New benchmark for EEG-eye movement reconstruction from functional data.
problem Reconstructing eye movements from EEG data.
method Functional neural networks and open challenges for evaluation.
result Baseline results for consumer-grade and research-grade hardware.
NKI integrates obfuscated datasets using nonlinear kernels for improved data collaboration.
problem Privacy-preserving data collaboration with reduced reconstruction risk.
method Formulates linear kernel integration, kernelizes it, and introduces graph regularization and centering constraints.
result NKI improves classification accuracy over existing linear integration methods under nonlinear dimensionality reduction.
MISA combines multiple datasets for better feature extraction.
problem Combining diverse datasets for better feature extraction.
method MISA combines multiple heterogeneous datasets using Kotz distribution and combinatorial optimization.
result MISA produces robust generalization of ICA, IVA, and ISA.
ERICA assesses reproducibility in cluster analysis.
problem Lack of a unified framework for evaluating cluster analysis replicability.
method ERICA (iterative clustering assignments) method to quantify replicability.
result Demonstrates ERICA's ability to identify reproducible cluster structure.
Differential privacy for simple linear regression protects small datasets from individual data leaks.
problem Protecting sensitive personal information in small datasets from individual data leaks.
method Differential privacy algorithms for simple linear regression tailored for small datasets (tens to hundreds of datapoints).
result Robust estimators like Theil-Sen perform well on small datasets, but standard algorithms improve as dataset size increases.
MI-GAN generates synthetic medical images for supervised analysis.
problem Lack of large datasets and overfitting in medical image analysis.
method Generative Adversarial Network (GAN) for generating synthetic medical images and masks.
result MI-GAN achieves state-of-the-art performance with dice coefficient of 0.837 on STARE and 0.832 on DRIVE datasets.
Two derivations of PCA for distributional data.
problem PCA for datasets of distributions.
method Two derivations: variance maximization and reconstruction error minimization.
result Closed-form solution for distributional PCA.
Paper proposes FinAR-Bench to evaluate LLMs in financial analysis tasks.
problem Inaccurate financial analysis by LLMs leading to investment and regulatory issues.
method Proposes FinAR-Bench, a benchmark dataset with three steps: key info extraction, financial indicator calculation, and logical reasoning.
result LLMs perform better in key info extraction and indicator calculation but struggle with logical reasoning.
A new algorithm reduces the size of datasets for TDA.
problem Processing large datasets with high dimensions in TDA is computationally infeasible.
method Introduced Characteristic Lattice Algorithm (CLA) for data reduction.
result CLA reduces dataset size while preserving geometric and topological features.
Paper introduces metrics to assess and control nuisance factors in sentiment analysis.
problem Challenges in learning invariant representations for sentiment analysis due to entangled nuisance factors.
method Developed two generalization metrics and a data filtering approach to control nuisance factors.
result Simple text classification baseline can be badly affected by product ID in sentiment analysis.
CRDA improves gene selection in microarray studies by reducing feature space.
problem Gene selection in high-dimensional microarray datasets.
method CRDA combines ℓq,1 norm minimization and hard thresholding for feature elimination. result CRDA outperforms competitors in misclassification and feature selection accuracy.
R-PCA extends PCA to Riemannian manifolds for structured data.
problem Applying PCA to data on Riemannian manifolds without vector space operations.
method Adapting PCA to Riemannian manifolds by equipping data with local metrics.
result Unified approach for dimensionality reduction and statistical analysis on manifolds.
Study analyzes Brazilian congress members' spending patterns.
problem Lack of transparency in government spending by congress members.
method Neural network-based approach for analyzing and visualizing spending patterns.
result Inspires new machine learning methodologies for government transparency.
A new model for multiview data analysis using graph autoencoders.
problem Nonlinear multiview canonical correlation analysis for large datasets.
method Variational approach with graph convolutional neural networks.
result Competitive performance on classification, clustering, and recommendation tasks.