Proposes a new machine learning-based method for conjoint analysis.
problem Testing the importance of factors in conjoint analysis with interactions.
method Conditional randomization test based on machine learning algorithms.
result Validates the importance of factors in conjoint analysis without model specification.
The paper compares clustering techniques for personalized food kits.
problem Designing food kits that match individual consumer preferences.
method Comparative analysis of clustering techniques using conjoint analysis data.
result SVD clustering outperforms k-means in personalized food kit design.
Bayesian model estimates feature values of premium products.
problem Understanding the monetary value of product features.
method Bayesian Hierarchical Logit Model
result Successfully recovers true feature valuations from data.
Paper proposes a data augmentation method for LLM-generated data in market research.
problem Bias in LLM-generated data in market research.
method Statistical data augmentation approach integrating LLM-generated and real data.
result Statistically robust estimators with reduced bias and cost savings.
FairNN learns fair representations and decisions by optimizing a multi-objective loss function.
problem Fairness in machine learning models for decision-making.
method Joint feature representation and classification with multi-objective loss function.
result Joint approach outperforms separate treatment of fairness in representation learning or supervised learning.
Study models growth of unorganized retail in Indian pharma sector amid organized and e-retail competition.
problem Survival strategies of unorganized retailers challenged by organized and e-retailers.
method Field investigation, conjoint analysis, design of experiments, agent-based simulation.
result Unorganized retailers' performance influenced by their own attribute levels and price discounts.
Global routing has been a historically challenging problem in electronic circuit design, where the challenge is to connect a large and arbitrary number of circuit components with wires without violating the design rules for the printed circuit boards or integrated circuits. Similar routing problems also exist in the de…
Terrorism has become one of the most tedious problems to deal with and a prominent threat to mankind. To enhance counter-terrorism, several research works are developing efficient and precise systems, data mining is not an exception. Immense data is floating in our lives, though the scarce availability of authentic ter…
Synthetic Combinations learns unit-specific causal outcomes for combinatorial interventions.
problem Estimating unit-specific causal outcomes for all combinations of p interventions in a heterogeneous setting. method Latent factor model with Fourier expansion sparsity, imposing structure across units and interventions.
result Synthetic Combinations provides consistent estimation with poly(r) * (N + s^2p) observations, outperforming previous methods.
Efficient private matrix analysis algorithms for recent variants.
problem Private analysis of recent matrix updates.
method Identifying sufficient conditions on positive semidefinite matrices.
result First efficient differentially private algorithms for various matrix analysis tasks.
This paper introduces compositional data analysis for financial ratios, improving industry-level analysis.
problem Statistical issues with standard financial ratios at industry level.
method Compositional data analysis techniques for financial ratios.
result Improved analysis of financial ratios using compositional data methods.
In this dissertation, the main goal is visualisation of financial time series. We expect that visualisation of financial time series will be a useful auxiliary for technical analysis. Firstly, we review the technical analysis methods and test our trading rules, which are built by the essential concepts of technical ana…
Paper combines geometry and time-series analysis for spatiotemporal data.
problem Multivariate time-series data from multiple sensors.
method Combines manifold learning, Riemannian geometry, and spectral analysis.
result Proposes Riemannian multi-resolution analysis (RMRA) for dynamic mode extraction.
In this paper the exact linear relation between the leading eigenvectors of the modularity matrix and the singular vectors of an uncentered data matrix is developed. Based on this analysis the concept of a modularity component is defined, and its properties are developed. It is shown that modularity component analysis …
This paper investigates to identify the requirement and the development of machine learning-based mobile big data analysis through discussing the insights of challenges in the mobile big data (MBD). Furthermore, it reviews the state-of-the-art applications of data analysis in the area of MBD. Firstly, we introduce the …
Interactive DR framework for comparing datasets.
problem Limited flexibility in existing DR methods for comparative analysis.
method Unified linear comparative analysis (ULCA) with interactive optimization and visualization.
result ULCA and optimization algorithm improve comparative analysis efficiency and flexibility.
Combines topological and geometric approaches to data analysis.
problem Understanding when and how geometric objects intersect.
method Connects topological and geometric concepts of curvature.
result Reconceptualizes curvature and links it to hyperconvexity.
Proposes a multivariate regression model for better analysis of multiple datasets.
problem Insufficient performance of single-dataset analysis in integrative studies.
method Sparse estimation for variable and group selection, alternating direction method of multipliers algorithm.
result Demonstrated improved performance through simulations and real data analysis.
New method uses topological data analysis to study stock market crashes.
problem Characterizing and predicting stock market crashes.
method Topological data analysis, persistence landscape, dynamic time series analysis.
result Demonstrates effectiveness of new method for Flash Crash characterization and prediction.
Analyzes stock trends and e-commerce user behavior using Twitter data.
problem Understanding the relationship between stock prices, stock news, and e-commerce user behavior.
method Cross-domain analysis using Hadoop, Hive, and Tableau on three datasets.
result Identified correlations between stock sentiment, stock trends, and e-commerce user behavior.
Study analyzes Disney stock market performance using machine learning.
problem Forecasting stock market performance of Disney.
method Exploratory data analysis, feature engineering, model selection (linear regression).
result Linear regression model performed best.
This study analyzes data science vocabulary changes over 13 years.
problem Understanding evolution of data science terms over time.
method Exploratory Data Analysis, Latent Semantic Analysis, Latent Dirichlet Analysis, N-grams Analysis.
result Identified new vocabulary and its incorporation into scientific literature.
FinSphere improves stock analysis quality with AI and expert-curated data.
problem Lack of objective evaluation metrics and depth in stock analysis by FinLLMs.
method Developed AnalyScore, curated Stocksis dataset, and FinSphere AI agent.
result FinSphere outperforms general and domain-specific LLMs in generating high-quality stock analysis reports.
This study examines whether PCA can effectively identify nitrogen pollution sources in rivers.
problem Identifying pollution sources in rivers for effective environmental management.
method Principal Component Analysis and its modifications, along with Independent Component Analysis and Factor Analysis, are applied to nitrogen pollution source identification.
result PCA and related techniques can be powerful tools for uncovering nitrogen pollution sources in rivers.
Paper introduces probabilistic methods to approximate archetypal analysis, reducing complexity.
problem Inherent computational complexity of archetypal analysis limits its practical applicability.
method Two preprocessing techniques: dimensionality reduction and representation cardinality reduction, using probabilistic geometry.
result The method effectively reduces scaling and provides near-optimal solutions for prediction errors.
We present a unifying framework which reduces the construction of probabilistic component analysis techniques to a mere selection of the latent neighbourhood, thus providing an elegant and principled framework for creating novel component analysis models as well as constructing probabilistic equivalents of deterministi…
Deep learning techniques are rapidly advanced recently, and becoming a necessity component for widespread systems. However, the inference process of deep learning is black-box, and not very suitable to safety-critical systems which must exhibit high transparency. In this paper, to address this black-box limitation, we …
In this paper, we explore the effectiveness of dynamic analysis techniques for identifying malware, using Hidden Markov Models (HMMs) and Profile Hidden Markov Models (PHMMs), both trained on sequences of API calls. We contrast our results to static analysis using HMMs trained on sequences of opcodes, and show that dyn…
Improved LDA method for better classification and dimensionality reduction.
problem Improving linear discriminant analysis for better classification performance.
method Integrates spectrally-corrected covariance matrix and regularized discriminant analysis.
result SRLDA has a linear classification global optimal solution under spiked model assumption.
CDVI improves variational inference for survival analysis by considering censoring mechanisms.
problem Challenges in applying variational methods to survival data, especially the dependence on censoring.
method Censor-dependent variational inference (CDVI) tailored for latent variable models in survival analysis.
result Significant improvements in estimating individual survival distributions.
The kernel matrix used in kernel methods encodes all the information required for solving complex nonlinear problems defined on data representations in the input space using simple, but implicitly defined, solutions. Spectral analysis on the kernel matrix defines an explicit nonlinear mapping of the input data represen…
Prototypal analysis is introduced to overcome two shortcomings of archetypal analysis: its sensitivity to outliers and its non-locality, which reduces its applicability as a learning tool. Same as archetypal analysis, prototypal analysis finds prototypes through convex combination of the data points and approximates th…
In this paper, we introduce a Deep Convolutional Analysis Dictionary Model (DeepCAM) by learning convolutional dictionaries instead of unstructured dictionaries as in the case of deep analysis dictionary model introduced in the companion paper. Convolutional dictionaries are more suitable for processing high-dimensiona…
Improved analysis of UCBVI algorithm with better empirical performance.
problem Improving the UCBVI algorithm's performance and understanding its bounds.
method Refined analysis of UCBVI algorithm with improved bonus terms and regret analysis.
result Improving multiplicative constants in UCBVI bounds enhances empirical performance.
Reduces survival analysis to common regression tasks.
problem Applying standard machine learning tools to survival analysis.
method Various reduction techniques to simplify survival analysis.
result Benchmark analysis shows improved predictive performance.
A new robust scaling approach improves downstream metabolomics analysis.
problem Challenges in choosing scaling techniques for metabolomics data.
method Introduces a weighted scaling approach robust to outliers.
result The proposed method outperforms traditional scaling techniques in both outlier-free and outlier-present datasets.
Paper proposes FinAR-Bench to evaluate LLMs in financial analysis tasks.
problem Inaccurate financial analysis by LLMs leading to investment and regulatory issues.
method Proposes FinAR-Bench, a benchmark dataset with three steps: key info extraction, financial indicator calculation, and logical reasoning.
result LLMs perform better in key info extraction and indicator calculation but struggle with logical reasoning.
Wavelet analysis reveals non-linear dynamics in cryptocurrency prices.
problem Understanding non-linear dynamics in high-frequency cryptocurrency prices.
method Wavelet analysis of frequency and time variables.
result Cyclical persistence at different frequencies in cryptocurrency prices.
The book explores alternatives to worst-case analysis for algorithm performance.
problem Providing strong worst-case guarantees for many algorithms is impossible.
method Surveying and detailing various nuanced analysis approaches.
result More nuanced analysis approaches are needed for fundamental problems.
Alternative wavelet analysis method for financial signals.
problem Analyzing oscillations in financial signals with noise.
method Modeling financial signals as isolated events producing ripples of various frequencies.
result Element analysis distinguishes between noise and logically matched generators.
These are lecture notes for the course "Analysis and X-ray tomography". The course is a broad overview of various tools in analysis that can be used to study X-ray tomography. The focus is on tools and ideas, not so much on technical details and minimal assumptions. Only very basic functional analysis is assumed as bac…
We investigate the difference between using an ℓ1 penalty versus an ℓ1 constraint in generalized eigenvalue problems, such as principal component analysis and discriminant analysis. Our main finding is that an ℓ1 penalty may fail to provide very sparse solutions; a severe disadvantage for variable sel…
Can textual data be compressed intelligently without losing accuracy in evaluating sentiment? In this study, we propose a novel evolutionary compression algorithm, PARSEC (PARts-of-Speech for sEntiment Compression), which makes use of Parts-of-Speech tags to compress text in a way that sacrifices minimal classification…
This paper analyzes text in financial disclosures to improve financial analysis.
problem Insufficient analysis of unstructured text in financial disclosures.
method Reviews and explores methods in computational linguistics and NLP.
result Highlights limitations of sentiment metrics and suggests future research areas.
This paper deals with various topics in analysis on hyperbolic spaces. It surveys some recent progress in non-Euclidean Fourier Analysis and proves some new results for the geodesic Radon transform on hyperbolic spaces.
Study compares BERT with other sentiment analysis models.
problem Comparing sentiment analysis techniques.
method Used four models: Sent WordNet, logistic regression, LSTM, and BERT on IMDB movie reviews.
result BERT outperformed other models in sentiment classification.
Bayesian analysis reveals asymmetry in financial data.
problem Quantifying asymmetry in financial time series data.
method Bayesian approach, t-Test generalization, two data distribution models, sensitivity analysis.
result Statistical significance of gain/loss asymmetry amounts.
New analysis shows halting time is predictable for large models, improving optimization efficiency.
problem Understanding the average-case complexity of optimization algorithms for large-scale models.
method Average-case analysis of first-order methods on random least squares and neural networks.
result Halting time is independent of input distribution, leading to tighter convergence rates.