Paper learns to generate scientific posters from papers.
problem Generating readable, informative, and visually aesthetic scientific posters is challenging.
method Data-driven framework using graphical models to learn poster elements.
result Model effectively synthesizes graphical elements for posters.
Deep learning from manga posters improves anime and manga recommendations.
problem Predicting user preferences for cold-start anime and manga recommendations.
method BALSE model using Illustration2Vec to extract tag information from posters.
result BALSE model significantly improves recommendation quality, especially for less-known mangas.
Improved multimodal learning with Gated Multimodal Units.
problem Finding an intermediate representation from multiple data sources.
method Gated neural networks for multimodal fusion.
result GMU outperformed single-modality approaches and other fusion strategies.
Extracts roles of authors from biomedical papers.
problem Lack of machine-readable author roles in biomedical papers.
method Statistical analysis of roles, Open Information Extraction, Naïve Bayes approach.
result Extracts roles with precision of 0.68, recall of 0.48, and F1 of 0.57.
Hybrid approach combines ASTs and deep learning for PowerShell malware detection.
problem Detecting malicious PowerShell scripts effectively.
method Combining static program analysis (ASTs) with deep learning.
result Preliminary results show promising classification of PowerShell scripts by family type.
TGDS integrates scientific theory into data science for better model interpretation and discovery.
problem Limited applicability of data science models in scientific problems involving complex phenomena.
method Integrating scientific theory into data science models to improve model effectiveness and interpretability.
result TGDS aims to advance scientific understanding by discovering novel insights.
ABtree assigns optimal treatments based on subgroup benefits.
problem Finding subgroups that benefit more from different treatments.
method Tree-based approach for per-individual optimal treatment assignment.
result Maximizes overall desired outcome conditional on covariates.
V-CNN improves CNN performance in network intrusion detection.
problem Applying CNN directly to non-image data leads to poor performance.
method Integrates data visualization before CNN modeling.
result Significantly outperforms other studies in network intrusion detection.
This work uses scientific constraints to validate neural network predictions in fusion physics.
problem Verifying the scientific plausibility of neural network predictions in fusion physics.
method Using known scientific constraints as a validation tool.
result Validated neural network predictions in fusion physics using scientific constraints.
xVal tokenizes numbers continuously for better scientific model training.
problem Lack of continuous numerical tokenization for scientific datasets in LLMs.
method xVal: Continuous numerical tokenization strategy.
result xVal outperforms other numerical tokenization methods on scientific datasets.
Crowdsourcing can improve scientific investigation by enabling reproducibility and transparency.
problem Current research methods lack reproducibility and transparency, leading to unreliable decisions.
method Next-generation investigative approach leveraging human diversity, micro-specialized crowds, and computer-assisted control methods.
result The Theory of Enablers provides specific cognitive and non-cognitive enablers for crowd-based scientific investigation.
Galactica learns from scientific literature to help researchers.
problem Information overload in scientific literature makes it hard to find useful insights.
method Trained on a large corpus of scientific papers, reference material, and knowledge bases.
result Outperforms existing models on various scientific tasks, including LaTeX equations and mathematical reasoning.
Prediction models can harm patients even when accurate, leading to self-fulfilling prophecies.
problem Prediction models can lead to harmful decisions that worsen patient outcomes.
method Formal characterization of harmful prediction models and analysis of their impact.
result Well-calibrated models are ineffective for decision-making as they do not change the data distribution.
Social media enhances or diminishes scientific status, depending on usage.
problem Impact of social media on scientific stratification and mobility.
method Logistic Attribution Analysis combining statistical and machine learning methods.
result Social media promotes stratification and mobility, but beyond a threshold, it negatively impacts status.
Extract keyphrases and relations from scientific documents.
problem Understanding which publications describe which processes, tasks, and materials.
method Evaluated 26 submissions across 3 scenarios.
result Task and findings relevant for researchers and information extraction communities.
Machine learning aids scientific discoveries by explaining complex data.
problem Extracting scientific insights from complex data.
method Combining machine learning with domain knowledge for transparency, interpretability, and explainability.
result Enhanced scientific consistency through machine learning and domain knowledge integration.
Visuals in scientific papers are used to express complex ideas; this study uses them to identify knowledge domains.
problem Scientific figures are underutilized in literature analysis.
method Encoded scientific figures into visual signatures and used distances between signatures to compare communities of practice.
result Figures can differentiate knowledge domains as effectively as text or citation patterns.
Paper proposes a method to estimate scientific parameters in hybrid models without relying on model architecture.
problem Estimating unknown parameters in hybrid models combining machine learning and scientific models.
method Sharpness-aware minimization adapted for hybrid modeling, focusing on model simplicity.
result Demonstrates effectiveness of SAM-based hybrid model learning for scientific parameter estimation.
The study reveals nations drive scientific research for social and economic interests.
problem Why do nations produce scientific research?
method Synthesizes previous concepts of science and scientific research, defines them, and identifies key drivers.
result Scientific research is driven by nations' social and economic interests, not just for philosophical inquiries.
TopicEq model generates equations and text from scientific papers.
problem Communicating ideas in scientific texts using both mathematics and text.
method Joint topic and equation generation model using correlated topic model and RNN.
result Joint model outperforms existing topic and equation models for scientific texts.
AutoSciDACT detects scientific anomalies in noisy data.
problem Detecting anomalies in large, noisy scientific datasets.
method Contrastive pre-training for low-dimensional data representations, two-sample test using NPLM.
result Strong sensitivity to small anomalies across various scientific domains.
MDNs offer a data-efficient alternative to diffusion and flow models for multimodal scientific learning.
problem Capturing multimodal conditional uncertainty in scientific inverse problems.
method Mixture Density Networks (MDNs) as explicit parametric density estimators.
result MDNs achieve superior generalization, interpretability, and sample efficiency in scientific tasks.
Study examines scientific research on Bitcoin across various disciplines.
problem Limited time but large number of papers on Bitcoin.
method Bibliometric analysis of papers indexed in Web of Science Core Collection.
result Observes research clusters, emerging topics, and leading scholars.
Survey of deep learning models for scientific discovery.
problem Identifying which scientific problems are most suitable for deep learning.
method Overview of deep learning models, tasks, training methods, and techniques.
result Helps accelerate deep learning use in scientific domains.
New framework compresses and recovers scientific data efficiently.
problem Efficiently managing and recovering from large scientific datasets.
method Grounded in learning exponential families, preserves uncertainty and supports trade-offs.
result Preserves physical features and quantities of interest in compressed representations.
Hurd's career overview and publications listed.
problem None explicitly stated in the abstract.
method Not applicable as it's an introduction.
result No specific key result mentioned.
This thesis advances algorithms and software for QMC, GP, and sciML.
problem Efficient high-dimensional integration, interpolation, and PDE modeling.
method Developed new algorithms and software for QMC, GP, and sciML.
result Efficient and accurate methods for high-dimensional problems.
New AI approach improves quantum device calibration by leveraging prior scientific discoveries.
problem Lack of abundant data in scientific disciplines hinders model generalizability.
method Introduces a new machine learning approach that combines prior scientific knowledge with data.
result Accuracy in predicting quantum device energy spectrum surpasses current state-of-the-art by over 20%.
Before retiring, looking back to forty years of writing and publishing scientific papers, I decided to present to the scientific community a selection of my scientific works. I chose mostly articles published in prestigious journals or Proceedings that made a certain impact in the scientific world. I have selected thir…
Paper presents a workflow for reliable unsupervised learning in science.
problem Lack of standardization in unsupervised learning workflows for reproducible scientific discoveries.
method Structured workflow including data preparation, modeling, validation, and communication.
result Illustrates the importance of validation in unsupervised learning.
Develops a Bayesian framework for symbolic regression of scientific expressions.
problem Lack of principled uncertainty quantification and interpretability in existing symbolic regression methods.
method Hierarchical Bayesian framework with tree-structured symbolic expressions and Markov chain Monte Carlo inference.
result Robust performance on various datasets, including single-atom catalysis.
EduQG generates better educational questions by pre-training on scientific text.
problem Improving the quality of educational questions for scalable self-assessment.
method Adapting a large language model for educational question generation, pre-trained on scientific text.
result EduQG produces superior educational questions compared to baseline models.
SOS-VAE improves generative models for scientific applications by correcting decoder bias.
problem Bias in generative parameters due to supervised learning in VAEs.
method Develops SOS-VAE framework to influence decoder for predictive latent representation.
result Ensures reliable generative parameters for scientific applications.
Convolutional neural networks win SemEval-2017 for scientific relation extraction.
problem Extracting relations between scientific concepts from scholarly articles.
method Convolutional neural network model for relation extraction.
result Ranked first in SemEval-2017 Task 10 for relation extraction in scientific articles.
Physics-guided models improve lake temperature and quality predictions.
problem Predicting and monitoring water temperature and quality in lakes.
method Combining physics-based models and recurrent neural networks with physical constraints.
result Improved prediction accuracy and scientific consistency.
Differentiable programming aids in solving differential equations and their sensitivities.
problem Computing gradients of numerical solutions of differential equations.
method Review of existing techniques and mathematical foundations.
result Established a coherent framework for combining differential equations with data-driven approaches.
Economics does not need a scientific revolution. Economics needs accurate measurements according to high standards of natural sciences and meticulous work on revealing empirical relationships between measured variables.
Deep neural nets improve KBC for scientific articles.
problem Lack of labelled data for keyphrase boundary classification.
method Multi-task learning with deep recurrent neural networks.
result Multi-task models significantly outperform previous methods.
Proposes a multi-modal attention network for better stock price prediction.
problem Predicting future stock movements using historical records and social media.
method Extracts semantic information from social media, estimates credibility, and integrates with numeric features.
result Significantly improved prediction accuracy and trading profits compared to previous methods.
PIMA autoencoders discover shared features in multimodal scientific data.
problem Discovering shared information in high-throughput scientific datasets.
method Physics-informed multimodal autoencoders (PIMA) with Gaussian mixture prior and product of experts formulation.
result Accurate cross-modal inference between images and mechanical stress-strain response in lattice metamaterials.
Machine learning needs stronger mathematical foundations for scientific applications.
problem Lack of rigorous mathematical foundations for machine learning in scientific and engineering contexts.
method Further mathematical developments and incorporation of prior knowledge and inductive biases.
result Stronger mathematical rigor is essential for reliable and interpretable machine learning results in scientific fields.
PGNN combines physics models with neural nets for lake temperature prediction.
problem Lake temperature modeling with physical constraints.
method Physics-guided neural networks using hybrid modeling and physics-based loss functions.
result PGNN improves generalizability and scientific consistency in lake temperature predictions.
A new method calibrates scientific models by adding randomness to their predictions.
problem Current scientific foundation models lack calibrated uncertainty.
method Stochastic Attention, which randomizes attention weights using multinomial samples.
result Stochastic Attention achieves the strongest native calibration and sharpest prediction intervals.
Deep learning detects radical content on social media.
problem Detecting extremist content on social media platforms.
method Employed an LSTM based feed forward neural network to classify radical content.
result Achieved a precision of 85.9% in detecting radical content.
HATT improves online decision tree ensembles by using a more eager splitting strategy.
problem Improving the efficiency of online decision tree ensembles.
method Replacing Hoeffding Tree's split strategy with HATT, which uses the Hoeffding Test for candidate splits.
result HATT outperforms Hoeffding Tree in online bagging and boosting ensembles, as shown by significant performance improvements in various testbenches.
New sampling strategy preserves relationships in multivariate scientific data.
problem Reducing storage and enabling efficient multivariate analyses on large scientific data.
method Uses principal component analysis for multivariate data and combines with existing univariate sampling algorithms.
result Efficacy demonstrated on real-world data sets, showing data reduction and multivariate analysis ease.
Fast emulators built with neural search accelerate expensive scientific simulations.
problem Slow execution of accurate simulations limits scientific discovery.
method Neural architecture search to build accurate emulators with limited data.
result Simulations accelerated by up to 2 billion times in various scientific fields.
iKF method uncovers complex variable interactions for scientific discovery.
problem Limited interpretability of existing models in decision-making applications.
method Iterative Kings' Forests (iKF) method to uncover multi-order interactions.
result iKF provides strong interpretive power for explainable modeling.