New algorithms use outsourced data to improve model training efficiency.
problem Limited computational resources restrict model training efficiency.
method Simulation-based algorithms using outsourced data to find good initial points.
result The algorithms can find good initial points with high probability under suitable conditions.
Detects backdoors in outsourced models by replicating training steps across multiple servers.
problem Detecting backdoors in models trained on cloud providers without prior knowledge.
method Replicate training steps across multiple servers to identify deviations and malicious updates.
result 99.6% accuracy in identifying backdoored models out of 50% malicious providers.
We deal with the problem of outsourcing the debt for a big investment, according two situations: either the firm outsources both the investment (and the associated debt) and the exploitation to a private consortium, or the firm supports the debt and the investment but outsources the exploitation. We prove the existence…
First private Bayesian optimization algorithm with provable performance.
problem Privacy-preserving Bayesian optimization in outsourced settings.
method Random projection-based transformation to preserve privacy and distances.
result Regret bound similar to non-private GP-UCB established for PO-GP-UCB.
Deep learning model developers often use cloud GPU resources to experiment with large data and models that need expensive setups. However, this practice raises privacy concerns. Adversaries may be interested in: 1) personally identifiable information or objects encoded in the training images, and 2) the models trained …
Proposes efficient 4PC framework for privacy-preserving machine learning.
problem Need for privacy-preserving machine learning in healthcare and finance.
method Proposes an actively secure 4PC protocol and a framework for PPML.
result Framework operates efficiently and outperforms existing methods.
The paper provides an algorithm for the risk estimation when a company selects an outsourcing service provider for innovation product. Calculations are based on expert surveys conducted among customers and among providers of outsourcing. The surveys assessed the degree of materiality of species at risk.
The paper offers algorithms for managing freelancers and in-house workers in online labor markets.
problem Managing freelancers and in-house workers in online labor markets efficiently.
method Developed algorithms for team formation with outsourcing in an online setting.
result Efficient online algorithms for minimizing costs in hiring and outsourcing.
Improves distributed SGD convergence speed with reduced computation load.
problem Mitigating stragglers in distributed SGD to speed up convergence.
method Modeling communication and computation times, adapting number of workers and computation load dynamically.
result Significantly reduces computation load while improving convergence speed.
As Machine Learning (ML) gets applied to security-critical or sensitive domains, there is a growing need for integrity and privacy for outsourced ML computations. A pragmatic solution comes from Trusted Execution Environments (TEEs), which use hardware and software protections to isolate sensitive computations from the…
We implement an all-optical setup demonstrating kernel-based quantum machine learning for two-dimensional classification problems. In this hybrid approach, kernel evaluations are outsourced to projective measurements on suitably designed quantum states encoding the training data, while the model training is processed o…
Machine learning on encrypted data has received a lot of attention thanks to recent breakthroughs in homomorphic encryption and secure multi-party computation. It allows outsourcing computation to untrusted servers without sacrificing privacy of sensitive data. We propose a practical framework to perform partially encr…
NIFTy.re accelerates imaging models and expands Gaussian processes and variational inference.
problem Slow performance and limited inference strategies in NIFTy.
method Rewritten NIFTy with new modeling principles, inference strategies, and JAX integration.
result Dramatic acceleration of models and new inference capabilities.
Decisions are increasingly taken by both humans and machine learning models. However, machine learning models are currently trained for full automation -- they are not aware that some of the decisions may still be taken by humans. In this paper, we take a first step towards the development of machine learning models th…
This paper advances theory on the process of collaboration between entities and its implications on the quality of services, information, and/or products (SIPs) that the collaborating entities provide to each other. It investigates the scenario of outsourced IS projects (such as custom software development) where the e…
Publicly pretraining models on Web data may undermine differential privacy.
problem The use of large Web-scraped datasets in differential privacy models.
method Critical review of leveraging pretrained models on public datasets for differential privacy.
result Publicizing pretrained models as 'private' could harm trust and generalize poorly.
In this paper, we consider a privacy preserving encoding framework for identification applications covering biometrics, physical object security and the Internet of Things (IoT). The proposed framework is based on a sparsifying transform, which consists of a trained linear map, an element-wise nonlinearity, and privacy…
Machine learning services pose privacy risks if data or model parameters are compromised.
problem Privacy risks in machine learning services when data or model parameters are exposed.
method Systematic review of privacy challenges, adversarial models, attacks, and defenses.
result Need for better evaluations, targeted defenses, and policy studies.
P3GM improves privacy-preserving data synthesis for high-dimensional data.
problem Mitigating privacy risks in releasing large volumes of sensitive data.
method Privacy-preserving phased generative model (P3GM) with two-phase learning process.
result P3GM significantly outperforms existing solutions in terms of noise reduction and data accuracy.
Deep learning architectures (DLA) have shown impressive performance in computer vision, natural language processing and so on. Many DLA make use of cloud computing to achieve classification due to the high computation and memory requirements. Privacy and latency concerns resulting from cloud computing has inspired the …
A deep learning method for regression without model assumptions.
problem Regression prediction without model specification.
method Deep Neural Network (DNN) for point and interval prediction.
result The method outperforms other DNN-based alternatives in stability and accuracy.
Study fair team formation in online labor marketplaces.
problem Design fair algorithms for team formation in online labor marketplaces.
method Define and analyze the Fair Team Formation problem, provide inapproximability results, and develop four algorithms.
result Developed four algorithms for fair team formation in online labor marketplaces.
In crowd labeling, a large amount of unlabeled data instances are outsourced to a crowd of workers. Workers will be paid for each label they provide, but the labeling requester usually has only a limited amount of the budget. Since data instances have different levels of labeling difficulty and workers have different r…
Novel deep learning approach for fast, differentiable fluid simulations.
problem Challenges in solving incompressible fluid dynamics equations efficiently.
method Physics-constrained training approach for convolutional neural networks.
result Trained models can handle various fluid phenomena and offer fast simulations.
Method reformulates constrained optimization as latent space inference.
problem Optimizing black-box functions with hard constraints.
method Posterior inference in latent space using flow-based models and diffusion models.
result Method achieves superior performance across various tasks.
Study examines European banks' digital transformation strategies.
problem Lack of a common framework for open banking innovation in banking sector.
method Qualitative analysis of partnerships and API development.
result European banks are diversifying and boosting customer relationship management.
DeepPeep attacks DNN architectures to reveal design details, posing IP theft risks.
problem Protecting DNN architecture from IP theft in cloud-based services.
method Two-stage attack methodology exploiting design characteristics.
result DeepPeep successfully reverses-engineers compact DNN architectures.
Train a lightweight carry-on model on existing LLMs for faster customization.
problem Customizing large language models for specific tasks is computationally expensive.
method Train an additional branch of transformer blocks on the final-layer embedding of pretrained LLMs, then merge them with a carry-on module.
result Training a 100M carry-on layer requires less than 1GB GPU memory, making it scalable and affordable.
The paper reviews machine learning safety techniques for autonomous vehicles.
problem Challenges in machine learning safety for autonomous vehicles.
method Organizes practical safety techniques to complement engineering safety.
result Enhances dependability and safety of machine learning algorithms in autonomous vehicles.
We conduct an empirical study of machine learning functionalities provided by major cloud service providers, which we call machine learning clouds. Machine learning clouds hold the promise of hiding all the sophistication of running large-scale machine learning: Instead of specifying how to run a machine learning task,…
Optimal Transport enhances machine learning with new methods.
problem Comparing and manipulating probability distributions in machine learning.
method Probabilistic framework rooted in rich history and theory.
result New solutions in generative modeling and transfer learning.
The current processes for building machine learning systems require practitioners with deep knowledge of machine learning. This significantly limits the number of machine learning systems that can be created and has led to a mismatch between the demand for machine learning systems and the ability for organizations to b…
DoubleML implements machine learning for causal inference in R.
problem Estimating causal effects in regression models with high-dimensional data.
method Double machine learning framework with Neyman orthogonality and sample splitting.
result Valid inference on causal parameters using machine learning methods.
Machine learning develops rapidly, which has made many theoretical breakthroughs and is widely applied in various fields. Optimization, as an important part of machine learning, has attracted much attention of researchers. With the exponential growth of data amount and the increase of model complexity, optimization met…
Quantum computers can speed up machine learning optimization problems.
problem Long computation times and high resource requirements for classical optimization algorithms in machine learning.
method Developed a mathematical model to leverage quantum parallelism for machine learning.
result Quantum machine learning applied to a 3D time-varying image demonstrated significant speedup.
This paper reviews quantum machine learning from NISQ to fault tolerance.
problem The challenges and opportunities in quantum machine learning.
method Comprehensive review of quantum machine learning concepts.
result Coverage of NISQ and fault-tolerant quantum computing approaches.
pystacked combines machine learning models for improved predictions.
problem Improving machine learning model performance through stacking.
method Stacked generalization using Python's scikit-learn with various base learners.
result Enhanced predictive models through combining multiple machine learning algorithms.
Machine learning explores symmetries in field theory and algebra.
problem Understanding symmetries in field theory and algebra.
method Using neural networks to analyze conformal field theory and Lie algebra representation theory.
result Recent advances in machine learning have uncovered new symmetries.
In this chapter, we provide a brief overview of applying machine learning techniques for clinical prediction tasks. We begin with a quick introduction to the concepts of machine learning and outline some of the most common machine learning algorithms. Next, we demonstrate how to apply the algorithms with appropriate to…
Survey on distributed machine learning to handle large data.
problem Training large models requires vast amounts of data.
method Distribute workload across multiple machines.
result Efficient parallelization and coherent model creation.
This paper explores causal analysis in machine learning for better interpretability.
problem The lack of causality in traditional interpretable machine learning models.
method An overview of causal approaches for interpretable machine learning.
result Causal analysis improves the interpretability of machine learning models.
R package for machine learning in survival analysis.
problem Limited machine learning interfaces for survival analysis.
method Provides a comprehensive machine learning interface for survival analysis.
result Systematic infrastructure for survival modeling and evaluation.
New theory challenges traditional machine learning assumptions.
problem Traditional machine learning theories are critiqued.
method A new theory is proposed and discussed.
result Learning true probabilities is not equivalent to other learning goals.
A new process model for machine learning applications with quality assurance.
problem Lack of standard process model for machine learning applications.
method Six-phase process model with quality assurance methodology.
result Proposes a new process model for machine learning applications.
Julia accelerates machine learning in various fields with balance of efficiency and simplicity.
problem Efficiency and simplicity in machine learning algorithms.
method Developed and applied Julia language in machine learning.
result Julia balances efficiency and simplicity for machine learning.
Matched Machine Learning combines machine learning and matching for causal inference.
problem Non-interpretable methods for causal inference.
method Combines machine learning and matching for interpretable causal inference.
result Performs as well as black-box machine learning methods and better than existing matching methods.
Machine learning boosts physics research, especially at high energy experiments.
problem Finding new fundamental physics in high energy experiments.
method Review of machine learning methods and applications in high energy physics.
result Modern machine learning techniques have expanded the scope of physics research.
Study examines challenges and applications of machine learning in finance.
problem Challenges in applying machine learning to financial research due to market idiosyncrasies and methodological differences.
method Discussion of adjustments needed to conventional machine learning methodology to account for financial market peculiarities.
result Machine learning can be unified with financial research as a robust complement to econometric methods.