Experimentation for Engineers: From A/B testing to Bayesian optimization

相似文件 换一批

是 否 +2 论坛币

k人 参与回答

经管之家送您一份

应届毕业生专属福利!

求职就业群

赵安豆老师微信：zhaoandou666

经管之家联合CDA

送您一个全额奖学金名额~ !

立即领取

感谢您参与论坛问题回答

经管之家送您两个论坛币！

+2 论坛币

Experimentation for Engineers: From A/B testing to Bayesian optimization

Optimize the performance of your systems with practical experiments used by engineers in the world’s most competitive industries.

In Experimentation for Engineers: From A/B testing to Bayesian optimization you will learn how to:

• Design, run, and analyze an A/B test
• Break the "feedback loops" caused by periodic retraining of ML models
• Increase experimentation rate with multi-armed bandits
• Tune multiple parameters experimentally with Bayesian optimization
• Clearly define business metrics used for decision-making
• Identify and avoid the common pitfalls of experimentation
  

Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You’ll start with a deep dive into methods like A/B testing, and then graduate to advanced techniques used to measure performance in industries such as finance and social media. Learn how to evaluate the changes you make to your system and ensure that your testing doesn’t undermine revenue or other business metrics. By the time you’re done, you’ll be able to seamlessly deploy experiments in production while avoiding common pitfalls.

about the technologyDoes my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world’s most competitive industries that will help you enhance machine learning systems, software applications, and quantitative trading solutions.
about the bookExperimentation for Engineers: From A/B testing to Bayesian optimization delivers a toolbox of processes for optimizing software systems. You’ll start by learning the limits of A/B testing, and then graduate to advanced experimentation strategies that take advantage of machine learning and probabilistic methods. The skills you’ll master in this practical guide will help you minimize the costs of experimentation and quickly reveal which approaches and features deliver the best business results.
table of contents

You can see this entire book for free. Click anywhere in the table of contents to start reading

• OPTIMIZING SYSTEMS BY EXPERIMENTREAD IN LIVEBOOK
• A/B TESTING: EVALUATING A MODIFICATION TO YOUR SYSTEMREAD IN LIVEBOOK
• MULTI-ARMED BANDITS: MAXIMIZING BUSINESS METRICS WHILE EXPERIMENTINGREAD IN LIVEBOOK
• RESPONSE SURFACE METHODOLOGY: OPTIMIZING CONTINUOUS PARAMETERSREAD IN LIVEBOOK
• CONTEXTUAL BANDITS: MAKING TARGETED DECISIONSREAD IN LIVEBOOK
• BAYESIAN OPTIMIZATION: AUTOMATING EXPERIMENTAL OPTIMIZATIONREAD IN LIVEBOOK
• MANAGING BUSINESS METRICSREAD IN LIVEBOOK
• PRACTICAL CONSIDERATIONSREAD IN LIVEBOOK
• APPENDIX A: LINEAR REGRESSION AND THE NORMAL EQUATIONSREAD IN LIVEBOOK
• APPENDIX B: ONE FACTOR AT A TIME
• APPENDIX C: GAUSSIAN PROCESS REGRESSION
  
  what's inside
  
  • Design, run, and analyze an A/B test
  • Break the “feedback loops” caused by periodic retraining of ML models
  • Increase experimentation rate with multi-armed bandits
  • Tune multiple parameters experimentally with Bayesian optimization
    
  
  about the readerFor ML and software engineers looking to extract the most value from their systems. Examples in Python and NumPy.
  about the authorDavid Sweet has worked as a quantitative trader at GETCO and a machine learning engineer at Instagram. He teaches in the AI and Data Science master's programs at Yeshiva University
  

扫码加我 拉你入群

请注明：姓名-公司-职位

以便审核进群资格，未注明则拒绝

关键词：Optimization experiment Engineers Engineer Bayesian