Just yesterday, I shared about a popular science book about Bayes. Today I started a new one, called Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing. I picked it because I want to learn more about the industry standard way of doing controlled experiments, an area where I have some experience. This particular book started well.
Even the first chapters show that the authors do have experience I can relate to and can, hopefully, learn from.
This quote, for example, is included in their preface:
Any figure that looks interesting or different is usually wrong
It matches my experience with overly positive results or ambitious claims in analysis. Can’t tell you how many times I’ve fallen into the trap of believing something wins big time while there was really just a mistake, or a bias of some kind, twisting the results. But I had no clue someone postulated a law on it and got a Wikipedia page about it. I can now cite it and gain mana points 😀
So, I have a good feeling about this book and I hope to be able to complete it much faster than the last one. It just starts well.
Unfortunately, my copy arrived with significant damage. It was improperly packaged and delivered poorly. However, it is a book I read with a pen, underlining what I think is important, and leaving notes inside, so it will not get any better anyway.
Veselin.blog 