Data Science In The Trenches

“This head of data analytics just put in their notice. You gravitate to this stuff-do you want to run the team until we find a real professional?” – COO of Operations to me in the hallway, 2016

Of course I will! It’s odd how so much of life is working hard until you get placed, by luck and by timing, to an opportunity to succeed. Since accepting I’ve been running a data science team for a ~15B enterprise on and off for 7 years. The “real professionals” chosen to run the team came and went…several times. 

The intention of this book is to guide data science leaders and their related influencers and supporters on how to create a successful data science organization within their company. The focus is not for the data first companies where applying data science will be easier for a variety of reasons. Not every company is a Google or Meta-there are infinitely more manufacturing, retail, and service companies based in America’s heartland than there are Apples and Amazons. This is data science in the trenches-it is gritty, pragmatic, and even more transformational than at the data first firms. You will face technical challenges, process challenges, and people challenges. It will be incredibly frustrating. You will fail many times. It will be one of the most rewarding things you will ever do in your professional career.

-Matt

I had the pleasure of meeting Matt during our time at UC Berkeley while we were pursuing our master’s degrees in data science. It was an extremely rewarding experience as we found ourselves connected to a tight-knit group of fellow lifelong learners and achievers. A connection that continues to this day.

I came to the Berkeley program from a background in software delivery and professional service consulting. My primary goal was to expand my skill set by embracing the world of data science, equipping myself with the tools needed to continue crafting impactful solutions for clients by leveraging the latest technology innovations.

Fast forward five years, and Matt is the US Division head of data science at one of the largest energy companies on the planet. Meanwhile, I find myself leading the charge as a practice director designing and delivering data and AI solutions at a management consulting company. I continue to do what I did before – advising and designing solutions for Fortune 500 clients – but my toolkit has expanded dramatically. Now, I work in data and AI strategy design. I create models using data science platform tools. I launch centers of excellence adopting ML lifecycle processes. I deploy real-time ML solutions using operational technologies. And then, I advise clients on the means and methods to manage all of that effectively.

In this book, I’ll share my experiences in building data and ML ecosystems for clients. Along with Matt, we’ll explore the balance between the ideal and the practical, recognizing that not all organizations start out being data-driven. In this book, there is no shame in being data-scrappy. I am delighted that Matt invited me as a collaborator in sharing these stories. Our hope is that this book can serve as a field guide to help you navigate your journey with data science, AI, and ML, no matter where you’re beginning.

-Kevin