Jeff Dean is an engineer and computer scientist who has been the head of Google AI since 2018.
The University of Minnesota – where Dean received a Bachelor of Science in Computer Science & Economics – once described him as the man who “masterminded many of the behind-the-scenes products that have helped his employer, Google, dominate the internet.”
Table of Contents
Early career
Dean received his Ph.D. in Computer Science from the University of Washington in 1996 and then joined Compaq’s Western Research Laboratory (WRL) in September of the same year. At the laboratory, his work focused on microprocessor architecture, information retrieval, and profiling tools.
He invented a hardware performance monitoring technique that made it possible to determine which instructions were experiencing cache misses and other events that debilitated performance. The technique, known as ProfileMe, was incorporated into all new Alpha microprocessors and was relatively low-cost.
More notably, Dean designed algorithms for information retrieval on the World Wide Web that found related websites and ranked query results. These algorithms were later implemented by the AltaVista search engine group.
mySimon Inc.
Dean left Compaq in January 1999 and then spent the next seven months at mySimon. As a Senior Member of Technical Staff, he was part of a team that created a system for the retrieval and caching of eCommerce content.
Over the rest of his time at the company, Dean worked on a comparison shopping service that included content from product specifications and reviews. He also developed a tracking system to analyze shopper behavior.
Google
Early years
Dean joined Google in August 1999 and has remained with the company in several capacities ever since.
As touched on earlier, Dean was instrumental in the development of advertising, crawling, indexing, and query serving systems as Google grew at a rapid pace and needed to digest increasingly large amounts of data.
Dean also worked with Sanjay Ghemawat to write code that compensated for a rising prevalence of hardware failures as the company expanded. He also developed algorithms to increase the quality and relevancy of AdSense ads and assisted Krishna Bharat to transition Google News from a prototype into a deployed system.
Google Brain
Sometime in 2011, Dean started to collaborate with Andrew Ng who was leading a secret neural network project at Google. Dean had worked with neural nets as an undergraduate, but they had been unable to solve real-world problems.
Ng told him that the field was evolving quickly and that Stanford researchers had achieved some impressive results after obtaining access to large volumes of data. Dean reportedly filled his bathroom with textbooks to brush up on the subject and was soon spending one day per week at Google Brain.
Google Engineer Claire Cui noted that Dean’s involvement in the project over the next seven years marked a turning point for the company’s AI efforts: “There were people who believed in it, and there were people who didn’t believe in it. Jeff proved that it can work.”
Some of the products in development over this time include the Tensor Processing Unit and AutoML system that utilizes neural nets to design other neural nets.
Google AI
Dean took the helm of Google AI in April 2018 as part of a reshuffle. Previously, Google’s AI product development (along with search) had been managed by SVP of Engineering John Giannandrea.
When Google merged its DeepMind and Brain research teams five years later, Fortune noted that Dean would become the company’s chief scientist and move out of his existing management-focused role.
Among other endeavors, he would report directly to CEO Sundar Pichai and help develop new, more capable AI systems.
Key takeaways:
Jeff Dean is an engineer and computer scientist who has been the head of Google AI since 2018. The University of Minnesota once described him as the man who “masterminded many of the behind-the-scenes products that have helped his employer, Google, dominate the internet.”
Dean joined Google in August 1999 and has remained with the company in several capacities ever since. Early on, he was instrumental in the development of advertising, crawling, indexing, and query serving systems as Google grew at a rapid pace and needed to digest increasingly large amounts of data.
Years later, Dean met Andrew Ng with both becoming early members of the Google Brain project. Dean’s passion for (and belief in) AI was a key turning point for Google according to one engineer, and he would later develop TensorFlow, the Tensor Processing Unit, and AutoML. After a corporate reshuffle, Dean became Google’s chief scientist in charge of former DeepMind and Brain teams.
Key Highlights
Overview of Jeff Dean:
Jeff Dean is a prominent computer scientist and engineer who has been the head of Google AI since 2018.
Known for his integral role in developing various critical systems at Google, he has been described as the mastermind behind many behind-the-scenes products that have contributed to Google’s dominance on the internet.
Dean earned his Bachelor of Science in Computer Science & Economics from the University of Minnesota.
He joined Google in August 1999 and has remained with the company in various capacities.
Dean played a significant role in developing advertising, crawling, indexing, and query serving systems at Google during its rapid expansion.
Google Brain and AI Efforts:
In collaboration with Andrew Ng, Dean started working on the Google Brain project in 2011, marking a turning point for Google’s AI initiatives.
Dean’s involvement in Google Brain demonstrated the feasibility of neural networks for real-world applications.
He played a crucial role in leading the development of TensorFlow, a widely used open-source machine learning framework.
Under Dean’s leadership, Google Brain worked on significant projects like the Tensor Processing Unit (TPU) and AutoML, which uses neural networks to design other neural networks.
In 2018, Dean became the head of Google AI as part of a reshuffle in the company’s AI leadership.
He oversees Google’s AI research and development efforts, and his work is instrumental in shaping the company’s advancements in artificial intelligence.
Following the merger of Google’s DeepMind and Brain research teams, Dean became the company’s chief scientist, focusing on developing advanced AI systems and technologies.
Direct Contributions and Leadership:
Dean’s contributions have had a profound impact on Google’s growth, particularly in the areas of AI and machine learning.
He has played a key role in developing core technologies, leading research projects, and advancing AI infrastructure.
Large language models (LLMs) are AI tools that can read, summarize, and translate text. This enables them to predict words and craft sentences that reflect how humans write and speak.
Prompt engineering is a natural language processing (NLP) concept that involves discovering inputs that yield desirable or useful results.
Like most processes, the quality of the inputs determines the quality of the outputs in prompt engineering. Designing effective prompts increases the likelihood that the model will return a response that is both favorable and contextual.
Developed by OpenAI, the CLIP (Contrastive Language-Image Pre-training) model is an example of a model that utilizes prompts to classify images and captions from over 400 million image-caption pairs.
OpenAI is an artificial intelligence research laboratory that transitioned into a for-profit organization in 2019. The corporate structure is organized around two entities: OpenAI, Inc., which is a single-member Delaware LLC controlled by OpenAI non-profit, And OpenAI LP, which is a capped, for-profit organization. The OpenAI LP is governed by the board of OpenAI, Inc (the foundation), which acts as a General Partner. At the same time, Limited Partners comprise employees of the LP, some of the board members, and other investors like Reid Hoffman’s charitable foundation, Khosla Ventures, and Microsoft, the leading investor in the LP.
OpenAI has built the foundational layer of the AI industry. With large generative models like GPT-3 and DALL-E, OpenAI offers API access to businesses that want to develop applications on top of its foundational models while being able to plug these models into their products and customize these models with proprietary data and additional AI features. On the other hand, OpenAI also released ChatGPT, developing around a freemium model. Microsoft also commercializes opener products through its commercial partnership.
OpenAI and Microsoft partnered up from a commercial standpoint. The history of the partnership started in 2016 and consolidated in 2019, with Microsoft investing a billion dollars into the partnership. It’s now taking a leap forward, with Microsoft in talks to put $10 billion into this partnership. Microsoft, through OpenAI, is developing its Azure AI Supercomputer while enhancing its Azure Enterprise Platform and integrating OpenAI’s models into its business and consumer products (GitHub, Office, Bing).
Stability AI is the entity behind Stable Diffusion. Stability makes money from our AI products and from providing AI consulting services to businesses. Stability AI monetizes Stable Diffusion via DreamStudio’s APIs. While it also releases it open-source for anyone to download and use. Stability AI also makes money via enterprise services, where its core development team offers the chance to enterprise customers to service, scale, and customize Stable Diffusion or other large generative models to their needs.
Gennaro is the creator of FourWeekMBA, which reached about four million business people, comprising C-level executives, investors, analysts, product managers, and aspiring digital entrepreneurs in 2022 alone | He is also Director of Sales for a high-tech scaleup in the AI Industry | In 2012, Gennaro earned an International MBA with emphasis on Corporate Finance and Business Strategy.
