Google Brain is an artificial intelligence research team that works at Google AI – a Google division dedicated exclusively to AI research and development.
The division was started in 2011 by Andrew Ng who named it the “Deep Learning Project at Google”. Ng was soon joined by fellow Google engineer Jeff Dean and researcher Greg Corrado, with much of the initial work part-time and only conducted in the employee’s “20 percent time”.
Below, we’ll chart a brief history of Google Brain and highlight some of the division’s proudest achievements to date.
Google Brain was initially conceived as a way to build deep learning processes over the top of Google’s existing infrastructure. This vision was clarified in a 2012 post in which Ng and Dean described a system (later known as DistBelief) that could distinguish between pictures of motorcycles and cars.
Instead of feeding the system labeled images, the pair showed it 10 million YouTube videos over a week based on a belief that it would learn to identify unlabeled images. After the week-long period, the neural network comprised of 16,000 computer processors had acquired unintended knowledge and had learned to identify cat.s
As Ng explained in The New York Times: “The remarkable thing was that [the system] had discovered the concept of a cat itself. No one had ever told it what a cat is. That was a milestone in machine learning.’
While neither the blog post nor the accompanying paper mentions Google Brain explicitly, the work undertaken was part of the Google Brain project.
DNNresearch Inc. acquisition
In March 2013, Google acquired Toronto-based neural networks start-up DNNresearch Inc.
As part of the deal, DNNresearch founder Geoffrey Hinton, a world-renowned neural net researcher, joined Google with two of his graduate students in Alex Krizhevsky and Ilya Sutskever (who would later co-found OpenAI).
The announcement also coincided with a $600,000 gift from Google to Hinton’s research team to support further research into neural nets. Hinton subsequently started a branch of Google Brain in Toronto.
Google Brain graduates
With the team afforded the space and time to prove the Google Brain tech, there was confidence that it could be used in other applications.
Google Brain thus graduated from Google X (now known as X, the moonshot factory) in late 2012 and became part of Google AI.
Google announced in November 2015 that it had created a new machine learning system known as TensorFlow. The software was made open source to both benefit Google and advanced the wider industry, and some saw it as the point at which Google started to pivot from a search company to an AI company.
TensorFlow was the successor of DistBelief and powers features such as Android’s speech recognition system, the search function in Google Photos, and the “smart reply” function in the inbox app. It can also be found in YouTube video recommendations and many other contexts.
Google Brain is verified
On April 6, 2016, Hacker News shared the Google Brain team page on its website. This data potentially marked the first time the team name had been used in the public arena.
Two months later, Google Brain released Magenta, a machine learning project that could generate art and music. In September, Google introduced the Google Neural Machine Translation (GNMT) system to increase the fluency and accuracy of Google Translate.
The announcement post, which was written by Google research scientists, once more publicly acknowledge that the Google Brain team existed by thanking them for their contributions.
- Google Brain is an artificial intelligence research team that works at Google AI – a Google division dedicated exclusively to AI research and development. The division was started in 2011 by Andrew Ng who named it the “Deep Learning Project at Google”.
- Google Brain was initially conceived as a way to build deep learning processes over the top of Google’s existing infrastructure. Much of the early work on the project was done in the “20% time” where employees pursue side projects.
- Google announced in November 2015 that it created a new machine learning system known as TensorFlow. This system is present in many features across Google’s product suite and was made open-source to advance the industry and in the process, position the company as a leader.
Read Next: History of OpenAI, AI Business Models, AI Economy.
Connected Business Model Analyses
OpenAI Organizational Structure
Stability AI Ecosystem