AI Model Simulates 500 Million Years of Evolution to create new Proteins! ESM3 is a LLM for Biology

The video showcases the development of the ESM3 AI model, which simulates 500 million years of evolution to create new proteins with unprecedented control. Additionally, it discusses the Soo AI chip by Etched, claimed to be the fastest AI chip ever made, which can run large language models over 10 times faster than Nvidia’s Next Generation Blackwell chip, potentially revolutionizing AI processing speeds.

In the video, a new AI model called ESM3 has been developed that simulates 500 million years of evolution to create new proteins. Proteins are essential for life and have various functions, from powering motion to information processing in organisms. The ESM3 model is designed to program and create proteins using the code of life, allowing for the engineering of biology from first principles. By tokenizing biological properties of proteins into sequences, structures, and functions, the AI model can reason over these fundamental properties and generate new proteins with unprecedented control.

The ESM3 model bridges sequence, structure, and function within the same language model, enabling scientists to prompt the model to propose potential scaffolds for active sites of enzymes. This capability opens up possibilities for designing proteins that can break down plastic waste and solve other challenging protein design tasks. The AI model can provide feedback to improve the quality of its own protein generations and has the ability to achieve atomic-level accuracy in structure generation. By simulating evolution and generating new proteins, the ESM3 model offers a powerful tool for advancing biotechnology and protein engineering.

The ESM3 model was able to generate a new glowing protein, ESM GFP, which was 58% different from the closest known fluorescent protein. Through multimodal prompting and reasoning, the model produced proteins with similar brightness to natural glowing proteins, including the brightest one, C10. The model is open-source, with the code and model releases available for research and non-profit use. The goal is to accelerate progress in understanding and engineering proteins, ultimately maximizing positive impact for the world.

In addition to the ESM3 model, another company called Etched has developed what they claim to be the fastest AI chip of all time, called Soo. This chip can run large language models like LLAMAs at over 500,000 tokens per second, making it more than 10 times faster than Nvidia’s Next Generation Blackwell chip. The Soo chip is specialized for running inference on Transformer models, offering faster and cheaper performance compared to other GPUs. The development of these AI chips presents new competition for Nvidia and has the potential to advance the capabilities of AI technology in various applications.

Overall, the video highlights the significant advancements in AI technology, particularly in protein engineering and AI chip development. The ESM3 model demonstrates the power of simulating evolution to create new proteins, while the Soo chip from Etched promises to revolutionize AI processing speeds for large language models. These innovations have the potential to drive progress in biotechnology, protein engineering, and AI applications, opening up new possibilities for research and development in the field of artificial intelligence.