hugging face Hugging Face Secures $40 Million to Expand Popular NLP Library AI startup Hugging Face raises a $40 million Series B round to grow its widely used open-source natural language processing library. The company currently supports 5,000 organizations and operates as a cash-flow positive business.
microsoft Microsoft Bing Expands AI Spelling Correction to Over 100 Languages Microsoft introduces Speller100, a zero-shot spelling correction model that brings high-quality typo fixes to over 100 languages on Bing. This AI advancement eliminates the massive data requirements typically needed to train spelling tools for individual languages.
google Google Switch Transformer Achieves Massive Scale Through Efficient Routing Google Brain introduces the Switch Transformer, a one-trillion-parameter language model that pre-trains faster than its T5 predecessor by only activating relevant parts of its network at any given time.
google brain Google Releases Open-Source Switch Transformer with 1.6 Trillion Parameters Google Brain open-sources the Switch Transformer, a massive 1.6-trillion-parameter AI language model that trains up to seven times faster than its predecessor. The model achieves this speed by using a mixture-of-experts approach to keep computational costs low.
google Google Open-Sources Trillion-Parameter Switch Transformer AI Model Google Brain releases the Switch Transformer, a 1.6-trillion-parameter NLP model that trains seven times faster than its T5 predecessor. The model achieves this efficiency by using a mixture-of-experts approach to activate only a portion of its massive network for any given input.
vision transformers Vision Transformers Bring NLP Efficiency to Computer Vision Tasks Transformer models, originally famous for natural language processing tasks like GPT-3, now expand into computer vision to improve efficiency and generality. These attention-based architectures replace older recurrent models to handle visual data effectively.
google Google Unveils 1.6 Trillion Parameter Switch Transformer AI Model Google introduces the Switch Transformer, a massive AI model reaching 1.6 trillion parameters that achieves unprecedented efficiency gains. The new architecture reduces training costs while significantly improving performance over previous models.
clip OpenAI's CLIP Teaches Neural Networks to Understand Text and Images Together CLIP is an OpenAI technique that trains neural networks to match images with text descriptions using a shared vector space. This contrastive approach powers diverse applications like cross-modal retrieval and text-to-image generation.
clubhouse Clubhouse Reaches $1B Valuation as Voice AI Community Embraces Social Audio The social audio app Clubhouse skyrockets to a $1 billion valuation and nearly three million users, drawing heavy interest from the voice AI industry. Analysts predict the rise of new business categories where voice AI technologies will play a central role.
google Google Unveils Switch Transformer, a Trillion-Parameter AI Model Google Research introduces the Switch Transformer, a massive language model with 1.6 trillion parameters that uses a Mixture of Experts approach to remain computationally efficient. This new architecture is six times larger than OpenAI's GPT-3.
google brain Google Brain Unveils 1.6-Trillion Parameter Switch Transformer Google Brain introduces the Switch Transformer, a massive 1.6-trillion parameter language model that achieves a four-times pretraining speedup over the T5-XXL baseline. The model keeps computational costs under control by using a simplified Mixture of Experts routing technique.
artificial intelligence Artificial Intelligence Expands Beyond Self-Driving Into Mainstream Enterprise Scale AI CEO Alexandr Wang observes a major shift as artificial intelligence applications broaden well beyond autonomous vehicles into government, real estate, and e-commerce sectors. This diversification signals that AI is finally reaching mainstream adoption across a wide variety of industries.
ai Top 15 Machine Learning and AI Research Papers of 2020 Despite the global pandemic, 2020 produces incredible breakthroughs in artificial intelligence research, with GPT-3 leading the pack. This curated list highlights fifteen essential papers that shape the future of deep learning and machine learning.
ai Top AI Research Papers of 2020 Show Transformer Expansion and Record Submissions AI research experiences massive growth in 2020 as top conferences receive record-breaking paper submissions despite virtual formats. Researchers make significant strides by expanding transformer architectures beyond natural language processing into computer vision and protein modeling.
ai Experts Review 2020 AI Breakthroughs and Forecast 2021 Data Science Trends Industry leaders highlight the most significant AI and machine learning developments from 2020 while forecasting critical trends for the coming year. Key focus areas include ongoing NLP advancements and the shift of ethical AI from a peripheral concern to a core requirement.