Scale AI
Ever wonder who's training the AI models that power everything from your self-driving car to ChatGPT? Scale AI is the powerhouse behind the scenes, a data annotation giant that helps make AI smarter and safer. From military defense to cutting-edge LLMs, this company, valued at billions, is shaping the future of artificial intelligence in ways you might not expect!
AI Summary
Ever wonder who's training the AI models that power everything from your self-driving car to ChatGPT? Scale AI is the powerhouse behind the scenes, a data annotation giant that helps make AI smarter and safer. From military defense to cutting-edge LLMs, this company, valued at billions, is shaping the future of artificial intelligence in ways you might not expect!
Scale AI: The Secret Engine Behind Today's AI
Scale AI, Inc. is a San Francisco-based company you might not know by name, but it's playing a crucial role in the artificial intelligence revolution. Their core business? Providing the essential 'data labeling' and 'model evaluation' services that teach AI systems how to understand the world.
Training the Titans: From Self-Driving Cars to ChatGPT
Think of Scale AI as the ultimate teacher for AI. They meticulously label vast amounts of data—images, text, audio—to help AI algorithms learn. This is critical for everything from perfecting self-driving car vision to fine-tuning the massive language models (LLMs) that power conversational AIs like ChatGPT.
Ensuring AI's Safety and Smarts
Scale AI isn't just about training; it's also about safety. Their Safety, Evaluation and Alignment Lab (SEAL) is dedicated to rigorously testing and aligning LLMs. They even created 'Humanity's Last Exam,' a benchmark designed to push advanced AI systems to their limits on reasoning, alignment, and crucial safety protocols.
Who's Trusting Scale AI?
Their client list reads like a who's who of global innovators! Major commercial players like OpenAI, General Motors, Toyota, Uber, Samsung, Etsy, PayPal, and Pinterest all rely on Scale AI to refine their AI applications. They're truly powering the next generation of tech.
But it's not just tech giants; Scale AI also works directly with governments. The United States has tapped them for multiple military-related projects, demonstrating the critical national security implications of their work, and they even assist Qatar in enhancing the efficiency of its social programs.
From Startup Dream to AI Unicorn
The Early Spark (2016-2019)
Scale AI sprang to life in 2016, co-founded by Alexandr Wang and Lucy Guo through the prestigious Y Combinator incubator. After working together at Quora, they secured initial investments from major players like Dragoneer Investment Group and Tiger Global Management, setting the stage for rapid growth.
Just three years later, in August 2019, Scale AI rocketed into 'unicorn' status, boasting a valuation over $1 billion. This incredible milestone was achieved after a substantial $100 million investment led by Peter Thiel's Founders Fund, cementing its position as a rising star in the AI landscape.
Explosive Growth and Strategic Alliances (2019-2025)
The company's momentum only accelerated. In May 2021, Michael Kratsios, who served as the Chief Technology Officer of the United States under the Trump administration, joined Scale AI as its managing director and head of strategy. This brought significant government experience and connections to the team.
By July 2021, Scale AI's valuation had surged to an astounding $7 billion, fueled by a financing round led by Greenoaks, Dragoneer Investment Group, and Tiger Global Management. The demand for their essential data labeling services across diverse industries was clearly reaching new heights.
Scale AI landed a colossal $250 million contract in January 2022, granting American federal agencies access to its powerful suite of AI tools. Their technology proved crucial during the Russian invasion of Ukraine, as their Automated Damage Identification Service analyzed satellite imagery to measure building damage, providing vital data to humanitarian groups.
Their innovations didn't go unnoticed: Time magazine recognized Scale AI on its 'Best Inventions of 2022' list. They continued their strategic expansion, opening a new office in St. Louis the same year, broadening their operational footprint.
A monumental achievement arrived in May 2023 when Scale AI inked a deal with the US Army's XVIII Airborne Corps. This made them the first AI company to deploy its large language model, known as Donovan, on a highly sensitive classified network, marking a new era for AI in defense.
Scale AI deepened its ties with OpenAI in August 2023, becoming their 'preferred partner' for fine-tuning GPT-3.5. This collaboration was critical, as Scale's services were instrumental in the initial creation of the groundbreaking ChatGPT, highlighting their foundational role in generative AI.
Continuing their crucial defense work, the Department of Defense selected Scale AI in February 2024 to test and evaluate LLMs for various military applications under a significant one-year contract, underscoring their expertise in secure and reliable AI deployment.
The financial world continued to buzz around Scale AI, with its valuation hitting nearly $13 billion in March 2024 after another major funding round led by Accel. Just two months later, in May 2024, they raised an additional $1 billion, pushing their valuation to a staggering $14 billion with new investors like Amazon and Meta Platforms jumping on board!
Legal Hurdles and Ethical Debates
Despite its meteoric rise, Scale AI has faced significant challenges. In December 2024, a former employee sued the company, alleging wage theft and worker misclassification, with a second similar suit filed the following month. These claims highlight complex labor issues often encountered in the rapidly evolving AI data industry.
The controversies escalated in January 2025, when several contractors sued Scale AI, claiming psychological harm from being exposed to disturbing content during their work. This raised serious ethical questions about worker well-being in the often-unseen parts of AI development.
Amidst legal battles, Scale AI continued to push boundaries. Reports in January 2025 revealed their collaboration with Meta on 'Defense Llama,' an LLM tailored for military-style defense. They even ran a full-page ad in The Washington Post, urging then-President Donald Trump to 'win the AI war,' showcasing their bold public stance on AI's strategic importance.
Further solidifying its role in AI governance, Scale AI partnered with the Center for AI Safety to launch 'Humanity's Last Exam' in January 2025, a critical benchmark for evaluating advanced AI systems. They've also contributed to other key benchmarks like EnigmaEval, MultiChallenge, and MASK.
In February 2025, Scale AI forged a five-year partnership with the Qatari government, aiming to revolutionize public services through AI-based tools, including predictive analytics and automation. This global collaboration underlines their commitment to deploying AI for societal impact.
That same month, Scale AI was designated a third-party evaluator of AI models for the U.S. AI Safety Institute, a testament to their expertise and trusted position in the field. This role is crucial for ensuring the responsible development and deployment of AI across the nation.
March 2025 brought another monumental deal: Scale AI secured a contract with the United States Department of Defense for the 'Thunderforge' project. This ambitious initiative aims to leverage AI to dramatically speed up military decision-making by planning and executing movements of ships, planes, and other assets during both peace and wartime, working with commands like USINDOPACOM and EUCOM.
A Seismic Shift: Meta's Massive Investment
On June 10, 2025, the tech world was rocked by news: Meta Platforms agreed to acquire a 49% stake in Scale AI for an eye-popping $14.8 billion! This massive investment signifies a profound vote of confidence in Scale AI's strategic importance to the future of artificial intelligence.
Despite Meta's colossal investment, Scale AI is set to remain a standalone, independent entity. However, its founder, Alexandr Wang, will be taking a top position within Meta as part of the deal. This monumental shift also led Google, previously Scale AI's largest customer, to state its intentions to cut ties, reshaping the competitive landscape for AI data services.
The Global Workforce Powering Scale AI
Remotasks: The Engine of Data Labeling
Launched in 2017, Remotasks is Scale AI's sprawling crowdworking platform, a global network of workers dedicated to creating labeled data for machine learning. This platform is particularly vital for training AI in complex areas like computer vision and autonomous vehicles, with key operational hubs across Southeast Asia and Africa.
However, Remotasks has faced significant backlash. It's been criticized for obscuring its direct affiliation with Scale AI and for opaque communication practices. In early 2024, the platform controversially terminated operations in several countries, including Kenya, Nigeria, and Pakistan, citing 'administrative and operational considerations,' leaving many workers without income.
Concerns have also been raised regarding working conditions and compensation. Reports from places like the Philippines, where Remotasks operates through a subsidiary called Smart Ecosystem Philippines, detail allegations of 'vicious competition' driving pay for some tasks to less than one cent, frequent late payments, and workers receiving only a fraction of their promised earnings.
Outlier: The High-Skill AI Data Specialists
On the other end of the spectrum is Outlier, Scale AI's specialized contributor platform focused on advanced generative AI data work. This platform is designed for the sophisticated task of developing and fine-tuning large language models, attracting professionals with advanced degrees, deep industry expertise, and native fluency in various languages to tackle highly complex data annotation challenges.
Article
Scale AI
Scale AI, Inc. is an American artificial intelligence infrastructure and software company based in San Francisco, California. Originally focused on data annotation, the company also offers RLHF services, large language model (LLM) evaluation, and enterprise software suites to build and deploy AI applications.
The company’s research arm, the Safety, Evaluation and Alignment Lab, focuses on evaluating and aligning LLMs. It also co-created the benchmark Humanity's Last Exam. Scale AI outsources data labeling through its subsidiaries, Remotasks, which focuses on computer vision and autonomous vehicles, and Outlier, which focuses on annotating data for LLMs.
Scale AI operates an LLM Red Team that conducts human adversarial testing to identify vulnerabilities, biases, and safety risks in AI models. The team has worked with OpenAI, Google DeepMind and national AI Safety Institutes to evaluate systems against complex threats, including cybersecurity vulnerabilities, jailbreaks, and agentic AI behaviors.
Scale AI's customers in the commercial sector have included Google, Microsoft, Meta, General Motors, OpenAI, and Time. The company also directly works with world governments, including the United States on military-related projects, and with Qatar to improve the efficiency of its social programs.
In June 2025, Meta Platforms spent more than $14 billion to acquire a 49% non-voting stake in Scale AI. CEO Alexandr Wang left Scale AI to join Meta and was replaced by Jason Droege.
History
Early years (2016–2019)
Scale was founded in 2016 by Alexandr Wang and Lucy Guo through Y Combinator. The pair had worked together at Quora. Initial investors of Scale included Dragoneer Investment Group, Tiger Global Management and Index Ventures. Guo was fired in 2018.
In August 2019, after Peter Thiel’s Founders Fund made a $100 million investment in Scale, its valuation exceeded $1 billion and it acquired unicorn status.
Growth (2019–2025)
Scale contracted with the United States Department of Defense in 2020.
In May 2021, Michael Kratsios, Chief Technology Officer of the United States under the Trump administration, joined as Scale AI's managing director and head of strategy.
By July 2021, Scale had reached a valuation of $7 billion, after a financing led by Greenoaks, Dragoneer Investment Group and Tiger Global Management. There was an increased demand for data labelling from clients in different industries.
In January 2022, Scale AI won a contract worth $250 million to give American federal agencies access to its suite of tools. In February 2022, Scale AI developed its Automated Damage Identification Service in response to the Russian invasion of Ukraine. Satellite imagery was analyzed, measuring the damage to buildings, which were then geotagged and reported to humanitarian groups. In November 2022, Scale AI was recognized by Time on it’s Best Inventions of 2022 list. The company also opened an office in St. Louis in that same year.
In January 2023, Scale laid off 20% of its workforce.
In May 2023, Scale AI signed a deal with the US Army’s XVIII Airborne Corps, becoming the first AI company to deploy its LLM (known as Donovan) on a classified network.
In August 2023, Scale AI became OpenAI’s "preferred partner" to fine-tune GPT-3.5. The company's services were used to create ChatGPT. In that same month, Scale AI’s evaluation platform was used at DEF CON, a hacking convention, at its first generative-AI red team event, testing models provided by various companies.
In December 2023, Scale AI was among a list of companies that contributed to Meta Platforms’s Purple Llama initiative, a security framework for the purpose of development of open generative AI models.
In February 2024, Scale AI was selected by the Department of Defense to test and evaluate its LLMs for military purposes under a one-year contract.
In March 2024, Scale reached a valuation of almost $13 billion after Accel led another round of funding. In May 2024, Scale raised an additional $1 billion with new investors including Amazon and Meta Platforms. Its valuation reached $14 billion.
In August 2024, Scale signed an agreement with the US AI Safety Institute, collaborating with the agency on research, testing, and evaluation of the company’s AI models. The US AI Safety Institute is controlled by the Department of Commerce’s National Institute of Standards and Technology.
In December 2024, Scale was sued by a former employee, alleging that the company was committing wage theft and misclassifying workers. The following month, a second employee filed a similar suit. In January 2025, several contractors sued Scale alleging psychological harm from being exposed to disturbing content.
In January 2025, it was reported in The Conversation that Scale AI and Meta had previously teamed up to create and sell Defense Llama, an LLM product with military-style defense purposes. The company also took out a full-page ad in The Washington Post, appealing to American President Donald Trump to "win the AI war". Later in the month, Scale AI and the Center for AI Safety partnered to release Humanity's Last Exam, a benchmark test for AI systems. The company has also assisted in the development of the benchmarks EnigmaEval, MultiChallenge, and MASK.
In February 2025, Scale AI agreed to a five-year partnership with the Qatari government to improve government services via AI-based tools and training, including predictive analytics, automation, and advanced data analytics. The deal was signed at the Web Qatar 2025 Summit by Mohammed bin Ali bin Mohammed Al Mannai, the Qatari Minister of Communications and Information Technology. Also in February, the company became a third-party evaluator of AI models for the U.S. AI Safety Institute.
In March 2025, Scale AI reached a deal with the United States Department of Defense to develop the Thunderforge project. The project aims to use AI to “plan and help execute movements of ships, planes, and other assets”, with the goal of speeding up military decisions in both peace and wartime. The contract was awarded to Scale AI and other companies (such as Anduril Industries and Microsoft) by the Defense Innovation Unit, and is intended to first be used with the USINDOPACOM and EUCOM.
In April 2025, Scale AI released Scale Evaluation, a platform used to test LLMs against benchmarks to pinpoint weaknesses and flag where additional training data would improve the model.
Additional investment from Meta (2025)
On June 10, 2025, it was reported that Meta Platforms had agreed to purchase a 49% stake (non-voting) in Scale AI for $14.8 billion. The company will remain as a standalone, independent entity from Meta. Former CEO Alexandr Wang took a top position inside Meta as a part of the deal and was replaced by the company's chief strategy officer and former Uber executive, Jason Droege.
Scale Labs (March 2026)
In March 2026, the company launched Scale Labs, an expanded research division that builds upon its Safety, Evaluation, and Alignment Lab (SEAL) founded in 2023. Scale Labs serves as a hub for research into artificial intelligence model capabilities, post-training evaluation methods, enterprise deployment, and risk oversight infrastructure. The division focuses on understanding and testing the reliability of advanced, agentic, and multimodal AI systems in real-world environments, developing public benchmarks and evaluation frameworks such as SWE-Atlas and Voice Showdown.
Remotasks
Scale AI
In 2017, Scale AI established Remotasks, a crowdworking platform to support the creation of labeled data for machine learning, particularly in areas such as computer vision and autonomous vehicles. The subsidiary has facilities in Southeast Asia and Africa.
In 2019, Scale AI set up a company called Smart Ecosystem Philippines to operate Remotasks within the country. In the Philippines, many of Remotasks' hires are freelance contractors not covered under labor laws. The pay for some annotation tasks dropped to less than one cent due to "vicious competition" after Remotask expanded to India as well as Venezuela. Late payments are reportedly "commonplace", and some workers received only a few percent of their promised compensation. In 2022, an Oxford Internet Institute study said Remotasks met the "minimum standards of fair work" in only one out of ten criteria.
Remotasks has been criticized for obscuring its affiliation with Scale AI, opaque communications, and abrupt changes in worker access in some regions. In early 2024, the platform terminated operations in several countries, including Kenya, Nigeria, and Pakistan, citing administrative and operational considerations.
Outlier
Scale AI
Outlier is a separate contributor platform operated by Scale AI, designed for generative AI data work, particularly in the development and fine-tuning of LLMs. Contributors on Outlier typically include professionals with advanced degrees, industry expertise, and native fluency in various languages. Outlier tasks involve content evaluation and reinforcement learning from human feedback (RLHF).