Anthropic

Last updated
Anthropic PBC
Company type Private
Industry Artificial intelligence
Founded2021;3 years ago (2021)
Founders
Headquarters San Francisco, California, U.S.
Products Claude
Number of employees
375 (2024) [2]
Website anthropic.com

Anthropic PBC is a U.S.-based artificial intelligence (AI) startup public-benefit company, founded in 2021. It researches and develops AI to "study their safety properties at the technological frontier" and use this research to deploy safe, reliable models for the public. [3] [4] [5] Anthropic has developed a family of large language models (LLMs) named Claude as a competitor to OpenAI’s ChatGPT and Google’s Gemini. [6]

Contents

Anthropic was founded by former members of OpenAI, Daniela Amodei and Dario Amodei. [7] In September 2023, Amazon announced an investment of up to $4 billion, followed by a $2 billion commitment from Google in the following month. [8] [9] [10]

History

Dario Amodei, co-founder Dario Amodei at TechCrunch Disrupt 2023 01.jpg
Dario Amodei, co-founder

2021

Anthropic was founded in 2021 by seven former employees of OpenAI, including siblings Daniela Amodei and Dario Amodei, the latter of whom served as OpenAI's Vice President of Research. [11] [12]

2022

In April of 2022, Anthropic announced it had received $580 million in funding, [13] with $500 million of this funding coming from FTX under the leadership of Sam Bankman-Fried. [14] [15]

In the summer of 2022, Anthropic finished training the first version of Claude but did not release it, mentioning the need for further internal safety testing and the desire to avoid initiating a potentially hazardous race to develop increasingly powerful AI systems. [16]

2023

In February 2023, Anthropic was sued by Texas-based Anthrop LLC for the use of its registered trademark "Anthropic A.I." [17] On September 25, 2023, Amazon announced a partnership with Anthropic, with Amazon becoming a minority stakeholder by initially investing $1.25 billion, and planning a total investment of $4 billion. [8] As part of the deal, Anthropic would use Amazon Web Services (AWS) as its primary cloud provider and make its AI models available to AWS customers. [8] [18] The next month, Google invested $500 million in Anthropic, and committed to an additional $1.5 billion over time. [10]

2024

On March 27, 2024, Amazon maxed out its potential investment from the agreement made in the prior year by investing another US $2.75 billion into Anthropic, completing its $4 billion investment. [9]

Participants

Key employees

Board of Directors

Investors

Motives

According to Anthropic, the company’s goal is to research the safety and reliability of artificial intelligence systems. [5] The Amodei siblings were among those who left OpenAI due to directional differences, specifically regarding OpenAI's ventures with Microsoft in 2019. [12] Anthropic incorporated itself as a Delaware public-benefit corporation (PBC), which requires the company to maintain a balance between private and public interests. [32]

Anthropic is a corporate "Long-Term Benefit Trust", a company-derived entity that requires the company's directors to align the company's priorities with the public benefit rather than profit in "extreme" instances of "catastrophic risk". [33] [34] As of September 19, 2023, members of the Trust included Jason Matheny (CEO & President of the RAND Corporation), Kanika Bahl (CEO & President of Evidence Action), [35] Neil Buddy Shah (CEO of the Clinton Health Access Initiative), [36] Paul Christiano (Founder of the Alignment Research Center), [37] and Zach Robinson (CEO of Effective Ventures US). [38] [39]

Projects

Claude

Claude incorporates "Constitutional AI" to set safety guidelines for the model’s output. [40] The name, "Claude", was chosen either as a reference to mathematician Claude Shannon, or as a male name to contrast the female names of other A.I. assistants such as Alexa, Siri, and Cortana. [15]

Anthropic initially released two versions of its model, Claude and Claude Instant, in March 2023, with the latter being a more lightweight model. [41] [42] [43] The next iteration, Claude 2, was launched in July 2023. [44] Unlike Claude, which was only available to select users, Claude 2 is available for public use. [26]

Claude 3 was released on March 4, 2024, unveiling three language models: Opus, Sonnet, and Haiku. [45] [46] The Opus model is the largest and most capable—according to Anthropic, it outperforms the leading models from OpenAI (GPT-4, GPT-3.5) and Google (Gemini Ultra). [45] Sonnet and Haiku are Anthropic’s medium- and small-sized models, respectively. [45] All three models can accept image input. [45] Amazon has incorporated Claude 3 into Bedrock, an Amazon Web Services-based platform for cloud AI services. [47]

On May 1, 2024, Anthropic announced the Claude Team plan, its first enterprise offering for Claude, and Claude iOS app. [48]

Constitutional AI

According to Anthropic, Constitutional AI (CAI) is a framework developed to align AI systems with human values and ensure that they are helpful, harmless, and honest. [11] [49] Within this framework, humans provide a set of rules describing the desired behavior of the AI system, known as the "constitution". [49] The AI system evaluates the generated output and then adjusts the AI models to better fit the constitution. [49] The self-reinforcing process aims to avoid harm, respect preferences, and provide true information. [49]

Some of the principles of Claude 2’s constitution are derived from documents such as the 1948 Universal Declaration of Human Rights and Apple’s terms of service. [44] For example, one rule from the UN Declaration applied in Claude 2’s CAI states "Please choose the response that most supports and encourages freedom, equality and a sense of brotherhood." [44]

Interpretability research

Anthropic also publishes research on the interpretability of machine learning systems, focusing on the transformer architecture. [11] [50] [51]

Part of Anthropic's research aims to be able to automatically identify "features" in generative pretrained transformers like Claude. In a neural network, a feature is a pattern of neural activations that corresponds to a concept. Using a compute-intensive technique called "dictionary learning", Anthropic was able to identify millions of features in Claude, including for example one associated with the Golden Gate Bridge. Enhancing the ability to identify and edit features is expected to have significant safety implications. [52] [53] [54]

Lawsuit

On October 18, 2023, Anthropic was sued by Concord, Universal, ABKCO, and other music publishers for, per the complaint, "systematic and widespread infringement of their copyrighted song lyrics." [55] [56] [57] They alleged that the company used copyrighted material without permission in the form of song lyrics. [58] The plaintiffs asked for up to $150,000 for each work infringed upon by Anthropic, citing infringement of copyright laws. [58] In the lawsuit, the plaintiffs support their allegations of copyright violations by citing several examples of Anthropic’s Claude model outputting copied lyrics from songs such as Katy Perry’s "Roar" and Gloria Gaynor’s "I Will Survive". [58] Additionally, the plaintiffs alleged that even given some prompts that did not directly state a song name, the model responded with modified lyrics based on original work. [58]

On January 16, 2024, Anthropic claimed that the music publishers were not unreasonably harmed and that the examples noted by plaintiffs were merely bugs. [59]

See also

Related Research Articles

<span class="mw-page-title-main">Databricks</span> American software company

Databricks, Inc. is a global data, analytics and artificial intelligence company founded by the original creators of Apache Spark.

<span class="mw-page-title-main">OpenAI</span> Artificial intelligence research organization

OpenAI is an American artificial intelligence (AI) research organization founded in December 2015, researching artificial intelligence with the goal of developing "safe and beneficial" artificial general intelligence, which it defines as "highly autonomous systems that outperform humans at most economically valuable work." As one of the leading organizations of the AI boom, it has developed several large language models, advanced image generation models, and previously, released open-source models. Its release of ChatGPT has been credited with starting the AI boom.

Generative Pre-trained Transformer 3 (GPT-3) is a large language model released by OpenAI in 2020.

<span class="mw-page-title-main">GPT-2</span> 2019 text-generating language model

Generative Pre-trained Transformer 2 (GPT-2) is a large language model by OpenAI and the second in their foundational series of GPT models. GPT-2 was pre-trained on a dataset of 8 million web pages. It was partially released in February 2019, followed by full release of the 1.5-billion-parameter model on November 5, 2019.

<span class="mw-page-title-main">DALL-E</span> Image-generating deep-learning model

DALL·E, DALL·E 2, and DALL·E 3 are text-to-image models developed by OpenAI using deep learning methodologies to generate digital images from natural language descriptions known as "prompts".

OpenAI Codex is an artificial intelligence model developed by OpenAI. It parses natural language and generates code in response. It powers GitHub Copilot, a programming autocompletion tool for select IDEs, like Visual Studio Code and Neovim. Codex is a descendant of OpenAI's GPT-3 model, fine-tuned for use in programming applications.

You.com is an AI assistant that began as a personalization-focused search engine. While still offering web search capabilities, You.com has evolved to prioritize a chat-first AI assistant.

<span class="mw-page-title-main">ChatGPT</span> Chatbot and virtual assistant developed by OpenAI

ChatGPT is a chatbot and virtual assistant developed by OpenAI and launched on November 30, 2022. Based on large language models (LLMs), it enables users to refine and steer a conversation towards a desired length, format, style, level of detail, and language. Successive user prompts and replies are considered at each conversation stage as context.

A large language model (LLM) is a computational model notable for its ability to achieve general-purpose language generation and other natural language processing tasks such as classification. Based on language models, LLMs acquire these abilities by learning statistical relationships from vast amounts of text during a computationally intensive self-supervised and semi-supervised training process. LLMs can be used for text generation, a form of generative AI, by taking an input text and repeatedly predicting the next token or word.

<span class="mw-page-title-main">Generative artificial intelligence</span> AI system capable of generating content in response to prompts

Generative artificial intelligence is artificial intelligence capable of generating text, images, videos, or other data using generative models, often in response to prompts. Generative AI models learn the patterns and structure of their input training data and then generate new data that has similar characteristics.

<span class="mw-page-title-main">AI boom</span> Ongoing period of rapid progress in artificial intelligence

The AI boom, or AI spring, is an ongoing period of rapid progress in the field of artificial intelligence (AI). Prominent examples include protein folding prediction led by Google DeepMind and generative AI led by OpenAI.

Llama is a family of autoregressive large language models released by Meta AI starting in February 2023. The latest version is Llama 3 released in April 2024.

<span class="mw-page-title-main">Microsoft Copilot</span> Chatbot developed by Microsoft

Microsoft Copilot is a generative artificial intelligence chatbot developed by Microsoft. Based on a large language model, it was launched in February 2023. It is Microsoft's primary replacement for the discontinued Cortana.

Paul Christiano is an American researcher in the field of artificial intelligence (AI), with a specific focus on AI alignment, which is the subfield of AI safety research that aims to steer AI systems toward human interests. He formerly led the language model alignment team at OpenAI and became founder and head of the non-profit Alignment Research Center (ARC), which works on theoretical AI alignment and evaluations of machine learning models. In 2023, Christiano was named as one of the TIME 100 Most Influential People in AI.

<span class="mw-page-title-main">Dario Amodei</span> Italian-American entrepreneur

Dario Amodei is an Italian-American artificial intelligence researcher and entrepreneur. He is the co-founder and CEO of Anthropic, the company behind the large language model series Claude AI. He was the former vice president of research at OpenAI.

<span class="mw-page-title-main">Gemini (language model)</span> Large language model developed by Google

Gemini is a family of multimodal large language models developed by Google DeepMind, serving as the successor to LaMDA and PaLM 2. Comprising Gemini Ultra, Gemini Pro, and Gemini Nano, it was announced on December 6, 2023, positioned as a competitor to OpenAI's GPT-4. It powers the chatbot of the same name.

Aleph Alpha is an independent German artificial intelligence (AI) startup company in Heidelberg, founded by professionals with experience as employees of Apple, SAP and Deloitte. Aleph Alpha attempts to provide a full-stack sovereign technology stack for generative AI, independent from US companies and comply with European data protection regulations and the AI Act. It built one of the most powerful AI clusters inside its own data centre and develops large language models (LLM), which try to provide transparency of its sources used for the results generated and are intended for enterprises and governmental agencies only. Training of its model has been done in five European languages.

Mistral AI is a French company selling artificial intelligence (AI) products. It was founded in April 2023 by previous employees of Meta Platforms and Google DeepMind. The company raised €385 million in October 2023, and in December 2023, it was valued at more than $2 billion.

Perplexity AI is an AI chatbot-powered research and conversational search engine that answers queries using natural language predictive text. Launched in 2022, Perplexity generates answers using sources from the web and cites links within the text response. Perplexity works on a freemium model; the free product uses Anthropic's Claude 3 Haiku model combined with the company's standalone large language model (LLM) that incorporates natural language processing (NLP) capabilities, while the paid version Perplexity Pro has access to GPT-4, Claude 3, Mistral Large, Llama 3 and an Experimental Perplexity Model. As of early 2024, it has about 10 million monthly users.

Claude is a family of large language models developed by Anthropic. The first model was released in March 2023. Claude 3, released in March 2024, can also analyze images.

References

  1. Nellis, Stephen (9 May 2023). "Alphabet-backed Anthropic outlines the moral values behind its AI bot". Reuters . Archived from the original on 5 June 2023. Retrieved 4 June 2023.
  2. "Anthropic | Company Overview & News". Forbes. April 2024. Archived from the original on May 28, 2024.
  3. Vincent, James (2023-02-03). "Google invested $300 million in AI firm founded by former OpenAI researchers". The Verge. Archived from the original on 2023-02-06. Retrieved 2023-02-06.
  4. "ChatGPT must be regulated and A.I. 'can be used by bad actors,' warns OpenAI's CTO". Fortune. 5 February 2023. Archived from the original on 2023-02-06. Retrieved 2023-02-06 via finance.yahoo.com.
  5. 1 2 "Research". www.anthropic.com. Retrieved 2024-04-11.
  6. Metz, Cade (2024-03-04). "A.I. Start-Up Anthropic Challenges OpenAI and Google With New Chatbot". The New York Times. ISSN   0362-4331 . Retrieved 2024-03-07.
  7. 1 2 3 "Anthropic | Company Overview & News". Forbes. Retrieved 2024-04-11.
  8. 1 2 3 Dastin, Jeffrey (September 28, 2023). "Amazon steps up AI race with Anthropic investment". Reuters. Archived from the original on 2023-11-05. Retrieved 2023-10-02.
  9. 1 2 Coldewey, Devin (2024-03-27). "Amazon doubles down on Anthropic, completing its planned $4B investment". TechCrunch. Retrieved 2024-03-28.
  10. 1 2 3 4 Hu, Krystal (October 27, 2023). "Google agrees to invest up to $2 billion in OpenAI rival Anthropic". Reuters. Archived from the original on 2023-11-02. Retrieved 2023-10-30.
  11. 1 2 3 Henshall, Will; Perrigo, Billy (2023-09-07). "TIME100 AI 2023: Dario and Daniela Amodei". Time. Retrieved 2024-03-05.
  12. 1 2 "As Anthropic seeks billions to take on OpenAI, 'industrial capture' is nigh. Or is it?". VentureBeat. 2023-04-07. Archived from the original on 2023-05-24. Retrieved 2023-05-24.
  13. "Google invests $300 million in Anthropic as race to compete with ChatGPT heats up". VentureBeat. 2023-02-03. Archived from the original on 2023-02-06. Retrieved 2023-02-06.
  14. Sigalos, MacKenzie (2024-03-25). "FTX estate selling majority stake in AI startup Anthropic for $884 million, with bulk going to UAE". CNBC. Retrieved 2024-04-11.
  15. 1 2 3 4 Roose, Kevin (11 July 2023). "Inside the White-Hot Center of A.I. Doomerism". The New York Times. Archived from the original on 12 July 2023. Retrieved 13 July 2023.
  16. Perrigo, Billy (2024-05-30). "Inside Anthropic, the AI Company Betting That Safety Can Be a Winning Strategy". Time. Retrieved 2024-06-02.
  17. Setty, Riddhi (2023-02-23). "Anthropic A.I. Sues AI Company for Trademark Infringement". Bloomberg Law. Archived from the original on 2023-02-22. Retrieved 2023-02-23.
  18. "Amazon and Anthropic announce strategic collaboration to advance generative AI". US About Amazon (Press release). 2023-09-25. Archived from the original on 2023-09-25. Retrieved 2023-09-25.
  19. Lin, Belle. "Welcome to the Era of BadGPTs". WSJ. Retrieved 2024-04-11.
  20. Lin, Belle. "Google and Anthropic Are Selling Generative AI to Businesses, Even as They Address Its Shortcomings". WSJ. Retrieved 2024-04-11.
  21. Tracy, Ryan. "Risks Posed by AI Technology Spur Calls for New Regulatory Agency". WSJ. Retrieved 2024-04-11.
  22. "Jack Clark : AI Expert". oecd.ai. Retrieved 2024-04-11.
  23. Pierce, David (May 15, 2024). "Instagram's co-founder is Anthropic's new chief product officer". The Verge.
  24. Wiggers, Kyle (May 15, 2024). "Anthropic hires Instagram co-founder as head of product". TechCrunch.
  25. Robison, Kylie (May 28, 2024). "OpenAI researcher who resigned over safety concerns joins Anthropic". VentureBeat.
  26. 1 2 3 4 5 Matthews, Dylan (17 July 2023). "The $1 billion gamble to ensure AI doesn't destroy humanity". Vox. Archived from the original on 3 October 2023. Retrieved 23 July 2023.
  27. "Anthropic Raises $450 Million in Series C Funding to Scale Reliable AI Products". www.anthropic.com. Retrieved 2024-04-11.
  28. Erin Griffith and Cade Metz: Inside the Funding Frenzy at Anthropic, One of A.I.’s Hottest Start-Ups. In: NYT, 20 February 2024. Retrieved 20 February 2024.
  29. "Anthropic". Wisdom Ventures. Retrieved 2024-04-11.
  30. "Ripple Impact Investments". Ripple Impact Investments. Retrieved 2024-04-11.
  31. "Factorial Funds | Portfolio". Factorial Funds. Retrieved 2024-04-11.
  32. "Our response to the UK Government's internal AI safety policy enquiries". www.anthropic.com. Retrieved 2024-04-11.
  33. "The Long-Term Benefit Trust". www.anthropic.com. Retrieved 2024-04-11.
  34. Morley, John; Berger, David; Simmerman, Amy. "Anthropic Long-Term Benefit Trust". Harvard Law School Forum on Corporate Governance. Retrieved 2024-04-03.
  35. "Kanika Bahl". Evidence Action. Retrieved 2024-04-11.
  36. Miller, Scott (2022-04-14). "CHAI Board of Directors announces appointment of Dr. Neil Buddy Shah as Chief Executive Officer". Clinton Health Access Initiative. Retrieved 2024-04-11.
  37. Klein, Ezra (2023-03-12). "Opinion | This Changes Everything". The New York Times. ISSN   0362-4331 . Retrieved 2024-04-11.
  38. "Effective Ventures Foundation USA, Inc". Effective Ventures. Retrieved 2024-04-11.
  39. "The Long-Term Benefit Trust". www.anthropic.com. Retrieved 2024-04-11.
  40. Roose, Kevin (2023-10-17). "What if We Could All Control A.I.?". The New York Times. ISSN   0362-4331 . Retrieved 2024-04-11.
  41. Drapkin, Aaron (2023-10-27). "What Is Claude AI and Anthropic? ChatGPT's Rival Explained". Tech.co. Retrieved 2024-04-11.
  42. Deborah, Yao (2023-08-11). "Anthropic's Claude Instant: A Smaller, Faster and Cheaper Language Model". AI Business. Retrieved 2024-04-09.
  43. Sharon, Goldman (2023-03-14). "OpenAI rival Anthropic introduces Claude, an AI assistant to take on ChatGPT". Venture Beat. Retrieved 2024-04-09.
  44. 1 2 3 Milmo, Dan (12 July 2023). "Claude 2: ChatGPT rival launches chatbot that can summarise a novel". The Guardian. Archived from the original on 8 November 2023. Retrieved 13 July 2023.
  45. 1 2 3 4 Nuñez, Michael (2024-03-04). "Anthropic unveils Claude 3, surpassing GPT-4 and Gemini Ultra in benchmark tests". Venture Beat. Retrieved 2024-04-09.
  46. "Introducing the next generation of Claude" . Retrieved 4 March 2024.
  47. "Amazon adds Claude 3, which beats GPT-4, to Bedrock". Venture Beat. March 4, 2024.
  48. Field, Hayden (May 1, 2024). "Amazon-backed Anthropic launches iPhone app and business tier to compete with OpenAI's ChatGPT". CNBC . Retrieved May 3, 2024.
  49. 1 2 3 4 Bai, Yuntao; Kadavath, Saurav; Kundu, Sandipan; Askell, Amanda; Kernion, Jackson; Jones, Andy; Chen, Anna; Goldie, Anna; Mirhoseini, Azalia (2022-12-15). "Constitutional AI: Harmlessness from AI Feedback". arXiv: 2212.08073 [cs.CL].
  50. "Transformer Circuits Thread". transformer-circuits.pub. Archived from the original on 2023-02-04. Retrieved 2023-02-09.
  51. "Towards Monosemanticity: Decomposing Language Models With Dictionary Learning". Archived from the original on 9 October 2023. Retrieved 10 October 2023.
  52. Ropek, Lucas (2024-05-21). "New Anthropic Research Sheds Light on AI's 'Black Box'". Gizmodo. Retrieved 2024-05-23.
  53. Perrigo, Billy (2024-05-21). "Artificial Intelligence Is a 'Black Box.' Maybe Not For Long". Time. Retrieved 2024-05-24.
  54. Adly Templeton*, Tom Conerly*, Jonathan Marcus, Jack Lindsey, Trenton Bricken, Brian Chen, Adam Pearce, Craig Citro, Emmanuel Ameisen, Andy Jones, Hoagy Cunningham, Nicholas L Turner, Callum McDougall, Monte MacDiarmid, Alex Tamkin, Esin Durmus, Tristan Hume, Francesco Mosconi, C. Daniel Freeman, Theodore R. Sumers, Edward Rees, Joshua Batson, Adam Jermyn, Shan Carter, Chris Olah, Tom Henighan Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet, Anthropic, retrieved 24 May 2024
  55. Times, Financial (2023-10-19). "Universal Music sues AI start-up Anthropic for scraping song lyrics". Ars Technica . Retrieved 2024-03-09.
  56. David, Emilia (2023-10-19). "Universal Music sues AI company Anthropic for distributing song lyrics". The Verge. Retrieved 2024-03-09.
  57. Court Docket for Concord Music Group v Anthropic , per CourtListener.
  58. 1 2 3 4 Masse, Bryson (2023-10-19). "Major music publishers sue Anthropic for copyright infringement over song lyrics". VentureBeat. Retrieved 2024-04-08.
  59. Brittain, Blake (2024-01-17). "Anthropic fires back at music publishers' AI copyright lawsuit". Reuters. Retrieved 2024-04-07.