{"id":9006,"date":"2025-07-21T16:47:25","date_gmt":"2025-07-21T13:47:25","guid":{"rendered":"https:\/\/handoli.com\/index.php\/2025\/07\/21\/meta-llama-3-1-405b-may-spark-a-tectonic-shift-in-the-llm-market-adoption\/"},"modified":"2025-07-21T16:47:25","modified_gmt":"2025-07-21T13:47:25","slug":"meta-llama-3-1-405b-may-spark-a-tectonic-shift-in-the-llm-market-adoption","status":"publish","type":"post","link":"https:\/\/handoli.com\/index.php\/2025\/07\/21\/meta-llama-3-1-405b-may-spark-a-tectonic-shift-in-the-llm-market-adoption\/","title":{"rendered":"Meta Llama 3.1 405B May Spark a Tectonic Shift in the LLM Market Adoption"},"content":{"rendered":"<div class=\"captioned-image-container\">\n<figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!Ywj5!,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e46dc62-9ce2-469b-ab4a-f79bb0de652a_1200x675.png\" data-component-name=\"Image2ToDOM\">\n<div class=\"image2-inset\"><img fetchpriority=\"high\" decoding=\"async\" src=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!Ywj5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e46dc62-9ce2-469b-ab4a-f79bb0de652a_1200x675.png\" width=\"1200\" height=\"675\" data-attrs='{\"src\":\"https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/9e46dc62-9ce2-469b-ab4a-f79bb0de652a_1200x675.png\",\"srcNoWatermark\":null,\"fullscreen\":null,\"imageSize\":null,\"height\":675,\"width\":1200,\"resizeWidth\":null,\"bytes\":900813,\"alt\":null,\"title\":null,\"type\":\"image\/png\",\"href\":null,\"belowTheFold\":false,\"topImage\":true,\"internalRedirect\":null,\"isProcessing\":false,\"align\":null,\"offset\":false}' class=\"sizing-normal\" alt=\"\"\/>\n<div class=\"image-link-expand\">\n<div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\">\n<div class=\"pencraft pc-reset icon-container restack-image\"><\/div>\n<div class=\"pencraft pc-reset icon-container view-image\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p><\/p><\/a><\/figure>\n<\/div>\n<p>The large language model (LLM) market has experienced several noted upheavals in 2024. New models have emerged to challenge OpenAI\u2019s unmatched quality supremacy of 2023 to the point where there are several leading foundation models that can legitimately claim to be \u201cmarket-leading.\u201d <\/p>\n<ul>\n<li>\n<p>Google <a href=\"https:\/\/synthedia.substack.com\/p\/google-gemini-15-and-flash-llms-show\">Gemini 1.5<\/a> introduced an industry-leading 1 million, then a 2 million token context window along with public LLM benchmark scores nearing OpenAI\u2019s leading models.<\/p>\n<\/li>\n<li>\n<p>Anthropic\u2019s <a href=\"https:\/\/synthedia.substack.com\/p\/anthropic-sonnet-35-sets-new-benchmark\">Claude 3.5 Sonnet<\/a> showed public benchmark results that beat those of OpenAI\u2019s GPT-4.<\/p>\n<\/li>\n<li>\n<p>OpenAI introduced <a href=\"https:\/\/synthedia.substack.com\/p\/accolades-for-openais-gpt-4o-are\">GPT-4o<\/a>, the latest multi-modal AI foundation model demonstrating industry-leading performance across numerous benchmarks.  <\/p>\n<\/li>\n<\/ul>\n<p>The result is greater user choice of AI frontier models. Frontier models are the LLMs and multimodal AI models that include the most impressive features, quality, and benchmark performance results. To date, this category has been dominated by proprietary models. Meta\u2019s Llama 3.1 405B deserves recognition as the first open model to join the elite frontier model category. The implications are significant. <\/p>\n<h2>From Niche Leader to Overall Competitor<\/h2>\n<p>Meta made headlines in 2023 when it introduced the first <a href=\"https:\/\/synthedia.substack.com\/p\/meta-just-became-a-big-player-in\">Llama 2 70B model<\/a>. It did not deliver the same performance as GPT-4, the leading model at the time. However, it was the most impressive LLM in the open model category, which meant it was free for nearly anyone to use\u2014provided the developer could set up the servers, manage the installation, and pay some fairly hefty cloud computing bills. <\/p>\n<p>With the July 2023 release, Meta carved out a leadership spot in the open LLM category. Offerings from X.ai, Databricks, and TII sought to challenge Meta\u2019s leadership throughout late 2023 and into 2024. Meta reasserted its clear open model leadership credentials with Llama 3 early this year. <\/p>\n<p>Llama 3.1 405B moves Meta up a notch. It retains and extends Meta\u2019s lead in the open model category. The new release also places Meta among the leaders in frontier LLMs alongside OpenAI, Anthropic, and Google. This is particularly noteworthy when considering findings from a16z research earlier in 2024.<\/p>\n<div class=\"captioned-image-container\">\n<figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!imyV!,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f39e67c-fec1-4119-ad22-850b83b44025_1500x808.png\" data-component-name=\"Image2ToDOM\">\n<div class=\"image2-inset\"><img decoding=\"async\" src=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!imyV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f39e67c-fec1-4119-ad22-850b83b44025_1500x808.png\" width=\"1456\" height=\"784\" data-attrs='{\"src\":\"https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/2f39e67c-fec1-4119-ad22-850b83b44025_1500x808.png\",\"srcNoWatermark\":null,\"fullscreen\":null,\"imageSize\":null,\"height\":784,\"width\":1456,\"resizeWidth\":null,\"bytes\":345553,\"alt\":null,\"title\":null,\"type\":\"image\/png\",\"href\":null,\"belowTheFold\":false,\"topImage\":false,\"internalRedirect\":null,\"isProcessing\":false,\"align\":null,\"offset\":false}' class=\"sizing-normal\" alt=\"\"\/>\n<div class=\"image-link-expand\">\n<div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\">\n<div class=\"pencraft pc-reset icon-container restack-image\"><\/div>\n<div class=\"pencraft pc-reset icon-container view-image\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p><\/p><\/a><\/figure>\n<\/div>\n<p>Forty-one percent of enterprises that have already deployed generative AI expect to  increase the adoption of \u201copen-source\u201d models when they match performance with the leading proprietary models. Llama 3.1 405B will put that sentiment to the test. Comparable performance has arrived.<\/p>\n<h2>Leveled Up Performance <\/h2>\n<p>The evidence of Llama 3.1 405B\u2019s performance rise can be seen in its improved scores on popular public LLM benchmarks. Its MMLU scores surpass GPT-4 and nearly match GPT-4o and Claude 3.5 Sonnet. Llama 3.1 also showed standout performance in reasoning, math, and long-context benchmarks. <\/p>\n<div class=\"captioned-image-container\">\n<figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!ceeF!,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3040e49e-7df7-4974-bc1c-faeee52284a2_1800x1247.png\" data-component-name=\"Image2ToDOM\">\n<div class=\"image2-inset\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!ceeF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3040e49e-7df7-4974-bc1c-faeee52284a2_1800x1247.png\" width=\"1456\" height=\"1009\" data-attrs='{\"src\":\"https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/3040e49e-7df7-4974-bc1c-faeee52284a2_1800x1247.png\",\"srcNoWatermark\":null,\"fullscreen\":null,\"imageSize\":null,\"height\":1009,\"width\":1456,\"resizeWidth\":null,\"bytes\":401806,\"alt\":null,\"title\":null,\"type\":\"image\/png\",\"href\":null,\"belowTheFold\":true,\"topImage\":false,\"internalRedirect\":null,\"isProcessing\":false,\"align\":null,\"offset\":false}' class=\"sizing-normal\" alt=\"\" loading=\"lazy\"\/>\n<div class=\"image-link-expand\">\n<div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\">\n<div class=\"pencraft pc-reset icon-container restack-image\"><\/div>\n<div class=\"pencraft pc-reset icon-container view-image\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p><\/p><\/a><\/figure>\n<\/div>\n<p>Comparing LLMs based on public benchmarks can be useful but doesn\u2019t necessarily tell users the entire story of model performance. Model developers selectively publish benchmark results, and strong results for a handful of tests don\u2019t necessarily translate into an optimal selection for a specific use case. Still, the benchmarks represent objective analyses of quality that users can consult before implementing or testing a model.  <\/p>\n<p>A key reason the 405B model performs so well is the data volume and quality used in training. It was trained on 15 trillion tokens. The new model also provides a 128K context window, which is sufficient for most use cases today.  A <a href=\"https:\/\/scontent.fcre1-1.fna.fbcdn.net\/v\/t39.2365-6\/452387774_1036916434819166_4173978747091533306_n.pdf?_nc_cat=104&amp;ccb=1-7&amp;_nc_sid=3c67a6&amp;_nc_ohc=t6egZJ8QdI4Q7kNvgFgxl87&amp;_nc_ht=scontent.fcre1-1.fna&amp;oh=00_AYACEt_qWe9_IAMFM5G6In7CSFCREVmdT2-DO6DDRhh_Ig&amp;oe=66A7CC8D\">research paper<\/a> outlining the new model capabilities offered additional details on the impact of data. <\/p>\n<blockquote>\n<p>Compared to prior versions of Llama, we improved both the quantity and quality of the data we use for pre-training and post-training. These improvements include the development of more careful pre-processing and curation pipelines for pre-training data and the development of more rigorous quality assurance and filtering approaches for post-training data. We pre-train Llama 3 on a corpus of about 15T multilingual tokens, compared to 1.8T tokens for Llama 2. <\/p>\n<\/blockquote>\n<h2>Excelling in Small Packages<\/h2>\n<p>For developers considering smaller models, the Llama 3.1 series also includes the 70B and 8B (B = billion parameters) model sizes. The 70B model handily outpaces GPT-3.5 Turbo, and 8B shows a similar lead over Mistral 7B Instruct. <\/p>\n<div class=\"captioned-image-container\">\n<figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!M9m3!,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe3dbde02-481c-48c0-a5f3-a3e959d9b9a8_1800x1247.png\" data-component-name=\"Image2ToDOM\">\n<div class=\"image2-inset\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!M9m3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe3dbde02-481c-48c0-a5f3-a3e959d9b9a8_1800x1247.png\" width=\"1456\" height=\"1009\" data-attrs='{\"src\":\"https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/e3dbde02-481c-48c0-a5f3-a3e959d9b9a8_1800x1247.png\",\"srcNoWatermark\":null,\"fullscreen\":null,\"imageSize\":null,\"height\":1009,\"width\":1456,\"resizeWidth\":null,\"bytes\":419310,\"alt\":null,\"title\":null,\"type\":\"image\/png\",\"href\":null,\"belowTheFold\":true,\"topImage\":false,\"internalRedirect\":null,\"isProcessing\":false,\"align\":null,\"offset\":false}' class=\"sizing-normal\" alt=\"\" loading=\"lazy\"\/>\n<div class=\"image-link-expand\">\n<div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\">\n<div class=\"pencraft pc-reset icon-container restack-image\"><\/div>\n<div class=\"pencraft pc-reset icon-container view-image\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p><\/p><\/a><\/figure>\n<\/div>\n<h2>Broad Availability<\/h2>\n<p>A key drawback of many open models is that they are not widely supported as end-points. That means users need to deploy the models and manage the infrastructure in order to run inference jobs. However, that is slowly changing for open-source overall and has rapidly changed for Llama. Meta announced ten partners hosting Llama 3.1 405B models today. All of them offer real-time inference, over half provide batch inference, and all but one offer knowledge bases and guardrails. <\/p>\n<div class=\"captioned-image-container\">\n<figure><a class=\"image-link image2 is-viewable-img\" target=\"_blank\" href=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!HMvn!,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d4ba957-8c14-43a8-9088-ea32165735c5_1800x994.png\" data-component-name=\"Image2ToDOM\">\n<div class=\"image2-inset\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/substackcdn.com\/image\/fetch\/%24s_!HMvn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d4ba957-8c14-43a8-9088-ea32165735c5_1800x994.png\" width=\"1456\" height=\"804\" data-attrs='{\"src\":\"https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/5d4ba957-8c14-43a8-9088-ea32165735c5_1800x994.png\",\"srcNoWatermark\":null,\"fullscreen\":null,\"imageSize\":null,\"height\":804,\"width\":1456,\"resizeWidth\":null,\"bytes\":247254,\"alt\":null,\"title\":null,\"type\":\"image\/png\",\"href\":null,\"belowTheFold\":true,\"topImage\":false,\"internalRedirect\":null,\"isProcessing\":false,\"align\":null,\"offset\":false}' class=\"sizing-normal\" alt=\"\" loading=\"lazy\"\/>\n<div class=\"image-link-expand\">\n<div class=\"pencraft pc-display-flex pc-gap-8 pc-reset\">\n<div class=\"pencraft pc-reset icon-container restack-image\"><\/div>\n<div class=\"pencraft pc-reset icon-container view-image\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<p><\/p><\/a><\/figure>\n<\/div>\n<p>High performance coupled with ease of access is critical for market penetration. Llama has generated a lot of enterprise interest, but there have been barriers to trial. The latest release shows that Llama 3.1 smartly adds more options for users to access the models, including those from each of the three leading cloud hyperscalers. <\/p>\n<h2>Open Leadership?<\/h2>\n<p>Meta CEO Mark Zuckerberg highlighted the market shift that Llama 3.1 405B represents in a <a href=\"https:\/\/about.fb.com\/news\/2024\/07\/open-source-ai-is-the-path-forward\/\">blog post<\/a> announcing the new models. <\/p>\n<blockquote>\n<p>Today we\u2019re taking the next steps towards open source AI becoming the industry standard. We\u2019re releasing Llama 3.1 405B, the first frontier-level open source AI model, as well as new and improved Llama 3.1 70B and 8B models. In addition to having significantly better cost\/performance relative to closed models, the fact that the 405B model is open will make it the best choice for fine-tuning and distilling smaller models.<\/p>\n<\/blockquote>\n<p>Will this lead to a shift away from proprietary AI models? I don\u2019t think so in the near term. However, there is strong interest among enterprise buyers for models that are frontier-grade and also open. Unsurprisingly, enterprises like the idea of asserting further control over their AI solutions along with enhanced privacy. Meta\u2019s Llama 3.1 \u201cHerd of Models\u201d will likely be the catalyst that drives more enterprise trials of open models.  <\/p>\n<p class=\"button-wrapper\" data-attrs='{\"url\":\"https:\/\/synthedia.substack.com\/p\/meta-llama-31-405b-may-spark-a-tectonic?utm_source=substack&amp;utm_medium=email&amp;utm_content=share&amp;action=share\",\"text\":\"Share\",\"action\":null,\"class\":null}' data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https:\/\/synthedia.substack.com\/p\/meta-llama-31-405b-may-spark-a-tectonic?utm_source=substack&amp;utm_medium=email&amp;utm_content=share&amp;action=share\"><span>Share<\/span><\/a><\/p>\n<p class=\"button-wrapper\" data-attrs='{\"url\":\"https:\/\/synthedia.substack.com\/subscribe?\",\"text\":\"Subscribe now\",\"action\":null,\"class\":null}' data-component-name=\"ButtonCreateButton\"><a class=\"button primary\" href=\"https:\/\/synthedia.substack.com\/subscribe?\"><span>Subscribe now<\/span><\/a><\/p>\n<p>Many thanks to our title sponsor.<\/p>\n<ul>\n<li>\n<p><a href=\"https:\/\/dabblelab.com\/\">Dabble Lab: AI-powered bespoke software development services<\/a><\/p>\n<\/li>\n<\/ul>\n<div class=\"digest-post-embed\" data-attrs='{\"nodeId\":\"519fe693-80f3-4ef5-82f6-46a4320255dd\",\"caption\":\"OpenAI\u2019s generative AI market leadership has converted to solid revenue and customer growth. Recent reporting by The Information revealed that CEO Sam Altman told company employees \u201cOpenAI has more than doubled its annualized revenue to $3.4 billion in the past six months or so.\u201d\",\"cta\":null,\"showBylines\":true,\"size\":\"lg\",\"isEditorNode\":true,\"title\":\"OpenAI Doubled Revenue and is Doing More Business Than Azure - New Reports\",\"publishedBylines\":[{\"id\":1988474,\"name\":\"Bret Kinsella\",\"bio\":\"Founder &amp; CEO - Voicebot.ai &amp; Synthedia. Top conference (CES, MWC) and news contributor (WSJ, HBR, USA Today) on generative AI, conversational AI, and bots. 4x awarded Top AI analyst and journalist, 400+ citations in Google Scholar. 10+ years in AI.\",\"photo_url\":\"https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/a18169dc-f92a-4897-9c6d-967e6b5ce4ac_800x800.jpeg\",\"is_guest\":false,\"bestseller_tier\":null}],\"post_date\":\"2024-06-28T04:36:08.982Z\",\"cover_image\":\"https:\/\/substackcdn.com\/image\/fetch\/f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3156438-676e-4109-ac6a-deabe13e133f_1024x1024.jpeg\",\"cover_image_alt\":null,\"canonical_url\":\"https:\/\/synthedia.substack.com\/p\/openai-doubled-revenue-and-is-doing\",\"section_name\":null,\"video_upload_id\":null,\"id\":146066805,\"type\":\"newsletter\",\"reaction_count\":3,\"comment_count\":4,\"publication_name\":\"Synthedia\",\"publication_logo_url\":\"https:\/\/substackcdn.com\/image\/fetch\/f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7cf2d4cb-a30a-4088-9e13-d1a884adf55d_800x800.png\",\"belowTheFold\":true}'><\/div>\n<div class=\"digest-post-embed\" data-attrs='{\"nodeId\":\"46ceab48-9d75-4e77-b0ac-1667299e65af\",\"caption\":\"Anthropic released a new AI foundation model today. Claude 3.5 Sonnet is the latest iteration of the large language model (LLM) that has morphed into a multimodal AI model that includes capabilities around language and images. The new offering arrived less than four months after the introduction of the Claude 3 model family, which was among the first to\u2026\",\"cta\":null,\"showBylines\":true,\"size\":\"lg\",\"isEditorNode\":true,\"title\":\"Anthropic Sonnet 3.5 Sets New Benchmark Standards \",\"publishedBylines\":[{\"id\":1988474,\"name\":\"Bret Kinsella\",\"bio\":\"Founder &amp; CEO - Voicebot.ai &amp; Synthedia. Top conference (CES, MWC) and news contributor (WSJ, HBR, USA Today) on generative AI, conversational AI, and bots. 4x awarded Top AI analyst and journalist, 400+ citations in Google Scholar. 10+ years in AI.\",\"photo_url\":\"https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/a18169dc-f92a-4897-9c6d-967e6b5ce4ac_800x800.jpeg\",\"is_guest\":false,\"bestseller_tier\":null}],\"post_date\":\"2024-06-21T03:08:08.094Z\",\"cover_image\":\"https:\/\/substackcdn.com\/image\/fetch\/f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5e032d38-eb73-4784-8d7b-08e2dd080029_1086x608.png\",\"cover_image_alt\":null,\"canonical_url\":\"https:\/\/synthedia.substack.com\/p\/anthropic-sonnet-35-sets-new-benchmark\",\"section_name\":null,\"video_upload_id\":null,\"id\":145846517,\"type\":\"newsletter\",\"reaction_count\":6,\"comment_count\":2,\"publication_name\":\"Synthedia\",\"publication_logo_url\":\"https:\/\/substackcdn.com\/image\/fetch\/f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7cf2d4cb-a30a-4088-9e13-d1a884adf55d_800x800.png\",\"belowTheFold\":true}'><\/div>\n<div class=\"digest-post-embed\" data-attrs='{\"nodeId\":\"2ecb23c1-bb34-4dbf-832e-e6d5728255df\",\"caption\":\"Meta launched the Llama 3 large language model (LLM) today in 8B and 70B parameter sizes. Both models were trained on 15 trillion tokens of data and are released under a permissive commercial and private use license. The license is not as permissive as traditional open-source options, but its restrictions are limited.\",\"cta\":null,\"showBylines\":true,\"size\":\"lg\",\"isEditorNode\":true,\"title\":\"Meta Llama 3 Launch Part 1 - 8B and 70B Models are Here, with 400B Model Coming\",\"publishedBylines\":[{\"id\":1988474,\"name\":\"Bret Kinsella\",\"bio\":\"Founder &amp; CEO - Voicebot.ai &amp; Synthedia. Top conference (CES, MWC) and news contributor (WSJ, HBR, USA Today) on generative AI, conversational AI, and bots. 4x awarded Top AI analyst and journalist, 400+ citations in Google Scholar. 10+ years in AI.\",\"photo_url\":\"https:\/\/substack-post-media.s3.amazonaws.com\/public\/images\/a18169dc-f92a-4897-9c6d-967e6b5ce4ac_800x800.jpeg\",\"is_guest\":false,\"bestseller_tier\":null}],\"post_date\":\"2024-04-19T03:39:09.705Z\",\"cover_image\":\"https:\/\/substackcdn.com\/image\/fetch\/f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e32b89a-9146-4004-81b4-18c20a913df0_1920x1080.jpeg\",\"cover_image_alt\":null,\"canonical_url\":\"https:\/\/synthedia.substack.com\/p\/meta-llama-3-launch-part-1-8b-and\",\"section_name\":null,\"video_upload_id\":null,\"id\":143718669,\"type\":\"newsletter\",\"reaction_count\":2,\"comment_count\":0,\"publication_name\":\"Synthedia\",\"publication_logo_url\":\"https:\/\/substackcdn.com\/image\/fetch\/f_auto,q_auto:good,fl_progressive:steep\/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7cf2d4cb-a30a-4088-9e13-d1a884adf55d_800x800.png\",\"belowTheFold\":true}'><\/div>","protected":false},"excerpt":{"rendered":"<p>The large language model (LLM) market has experienced several noted upheavals in 2024. New models have emerged to challenge OpenAI\u2019s unmatched quality supremacy of 2023 to the point where there are several leading foundation models that can legitimately claim to be \u201cmarket-leading.\u201d Google Gemini 1.5 introduced an industry-leading 1 million, then a 2 million token [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":8900,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rop_custom_images_group":[],"rop_custom_messages_group":[],"rop_publish_now":"initial","rop_publish_now_accounts":[],"rop_publish_now_history":[],"rop_publish_now_status":"pending","footnotes":""},"categories":[114],"tags":[],"class_list":["post-9006","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-spotlight"],"_links":{"self":[{"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/posts\/9006","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/comments?post=9006"}],"version-history":[{"count":0,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/posts\/9006\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/media\/8900"}],"wp:attachment":[{"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/media?parent=9006"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/categories?post=9006"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/handoli.com\/index.php\/wp-json\/wp\/v2\/tags?post=9006"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}